INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.21.0.1:53766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37742 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:12:07,044 - lava_callback - INFO - Received callback for node 69dd865317c944d2f17deac2 2026-04-16 00:12:07,051 - lava_callback - INFO - Starting async job submit for node 69dd865317c944d2f17deac2 INFO: 172.21.0.1:37746 - "POST /node/69dd865317c944d2f17deac2 HTTP/1.0" 202 Accepted 2026-04-16 00:12:07,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:12:07,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd865317c944d2f17deac2 HTTP/1.1" 200 None 2026-04-16 00:12:07,072 - lava_callback - DEBUG - Processing node 69dd865317c944d2f17deac2: baseline-arm64-clabbe 2026-04-16 00:12:07,072 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd865317c944d2f17deac2 2026-04-16 00:12:07,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:12:07,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd865317c944d2f17deac2 HTTP/1.1" 200 None 2026-04-16 00:12:07,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:12:07,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-16 00:12:07,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:12:07,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd865317c944d2f17deac2 HTTP/1.1" 200 None 2026-04-16 00:12:07,159 - lava_callback - ERROR - Error processing callback for node 69dd865317c944d2f17deac2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50254 - "GET /node/69d6fa9735ac66e13269aa87%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:50268 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38152 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:14:06,695 - lava_callback - INFO - Received callback for node 69de54dc12f38614f3ded42e INFO: 172.21.0.1:38166 - "POST /node/69de54dc12f38614f3ded42e HTTP/1.0" 202 Accepted 2026-04-16 00:14:06,702 - lava_callback - INFO - Starting async job submit for node 69de54dc12f38614f3ded42e 2026-04-16 00:14:06,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:14:06,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de54dc12f38614f3ded42e HTTP/1.1" 200 None 2026-04-16 00:14:06,738 - lava_callback - DEBUG - Processing node 69de54dc12f38614f3ded42e: baseline-x86 2026-04-16 00:14:07,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:14:07,246 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:14:07,248 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69de54dc12f38614f3ded42e/log.txt.gz 2026-04-16 00:14:07,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:14:07,648 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:14:07,650 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69de54dc12f38614f3ded42e/lava-logs.yaml 2026-04-16 00:14:07,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:14:07,793 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:14:07,795 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69de54dc12f38614f3ded42e/lava_callback.json.gz 2026-04-16 00:14:07,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:14:07,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de54dc12f38614f3ded42e HTTP/1.1" 200 None 2026-04-16 00:14:07,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:14:07,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87d4c2164e674d71ee5f HTTP/1.1" 200 None 2026-04-16 00:14:07,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:14:07,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de54dc12f38614f3ded42e HTTP/1.1" 200 None 2026-04-16 00:14:07,913 - lava_callback - INFO - Completed processing callback for node 69de54dc12f38614f3ded42e INFO: 172.21.0.1:53424 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48878 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:14:37,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:14:37,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53012 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53024 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:17:23,304 - lava_callback - INFO - Received callback for node 69de74c3f6535ffd5b3ede8c INFO: 172.21.0.1:35738 - "POST /node/69de74c3f6535ffd5b3ede8c HTTP/1.0" 202 Accepted 2026-04-16 00:17:23,310 - lava_callback - INFO - Starting async job submit for node 69de74c3f6535ffd5b3ede8c 2026-04-16 00:17:23,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:17:23,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de74c3f6535ffd5b3ede8c HTTP/1.1" 200 None 2026-04-16 00:17:23,344 - lava_callback - DEBUG - Processing node 69de74c3f6535ffd5b3ede8c: baseline-x86 2026-04-16 00:17:23,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:17:23,816 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:17:23,818 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69de74c3f6535ffd5b3ede8c/log.txt.gz 2026-04-16 00:17:24,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:17:24,225 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:17:24,228 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69de74c3f6535ffd5b3ede8c/lava-logs.yaml 2026-04-16 00:17:24,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:17:24,627 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:17:24,629 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69de74c3f6535ffd5b3ede8c/lava_callback.json.gz 2026-04-16 00:17:24,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:17:24,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de74c3f6535ffd5b3ede8c HTTP/1.1" 200 None 2026-04-16 00:17:24,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:17:24,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de68dcf6535ffd5b3ed8db HTTP/1.1" 200 None 2026-04-16 00:17:24,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:17:24,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de74c3f6535ffd5b3ede8c HTTP/1.1" 200 None 2026-04-16 00:17:24,701 - lava_callback - INFO - Completed processing callback for node 69de74c3f6535ffd5b3ede8c INFO: 172.21.0.1:35744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45216 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:17:37,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:17:37,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59980 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:19:20,534 - lava_callback - INFO - Received callback for node 69de9a55d105963562bb3be6 INFO: 172.21.0.1:42270 - "POST /node/69de9a55d105963562bb3be6 HTTP/1.0" 202 Accepted 2026-04-16 00:19:20,540 - lava_callback - INFO - Starting async job submit for node 69de9a55d105963562bb3be6 2026-04-16 00:19:20,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:19:20,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9a55d105963562bb3be6 HTTP/1.1" 200 None 2026-04-16 00:19:20,588 - lava_callback - DEBUG - Processing node 69de9a55d105963562bb3be6: baseline-x86 2026-04-16 00:19:20,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:19:21,039 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:19:21,041 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69de9a55d105963562bb3be6/log.txt.gz 2026-04-16 00:19:21,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:19:21,415 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:19:21,417 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69de9a55d105963562bb3be6/lava-logs.yaml 2026-04-16 00:19:21,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:19:21,577 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:19:21,579 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69de9a55d105963562bb3be6/lava_callback.json.gz 2026-04-16 00:19:21,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:19:21,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9a55d105963562bb3be6 HTTP/1.1" 200 None 2026-04-16 00:19:21,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:19:21,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de962ed105963562bb3a70 HTTP/1.1" 200 None 2026-04-16 00:19:21,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:19:21,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de9a55d105963562bb3be6 HTTP/1.1" 200 None 2026-04-16 00:19:21,663 - lava_callback - INFO - Completed processing callback for node 69de9a55d105963562bb3be6 INFO: 172.21.0.1:42280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59276 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:19:37,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:19:37,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38222 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45202 - "GET /node/69936fbfcebe99dd8e068af0%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:45212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42684 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:22:06,156 - lava_callback - INFO - Received callback for node 69deaa797a8aab7fee69e279 INFO: 172.21.0.1:51310 - "POST /node/69deaa797a8aab7fee69e279 HTTP/1.0" 202 Accepted 2026-04-16 00:22:06,161 - lava_callback - INFO - Starting async job submit for node 69deaa797a8aab7fee69e279 2026-04-16 00:22:06,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:22:06,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69deaa797a8aab7fee69e279 HTTP/1.1" 200 None 2026-04-16 00:22:06,208 - lava_callback - DEBUG - Processing node 69deaa797a8aab7fee69e279: baseline-x86 2026-04-16 00:22:06,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:51316 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:22:06,635 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:22:06,637 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69deaa797a8aab7fee69e279/log.txt.gz 2026-04-16 00:22:06,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:22:07,007 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:22:07,009 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69deaa797a8aab7fee69e279/lava-logs.yaml 2026-04-16 00:22:07,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:22:07,154 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:22:07,155 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69deaa797a8aab7fee69e279/lava_callback.json.gz 2026-04-16 00:22:07,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:22:07,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69deaa797a8aab7fee69e279 HTTP/1.1" 200 None 2026-04-16 00:22:07,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:22:07,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87d4c2164e674d71ee5f HTTP/1.1" 200 None 2026-04-16 00:22:07,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:22:07,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69deaa797a8aab7fee69e279 HTTP/1.1" 200 None 2026-04-16 00:22:07,247 - lava_callback - INFO - Completed processing callback for node 69deaa797a8aab7fee69e279 INFO: 172.21.0.1:58354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48470 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:22:37,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:22:37,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37846 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:23:54,719 - lava_callback - INFO - Received callback for node 69dec9997a8aab7fee6a19a4 INFO: 172.21.0.1:50420 - "POST /node/69dec9997a8aab7fee6a19a4 HTTP/1.0" 202 Accepted 2026-04-16 00:23:54,725 - lava_callback - INFO - Starting async job submit for node 69dec9997a8aab7fee6a19a4 2026-04-16 00:23:54,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:23:54,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dec9997a8aab7fee6a19a4 HTTP/1.1" 200 None 2026-04-16 00:23:54,775 - lava_callback - DEBUG - Processing node 69dec9997a8aab7fee6a19a4: baseline-x86 2026-04-16 00:23:55,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:23:55,254 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:23:55,256 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69dec9997a8aab7fee6a19a4/log.txt.gz 2026-04-16 00:23:55,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:23:55,698 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:23:55,700 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69dec9997a8aab7fee6a19a4/lava-logs.yaml 2026-04-16 00:23:55,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:23:55,876 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:23:55,877 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69dec9997a8aab7fee6a19a4/lava_callback.json.gz 2026-04-16 00:23:55,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:23:55,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dec9997a8aab7fee6a19a4 HTTP/1.1" 200 None 2026-04-16 00:23:55,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:23:55,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de68dcf6535ffd5b3ed8db HTTP/1.1" 200 None 2026-04-16 00:23:55,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:23:55,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dec9997a8aab7fee6a19a4 HTTP/1.1" 200 None 2026-04-16 00:23:55,950 - lava_callback - INFO - Completed processing callback for node 69dec9997a8aab7fee6a19a4 INFO: 172.21.0.1:50426 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:24:04,582 - lava_callback - INFO - Received callback for node 69dedd88f490930782fb7034 INFO: 172.21.0.1:51566 - "POST /node/69dedd88f490930782fb7034 HTTP/1.0" 202 Accepted 2026-04-16 00:24:04,588 - lava_callback - INFO - Starting async job submit for node 69dedd88f490930782fb7034 2026-04-16 00:24:04,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:24:04,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedd88f490930782fb7034 HTTP/1.1" 200 None 2026-04-16 00:24:04,621 - lava_callback - DEBUG - Processing node 69dedd88f490930782fb7034: baseline-x86 2026-04-16 00:24:04,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:24:05,065 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:24:05,067 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69dedd88f490930782fb7034/log.txt.gz 2026-04-16 00:24:05,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:24:05,444 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:24:05,446 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69dedd88f490930782fb7034/lava-logs.yaml 2026-04-16 00:24:05,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:24:05,586 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:24:05,588 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69dedd88f490930782fb7034/lava_callback.json.gz 2026-04-16 00:24:05,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:24:05,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedd88f490930782fb7034 HTTP/1.1" 200 None 2026-04-16 00:24:05,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:24:05,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded961f490930782fb6e47 HTTP/1.1" 200 None 2026-04-16 00:24:05,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:24:05,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dedd88f490930782fb7034 HTTP/1.1" 200 None 2026-04-16 00:24:05,665 - lava_callback - INFO - Completed processing callback for node 69dedd88f490930782fb7034 INFO: 172.21.0.1:51570 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:24:07,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:24:07,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44952 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:25:46,590 - lava_callback - INFO - Received callback for node 69defaaaf490930782fbb89f INFO: 172.21.0.1:44960 - "POST /node/69defaaaf490930782fbb89f HTTP/1.0" 202 Accepted 2026-04-16 00:25:46,596 - lava_callback - INFO - Starting async job submit for node 69defaaaf490930782fbb89f 2026-04-16 00:25:46,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:25:46,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69defaaaf490930782fbb89f HTTP/1.1" 200 None 2026-04-16 00:25:46,632 - lava_callback - DEBUG - Processing node 69defaaaf490930782fbb89f: baseline-x86 2026-04-16 00:25:46,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:25:47,114 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:25:47,115 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69defaaaf490930782fbb89f/log.txt.gz 2026-04-16 00:25:47,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:25:47,504 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:25:47,506 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69defaaaf490930782fbb89f/lava-logs.yaml 2026-04-16 00:25:47,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:25:47,705 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:25:47,706 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69defaaaf490930782fbb89f/lava_callback.json.gz 2026-04-16 00:25:47,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:25:47,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69defaaaf490930782fbb89f HTTP/1.1" 200 None 2026-04-16 00:25:47,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:25:47,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de962ed105963562bb3a70 HTTP/1.1" 200 None 2026-04-16 00:25:47,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:25:47,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69defaaaf490930782fbb89f HTTP/1.1" 200 None 2026-04-16 00:25:47,784 - lava_callback - INFO - Completed processing callback for node 69defaaaf490930782fbb89f INFO: 172.21.0.1:47124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55876 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:26:07,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:26:07,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46104 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:28:06,808 - lava_callback - INFO - Received callback for node 69df1e53f490930782fbde15 INFO: 172.21.0.1:46108 - "POST /node/69df1e53f490930782fbde15 HTTP/1.0" 202 Accepted 2026-04-16 00:28:06,814 - lava_callback - INFO - Starting async job submit for node 69df1e53f490930782fbde15 2026-04-16 00:28:06,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:28:06,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df1e53f490930782fbde15 HTTP/1.1" 200 None 2026-04-16 00:28:06,848 - lava_callback - DEBUG - Processing node 69df1e53f490930782fbde15: baseline-x86 2026-04-16 00:28:07,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:28:07,305 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:28:07,307 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69df1e53f490930782fbde15/log.txt.gz 2026-04-16 00:28:07,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:28:07,741 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:28:07,743 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69df1e53f490930782fbde15/lava-logs.yaml 2026-04-16 00:28:07,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:28:07,916 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:28:07,918 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69df1e53f490930782fbde15/lava_callback.json.gz 2026-04-16 00:28:07,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:28:07,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df1e53f490930782fbde15 HTTP/1.1" 200 None 2026-04-16 00:28:07,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:28:07,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de68dcf6535ffd5b3ed8db HTTP/1.1" 200 None 2026-04-16 00:28:07,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:28:07,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df1e53f490930782fbde15 HTTP/1.1" 200 None 2026-04-16 00:28:07,991 - lava_callback - INFO - Completed processing callback for node 69df1e53f490930782fbde15 INFO: 172.21.0.1:33026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58670 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:28:37,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:28:37,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59182 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:29:08,789 - lava_callback - INFO - Received callback for node 69df329bf490930782fbec58 INFO: 172.21.0.1:59196 - "POST /node/69df329bf490930782fbec58 HTTP/1.0" 202 Accepted 2026-04-16 00:29:08,796 - lava_callback - INFO - Starting async job submit for node 69df329bf490930782fbec58 2026-04-16 00:29:08,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:29:08,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df329bf490930782fbec58 HTTP/1.1" 200 None 2026-04-16 00:29:08,832 - lava_callback - DEBUG - Processing node 69df329bf490930782fbec58: baseline-x86 2026-04-16 00:29:09,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:29:09,529 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:29:09,531 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69df329bf490930782fbec58/log.txt.gz 2026-04-16 00:29:09,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:29:10,159 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:29:10,161 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69df329bf490930782fbec58/lava-logs.yaml 2026-04-16 00:29:10,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:29:10,660 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:29:10,662 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69df329bf490930782fbec58/lava_callback.json.gz 2026-04-16 00:29:10,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:29:10,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df329bf490930782fbec58 HTTP/1.1" 200 None 2026-04-16 00:29:10,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:29:10,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded961f490930782fb6e47 HTTP/1.1" 200 None 2026-04-16 00:29:10,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:29:10,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df329bf490930782fbec58 HTTP/1.1" 200 None 2026-04-16 00:29:10,782 - lava_callback - INFO - Completed processing callback for node 69df329bf490930782fbec58 INFO: 172.21.0.1:59916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35918 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:29:37,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:29:37,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36916 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:30:34,211 - lava_callback - INFO - Received callback for node 69df50b106e8e7b15e962b5d INFO: 172.21.0.1:59002 - "POST /node/69df50b106e8e7b15e962b5d HTTP/1.0" 202 Accepted 2026-04-16 00:30:34,220 - lava_callback - INFO - Starting async job submit for node 69df50b106e8e7b15e962b5d 2026-04-16 00:30:34,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:30:34,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df50b106e8e7b15e962b5d HTTP/1.1" 200 None 2026-04-16 00:30:34,268 - lava_callback - DEBUG - Processing node 69df50b106e8e7b15e962b5d: baseline-x86 2026-04-16 00:30:34,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:30:34,965 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:30:34,967 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69df50b106e8e7b15e962b5d/log.txt.gz 2026-04-16 00:30:35,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:30:35,737 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:30:35,739 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69df50b106e8e7b15e962b5d/lava-logs.yaml 2026-04-16 00:30:35,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:30:35,904 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:30:35,906 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69df50b106e8e7b15e962b5d/lava_callback.json.gz 2026-04-16 00:30:35,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:30:35,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df50b106e8e7b15e962b5d HTTP/1.1" 200 None 2026-04-16 00:30:35,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:30:35,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de962ed105963562bb3a70 HTTP/1.1" 200 None 2026-04-16 00:30:35,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:30:35,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df50b106e8e7b15e962b5d HTTP/1.1" 200 None 2026-04-16 00:30:35,987 - lava_callback - INFO - Completed processing callback for node 69df50b106e8e7b15e962b5d INFO: 172.21.0.1:59012 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:30:37,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:30:37,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-16 00:30:43,059 - lava_callback - INFO - Received callback for node 69df53fa06e8e7b15e962f74 INFO: 172.21.0.1:60206 - "POST /node/69df53fa06e8e7b15e962f74 HTTP/1.0" 202 Accepted 2026-04-16 00:30:43,065 - lava_callback - INFO - Starting async job submit for node 69df53fa06e8e7b15e962f74 2026-04-16 00:30:43,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:30:43,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df53fa06e8e7b15e962f74 HTTP/1.1" 200 None 2026-04-16 00:30:43,098 - lava_callback - DEBUG - Processing node 69df53fa06e8e7b15e962f74: baseline-x86 2026-04-16 00:30:43,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:30:43,576 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:30:43,577 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69df53fa06e8e7b15e962f74/log.txt.gz 2026-04-16 00:30:43,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:30:43,930 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:30:43,932 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69df53fa06e8e7b15e962f74/lava-logs.yaml 2026-04-16 00:30:43,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:30:44,107 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:30:44,110 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69df53fa06e8e7b15e962f74/lava_callback.json.gz 2026-04-16 00:30:44,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:30:44,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df53fa06e8e7b15e962f74 HTTP/1.1" 200 None 2026-04-16 00:30:44,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:30:44,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49c106e8e7b15e9624ed HTTP/1.1" 200 None 2026-04-16 00:30:44,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:30:44,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df53fa06e8e7b15e962f74 HTTP/1.1" 200 None 2026-04-16 00:30:44,215 - lava_callback - INFO - Completed processing callback for node 69df53fa06e8e7b15e962f74 INFO: 172.21.0.1:60212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43468 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:31:07,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:31:07,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45528 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:32:07,758 - lava_callback - INFO - Received callback for node 69df732006e8e7b15e9647ed INFO: 172.21.0.1:45538 - "POST /node/69df732006e8e7b15e9647ed HTTP/1.0" 202 Accepted 2026-04-16 00:32:07,767 - lava_callback - INFO - Starting async job submit for node 69df732006e8e7b15e9647ed 2026-04-16 00:32:07,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:32:07,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df732006e8e7b15e9647ed HTTP/1.1" 200 None 2026-04-16 00:32:07,805 - lava_callback - DEBUG - Processing node 69df732006e8e7b15e9647ed: baseline-x86 2026-04-16 00:32:08,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:32:08,347 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:32:08,349 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69df732006e8e7b15e9647ed/log.txt.gz 2026-04-16 00:32:08,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:32:08,736 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:32:08,738 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69df732006e8e7b15e9647ed/lava-logs.yaml 2026-04-16 00:32:08,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:32:08,891 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:32:08,892 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69df732006e8e7b15e9647ed/lava_callback.json.gz 2026-04-16 00:32:08,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:32:08,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df732006e8e7b15e9647ed HTTP/1.1" 200 None 2026-04-16 00:32:08,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:32:08,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de68dcf6535ffd5b3ed8db HTTP/1.1" 200 None 2026-04-16 00:32:08,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:32:08,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df732006e8e7b15e9647ed HTTP/1.1" 200 None 2026-04-16 00:32:08,976 - lava_callback - INFO - Completed processing callback for node 69df732006e8e7b15e9647ed INFO: 172.21.0.1:35184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39900 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:32:37,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:32:37,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52202 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:33:28,962 - lava_callback - INFO - Received callback for node 69df875606e8e7b15e964aba INFO: 172.21.0.1:52204 - "POST /node/69df875606e8e7b15e964aba HTTP/1.0" 202 Accepted 2026-04-16 00:33:28,968 - lava_callback - INFO - Starting async job submit for node 69df875606e8e7b15e964aba 2026-04-16 00:33:28,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:33:29,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df875606e8e7b15e964aba HTTP/1.1" 200 None 2026-04-16 00:33:29,003 - lava_callback - DEBUG - Processing node 69df875606e8e7b15e964aba: baseline-x86 2026-04-16 00:33:29,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:33:29,440 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:33:29,442 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69df875606e8e7b15e964aba/log.txt.gz 2026-04-16 00:33:29,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:33:29,891 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:33:29,893 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69df875606e8e7b15e964aba/lava-logs.yaml 2026-04-16 00:33:29,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:33:30,059 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:33:30,061 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69df875606e8e7b15e964aba/lava_callback.json.gz 2026-04-16 00:33:30,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:33:30,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df875606e8e7b15e964aba HTTP/1.1" 200 None 2026-04-16 00:33:30,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:33:30,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded961f490930782fb6e47 HTTP/1.1" 200 None 2026-04-16 00:33:30,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:33:30,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df875606e8e7b15e964aba HTTP/1.1" 200 None 2026-04-16 00:33:30,147 - lava_callback - INFO - Completed processing callback for node 69df875606e8e7b15e964aba 2026-04-16 00:33:32,554 - lava_callback - INFO - Received callback for node 69dd8b52c2164e674d71f0d0 INFO: 172.21.0.1:33766 - "POST /node/69dd8b52c2164e674d71f0d0 HTTP/1.0" 202 Accepted 2026-04-16 00:33:32,562 - lava_callback - INFO - Starting async job submit for node 69dd8b52c2164e674d71f0d0 2026-04-16 00:33:32,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:33:32,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8b52c2164e674d71f0d0 HTTP/1.1" 200 None 2026-04-16 00:33:32,580 - lava_callback - DEBUG - Processing node 69dd8b52c2164e674d71f0d0: baseline-arm64-baylibre 2026-04-16 00:33:32,580 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd8b52c2164e674d71f0d0 2026-04-16 00:33:32,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:33:32,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8b52c2164e674d71f0d0 HTTP/1.1" 200 None 2026-04-16 00:33:32,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:33:32,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd171917c944d2f17d8b46 HTTP/1.1" 200 None 2026-04-16 00:33:32,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:33:32,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8b52c2164e674d71f0d0 HTTP/1.1" 200 None 2026-04-16 00:33:32,652 - lava_callback - ERROR - Error processing callback for node 69dd8b52c2164e674d71f0d0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33782 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:33:37,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:33:37,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40884 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:34:52,652 - lava_callback - INFO - Received callback for node 69dd8b99c2164e674d71f13b INFO: 172.21.0.1:37480 - "POST /node/69dd8b99c2164e674d71f13b HTTP/1.0" 202 Accepted 2026-04-16 00:34:52,661 - lava_callback - INFO - Starting async job submit for node 69dd8b99c2164e674d71f13b 2026-04-16 00:34:52,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:34:52,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8b99c2164e674d71f13b HTTP/1.1" 200 None 2026-04-16 00:34:52,691 - lava_callback - DEBUG - Processing node 69dd8b99c2164e674d71f13b: baseline-arm64-baylibre 2026-04-16 00:34:52,691 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd8b99c2164e674d71f13b 2026-04-16 00:34:52,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:34:52,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8b99c2164e674d71f13b HTTP/1.1" 200 None 2026-04-16 00:34:52,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:34:52,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd171917c944d2f17d8b46 HTTP/1.1" 200 None 2026-04-16 00:34:52,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:34:52,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8b99c2164e674d71f13b HTTP/1.1" 200 None 2026-04-16 00:34:52,791 - lava_callback - ERROR - Error processing callback for node 69dd8b99c2164e674d71f13b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49942 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:35:08,167 - lava_callback - INFO - Received callback for node 69dfa99c06e8e7b15e966483 INFO: 172.21.0.1:49944 - "POST /node/69dfa99c06e8e7b15e966483 HTTP/1.0" 202 Accepted 2026-04-16 00:35:08,177 - lava_callback - INFO - Starting async job submit for node 69dfa99c06e8e7b15e966483 2026-04-16 00:35:08,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:35:08,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dfa99c06e8e7b15e966483 HTTP/1.1" 200 None 2026-04-16 00:35:08,241 - lava_callback - DEBUG - Processing node 69dfa99c06e8e7b15e966483: baseline-x86 2026-04-16 00:35:08,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:35:09,069 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:35:09,071 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69dfa99c06e8e7b15e966483/log.txt.gz 2026-04-16 00:35:09,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:35:09,915 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:35:09,918 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69dfa99c06e8e7b15e966483/lava-logs.yaml 2026-04-16 00:35:09,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:35:10,468 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:35:10,470 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69dfa99c06e8e7b15e966483/lava_callback.json.gz 2026-04-16 00:35:10,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:35:10,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dfa99c06e8e7b15e966483 HTTP/1.1" 200 None 2026-04-16 00:35:10,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:35:10,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de962ed105963562bb3a70 HTTP/1.1" 200 None 2026-04-16 00:35:10,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:35:10,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dfa99c06e8e7b15e966483 HTTP/1.1" 200 None 2026-04-16 00:35:10,593 - lava_callback - INFO - Completed processing callback for node 69dfa99c06e8e7b15e966483 INFO: 172.21.0.1:59866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58548 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:35:30,182 - lava_callback - INFO - Received callback for node 69e02ec91fb14b744a548b9f INFO: 172.21.0.1:55244 - "POST /node/69e02ec91fb14b744a548b9f HTTP/1.0" 202 Accepted 2026-04-16 00:35:30,189 - lava_callback - INFO - Starting async job submit for node 69e02ec91fb14b744a548b9f 2026-04-16 00:35:30,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:35:30,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02ec91fb14b744a548b9f HTTP/1.1" 200 None 2026-04-16 00:35:30,213 - lava_callback - DEBUG - Processing node 69e02ec91fb14b744a548b9f: baseline-arm 2026-04-16 00:35:30,219 - lava_callback - WARNING - Failed to upload log 2026-04-16 00:35:30,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:35:30,734 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:35:30,736 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e02ec91fb14b744a548b9f/lava-logs.yaml 2026-04-16 00:35:30,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:35:31,057 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:35:31,059 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e02ec91fb14b744a548b9f/lava_callback.json.gz 2026-04-16 00:35:31,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:35:31,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02ec91fb14b744a548b9f HTTP/1.1" 200 None 2026-04-16 00:35:31,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:35:31,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 00:35:31,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:35:31,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e02ec91fb14b744a548b9f HTTP/1.1" 200 None 2026-04-16 00:35:31,121 - lava_callback - INFO - Completed processing callback for node 69e02ec91fb14b744a548b9f 2026-04-16 00:35:35,057 - lava_callback - INFO - Received callback for node 69dfaa2706e8e7b15e966499 INFO: 172.21.0.1:55256 - "POST /node/69dfaa2706e8e7b15e966499 HTTP/1.0" 202 Accepted 2026-04-16 00:35:35,069 - lava_callback - INFO - Starting async job submit for node 69dfaa2706e8e7b15e966499 2026-04-16 00:35:35,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:35:35,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dfaa2706e8e7b15e966499 HTTP/1.1" 200 None 2026-04-16 00:35:35,144 - lava_callback - DEBUG - Processing node 69dfaa2706e8e7b15e966499: baseline-x86 2026-04-16 00:35:35,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:35:35,659 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:35:35,660 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69dfaa2706e8e7b15e966499/log.txt.gz 2026-04-16 00:35:35,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:35:36,126 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:35:36,128 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69dfaa2706e8e7b15e966499/lava-logs.yaml 2026-04-16 00:35:36,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:35:36,304 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:35:36,306 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69dfaa2706e8e7b15e966499/lava_callback.json.gz 2026-04-16 00:35:36,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:35:36,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dfaa2706e8e7b15e966499 HTTP/1.1" 200 None 2026-04-16 00:35:36,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:35:36,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49c106e8e7b15e9624ed HTTP/1.1" 200 None 2026-04-16 00:35:36,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:35:36,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dfaa2706e8e7b15e966499 HTTP/1.1" 200 None 2026-04-16 00:35:36,388 - lava_callback - INFO - Completed processing callback for node 69dfaa2706e8e7b15e966499 INFO: 172.21.0.1:55268 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:35:37,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:35:37,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35410 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:36:13,584 - lava_callback - INFO - Received callback for node 69e02ecd1fb14b744a548bab INFO: 172.21.0.1:56052 - "POST /node/69e02ecd1fb14b744a548bab HTTP/1.0" 202 Accepted 2026-04-16 00:36:13,636 - lava_callback - INFO - Starting async job submit for node 69e02ecd1fb14b744a548bab 2026-04-16 00:36:13,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:36:13,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02ecd1fb14b744a548bab HTTP/1.1" 200 None 2026-04-16 00:36:13,684 - lava_callback - DEBUG - Processing node 69e02ecd1fb14b744a548bab: baseline-arm 2026-04-16 00:36:13,831 - lava_callback - INFO - Received callback for node 69e02eca1fb14b744a548ba2 2026-04-16 00:36:13,861 - lava_callback - INFO - Starting async job submit for node 69e02eca1fb14b744a548ba2 INFO: 172.21.0.1:56064 - "POST /node/69e02eca1fb14b744a548ba2 HTTP/1.0" 202 Accepted 2026-04-16 00:36:13,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:36:13,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:36:13,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02eca1fb14b744a548ba2 HTTP/1.1" 200 None 2026-04-16 00:36:13,906 - lava_callback - DEBUG - Processing node 69e02eca1fb14b744a548ba2: baseline-arm 2026-04-16 00:36:14,089 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:36:14,102 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e02ecd1fb14b744a548bab/log.txt.gz 2026-04-16 00:36:14,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:36:14,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:36:14,427 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:36:14,429 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e02eca1fb14b744a548ba2/log.txt.gz 2026-04-16 00:36:14,455 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:36:14,500 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e02ecd1fb14b744a548bab/lava-logs.yaml 2026-04-16 00:36:14,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:36:14,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:36:14,675 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:36:14,677 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e02ecd1fb14b744a548bab/lava_callback.json.gz 2026-04-16 00:36:14,699 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:36:14,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:36:14,701 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e02eca1fb14b744a548ba2/lava-logs.yaml 2026-04-16 00:36:14,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:36:14,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02ecd1fb14b744a548bab HTTP/1.1" 200 None 2026-04-16 00:36:14,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:36:14,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 00:36:14,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:36:14,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e02ecd1fb14b744a548bab HTTP/1.1" 200 None 2026-04-16 00:36:14,758 - lava_callback - INFO - Completed processing callback for node 69e02ecd1fb14b744a548bab 2026-04-16 00:36:14,840 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:36:14,842 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e02eca1fb14b744a548ba2/lava_callback.json.gz 2026-04-16 00:36:14,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:36:14,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02eca1fb14b744a548ba2 HTTP/1.1" 200 None 2026-04-16 00:36:14,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:36:14,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 00:36:14,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:36:14,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e02eca1fb14b744a548ba2 HTTP/1.1" 200 None 2026-04-16 00:36:14,977 - lava_callback - INFO - Completed processing callback for node 69e02eca1fb14b744a548ba2 INFO: 172.21.0.1:56080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58424 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:36:37,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:36:37,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-16 00:36:37,630 - lava_callback - INFO - Received callback for node 69e02ecc1fb14b744a548ba8 INFO: 172.21.0.1:58432 - "POST /node/69e02ecc1fb14b744a548ba8 HTTP/1.0" 202 Accepted 2026-04-16 00:36:37,637 - lava_callback - INFO - Starting async job submit for node 69e02ecc1fb14b744a548ba8 2026-04-16 00:36:37,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:36:37,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02ecc1fb14b744a548ba8 HTTP/1.1" 200 None 2026-04-16 00:36:37,698 - lava_callback - DEBUG - Processing node 69e02ecc1fb14b744a548ba8: baseline-arm 2026-04-16 00:36:37,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:36:38,093 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:36:38,095 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e02ecc1fb14b744a548ba8/log.txt.gz 2026-04-16 00:36:38,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:36:38,505 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:36:38,507 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e02ecc1fb14b744a548ba8/lava-logs.yaml 2026-04-16 00:36:38,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:36:38,659 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:36:38,661 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e02ecc1fb14b744a548ba8/lava_callback.json.gz 2026-04-16 00:36:38,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:36:38,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02ecc1fb14b744a548ba8 HTTP/1.1" 200 None 2026-04-16 00:36:38,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:36:38,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 00:36:38,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:36:38,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e02ecc1fb14b744a548ba8 HTTP/1.1" 200 None 2026-04-16 00:36:38,746 - lava_callback - INFO - Completed processing callback for node 69e02ecc1fb14b744a548ba8 INFO: 172.21.0.1:45566 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:36:49,262 - lava_callback - INFO - Received callback for node 69e02ec81fb14b744a548b9c INFO: 172.21.0.1:45578 - "POST /node/69e02ec81fb14b744a548b9c HTTP/1.0" 202 Accepted 2026-04-16 00:36:49,268 - lava_callback - INFO - Starting async job submit for node 69e02ec81fb14b744a548b9c 2026-04-16 00:36:49,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:36:49,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02ec81fb14b744a548b9c HTTP/1.1" 200 None 2026-04-16 00:36:49,316 - lava_callback - DEBUG - Processing node 69e02ec81fb14b744a548b9c: baseline-arm 2026-04-16 00:36:49,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:36:49,910 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:36:49,913 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e02ec81fb14b744a548b9c/log.txt.gz 2026-04-16 00:36:50,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:36:50,265 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:36:50,267 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e02ec81fb14b744a548b9c/lava-logs.yaml 2026-04-16 00:36:50,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:36:50,443 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:36:50,445 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e02ec81fb14b744a548b9c/lava_callback.json.gz 2026-04-16 00:36:50,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:36:50,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02ec81fb14b744a548b9c HTTP/1.1" 200 None 2026-04-16 00:36:50,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:36:50,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 00:36:50,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:36:50,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e02ec81fb14b744a548b9c HTTP/1.1" 200 None 2026-04-16 00:36:50,537 - lava_callback - INFO - Completed processing callback for node 69e02ec81fb14b744a548b9c INFO: 172.21.0.1:56486 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:36:59,692 - lava_callback - INFO - Received callback for node 69e02edb1fb14b744a548bd7 INFO: 172.21.0.1:56498 - "POST /node/69e02edb1fb14b744a548bd7 HTTP/1.0" 202 Accepted 2026-04-16 00:36:59,699 - lava_callback - INFO - Starting async job submit for node 69e02edb1fb14b744a548bd7 2026-04-16 00:36:59,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:36:59,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02edb1fb14b744a548bd7 HTTP/1.1" 200 None 2026-04-16 00:36:59,756 - lava_callback - DEBUG - Processing node 69e02edb1fb14b744a548bd7: baseline-arm-broonie 2026-04-16 00:37:00,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:37:00,323 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:37:00,326 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e02edb1fb14b744a548bd7/log.txt.gz 2026-04-16 00:37:00,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:37:00,729 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:37:00,732 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e02edb1fb14b744a548bd7/lava-logs.yaml 2026-04-16 00:37:00,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:37:01,468 - lava_callback - INFO - Received callback for node 69e02edd1fb14b744a548bda INFO: 172.21.0.1:54366 - "POST /node/69e02edd1fb14b744a548bda HTTP/1.0" 202 Accepted 2026-04-16 00:37:01,479 - lava_callback - INFO - Starting async job submit for node 69e02edd1fb14b744a548bda 2026-04-16 00:37:01,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:37:01,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02edd1fb14b744a548bda HTTP/1.1" 200 None 2026-04-16 00:37:01,542 - lava_callback - DEBUG - Processing node 69e02edd1fb14b744a548bda: baseline-arm-broonie 2026-04-16 00:37:01,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:37:01,872 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:37:01,874 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e02edd1fb14b744a548bda/log.txt.gz 2026-04-16 00:37:02,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:37:02,407 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:37:02,410 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e02edd1fb14b744a548bda/lava-logs.yaml 2026-04-16 00:37:02,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:37:02,530 - lava_callback - INFO - Received callback for node 69e02eef1fb14b744a548c40 2026-04-16 00:37:02,578 - lava_callback - INFO - Starting async job submit for node 69e02eef1fb14b744a548c40 INFO: 172.21.0.1:54382 - "POST /node/69e02eef1fb14b744a548c40 HTTP/1.0" 202 Accepted 2026-04-16 00:37:02,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:37:02,605 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:37:02,606 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e02edd1fb14b744a548bda/lava_callback.json.gz 2026-04-16 00:37:02,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:37:02,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02eef1fb14b744a548c40 HTTP/1.1" 200 None 2026-04-16 00:37:02,643 - lava_callback - DEBUG - Processing node 69e02eef1fb14b744a548c40: baseline-arm-pengutronix 2026-04-16 00:37:02,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02edd1fb14b744a548bda HTTP/1.1" 200 None 2026-04-16 00:37:02,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:37:02,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:37:02,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 00:37:02,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:37:02,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e02edd1fb14b744a548bda HTTP/1.1" 200 None 2026-04-16 00:37:02,815 - lava_callback - INFO - Completed processing callback for node 69e02edd1fb14b744a548bda 2026-04-16 00:37:02,961 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:37:02,963 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e02eef1fb14b744a548c40/log.txt.gz 2026-04-16 00:37:03,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:37:03,247 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:37:03,250 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e02eef1fb14b744a548c40/lava-logs.yaml 2026-04-16 00:37:03,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:37:03,650 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:37:03,652 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e02eef1fb14b744a548c40/lava_callback.json.gz 2026-04-16 00:37:03,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:37:03,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02eef1fb14b744a548c40 HTTP/1.1" 200 None 2026-04-16 00:37:03,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:37:03,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 00:37:03,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:37:03,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e02eef1fb14b744a548c40 HTTP/1.1" 200 None 2026-04-16 00:37:03,768 - lava_callback - INFO - Completed processing callback for node 69e02eef1fb14b744a548c40 2026-04-16 00:37:04,885 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:37:04,887 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e02edb1fb14b744a548bd7/lava_callback.json.gz 2026-04-16 00:37:04,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:37:04,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02edb1fb14b744a548bd7 HTTP/1.1" 200 None 2026-04-16 00:37:04,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:37:04,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 00:37:04,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:37:05,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e02edb1fb14b744a548bd7 HTTP/1.1" 200 None 2026-04-16 00:37:05,033 - lava_callback - INFO - Completed processing callback for node 69e02edb1fb14b744a548bd7 INFO: 172.21.0.1:54390 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:37:07,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:37:07,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-16 00:37:08,273 - lava_callback - INFO - Received callback for node 69e02eee1fb14b744a548c3b INFO: 172.21.0.1:54402 - "POST /node/69e02eee1fb14b744a548c3b HTTP/1.0" 202 Accepted 2026-04-16 00:37:08,283 - lava_callback - INFO - Starting async job submit for node 69e02eee1fb14b744a548c3b 2026-04-16 00:37:08,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:37:08,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02eee1fb14b744a548c3b HTTP/1.1" 200 None 2026-04-16 00:37:08,329 - lava_callback - DEBUG - Processing node 69e02eee1fb14b744a548c3b: baseline-arm-pengutronix 2026-04-16 00:37:08,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:37:08,655 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:37:08,657 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e02eee1fb14b744a548c3b/log.txt.gz 2026-04-16 00:37:08,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:37:08,951 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:37:08,954 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e02eee1fb14b744a548c3b/lava-logs.yaml 2026-04-16 00:37:08,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:37:09,217 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:37:09,219 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e02eee1fb14b744a548c3b/lava_callback.json.gz 2026-04-16 00:37:09,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:37:09,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02eee1fb14b744a548c3b HTTP/1.1" 200 None 2026-04-16 00:37:09,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:37:09,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 00:37:09,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:37:09,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e02eee1fb14b744a548c3b HTTP/1.1" 200 None 2026-04-16 00:37:09,340 - lava_callback - INFO - Completed processing callback for node 69e02eee1fb14b744a548c3b INFO: 172.21.0.1:43832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43844 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:37:22,771 - lava_callback - INFO - Received callback for node 69e02ee91fb14b744a548c2c INFO: 172.21.0.1:50464 - "POST /node/69e02ee91fb14b744a548c2c HTTP/1.0" 202 Accepted 2026-04-16 00:37:22,781 - lava_callback - INFO - Starting async job submit for node 69e02ee91fb14b744a548c2c 2026-04-16 00:37:22,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:37:22,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02ee91fb14b744a548c2c HTTP/1.1" 200 None 2026-04-16 00:37:22,855 - lava_callback - DEBUG - Processing node 69e02ee91fb14b744a548c2c: baseline-arm-kontron 2026-04-16 00:37:23,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:37:23,231 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:37:23,232 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69e02ee91fb14b744a548c2c/log.txt.gz 2026-04-16 00:37:23,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:37:23,628 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:37:23,631 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69e02ee91fb14b744a548c2c/lava-logs.yaml 2026-04-16 00:37:23,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:37:23,855 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:37:23,857 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69e02ee91fb14b744a548c2c/lava_callback.json.gz 2026-04-16 00:37:23,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:37:23,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02ee91fb14b744a548c2c HTTP/1.1" 200 None 2026-04-16 00:37:23,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:37:23,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 00:37:23,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:37:23,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e02ee91fb14b744a548c2c HTTP/1.1" 200 None 2026-04-16 00:37:23,995 - lava_callback - INFO - Completed processing callback for node 69e02ee91fb14b744a548c2c 2026-04-16 00:37:24,048 - lava_callback - INFO - Received callback for node 69e02eeb1fb14b744a548c2f INFO: 172.21.0.1:50474 - "POST /node/69e02eeb1fb14b744a548c2f HTTP/1.0" 202 Accepted 2026-04-16 00:37:24,110 - lava_callback - INFO - Starting async job submit for node 69e02eeb1fb14b744a548c2f 2026-04-16 00:37:24,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:37:24,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02eeb1fb14b744a548c2f HTTP/1.1" 200 None 2026-04-16 00:37:24,164 - lava_callback - DEBUG - Processing node 69e02eeb1fb14b744a548c2f: baseline-arm-kontron 2026-04-16 00:37:24,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:37:24,558 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:37:24,560 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69e02eeb1fb14b744a548c2f/log.txt.gz 2026-04-16 00:37:24,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:37:24,831 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:37:24,833 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69e02eeb1fb14b744a548c2f/lava-logs.yaml 2026-04-16 00:37:24,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:37:24,983 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:37:24,985 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69e02eeb1fb14b744a548c2f/lava_callback.json.gz 2026-04-16 00:37:25,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:37:25,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02eeb1fb14b744a548c2f HTTP/1.1" 200 None 2026-04-16 00:37:25,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:37:25,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 00:37:25,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:37:25,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e02eeb1fb14b744a548c2f HTTP/1.1" 200 None 2026-04-16 00:37:25,068 - lava_callback - INFO - Completed processing callback for node 69e02eeb1fb14b744a548c2f INFO: 172.21.0.1:50486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50900 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:37:37,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:37:37,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50658 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:38:08,186 - lava_callback - INFO - Received callback for node 69e02f051fb14b744a548c99 INFO: 172.21.0.1:50668 - "POST /node/69e02f051fb14b744a548c99 HTTP/1.0" 202 Accepted 2026-04-16 00:38:08,194 - lava_callback - INFO - Starting async job submit for node 69e02f051fb14b744a548c99 2026-04-16 00:38:08,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:38:08,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02f051fb14b744a548c99 HTTP/1.1" 200 None 2026-04-16 00:38:08,236 - lava_callback - DEBUG - Processing node 69e02f051fb14b744a548c99: ltp-dio 2026-04-16 00:38:08,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:38:09,079 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:38:09,081 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-69e02f051fb14b744a548c99/log.txt.gz 2026-04-16 00:38:09,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:38:09,784 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:38:09,786 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-69e02f051fb14b744a548c99/lava-logs.yaml 2026-04-16 00:38:09,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:38:09,972 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:38:09,975 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-69e02f051fb14b744a548c99/lava_callback.json.gz 2026-04-16 00:38:10,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:38:10,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02f051fb14b744a548c99 HTTP/1.1" 200 None 2026-04-16 00:38:10,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:38:10,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 00:38:10,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:38:10,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e02f051fb14b744a548c99 HTTP/1.1" 200 None 2026-04-16 00:38:10,110 - lava_callback - INFO - Completed processing callback for node 69e02f051fb14b744a548c99 INFO: 172.21.0.1:46774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46790 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:38:17,522 - lava_callback - INFO - Received callback for node 69e02ede1fb14b744a548bdd INFO: 172.21.0.1:46794 - "POST /node/69e02ede1fb14b744a548bdd HTTP/1.0" 202 Accepted 2026-04-16 00:38:17,529 - lava_callback - INFO - Starting async job submit for node 69e02ede1fb14b744a548bdd 2026-04-16 00:38:17,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:38:17,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02ede1fb14b744a548bdd HTTP/1.1" 200 None 2026-04-16 00:38:17,569 - lava_callback - DEBUG - Processing node 69e02ede1fb14b744a548bdd: baseline-arm-broonie 2026-04-16 00:38:17,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:38:18,258 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:38:18,260 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e02ede1fb14b744a548bdd/log.txt.gz 2026-04-16 00:38:18,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:38:19,031 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:38:19,033 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e02ede1fb14b744a548bdd/lava-logs.yaml 2026-04-16 00:38:19,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:38:19,215 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:38:19,217 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e02ede1fb14b744a548bdd/lava_callback.json.gz 2026-04-16 00:38:19,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:38:19,261 - lava_callback - INFO - Received callback for node 69e02f6e1fb14b744a548d7a INFO: 172.21.0.1:46800 - "POST /node/69e02f6e1fb14b744a548d7a HTTP/1.0" 202 Accepted 2026-04-16 00:38:19,288 - lava_callback - INFO - Starting async job submit for node 69e02f6e1fb14b744a548d7a 2026-04-16 00:38:19,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02ede1fb14b744a548bdd HTTP/1.1" 200 None 2026-04-16 00:38:19,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:38:19,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:38:19,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02f6e1fb14b744a548d7a HTTP/1.1" 200 None 2026-04-16 00:38:19,313 - lava_callback - DEBUG - Processing node 69e02f6e1fb14b744a548d7a: baseline-arm 2026-04-16 00:38:19,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 00:38:19,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:38:19,326 - lava_callback - WARNING - Failed to upload log 2026-04-16 00:38:19,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:38:19,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e02ede1fb14b744a548bdd HTTP/1.1" 200 None 2026-04-16 00:38:19,362 - lava_callback - INFO - Completed processing callback for node 69e02ede1fb14b744a548bdd 2026-04-16 00:38:19,919 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:38:19,921 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e02f6e1fb14b744a548d7a/lava-logs.yaml 2026-04-16 00:38:19,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:38:20,083 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:38:20,085 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e02f6e1fb14b744a548d7a/lava_callback.json.gz 2026-04-16 00:38:20,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:38:20,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02f6e1fb14b744a548d7a HTTP/1.1" 200 None 2026-04-16 00:38:20,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:38:20,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 00:38:20,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:38:20,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e02f6e1fb14b744a548d7a HTTP/1.1" 200 None 2026-04-16 00:38:20,157 - lava_callback - INFO - Completed processing callback for node 69e02f6e1fb14b744a548d7a INFO: 172.21.0.1:58988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58994 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:38:32,814 - lava_callback - INFO - Received callback for node 69dd8c74c2164e674d71f250 INFO: 172.21.0.1:36614 - "POST /node/69dd8c74c2164e674d71f250 HTTP/1.0" 202 Accepted 2026-04-16 00:38:32,828 - lava_callback - INFO - Starting async job submit for node 69dd8c74c2164e674d71f250 2026-04-16 00:38:32,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:38:32,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8c74c2164e674d71f250 HTTP/1.1" 200 None 2026-04-16 00:38:32,855 - lava_callback - DEBUG - Processing node 69dd8c74c2164e674d71f250: baseline-arm64-baylibre 2026-04-16 00:38:32,855 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd8c74c2164e674d71f250 2026-04-16 00:38:32,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:38:32,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8c74c2164e674d71f250 HTTP/1.1" 200 None 2026-04-16 00:38:32,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:38:32,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd171917c944d2f17d8b46 HTTP/1.1" 200 None 2026-04-16 00:38:32,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:38:32,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8c74c2164e674d71f250 HTTP/1.1" 200 None 2026-04-16 00:38:32,966 - lava_callback - ERROR - Error processing callback for node 69dd8c74c2164e674d71f250: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36622 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:38:37,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:38:37,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36578 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:39:12,822 - lava_callback - INFO - Received callback for node 69dd8c9dc2164e674d71f2c4 INFO: 172.21.0.1:46870 - "POST /node/69dd8c9dc2164e674d71f2c4 HTTP/1.0" 202 Accepted 2026-04-16 00:39:12,831 - lava_callback - INFO - Starting async job submit for node 69dd8c9dc2164e674d71f2c4 2026-04-16 00:39:12,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:12,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8c9dc2164e674d71f2c4 HTTP/1.1" 200 None 2026-04-16 00:39:12,848 - lava_callback - DEBUG - Processing node 69dd8c9dc2164e674d71f2c4: baseline-arm-baylibre 2026-04-16 00:39:12,848 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd8c9dc2164e674d71f2c4 2026-04-16 00:39:12,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:12,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8c9dc2164e674d71f2c4 HTTP/1.1" 200 None 2026-04-16 00:39:12,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:12,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-16 00:39:12,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:12,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8c9dc2164e674d71f2c4 HTTP/1.1" 200 None 2026-04-16 00:39:12,929 - lava_callback - ERROR - Error processing callback for node 69dd8c9dc2164e674d71f2c4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 00:39:13,493 - lava_callback - INFO - Received callback for node 69dd8c9ec2164e674d71f2c7 INFO: 172.21.0.1:46880 - "POST /node/69dd8c9ec2164e674d71f2c7 HTTP/1.0" 202 Accepted 2026-04-16 00:39:13,499 - lava_callback - INFO - Starting async job submit for node 69dd8c9ec2164e674d71f2c7 2026-04-16 00:39:13,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:13,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8c9ec2164e674d71f2c7 HTTP/1.1" 200 None 2026-04-16 00:39:13,514 - lava_callback - DEBUG - Processing node 69dd8c9ec2164e674d71f2c7: baseline-arm-baylibre 2026-04-16 00:39:13,515 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd8c9ec2164e674d71f2c7 2026-04-16 00:39:13,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:13,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8c9ec2164e674d71f2c7 HTTP/1.1" 200 None 2026-04-16 00:39:13,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:13,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-16 00:39:13,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:13,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8c9ec2164e674d71f2c7 HTTP/1.1" 200 None 2026-04-16 00:39:13,572 - lava_callback - ERROR - Error processing callback for node 69dd8c9ec2164e674d71f2c7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 00:39:14,165 - lava_callback - INFO - Received callback for node 69dd8c9fc2164e674d71f2ca INFO: 172.21.0.1:46888 - "POST /node/69dd8c9fc2164e674d71f2ca HTTP/1.0" 202 Accepted 2026-04-16 00:39:14,171 - lava_callback - INFO - Starting async job submit for node 69dd8c9fc2164e674d71f2ca 2026-04-16 00:39:14,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:14,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8c9fc2164e674d71f2ca HTTP/1.1" 200 None 2026-04-16 00:39:14,205 - lava_callback - DEBUG - Processing node 69dd8c9fc2164e674d71f2ca: baseline-arm-baylibre 2026-04-16 00:39:14,205 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd8c9fc2164e674d71f2ca 2026-04-16 00:39:14,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:14,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8c9fc2164e674d71f2ca HTTP/1.1" 200 None 2026-04-16 00:39:14,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:14,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-16 00:39:14,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:14,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8c9fc2164e674d71f2ca HTTP/1.1" 200 None 2026-04-16 00:39:14,263 - lava_callback - ERROR - Error processing callback for node 69dd8c9fc2164e674d71f2ca: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 00:39:14,863 - lava_callback - INFO - Received callback for node 69dd8ca1c2164e674d71f2cd INFO: 172.21.0.1:46896 - "POST /node/69dd8ca1c2164e674d71f2cd HTTP/1.0" 202 Accepted 2026-04-16 00:39:14,871 - lava_callback - INFO - Starting async job submit for node 69dd8ca1c2164e674d71f2cd 2026-04-16 00:39:14,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:14,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8ca1c2164e674d71f2cd HTTP/1.1" 200 None 2026-04-16 00:39:14,894 - lava_callback - DEBUG - Processing node 69dd8ca1c2164e674d71f2cd: baseline-arm-baylibre 2026-04-16 00:39:14,894 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd8ca1c2164e674d71f2cd 2026-04-16 00:39:14,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:14,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8ca1c2164e674d71f2cd HTTP/1.1" 200 None 2026-04-16 00:39:14,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:14,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-16 00:39:14,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:14,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8ca1c2164e674d71f2cd HTTP/1.1" 200 None 2026-04-16 00:39:14,952 - lava_callback - ERROR - Error processing callback for node 69dd8ca1c2164e674d71f2cd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46902 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-16 00:39:15,560 - lava_callback - INFO - Received callback for node 69dd8ca3c2164e674d71f2d8 INFO: 172.21.0.1:46918 - "POST /node/69dd8ca3c2164e674d71f2d8 HTTP/1.0" 202 Accepted 2026-04-16 00:39:15,568 - lava_callback - INFO - Starting async job submit for node 69dd8ca3c2164e674d71f2d8 2026-04-16 00:39:15,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:15,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8ca3c2164e674d71f2d8 HTTP/1.1" 200 None 2026-04-16 00:39:15,595 - lava_callback - DEBUG - Processing node 69dd8ca3c2164e674d71f2d8: baseline-arm-baylibre 2026-04-16 00:39:15,595 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd8ca3c2164e674d71f2d8 2026-04-16 00:39:15,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:15,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8ca3c2164e674d71f2d8 HTTP/1.1" 200 None 2026-04-16 00:39:15,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:15,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-16 00:39:15,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:15,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8ca3c2164e674d71f2d8 HTTP/1.1" 200 None 2026-04-16 00:39:15,654 - lava_callback - ERROR - Error processing callback for node 69dd8ca3c2164e674d71f2d8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 00:39:16,234 - lava_callback - INFO - Received callback for node 69dd8ca5c2164e674d71f2db INFO: 172.21.0.1:46924 - "POST /node/69dd8ca5c2164e674d71f2db HTTP/1.0" 202 Accepted 2026-04-16 00:39:16,243 - lava_callback - INFO - Starting async job submit for node 69dd8ca5c2164e674d71f2db 2026-04-16 00:39:16,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:16,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8ca5c2164e674d71f2db HTTP/1.1" 200 None 2026-04-16 00:39:16,280 - lava_callback - DEBUG - Processing node 69dd8ca5c2164e674d71f2db: baseline-arm-baylibre 2026-04-16 00:39:16,280 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd8ca5c2164e674d71f2db 2026-04-16 00:39:16,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:16,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8ca5c2164e674d71f2db HTTP/1.1" 200 None 2026-04-16 00:39:16,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:16,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-16 00:39:16,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:16,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8ca5c2164e674d71f2db HTTP/1.1" 200 None 2026-04-16 00:39:16,353 - lava_callback - ERROR - Error processing callback for node 69dd8ca5c2164e674d71f2db: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40714 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:39:28,471 - lava_callback - INFO - Received callback for node 69dd8cadc2164e674d71f30a INFO: 172.21.0.1:40722 - "POST /node/69dd8cadc2164e674d71f30a HTTP/1.0" 202 Accepted 2026-04-16 00:39:28,476 - lava_callback - INFO - Starting async job submit for node 69dd8cadc2164e674d71f30a 2026-04-16 00:39:28,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:28,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8cadc2164e674d71f30a HTTP/1.1" 200 None 2026-04-16 00:39:28,494 - lava_callback - DEBUG - Processing node 69dd8cadc2164e674d71f30a: baseline-arm-clabbe 2026-04-16 00:39:28,495 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd8cadc2164e674d71f30a 2026-04-16 00:39:28,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:28,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8cadc2164e674d71f30a HTTP/1.1" 200 None 2026-04-16 00:39:28,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:28,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-16 00:39:28,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:28,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8cadc2164e674d71f30a HTTP/1.1" 200 None 2026-04-16 00:39:28,543 - lava_callback - ERROR - Error processing callback for node 69dd8cadc2164e674d71f30a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40724 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:39:29,164 - lava_callback - INFO - Received callback for node 69dd8cafc2164e674d71f310 INFO: 172.21.0.1:40736 - "POST /node/69dd8cafc2164e674d71f310 HTTP/1.0" 202 Accepted 2026-04-16 00:39:29,169 - lava_callback - INFO - Starting async job submit for node 69dd8cafc2164e674d71f310 2026-04-16 00:39:29,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:29,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8cafc2164e674d71f310 HTTP/1.1" 200 None 2026-04-16 00:39:29,188 - lava_callback - DEBUG - Processing node 69dd8cafc2164e674d71f310: baseline-arm-clabbe 2026-04-16 00:39:29,188 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd8cafc2164e674d71f310 2026-04-16 00:39:29,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:29,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8cafc2164e674d71f310 HTTP/1.1" 200 None 2026-04-16 00:39:29,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:29,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-16 00:39:29,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:29,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8cafc2164e674d71f310 HTTP/1.1" 200 None 2026-04-16 00:39:29,238 - lava_callback - ERROR - Error processing callback for node 69dd8cafc2164e674d71f310: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 00:39:29,855 - lava_callback - INFO - Received callback for node 69dd8cb0c2164e674d71f314 INFO: 172.21.0.1:39530 - "POST /node/69dd8cb0c2164e674d71f314 HTTP/1.0" 202 Accepted 2026-04-16 00:39:29,862 - lava_callback - INFO - Starting async job submit for node 69dd8cb0c2164e674d71f314 2026-04-16 00:39:29,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:29,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8cb0c2164e674d71f314 HTTP/1.1" 200 None 2026-04-16 00:39:29,881 - lava_callback - DEBUG - Processing node 69dd8cb0c2164e674d71f314: baseline-arm-clabbe 2026-04-16 00:39:29,881 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd8cb0c2164e674d71f314 2026-04-16 00:39:29,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:29,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8cb0c2164e674d71f314 HTTP/1.1" 200 None 2026-04-16 00:39:29,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:29,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-16 00:39:29,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:29,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8cb0c2164e674d71f314 HTTP/1.1" 200 None 2026-04-16 00:39:29,934 - lava_callback - ERROR - Error processing callback for node 69dd8cb0c2164e674d71f314: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 00:39:30,544 - lava_callback - INFO - Received callback for node 69dd8cb1c2164e674d71f317 INFO: 172.21.0.1:39534 - "POST /node/69dd8cb1c2164e674d71f317 HTTP/1.0" 202 Accepted 2026-04-16 00:39:30,553 - lava_callback - INFO - Starting async job submit for node 69dd8cb1c2164e674d71f317 2026-04-16 00:39:30,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:30,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8cb1c2164e674d71f317 HTTP/1.1" 200 None 2026-04-16 00:39:30,570 - lava_callback - DEBUG - Processing node 69dd8cb1c2164e674d71f317: baseline-arm-clabbe 2026-04-16 00:39:30,570 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd8cb1c2164e674d71f317 2026-04-16 00:39:30,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:30,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8cb1c2164e674d71f317 HTTP/1.1" 200 None 2026-04-16 00:39:30,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:30,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-16 00:39:30,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:30,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8cb1c2164e674d71f317 HTTP/1.1" 200 None 2026-04-16 00:39:30,619 - lava_callback - ERROR - Error processing callback for node 69dd8cb1c2164e674d71f317: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 00:39:31,234 - lava_callback - INFO - Received callback for node 69dd8cb2c2164e674d71f31a INFO: 172.21.0.1:39538 - "POST /node/69dd8cb2c2164e674d71f31a HTTP/1.0" 202 Accepted 2026-04-16 00:39:31,241 - lava_callback - INFO - Starting async job submit for node 69dd8cb2c2164e674d71f31a 2026-04-16 00:39:31,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:31,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8cb2c2164e674d71f31a HTTP/1.1" 200 None 2026-04-16 00:39:31,260 - lava_callback - DEBUG - Processing node 69dd8cb2c2164e674d71f31a: baseline-arm-clabbe 2026-04-16 00:39:31,261 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd8cb2c2164e674d71f31a 2026-04-16 00:39:31,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:31,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8cb2c2164e674d71f31a HTTP/1.1" 200 None 2026-04-16 00:39:31,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:31,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-16 00:39:31,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:31,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8cb2c2164e674d71f31a HTTP/1.1" 200 None 2026-04-16 00:39:31,323 - lava_callback - ERROR - Error processing callback for node 69dd8cb2c2164e674d71f31a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 00:39:31,927 - lava_callback - INFO - Received callback for node 69dd8cb2c2164e674d71f31d INFO: 172.21.0.1:39548 - "POST /node/69dd8cb2c2164e674d71f31d HTTP/1.0" 202 Accepted 2026-04-16 00:39:31,933 - lava_callback - INFO - Starting async job submit for node 69dd8cb2c2164e674d71f31d 2026-04-16 00:39:31,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:31,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8cb2c2164e674d71f31d HTTP/1.1" 200 None 2026-04-16 00:39:31,949 - lava_callback - DEBUG - Processing node 69dd8cb2c2164e674d71f31d: baseline-arm-clabbe 2026-04-16 00:39:31,950 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd8cb2c2164e674d71f31d 2026-04-16 00:39:31,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:31,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8cb2c2164e674d71f31d HTTP/1.1" 200 None 2026-04-16 00:39:31,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:31,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-16 00:39:31,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:32,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8cb2c2164e674d71f31d HTTP/1.1" 200 None 2026-04-16 00:39:32,008 - lava_callback - ERROR - Error processing callback for node 69dd8cb2c2164e674d71f31d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 00:39:32,609 - lava_callback - INFO - Received callback for node 69dd8cb3c2164e674d71f320 INFO: 172.21.0.1:39564 - "POST /node/69dd8cb3c2164e674d71f320 HTTP/1.0" 202 Accepted 2026-04-16 00:39:32,614 - lava_callback - INFO - Starting async job submit for node 69dd8cb3c2164e674d71f320 2026-04-16 00:39:32,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:32,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8cb3c2164e674d71f320 HTTP/1.1" 200 None 2026-04-16 00:39:32,630 - lava_callback - DEBUG - Processing node 69dd8cb3c2164e674d71f320: baseline-arm-clabbe 2026-04-16 00:39:32,630 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd8cb3c2164e674d71f320 2026-04-16 00:39:32,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:32,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8cb3c2164e674d71f320 HTTP/1.1" 200 None 2026-04-16 00:39:32,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:32,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-16 00:39:32,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:32,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8cb3c2164e674d71f320 HTTP/1.1" 200 None 2026-04-16 00:39:32,678 - lava_callback - ERROR - Error processing callback for node 69dd8cb3c2164e674d71f320: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 00:39:33,321 - lava_callback - INFO - Received callback for node 69dd8cb4c2164e674d71f323 INFO: 172.21.0.1:39580 - "POST /node/69dd8cb4c2164e674d71f323 HTTP/1.0" 202 Accepted 2026-04-16 00:39:33,330 - lava_callback - INFO - Starting async job submit for node 69dd8cb4c2164e674d71f323 2026-04-16 00:39:33,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:33,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8cb4c2164e674d71f323 HTTP/1.1" 200 None 2026-04-16 00:39:33,372 - lava_callback - DEBUG - Processing node 69dd8cb4c2164e674d71f323: baseline-arm-clabbe 2026-04-16 00:39:33,372 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd8cb4c2164e674d71f323 2026-04-16 00:39:33,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:33,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8cb4c2164e674d71f323 HTTP/1.1" 200 None 2026-04-16 00:39:33,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:33,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-16 00:39:33,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:33,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8cb4c2164e674d71f323 HTTP/1.1" 200 None 2026-04-16 00:39:33,424 - lava_callback - ERROR - Error processing callback for node 69dd8cb4c2164e674d71f323: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 00:39:34,010 - lava_callback - INFO - Received callback for node 69dd8cb5c2164e674d71f326 INFO: 172.21.0.1:39584 - "POST /node/69dd8cb5c2164e674d71f326 HTTP/1.0" 202 Accepted 2026-04-16 00:39:34,016 - lava_callback - INFO - Starting async job submit for node 69dd8cb5c2164e674d71f326 2026-04-16 00:39:34,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:34,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8cb5c2164e674d71f326 HTTP/1.1" 200 None 2026-04-16 00:39:34,033 - lava_callback - DEBUG - Processing node 69dd8cb5c2164e674d71f326: baseline-arm-clabbe 2026-04-16 00:39:34,033 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd8cb5c2164e674d71f326 2026-04-16 00:39:34,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:34,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8cb5c2164e674d71f326 HTTP/1.1" 200 None 2026-04-16 00:39:34,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:34,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-16 00:39:34,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:34,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8cb5c2164e674d71f326 HTTP/1.1" 200 None 2026-04-16 00:39:34,097 - lava_callback - ERROR - Error processing callback for node 69dd8cb5c2164e674d71f326: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60126 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:39:59,995 - lava_callback - INFO - Received callback for node 69e02f181fb14b744a548cc8 INFO: 172.21.0.1:52098 - "POST /node/69e02f181fb14b744a548cc8 HTTP/1.0" 202 Accepted 2026-04-16 00:40:00,002 - lava_callback - INFO - Starting async job submit for node 69e02f181fb14b744a548cc8 2026-04-16 00:40:00,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:40:00,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02f181fb14b744a548cc8 HTTP/1.1" 200 None 2026-04-16 00:40:00,043 - lava_callback - DEBUG - Processing node 69e02f181fb14b744a548cc8: baseline-arm 2026-04-16 00:40:00,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:40:00,379 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:40:00,381 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e02f181fb14b744a548cc8/log.txt.gz 2026-04-16 00:40:00,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:40:00,679 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:40:00,681 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e02f181fb14b744a548cc8/lava-logs.yaml 2026-04-16 00:40:00,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:40:00,854 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:40:00,855 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e02f181fb14b744a548cc8/lava_callback.json.gz 2026-04-16 00:40:00,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:40:00,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02f181fb14b744a548cc8 HTTP/1.1" 200 None 2026-04-16 00:40:00,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:40:00,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a2e1fb14b744a54889b HTTP/1.1" 200 None 2026-04-16 00:40:00,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:40:00,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e02f181fb14b744a548cc8 HTTP/1.1" 200 None 2026-04-16 00:40:00,969 - lava_callback - INFO - Completed processing callback for node 69e02f181fb14b744a548cc8 INFO: 172.21.0.1:52104 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:40:07,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:40:07,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40502 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:40:27,241 - lava_callback - INFO - Received callback for node 69dffeeeb70ef96924eadca6 INFO: 172.21.0.1:40508 - "POST /node/69dffeeeb70ef96924eadca6 HTTP/1.0" 202 Accepted 2026-04-16 00:40:27,251 - lava_callback - INFO - Starting async job submit for node 69dffeeeb70ef96924eadca6 2026-04-16 00:40:27,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:40:27,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dffeeeb70ef96924eadca6 HTTP/1.1" 200 None 2026-04-16 00:40:27,300 - lava_callback - DEBUG - Processing node 69dffeeeb70ef96924eadca6: baseline-x86 2026-04-16 00:40:27,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:40:27,861 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:40:27,863 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69dffeeeb70ef96924eadca6/log.txt.gz 2026-04-16 00:40:28,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:40:28,317 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:40:28,319 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69dffeeeb70ef96924eadca6/lava-logs.yaml 2026-04-16 00:40:28,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:40:28,461 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:40:28,463 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69dffeeeb70ef96924eadca6/lava_callback.json.gz 2026-04-16 00:40:28,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:40:28,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dffeeeb70ef96924eadca6 HTTP/1.1" 200 None 2026-04-16 00:40:28,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:40:28,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49c106e8e7b15e9624ed HTTP/1.1" 200 None 2026-04-16 00:40:28,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:40:28,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dffeeeb70ef96924eadca6 HTTP/1.1" 200 None 2026-04-16 00:40:28,544 - lava_callback - INFO - Completed processing callback for node 69dffeeeb70ef96924eadca6 INFO: 172.21.0.1:40512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49336 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:40:37,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:40:37,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35352 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47812 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:41:37,116 - lava_callback - INFO - Received callback for node 69e02f111fb14b744a548cb2 INFO: 172.21.0.1:47820 - "POST /node/69e02f111fb14b744a548cb2 HTTP/1.0" 202 Accepted 2026-04-16 00:41:37,124 - lava_callback - INFO - Starting async job submit for node 69e02f111fb14b744a548cb2 2026-04-16 00:41:37,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:41:37,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02f111fb14b744a548cb2 HTTP/1.1" 200 None 2026-04-16 00:41:37,165 - lava_callback - DEBUG - Processing node 69e02f111fb14b744a548cb2: ltp-syscalls 2026-04-16 00:41:38,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:41:38,198 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:41:38,200 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-69e02f111fb14b744a548cb2/log.txt.gz 2026-04-16 00:41:38,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:41:38,998 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:41:39,000 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-69e02f111fb14b744a548cb2/lava-logs.yaml 2026-04-16 00:41:39,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:41:39,216 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:41:39,218 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-69e02f111fb14b744a548cb2/lava_callback.json.gz 2026-04-16 00:41:39,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:41:39,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02f111fb14b744a548cb2 HTTP/1.1" 200 None 2026-04-16 00:41:39,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:41:39,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 00:41:39,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:41:39,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e02f111fb14b744a548cb2 HTTP/1.1" 200 None 2026-04-16 00:41:39,302 - lava_callback - INFO - Completed processing callback for node 69e02f111fb14b744a548cb2 INFO: 172.21.0.1:48590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36340 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:41:57,453 - lava_callback - INFO - Received callback for node 69e02eda1fb14b744a548bd4 INFO: 172.21.0.1:36348 - "POST /node/69e02eda1fb14b744a548bd4 HTTP/1.0" 202 Accepted 2026-04-16 00:41:57,460 - lava_callback - INFO - Starting async job submit for node 69e02eda1fb14b744a548bd4 2026-04-16 00:41:57,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:41:57,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02eda1fb14b744a548bd4 HTTP/1.1" 200 None 2026-04-16 00:41:57,501 - lava_callback - DEBUG - Processing node 69e02eda1fb14b744a548bd4: baseline-arm-broonie 2026-04-16 00:41:57,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:41:57,909 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:41:57,911 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e02eda1fb14b744a548bd4/log.txt.gz 2026-04-16 00:41:58,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:41:58,227 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:41:58,229 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e02eda1fb14b744a548bd4/lava-logs.yaml 2026-04-16 00:41:58,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:41:58,373 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:41:58,375 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e02eda1fb14b744a548bd4/lava_callback.json.gz 2026-04-16 00:41:58,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:41:58,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02eda1fb14b744a548bd4 HTTP/1.1" 200 None 2026-04-16 00:41:58,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:41:58,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 00:41:58,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:41:58,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e02eda1fb14b744a548bd4 HTTP/1.1" 200 None 2026-04-16 00:41:58,465 - lava_callback - INFO - Completed processing callback for node 69e02eda1fb14b744a548bd4 INFO: 172.21.0.1:35408 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:42:06,971 - lava_callback - INFO - Received callback for node 69e030401fb14b744a548eaf INFO: 172.21.0.1:35424 - "POST /node/69e030401fb14b744a548eaf HTTP/1.0" 202 Accepted 2026-04-16 00:42:06,977 - lava_callback - INFO - Starting async job submit for node 69e030401fb14b744a548eaf 2026-04-16 00:42:06,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:42:07,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e030401fb14b744a548eaf HTTP/1.1" 200 None 2026-04-16 00:42:07,011 - lava_callback - DEBUG - Processing node 69e030401fb14b744a548eaf: baseline-x86 2026-04-16 00:42:07,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:42:07,296 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:42:07,297 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69e030401fb14b744a548eaf/log.txt.gz 2026-04-16 00:42:07,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:42:07,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:42:07,598 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:42:07,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-16 00:42:07,602 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69e030401fb14b744a548eaf/lava-logs.yaml 2026-04-16 00:42:07,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:42:07,734 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:42:07,736 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69e030401fb14b744a548eaf/lava_callback.json.gz 2026-04-16 00:42:07,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:42:07,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e030401fb14b744a548eaf HTTP/1.1" 200 None 2026-04-16 00:42:07,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:42:07,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a551fb14b744a5488c2 HTTP/1.1" 200 None 2026-04-16 00:42:07,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:42:07,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e030401fb14b744a548eaf HTTP/1.1" 200 None 2026-04-16 00:42:07,812 - lava_callback - INFO - Completed processing callback for node 69e030401fb14b744a548eaf INFO: 172.21.0.1:37164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37166 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:42:24,625 - lava_callback - INFO - Received callback for node 69e0303e1fb14b744a548ea6 INFO: 172.21.0.1:44018 - "POST /node/69e0303e1fb14b744a548ea6 HTTP/1.0" 202 Accepted 2026-04-16 00:42:24,631 - lava_callback - INFO - Starting async job submit for node 69e0303e1fb14b744a548ea6 2026-04-16 00:42:24,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:42:24,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0303e1fb14b744a548ea6 HTTP/1.1" 200 None 2026-04-16 00:42:24,665 - lava_callback - DEBUG - Processing node 69e0303e1fb14b744a548ea6: baseline-x86 2026-04-16 00:42:24,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:42:24,973 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:42:24,975 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69e0303e1fb14b744a548ea6/log.txt.gz 2026-04-16 00:42:25,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:42:25,281 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:42:25,284 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69e0303e1fb14b744a548ea6/lava-logs.yaml 2026-04-16 00:42:25,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:42:25,445 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:42:25,447 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69e0303e1fb14b744a548ea6/lava_callback.json.gz 2026-04-16 00:42:25,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:42:25,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0303e1fb14b744a548ea6 HTTP/1.1" 200 None 2026-04-16 00:42:25,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:42:25,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a551fb14b744a5488c2 HTTP/1.1" 200 None 2026-04-16 00:42:25,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:42:25,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e0303e1fb14b744a548ea6 HTTP/1.1" 200 None 2026-04-16 00:42:25,536 - lava_callback - INFO - Completed processing callback for node 69e0303e1fb14b744a548ea6 INFO: 172.21.0.1:44020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34934 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:42:37,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:42:37,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41982 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:42:55,172 - lava_callback - INFO - Received callback for node 69e0303e1fb14b744a548ea9 INFO: 172.21.0.1:40070 - "POST /node/69e0303e1fb14b744a548ea9 HTTP/1.0" 202 Accepted 2026-04-16 00:42:55,178 - lava_callback - INFO - Starting async job submit for node 69e0303e1fb14b744a548ea9 2026-04-16 00:42:55,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:42:55,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0303e1fb14b744a548ea9 HTTP/1.1" 200 None 2026-04-16 00:42:55,230 - lava_callback - DEBUG - Processing node 69e0303e1fb14b744a548ea9: baseline-x86 2026-04-16 00:42:55,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:42:55,660 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:42:55,662 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69e0303e1fb14b744a548ea9/log.txt.gz 2026-04-16 00:42:55,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:42:56,085 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:42:56,087 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69e0303e1fb14b744a548ea9/lava-logs.yaml 2026-04-16 00:42:56,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:42:56,244 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:42:56,246 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69e0303e1fb14b744a548ea9/lava_callback.json.gz 2026-04-16 00:42:56,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:42:56,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0303e1fb14b744a548ea9 HTTP/1.1" 200 None 2026-04-16 00:42:56,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:42:56,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a551fb14b744a5488c2 HTTP/1.1" 200 None 2026-04-16 00:42:56,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:42:56,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e0303e1fb14b744a548ea9 HTTP/1.1" 200 None 2026-04-16 00:42:56,364 - lava_callback - INFO - Completed processing callback for node 69e0303e1fb14b744a548ea9 INFO: 172.21.0.1:38606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38614 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:43:07,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:43:07,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-16 00:43:14,361 - lava_callback - INFO - Received callback for node 69e0303f1fb14b744a548eac INFO: 172.21.0.1:53152 - "POST /node/69e0303f1fb14b744a548eac HTTP/1.0" 202 Accepted 2026-04-16 00:43:14,367 - lava_callback - INFO - Starting async job submit for node 69e0303f1fb14b744a548eac 2026-04-16 00:43:14,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:43:14,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0303f1fb14b744a548eac HTTP/1.1" 200 None 2026-04-16 00:43:14,412 - lava_callback - DEBUG - Processing node 69e0303f1fb14b744a548eac: baseline-x86 2026-04-16 00:43:14,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:43:14,799 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:43:14,800 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69e0303f1fb14b744a548eac/log.txt.gz 2026-04-16 00:43:14,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:43:15,129 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:43:15,131 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69e0303f1fb14b744a548eac/lava-logs.yaml 2026-04-16 00:43:15,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:53156 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-16 00:43:15,276 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:43:15,277 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69e0303f1fb14b744a548eac/lava_callback.json.gz 2026-04-16 00:43:15,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:43:15,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0303f1fb14b744a548eac HTTP/1.1" 200 None 2026-04-16 00:43:15,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:43:15,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a551fb14b744a5488c2 HTTP/1.1" 200 None 2026-04-16 00:43:15,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:43:15,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e0303f1fb14b744a548eac HTTP/1.1" 200 None 2026-04-16 00:43:15,356 - lava_callback - INFO - Completed processing callback for node 69e0303f1fb14b744a548eac INFO: 172.21.0.1:53160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50650 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:43:28,356 - lava_callback - INFO - Received callback for node 69dd8d9ec2164e674d71f525 INFO: 172.21.0.1:50658 - "POST /node/69dd8d9ec2164e674d71f525 HTTP/1.0" 202 Accepted 2026-04-16 00:43:28,361 - lava_callback - INFO - Starting async job submit for node 69dd8d9ec2164e674d71f525 2026-04-16 00:43:28,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:43:28,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8d9ec2164e674d71f525 HTTP/1.1" 200 None 2026-04-16 00:43:28,378 - lava_callback - DEBUG - Processing node 69dd8d9ec2164e674d71f525: baseline-arm64-clabbe 2026-04-16 00:43:28,378 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd8d9ec2164e674d71f525 2026-04-16 00:43:28,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:43:28,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8d9ec2164e674d71f525 HTTP/1.1" 200 None 2026-04-16 00:43:28,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:43:28,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd171917c944d2f17d8b46 HTTP/1.1" 200 None 2026-04-16 00:43:28,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:43:28,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8d9ec2164e674d71f525 HTTP/1.1" 200 None 2026-04-16 00:43:28,437 - lava_callback - ERROR - Error processing callback for node 69dd8d9ec2164e674d71f525: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38642 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:43:37,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:43:37,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33002 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:44:28,382 - lava_callback - INFO - Received callback for node 69dd8de9c2164e674d71f583 INFO: 172.21.0.1:33010 - "POST /node/69dd8de9c2164e674d71f583 HTTP/1.0" 202 Accepted 2026-04-16 00:44:28,397 - lava_callback - INFO - Starting async job submit for node 69dd8de9c2164e674d71f583 2026-04-16 00:44:28,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:44:28,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8de9c2164e674d71f583 HTTP/1.1" 200 None 2026-04-16 00:44:28,438 - lava_callback - DEBUG - Processing node 69dd8de9c2164e674d71f583: baseline-arm64-clabbe 2026-04-16 00:44:28,438 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd8de9c2164e674d71f583 2026-04-16 00:44:28,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:44:28,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8de9c2164e674d71f583 HTTP/1.1" 200 None 2026-04-16 00:44:28,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:44:28,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd171917c944d2f17d8b46 HTTP/1.1" 200 None 2026-04-16 00:44:28,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:44:28,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8de9c2164e674d71f583 HTTP/1.1" 200 None 2026-04-16 00:44:28,539 - lava_callback - ERROR - Error processing callback for node 69dd8de9c2164e674d71f583: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44384 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50068 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:45:48,480 - lava_callback - INFO - Received callback for node 69dd8e32c2164e674d71f5f1 INFO: 172.21.0.1:50084 - "POST /node/69dd8e32c2164e674d71f5f1 HTTP/1.0" 202 Accepted 2026-04-16 00:45:48,489 - lava_callback - INFO - Starting async job submit for node 69dd8e32c2164e674d71f5f1 2026-04-16 00:45:48,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:45:48,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8e32c2164e674d71f5f1 HTTP/1.1" 200 None 2026-04-16 00:45:48,520 - lava_callback - DEBUG - Processing node 69dd8e32c2164e674d71f5f1: baseline-arm64-clabbe 2026-04-16 00:45:48,520 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd8e32c2164e674d71f5f1 2026-04-16 00:45:48,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:45:48,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8e32c2164e674d71f5f1 HTTP/1.1" 200 None 2026-04-16 00:45:48,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:45:48,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd171917c944d2f17d8b46 HTTP/1.1" 200 None 2026-04-16 00:45:48,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:45:48,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8e32c2164e674d71f5f1 HTTP/1.1" 200 None 2026-04-16 00:45:48,628 - lava_callback - ERROR - Error processing callback for node 69dd8e32c2164e674d71f5f1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42778 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:45:58,575 - lava_callback - INFO - Received callback for node 69e02efd1fb14b744a548c7e INFO: 172.21.0.1:42786 - "POST /node/69e02efd1fb14b744a548c7e HTTP/1.0" 202 Accepted 2026-04-16 00:45:58,585 - lava_callback - INFO - Starting async job submit for node 69e02efd1fb14b744a548c7e 2026-04-16 00:45:58,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:45:58,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02efd1fb14b744a548c7e HTTP/1.1" 200 None 2026-04-16 00:45:58,663 - lava_callback - DEBUG - Processing node 69e02efd1fb14b744a548c7e: ltp-cap_bounds 2026-04-16 00:45:59,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:45:59,698 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:45:59,700 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69e02efd1fb14b744a548c7e/log.txt.gz 2026-04-16 00:46:00,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:46:00,188 - lava_callback - INFO - Received callback for node 69e02f011fb14b744a548c92 INFO: 172.21.0.1:53616 - "POST /node/69e02f011fb14b744a548c92 HTTP/1.0" 202 Accepted 2026-04-16 00:46:00,203 - lava_callback - INFO - Starting async job submit for node 69e02f011fb14b744a548c92 2026-04-16 00:46:00,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:46:00,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02f011fb14b744a548c92 HTTP/1.1" 200 None 2026-04-16 00:46:00,293 - lava_callback - DEBUG - Processing node 69e02f011fb14b744a548c92: ltp-controllers 2026-04-16 00:46:00,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:46:01,019 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:46:01,022 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69e02efd1fb14b744a548c7e/lava-logs.yaml 2026-04-16 00:46:01,023 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:46:01,026 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-controllers-69e02f011fb14b744a548c92/log.txt.gz 2026-04-16 00:46:01,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:46:01,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:46:01,584 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:46:01,586 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69e02efd1fb14b744a548c7e/lava_callback.json.gz 2026-04-16 00:46:01,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:46:01,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02efd1fb14b744a548c7e HTTP/1.1" 200 None 2026-04-16 00:46:01,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:46:01,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 00:46:01,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:46:01,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e02efd1fb14b744a548c7e HTTP/1.1" 200 None 2026-04-16 00:46:01,761 - lava_callback - INFO - Completed processing callback for node 69e02efd1fb14b744a548c7e 2026-04-16 00:46:02,175 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:46:02,178 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-controllers-69e02f011fb14b744a548c92/lava-logs.yaml 2026-04-16 00:46:02,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:46:02,752 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:46:02,754 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-controllers-69e02f011fb14b744a548c92/lava_callback.json.gz 2026-04-16 00:46:02,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:46:02,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02f011fb14b744a548c92 HTTP/1.1" 200 None 2026-04-16 00:46:02,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:46:02,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 00:46:02,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:46:02,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e02f011fb14b744a548c92 HTTP/1.1" 200 None 2026-04-16 00:46:02,881 - lava_callback - INFO - Completed processing callback for node 69e02f011fb14b744a548c92 INFO: 172.21.0.1:53628 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:46:07,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:46:07,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43202 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:46:20,145 - lava_callback - INFO - Received callback for node 69e02f061fb14b744a548c9c INFO: 172.21.0.1:34552 - "POST /node/69e02f061fb14b744a548c9c HTTP/1.0" 202 Accepted 2026-04-16 00:46:20,151 - lava_callback - INFO - Starting async job submit for node 69e02f061fb14b744a548c9c 2026-04-16 00:46:20,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:46:20,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02f061fb14b744a548c9c HTTP/1.1" 200 None 2026-04-16 00:46:20,192 - lava_callback - DEBUG - Processing node 69e02f061fb14b744a548c9c: ltp-fs_bind 2026-04-16 00:46:20,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:46:20,746 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:46:20,748 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69e02f061fb14b744a548c9c/log.txt.gz 2026-04-16 00:46:20,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:46:21,208 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:46:21,210 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69e02f061fb14b744a548c9c/lava-logs.yaml 2026-04-16 00:46:21,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:46:21,407 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:46:21,409 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69e02f061fb14b744a548c9c/lava_callback.json.gz 2026-04-16 00:46:21,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:46:21,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02f061fb14b744a548c9c HTTP/1.1" 200 None 2026-04-16 00:46:21,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:46:21,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 00:46:21,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:46:21,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e02f061fb14b744a548c9c HTTP/1.1" 200 None 2026-04-16 00:46:21,495 - lava_callback - INFO - Completed processing callback for node 69e02f061fb14b744a548c9c INFO: 172.21.0.1:34568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46078 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:46:37,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:46:37,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60700 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:47:08,483 - lava_callback - INFO - Received callback for node 69dd8e79c2164e674d71f645 INFO: 172.21.0.1:60704 - "POST /node/69dd8e79c2164e674d71f645 HTTP/1.0" 202 Accepted 2026-04-16 00:47:08,489 - lava_callback - INFO - Starting async job submit for node 69dd8e79c2164e674d71f645 2026-04-16 00:47:08,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:47:08,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8e79c2164e674d71f645 HTTP/1.1" 200 None 2026-04-16 00:47:08,505 - lava_callback - DEBUG - Processing node 69dd8e79c2164e674d71f645: baseline-arm64-clabbe 2026-04-16 00:47:08,505 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd8e79c2164e674d71f645 2026-04-16 00:47:08,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:47:08,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8e79c2164e674d71f645 HTTP/1.1" 200 None 2026-04-16 00:47:08,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:47:08,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd171917c944d2f17d8b46 HTTP/1.1" 200 None 2026-04-16 00:47:08,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:47:08,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8e79c2164e674d71f645 HTTP/1.1" 200 None 2026-04-16 00:47:08,554 - lava_callback - ERROR - Error processing callback for node 69dd8e79c2164e674d71f645: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45868 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:47:39,422 - lava_callback - INFO - Received callback for node 69e0319e1fb14b744a549071 INFO: 172.21.0.1:45884 - "POST /node/69e0319e1fb14b744a549071 HTTP/1.0" 202 Accepted 2026-04-16 00:47:39,428 - lava_callback - INFO - Starting async job submit for node 69e0319e1fb14b744a549071 2026-04-16 00:47:39,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:47:39,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0319e1fb14b744a549071 HTTP/1.1" 200 None 2026-04-16 00:47:39,447 - lava_callback - DEBUG - Processing node 69e0319e1fb14b744a549071: baseline-arm 2026-04-16 00:47:39,452 - lava_callback - WARNING - Failed to upload log 2026-04-16 00:47:39,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:47:39,633 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:47:39,635 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e0319e1fb14b744a549071/lava-logs.yaml 2026-04-16 00:47:39,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:47:39,750 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:47:39,751 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e0319e1fb14b744a549071/lava_callback.json.gz 2026-04-16 00:47:39,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:47:39,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0319e1fb14b744a549071 HTTP/1.1" 200 None 2026-04-16 00:47:39,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:47:39,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 00:47:39,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:47:39,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e0319e1fb14b744a549071 HTTP/1.1" 200 None 2026-04-16 00:47:39,825 - lava_callback - INFO - Completed processing callback for node 69e0319e1fb14b744a549071 INFO: 172.21.0.1:47428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48336 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:48:07,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:48:07,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-16 00:48:08,576 - lava_callback - INFO - Received callback for node 69dd8ec4c2164e674d71f6be INFO: 172.21.0.1:48348 - "POST /node/69dd8ec4c2164e674d71f6be HTTP/1.0" 202 Accepted 2026-04-16 00:48:08,585 - lava_callback - INFO - Starting async job submit for node 69dd8ec4c2164e674d71f6be 2026-04-16 00:48:08,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:48:08,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8ec4c2164e674d71f6be HTTP/1.1" 200 None 2026-04-16 00:48:08,619 - lava_callback - DEBUG - Processing node 69dd8ec4c2164e674d71f6be: baseline-arm64-clabbe 2026-04-16 00:48:08,619 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd8ec4c2164e674d71f6be 2026-04-16 00:48:08,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:48:08,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8ec4c2164e674d71f6be HTTP/1.1" 200 None 2026-04-16 00:48:08,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:48:08,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd171917c944d2f17d8b46 HTTP/1.1" 200 None 2026-04-16 00:48:08,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:48:08,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8ec4c2164e674d71f6be HTTP/1.1" 200 None 2026-04-16 00:48:08,709 - lava_callback - ERROR - Error processing callback for node 69dd8ec4c2164e674d71f6be: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51454 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56922 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42060 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:49:28,635 - lava_callback - INFO - Received callback for node 69dd8f0fc2164e674d71f707 INFO: 172.21.0.1:42062 - "POST /node/69dd8f0fc2164e674d71f707 HTTP/1.0" 202 Accepted 2026-04-16 00:49:28,641 - lava_callback - INFO - Starting async job submit for node 69dd8f0fc2164e674d71f707 2026-04-16 00:49:28,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:49:28,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8f0fc2164e674d71f707 HTTP/1.1" 200 None 2026-04-16 00:49:28,656 - lava_callback - DEBUG - Processing node 69dd8f0fc2164e674d71f707: baseline-arm64-clabbe 2026-04-16 00:49:28,656 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd8f0fc2164e674d71f707 2026-04-16 00:49:28,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:49:28,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8f0fc2164e674d71f707 HTTP/1.1" 200 None 2026-04-16 00:49:28,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:49:28,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd171917c944d2f17d8b46 HTTP/1.1" 200 None 2026-04-16 00:49:28,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:49:28,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8f0fc2164e674d71f707 HTTP/1.1" 200 None 2026-04-16 00:49:28,712 - lava_callback - ERROR - Error processing callback for node 69dd8f0fc2164e674d71f707: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36522 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:49:57,401 - lava_callback - INFO - Received callback for node 69e02f0b1fb14b744a548ca5 INFO: 172.21.0.1:36524 - "POST /node/69e02f0b1fb14b744a548ca5 HTTP/1.0" 202 Accepted 2026-04-16 00:49:57,408 - lava_callback - INFO - Starting async job submit for node 69e02f0b1fb14b744a548ca5 2026-04-16 00:49:57,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:49:57,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02f0b1fb14b744a548ca5 HTTP/1.1" 200 None 2026-04-16 00:49:57,459 - lava_callback - DEBUG - Processing node 69e02f0b1fb14b744a548ca5: ltp-ipc 2026-04-16 00:49:57,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:49:58,275 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:49:58,276 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-ipc-69e02f0b1fb14b744a548ca5/log.txt.gz 2026-04-16 00:49:58,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:49:58,701 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:49:58,703 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-ipc-69e02f0b1fb14b744a548ca5/lava-logs.yaml 2026-04-16 00:49:58,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:49:58,890 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:49:58,892 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-ipc-69e02f0b1fb14b744a548ca5/lava_callback.json.gz 2026-04-16 00:49:58,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:49:58,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02f0b1fb14b744a548ca5 HTTP/1.1" 200 None 2026-04-16 00:49:58,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:49:58,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 00:49:58,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:49:58,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e02f0b1fb14b744a548ca5 HTTP/1.1" 200 None 2026-04-16 00:49:58,971 - lava_callback - INFO - Completed processing callback for node 69e02f0b1fb14b744a548ca5 INFO: 172.21.0.1:48048 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:50:07,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:50:07,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-16 00:50:10,759 - lava_callback - INFO - Received callback for node 69e030411fb14b744a548eb2 INFO: 172.21.0.1:59316 - "POST /node/69e030411fb14b744a548eb2 HTTP/1.0" 202 Accepted 2026-04-16 00:50:10,765 - lava_callback - INFO - Starting async job submit for node 69e030411fb14b744a548eb2 2026-04-16 00:50:10,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:50:10,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e030411fb14b744a548eb2 HTTP/1.1" 200 None 2026-04-16 00:50:10,798 - lava_callback - DEBUG - Processing node 69e030411fb14b744a548eb2: baseline-x86 2026-04-16 00:50:11,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:50:11,241 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:50:11,243 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69e030411fb14b744a548eb2/log.txt.gz 2026-04-16 00:50:11,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:50:11,607 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:50:11,609 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69e030411fb14b744a548eb2/lava-logs.yaml 2026-04-16 00:50:11,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:50:11,743 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:50:11,745 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69e030411fb14b744a548eb2/lava_callback.json.gz 2026-04-16 00:50:11,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:50:11,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e030411fb14b744a548eb2 HTTP/1.1" 200 None 2026-04-16 00:50:11,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:50:11,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a551fb14b744a5488c2 HTTP/1.1" 200 None 2026-04-16 00:50:11,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:50:11,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e030411fb14b744a548eb2 HTTP/1.1" 200 None 2026-04-16 00:50:11,822 - lava_callback - INFO - Completed processing callback for node 69e030411fb14b744a548eb2 INFO: 172.21.0.1:59320 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59330 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:50:17,618 - lava_callback - INFO - Received callback for node 69e02f091fb14b744a548ca2 INFO: 172.21.0.1:59338 - "POST /node/69e02f091fb14b744a548ca2 HTTP/1.0" 202 Accepted 2026-04-16 00:50:17,625 - lava_callback - INFO - Starting async job submit for node 69e02f091fb14b744a548ca2 2026-04-16 00:50:17,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:50:17,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02f091fb14b744a548ca2 HTTP/1.1" 200 None 2026-04-16 00:50:17,676 - lava_callback - DEBUG - Processing node 69e02f091fb14b744a548ca2: ltp-input 2026-04-16 00:50:18,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:50:18,201 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:50:18,202 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-input-69e02f091fb14b744a548ca2/log.txt.gz 2026-04-16 00:50:18,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:50:18,628 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:50:18,630 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-input-69e02f091fb14b744a548ca2/lava-logs.yaml 2026-04-16 00:50:18,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:50:18,813 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:50:18,815 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-input-69e02f091fb14b744a548ca2/lava_callback.json.gz 2026-04-16 00:50:18,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:50:18,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02f091fb14b744a548ca2 HTTP/1.1" 200 None 2026-04-16 00:50:18,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:50:18,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 00:50:18,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:50:18,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e02f091fb14b744a548ca2 HTTP/1.1" 200 None 2026-04-16 00:50:18,897 - lava_callback - INFO - Completed processing callback for node 69e02f091fb14b744a548ca2 2026-04-16 00:50:20,070 - lava_callback - INFO - Received callback for node 69e02f0c1fb14b744a548ca8 INFO: 172.21.0.1:59198 - "POST /node/69e02f0c1fb14b744a548ca8 HTTP/1.0" 202 Accepted 2026-04-16 00:50:20,076 - lava_callback - INFO - Starting async job submit for node 69e02f0c1fb14b744a548ca8 2026-04-16 00:50:20,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:50:20,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02f0c1fb14b744a548ca8 HTTP/1.1" 200 None 2026-04-16 00:50:20,117 - lava_callback - DEBUG - Processing node 69e02f0c1fb14b744a548ca8: ltp-pty 2026-04-16 00:50:20,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:50:20,583 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:50:20,585 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-pty-69e02f0c1fb14b744a548ca8/log.txt.gz 2026-04-16 00:50:20,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:50:21,039 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:50:21,041 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-pty-69e02f0c1fb14b744a548ca8/lava-logs.yaml 2026-04-16 00:50:21,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:50:21,214 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:50:21,215 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-pty-69e02f0c1fb14b744a548ca8/lava_callback.json.gz 2026-04-16 00:50:21,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:50:21,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02f0c1fb14b744a548ca8 HTTP/1.1" 200 None 2026-04-16 00:50:21,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:50:21,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 00:50:21,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:50:21,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e02f0c1fb14b744a548ca8 HTTP/1.1" 200 None 2026-04-16 00:50:21,298 - lava_callback - INFO - Completed processing callback for node 69e02f0c1fb14b744a548ca8 INFO: 172.21.0.1:59202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43762 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:50:37,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:50:37,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55444 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:50:48,711 - lava_callback - INFO - Received callback for node 69dd8f59c2164e674d71f74b INFO: 172.21.0.1:55448 - "POST /node/69dd8f59c2164e674d71f74b HTTP/1.0" 202 Accepted 2026-04-16 00:50:48,720 - lava_callback - INFO - Starting async job submit for node 69dd8f59c2164e674d71f74b 2026-04-16 00:50:48,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:50:48,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8f59c2164e674d71f74b HTTP/1.1" 200 None 2026-04-16 00:50:48,750 - lava_callback - DEBUG - Processing node 69dd8f59c2164e674d71f74b: baseline-arm64-clabbe 2026-04-16 00:50:48,751 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd8f59c2164e674d71f74b 2026-04-16 00:50:48,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:50:48,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8f59c2164e674d71f74b HTTP/1.1" 200 None 2026-04-16 00:50:48,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:50:48,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd171917c944d2f17d8b46 HTTP/1.1" 200 None 2026-04-16 00:50:48,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:50:48,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8f59c2164e674d71f74b HTTP/1.1" 200 None 2026-04-16 00:50:48,854 - lava_callback - ERROR - Error processing callback for node 69dd8f59c2164e674d71f74b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50458 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:50:57,512 - lava_callback - INFO - Received callback for node 69e02f101fb14b744a548caf INFO: 172.21.0.1:50460 - "POST /node/69e02f101fb14b744a548caf HTTP/1.0" 202 Accepted 2026-04-16 00:50:57,522 - lava_callback - INFO - Starting async job submit for node 69e02f101fb14b744a548caf 2026-04-16 00:50:57,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:50:57,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02f101fb14b744a548caf HTTP/1.1" 200 None 2026-04-16 00:50:57,662 - lava_callback - DEBUG - Processing node 69e02f101fb14b744a548caf: ltp-smoke 2026-04-16 00:50:58,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:50:58,547 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:50:58,549 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69e02f101fb14b744a548caf/log.txt.gz 2026-04-16 00:50:58,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:50:59,250 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:50:59,253 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69e02f101fb14b744a548caf/lava-logs.yaml 2026-04-16 00:50:59,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:50:59,401 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:50:59,403 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69e02f101fb14b744a548caf/lava_callback.json.gz 2026-04-16 00:50:59,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:50:59,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02f101fb14b744a548caf HTTP/1.1" 200 None 2026-04-16 00:50:59,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:50:59,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 00:50:59,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:50:59,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e02f101fb14b744a548caf HTTP/1.1" 200 None 2026-04-16 00:50:59,526 - lava_callback - INFO - Completed processing callback for node 69e02f101fb14b744a548caf INFO: 172.21.0.1:59456 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:51:07,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:51:07,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38040 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52984 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:51:28,788 - lava_callback - INFO - Received callback for node 69dfdc248aa6875c96aff0a5 INFO: 172.21.0.1:52998 - "POST /node/69dfdc248aa6875c96aff0a5 HTTP/1.0" 202 Accepted 2026-04-16 00:51:28,799 - lava_callback - INFO - Starting async job submit for node 69dfdc248aa6875c96aff0a5 2026-04-16 00:51:28,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:51:28,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dfdc248aa6875c96aff0a5 HTTP/1.1" 200 None 2026-04-16 00:51:28,884 - lava_callback - DEBUG - Processing node 69dfdc248aa6875c96aff0a5: baseline-x86 INFO: 172.21.0.1:53012 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:51:29,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:51:30,095 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:51:30,097 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69dfdc248aa6875c96aff0a5/log.txt.gz 2026-04-16 00:51:30,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:51:30,940 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:51:30,942 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69dfdc248aa6875c96aff0a5/lava-logs.yaml 2026-04-16 00:51:30,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:51:31,411 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:51:31,413 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69dfdc248aa6875c96aff0a5/lava_callback.json.gz 2026-04-16 00:51:31,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:51:31,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dfdc248aa6875c96aff0a5 HTTP/1.1" 200 None 2026-04-16 00:51:31,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:51:31,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded961f490930782fb6e47 HTTP/1.1" 200 None 2026-04-16 00:51:31,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:51:31,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dfdc248aa6875c96aff0a5 HTTP/1.1" 200 None 2026-04-16 00:51:31,507 - lava_callback - INFO - Completed processing callback for node 69dfdc248aa6875c96aff0a5 INFO: 172.21.0.1:59012 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:51:37,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:51:37,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54504 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:52:05,110 - lava_callback - INFO - Received callback for node 69e02ecb1fb14b744a548ba5 INFO: 172.21.0.1:43676 - "POST /node/69e02ecb1fb14b744a548ba5 HTTP/1.0" 202 Accepted 2026-04-16 00:52:05,122 - lava_callback - INFO - Starting async job submit for node 69e02ecb1fb14b744a548ba5 2026-04-16 00:52:05,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:52:05,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02ecb1fb14b744a548ba5 HTTP/1.1" 200 None 2026-04-16 00:52:05,289 - lava_callback - DEBUG - Processing node 69e02ecb1fb14b744a548ba5: baseline-arm 2026-04-16 00:52:06,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:52:06,302 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:52:06,304 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e02ecb1fb14b744a548ba5/log.txt.gz INFO: 172.21.0.1:43688 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:52:06,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:52:07,066 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:52:07,069 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e02ecb1fb14b744a548ba5/lava-logs.yaml 2026-04-16 00:52:07,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:52:07,521 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:52:07,523 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e02ecb1fb14b744a548ba5/lava_callback.json.gz DEBUG: Setup failed for 69e02ecb1fb14b744a548ba5. Transitting job node result: incomplete -> fail 2026-04-16 00:52:07,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:52:07,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02ecb1fb14b744a548ba5 HTTP/1.1" 200 None 2026-04-16 00:52:07,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:52:07,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 00:52:07,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:52:07,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e02ecb1fb14b744a548ba5 HTTP/1.1" 200 None 2026-04-16 00:52:07,807 - lava_callback - INFO - Completed processing callback for node 69e02ecb1fb14b744a548ba5 2026-04-16 00:52:07,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:52:07,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-16 00:52:13,585 - lava_callback - INFO - Received callback for node 69dd8fb0c2164e674d71f7b7 INFO: 172.21.0.1:46186 - "POST /node/69dd8fb0c2164e674d71f7b7 HTTP/1.0" 202 Accepted 2026-04-16 00:52:13,592 - lava_callback - INFO - Starting async job submit for node 69dd8fb0c2164e674d71f7b7 2026-04-16 00:52:13,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:52:13,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8fb0c2164e674d71f7b7 HTTP/1.1" 200 None 2026-04-16 00:52:13,608 - lava_callback - DEBUG - Processing node 69dd8fb0c2164e674d71f7b7: baseline-arm-baylibre 2026-04-16 00:52:13,608 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd8fb0c2164e674d71f7b7 2026-04-16 00:52:13,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:52:13,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8fb0c2164e674d71f7b7 HTTP/1.1" 200 None 2026-04-16 00:52:13,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:52:13,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 00:52:13,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:52:13,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8fb0c2164e674d71f7b7 HTTP/1.1" 200 None 2026-04-16 00:52:13,663 - lava_callback - ERROR - Error processing callback for node 69dd8fb0c2164e674d71f7b7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52680 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:52:53,580 - lava_callback - INFO - Received callback for node 69dd8fd4c2164e674d71f7fd INFO: 172.21.0.1:41000 - "POST /node/69dd8fd4c2164e674d71f7fd HTTP/1.0" 202 Accepted 2026-04-16 00:52:53,586 - lava_callback - INFO - Starting async job submit for node 69dd8fd4c2164e674d71f7fd 2026-04-16 00:52:53,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:52:53,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8fd4c2164e674d71f7fd HTTP/1.1" 200 None 2026-04-16 00:52:53,601 - lava_callback - DEBUG - Processing node 69dd8fd4c2164e674d71f7fd: baseline-arm-baylibre 2026-04-16 00:52:53,601 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd8fd4c2164e674d71f7fd 2026-04-16 00:52:53,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:52:53,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8fd4c2164e674d71f7fd HTTP/1.1" 200 None 2026-04-16 00:52:53,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:52:53,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 00:52:53,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:52:53,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8fd4c2164e674d71f7fd HTTP/1.1" 200 None 2026-04-16 00:52:53,649 - lava_callback - ERROR - Error processing callback for node 69dd8fd4c2164e674d71f7fd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55512 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:53:13,610 - lava_callback - INFO - Received callback for node 69dd8ff5c2164e674d71f842 INFO: 172.21.0.1:39640 - "POST /node/69dd8ff5c2164e674d71f842 HTTP/1.0" 202 Accepted 2026-04-16 00:53:13,618 - lava_callback - INFO - Starting async job submit for node 69dd8ff5c2164e674d71f842 2026-04-16 00:53:13,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:53:13,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8ff5c2164e674d71f842 HTTP/1.1" 200 None 2026-04-16 00:53:13,639 - lava_callback - DEBUG - Processing node 69dd8ff5c2164e674d71f842: baseline-arm-baylibre 2026-04-16 00:53:13,639 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd8ff5c2164e674d71f842 2026-04-16 00:53:13,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:53:13,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8ff5c2164e674d71f842 HTTP/1.1" 200 None 2026-04-16 00:53:13,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:53:13,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 00:53:13,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:53:13,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8ff5c2164e674d71f842 HTTP/1.1" 200 None 2026-04-16 00:53:13,697 - lava_callback - ERROR - Error processing callback for node 69dd8ff5c2164e674d71f842: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39646 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37368 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:53:53,601 - lava_callback - INFO - Received callback for node 69dd9019c2164e674d71f8cb INFO: 172.21.0.1:36428 - "POST /node/69dd9019c2164e674d71f8cb HTTP/1.0" 202 Accepted 2026-04-16 00:53:53,610 - lava_callback - INFO - Starting async job submit for node 69dd9019c2164e674d71f8cb 2026-04-16 00:53:53,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:53:53,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9019c2164e674d71f8cb HTTP/1.1" 200 None 2026-04-16 00:53:53,627 - lava_callback - DEBUG - Processing node 69dd9019c2164e674d71f8cb: baseline-arm-baylibre 2026-04-16 00:53:53,627 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9019c2164e674d71f8cb 2026-04-16 00:53:53,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:53:53,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9019c2164e674d71f8cb HTTP/1.1" 200 None 2026-04-16 00:53:53,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:53:53,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-16 00:53:53,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:53:53,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9019c2164e674d71f8cb HTTP/1.1" 200 None 2026-04-16 00:53:53,679 - lava_callback - ERROR - Error processing callback for node 69dd9019c2164e674d71f8cb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 00:53:54,298 - lava_callback - INFO - Received callback for node 69dd901cc2164e674d71f8cf INFO: 172.21.0.1:36438 - "POST /node/69dd901cc2164e674d71f8cf HTTP/1.0" 202 Accepted 2026-04-16 00:53:54,308 - lava_callback - INFO - Starting async job submit for node 69dd901cc2164e674d71f8cf 2026-04-16 00:53:54,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:53:54,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd901cc2164e674d71f8cf HTTP/1.1" 200 None 2026-04-16 00:53:54,332 - lava_callback - DEBUG - Processing node 69dd901cc2164e674d71f8cf: baseline-arm64-baylibre 2026-04-16 00:53:54,333 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd901cc2164e674d71f8cf 2026-04-16 00:53:54,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:53:54,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd901cc2164e674d71f8cf HTTP/1.1" 200 None 2026-04-16 00:53:54,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:53:54,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-16 00:53:54,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:53:54,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd901cc2164e674d71f8cf HTTP/1.1" 200 None 2026-04-16 00:53:54,398 - lava_callback - ERROR - Error processing callback for node 69dd901cc2164e674d71f8cf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 00:53:54,975 - lava_callback - INFO - Received callback for node 69dd901dc2164e674d71f8d2 INFO: 172.21.0.1:36446 - "POST /node/69dd901dc2164e674d71f8d2 HTTP/1.0" 202 Accepted 2026-04-16 00:53:54,982 - lava_callback - INFO - Starting async job submit for node 69dd901dc2164e674d71f8d2 2026-04-16 00:53:54,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:53:54,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd901dc2164e674d71f8d2 HTTP/1.1" 200 None 2026-04-16 00:53:54,997 - lava_callback - DEBUG - Processing node 69dd901dc2164e674d71f8d2: baseline-arm64-baylibre 2026-04-16 00:53:54,997 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd901dc2164e674d71f8d2 2026-04-16 00:53:54,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:53:55,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd901dc2164e674d71f8d2 HTTP/1.1" 200 None 2026-04-16 00:53:55,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:53:55,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-16 00:53:55,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:53:55,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd901dc2164e674d71f8d2 HTTP/1.1" 200 None 2026-04-16 00:53:55,050 - lava_callback - ERROR - Error processing callback for node 69dd901dc2164e674d71f8d2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36450 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:53:57,535 - lava_callback - INFO - Received callback for node 69e02f131fb14b744a548cb5 INFO: 172.21.0.1:36460 - "POST /node/69e02f131fb14b744a548cb5 HTTP/1.0" 202 Accepted 2026-04-16 00:53:57,545 - lava_callback - INFO - Starting async job submit for node 69e02f131fb14b744a548cb5 2026-04-16 00:53:57,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:53:57,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02f131fb14b744a548cb5 HTTP/1.1" 200 None 2026-04-16 00:53:57,590 - lava_callback - DEBUG - Processing node 69e02f131fb14b744a548cb5: ltp-syscalls-ipc 2026-04-16 00:53:58,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:53:58,187 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:53:58,189 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69e02f131fb14b744a548cb5/log.txt.gz 2026-04-16 00:53:58,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:53:58,687 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:53:58,689 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69e02f131fb14b744a548cb5/lava-logs.yaml 2026-04-16 00:53:58,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:53:58,903 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:53:58,905 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69e02f131fb14b744a548cb5/lava_callback.json.gz 2026-04-16 00:53:58,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:53:58,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02f131fb14b744a548cb5 HTTP/1.1" 200 None 2026-04-16 00:53:58,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:53:58,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 00:53:58,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:53:58,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e02f131fb14b744a548cb5 HTTP/1.1" 200 None 2026-04-16 00:53:59,001 - lava_callback - INFO - Completed processing callback for node 69e02f131fb14b744a548cb5 INFO: 172.21.0.1:43536 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:54:07,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:07,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-16 00:54:13,603 - lava_callback - INFO - Received callback for node 69dd9021c2164e674d71f8d9 INFO: 172.21.0.1:37946 - "POST /node/69dd9021c2164e674d71f8d9 HTTP/1.0" 202 Accepted 2026-04-16 00:54:13,608 - lava_callback - INFO - Starting async job submit for node 69dd9021c2164e674d71f8d9 2026-04-16 00:54:13,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:13,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9021c2164e674d71f8d9 HTTP/1.1" 200 None 2026-04-16 00:54:13,624 - lava_callback - DEBUG - Processing node 69dd9021c2164e674d71f8d9: baseline-arm64-baylibre 2026-04-16 00:54:13,625 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9021c2164e674d71f8d9 2026-04-16 00:54:13,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:13,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9021c2164e674d71f8d9 HTTP/1.1" 200 None 2026-04-16 00:54:13,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:13,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-16 00:54:13,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:13,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9021c2164e674d71f8d9 HTTP/1.1" 200 None 2026-04-16 00:54:13,681 - lava_callback - ERROR - Error processing callback for node 69dd9021c2164e674d71f8d9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37974 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:54:20,283 - lava_callback - INFO - Received callback for node 69e02f161fb14b744a548cc5 INFO: 172.21.0.1:42380 - "POST /node/69e02f161fb14b744a548cc5 HTTP/1.0" 202 Accepted 2026-04-16 00:54:20,291 - lava_callback - INFO - Starting async job submit for node 69e02f161fb14b744a548cc5 2026-04-16 00:54:20,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:20,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02f161fb14b744a548cc5 HTTP/1.1" 200 None 2026-04-16 00:54:20,338 - lava_callback - DEBUG - Processing node 69e02f161fb14b744a548cc5: ltp-watchqueue 2026-04-16 00:54:20,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:54:20,917 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:54:20,918 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69e02f161fb14b744a548cc5/log.txt.gz 2026-04-16 00:54:21,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:54:21,339 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:54:21,341 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69e02f161fb14b744a548cc5/lava-logs.yaml 2026-04-16 00:54:21,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:54:21,506 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:54:21,507 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69e02f161fb14b744a548cc5/lava_callback.json.gz 2026-04-16 00:54:21,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:21,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02f161fb14b744a548cc5 HTTP/1.1" 200 None 2026-04-16 00:54:21,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:21,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 00:54:21,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:21,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e02f161fb14b744a548cc5 HTTP/1.1" 200 None 2026-04-16 00:54:21,590 - lava_callback - INFO - Completed processing callback for node 69e02f161fb14b744a548cc5 INFO: 172.21.0.1:42394 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:54:28,891 - lava_callback - INFO - Received callback for node 69dd9032c2164e674d71f949 INFO: 172.21.0.1:42402 - "POST /node/69dd9032c2164e674d71f949 HTTP/1.0" 202 Accepted 2026-04-16 00:54:28,897 - lava_callback - INFO - Starting async job submit for node 69dd9032c2164e674d71f949 2026-04-16 00:54:28,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:28,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9032c2164e674d71f949 HTTP/1.1" 200 None 2026-04-16 00:54:28,916 - lava_callback - DEBUG - Processing node 69dd9032c2164e674d71f949: baseline-arm64-clabbe 2026-04-16 00:54:28,916 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9032c2164e674d71f949 2026-04-16 00:54:28,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:28,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9032c2164e674d71f949 HTTP/1.1" 200 None 2026-04-16 00:54:28,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:28,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-16 00:54:28,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:28,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9032c2164e674d71f949 HTTP/1.1" 200 None 2026-04-16 00:54:28,980 - lava_callback - ERROR - Error processing callback for node 69dd9032c2164e674d71f949: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42412 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:54:29,583 - lava_callback - INFO - Received callback for node 69dd9034c2164e674d71f94d INFO: 172.21.0.1:42424 - "POST /node/69dd9034c2164e674d71f94d HTTP/1.0" 202 Accepted 2026-04-16 00:54:29,589 - lava_callback - INFO - Starting async job submit for node 69dd9034c2164e674d71f94d 2026-04-16 00:54:29,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:29,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9034c2164e674d71f94d HTTP/1.1" 200 None 2026-04-16 00:54:29,604 - lava_callback - DEBUG - Processing node 69dd9034c2164e674d71f94d: baseline-arm64-clabbe 2026-04-16 00:54:29,605 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9034c2164e674d71f94d 2026-04-16 00:54:29,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:29,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9034c2164e674d71f94d HTTP/1.1" 200 None 2026-04-16 00:54:29,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:29,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-16 00:54:29,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:29,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9034c2164e674d71f94d HTTP/1.1" 200 None 2026-04-16 00:54:29,653 - lava_callback - ERROR - Error processing callback for node 69dd9034c2164e674d71f94d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 00:54:30,270 - lava_callback - INFO - Received callback for node 69dd9034c2164e674d71f950 INFO: 172.21.0.1:41990 - "POST /node/69dd9034c2164e674d71f950 HTTP/1.0" 202 Accepted 2026-04-16 00:54:30,275 - lava_callback - INFO - Starting async job submit for node 69dd9034c2164e674d71f950 2026-04-16 00:54:30,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:30,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9034c2164e674d71f950 HTTP/1.1" 200 None 2026-04-16 00:54:30,314 - lava_callback - DEBUG - Processing node 69dd9034c2164e674d71f950: baseline-arm64-clabbe 2026-04-16 00:54:30,314 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9034c2164e674d71f950 2026-04-16 00:54:30,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:30,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9034c2164e674d71f950 HTTP/1.1" 200 None 2026-04-16 00:54:30,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:30,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-16 00:54:30,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:30,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9034c2164e674d71f950 HTTP/1.1" 200 None 2026-04-16 00:54:30,363 - lava_callback - ERROR - Error processing callback for node 69dd9034c2164e674d71f950: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 00:54:30,960 - lava_callback - INFO - Received callback for node 69dd9035c2164e674d71f953 INFO: 172.21.0.1:42006 - "POST /node/69dd9035c2164e674d71f953 HTTP/1.0" 202 Accepted 2026-04-16 00:54:30,966 - lava_callback - INFO - Starting async job submit for node 69dd9035c2164e674d71f953 2026-04-16 00:54:30,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:30,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9035c2164e674d71f953 HTTP/1.1" 200 None 2026-04-16 00:54:30,982 - lava_callback - DEBUG - Processing node 69dd9035c2164e674d71f953: baseline-arm64-clabbe 2026-04-16 00:54:30,982 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9035c2164e674d71f953 2026-04-16 00:54:30,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:30,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9035c2164e674d71f953 HTTP/1.1" 200 None 2026-04-16 00:54:30,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:31,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-16 00:54:31,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:31,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9035c2164e674d71f953 HTTP/1.1" 200 None 2026-04-16 00:54:31,033 - lava_callback - ERROR - Error processing callback for node 69dd9035c2164e674d71f953: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 00:54:31,637 - lava_callback - INFO - Received callback for node 69dd9036c2164e674d71f956 INFO: 172.21.0.1:42012 - "POST /node/69dd9036c2164e674d71f956 HTTP/1.0" 202 Accepted 2026-04-16 00:54:31,643 - lava_callback - INFO - Starting async job submit for node 69dd9036c2164e674d71f956 2026-04-16 00:54:31,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:31,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9036c2164e674d71f956 HTTP/1.1" 200 None 2026-04-16 00:54:31,661 - lava_callback - DEBUG - Processing node 69dd9036c2164e674d71f956: baseline-arm64-clabbe 2026-04-16 00:54:31,661 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9036c2164e674d71f956 2026-04-16 00:54:31,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:31,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9036c2164e674d71f956 HTTP/1.1" 200 None 2026-04-16 00:54:31,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:31,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-16 00:54:31,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:31,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9036c2164e674d71f956 HTTP/1.1" 200 None 2026-04-16 00:54:31,712 - lava_callback - ERROR - Error processing callback for node 69dd9036c2164e674d71f956: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 00:54:32,306 - lava_callback - INFO - Received callback for node 69dd9038c2164e674d71f95c INFO: 172.21.0.1:42016 - "POST /node/69dd9038c2164e674d71f95c HTTP/1.0" 202 Accepted 2026-04-16 00:54:32,312 - lava_callback - INFO - Starting async job submit for node 69dd9038c2164e674d71f95c 2026-04-16 00:54:32,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:32,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9038c2164e674d71f95c HTTP/1.1" 200 None 2026-04-16 00:54:32,331 - lava_callback - DEBUG - Processing node 69dd9038c2164e674d71f95c: baseline-arm64-clabbe 2026-04-16 00:54:32,331 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9038c2164e674d71f95c 2026-04-16 00:54:32,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:32,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9038c2164e674d71f95c HTTP/1.1" 200 None 2026-04-16 00:54:32,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:32,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-16 00:54:32,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:32,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9038c2164e674d71f95c HTTP/1.1" 200 None 2026-04-16 00:54:32,400 - lava_callback - ERROR - Error processing callback for node 69dd9038c2164e674d71f95c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 00:54:32,992 - lava_callback - INFO - Received callback for node 69dd9037c2164e674d71f959 INFO: 172.21.0.1:42032 - "POST /node/69dd9037c2164e674d71f959 HTTP/1.0" 202 Accepted 2026-04-16 00:54:32,998 - lava_callback - INFO - Starting async job submit for node 69dd9037c2164e674d71f959 2026-04-16 00:54:32,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:33,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9037c2164e674d71f959 HTTP/1.1" 200 None 2026-04-16 00:54:33,021 - lava_callback - DEBUG - Processing node 69dd9037c2164e674d71f959: baseline-arm64-clabbe 2026-04-16 00:54:33,021 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9037c2164e674d71f959 2026-04-16 00:54:33,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:33,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9037c2164e674d71f959 HTTP/1.1" 200 None 2026-04-16 00:54:33,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:33,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-16 00:54:33,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:33,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9037c2164e674d71f959 HTTP/1.1" 200 None 2026-04-16 00:54:33,085 - lava_callback - ERROR - Error processing callback for node 69dd9037c2164e674d71f959: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 00:54:33,664 - lava_callback - INFO - Received callback for node 69dd903dc2164e674d71f96a INFO: 172.21.0.1:42042 - "POST /node/69dd903dc2164e674d71f96a HTTP/1.0" 202 Accepted 2026-04-16 00:54:33,673 - lava_callback - INFO - Starting async job submit for node 69dd903dc2164e674d71f96a 2026-04-16 00:54:33,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:33,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd903dc2164e674d71f96a HTTP/1.1" 200 None 2026-04-16 00:54:33,699 - lava_callback - DEBUG - Processing node 69dd903dc2164e674d71f96a: baseline-arm-baylibre 2026-04-16 00:54:33,699 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd903dc2164e674d71f96a 2026-04-16 00:54:33,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:33,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd903dc2164e674d71f96a HTTP/1.1" 200 None 2026-04-16 00:54:33,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:33,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-16 00:54:33,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:33,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd903dc2164e674d71f96a HTTP/1.1" 200 None 2026-04-16 00:54:33,749 - lava_callback - ERROR - Error processing callback for node 69dd903dc2164e674d71f96a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42050 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:54:37,533 - lava_callback - INFO - Received callback for node 69e02f151fb14b744a548cb8 INFO: 172.21.0.1:42056 - "POST /node/69e02f151fb14b744a548cb8 HTTP/1.0" 202 Accepted 2026-04-16 00:54:37,540 - lava_callback - INFO - Starting async job submit for node 69e02f151fb14b744a548cb8 2026-04-16 00:54:37,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:37,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02f151fb14b744a548cb8 HTTP/1.1" 200 None 2026-04-16 00:54:37,592 - lava_callback - DEBUG - Processing node 69e02f151fb14b744a548cb8: ltp-timers 2026-04-16 00:54:37,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:37,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:54:37,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-16 00:54:38,135 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:54:38,137 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-timers-69e02f151fb14b744a548cb8/log.txt.gz 2026-04-16 00:54:38,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:54:38,595 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:54:38,597 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-timers-69e02f151fb14b744a548cb8/lava-logs.yaml 2026-04-16 00:54:38,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:54:38,810 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:54:38,812 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-timers-69e02f151fb14b744a548cb8/lava_callback.json.gz 2026-04-16 00:54:38,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:38,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02f151fb14b744a548cb8 HTTP/1.1" 200 None 2026-04-16 00:54:38,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:38,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 00:54:38,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:38,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e02f151fb14b744a548cb8 HTTP/1.1" 200 None 2026-04-16 00:54:38,915 - lava_callback - INFO - Completed processing callback for node 69e02f151fb14b744a548cb8 INFO: 172.21.0.1:40588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54422 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:55:07,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:55:07,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52166 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58410 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:55:33,666 - lava_callback - INFO - Received callback for node 69dd9081c2164e674d71fa40 INFO: 172.21.0.1:39500 - "POST /node/69dd9081c2164e674d71fa40 HTTP/1.0" 202 Accepted 2026-04-16 00:55:33,671 - lava_callback - INFO - Starting async job submit for node 69dd9081c2164e674d71fa40 2026-04-16 00:55:33,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:55:33,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9081c2164e674d71fa40 HTTP/1.1" 200 None 2026-04-16 00:55:33,688 - lava_callback - DEBUG - Processing node 69dd9081c2164e674d71fa40: baseline-arm-baylibre 2026-04-16 00:55:33,688 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9081c2164e674d71fa40 2026-04-16 00:55:33,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:55:33,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9081c2164e674d71fa40 HTTP/1.1" 200 None 2026-04-16 00:55:33,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:55:33,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-16 00:55:33,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:55:33,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9081c2164e674d71fa40 HTTP/1.1" 200 None 2026-04-16 00:55:33,737 - lava_callback - ERROR - Error processing callback for node 69dd9081c2164e674d71fa40: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53472 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45098 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:56:28,950 - lava_callback - INFO - Received callback for node 69dd90acc2164e674d71fab3 INFO: 172.21.0.1:45108 - "POST /node/69dd90acc2164e674d71fab3 HTTP/1.0" 202 Accepted 2026-04-16 00:56:28,956 - lava_callback - INFO - Starting async job submit for node 69dd90acc2164e674d71fab3 2026-04-16 00:56:28,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:56:28,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd90acc2164e674d71fab3 HTTP/1.1" 200 None 2026-04-16 00:56:28,972 - lava_callback - DEBUG - Processing node 69dd90acc2164e674d71fab3: baseline-arm-clabbe 2026-04-16 00:56:28,973 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd90acc2164e674d71fab3 2026-04-16 00:56:28,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:56:28,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd90acc2164e674d71fab3 HTTP/1.1" 200 None 2026-04-16 00:56:28,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:56:29,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-16 00:56:29,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:56:29,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd90acc2164e674d71fab3 HTTP/1.1" 200 None 2026-04-16 00:56:29,037 - lava_callback - ERROR - Error processing callback for node 69dd90acc2164e674d71fab3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42460 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:57:08,945 - lava_callback - INFO - Received callback for node 69dd90d4c2164e674d71faf3 INFO: 172.21.0.1:42464 - "POST /node/69dd90d4c2164e674d71faf3 HTTP/1.0" 202 Accepted 2026-04-16 00:57:08,953 - lava_callback - INFO - Starting async job submit for node 69dd90d4c2164e674d71faf3 2026-04-16 00:57:08,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:57:08,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd90d4c2164e674d71faf3 HTTP/1.1" 200 None 2026-04-16 00:57:08,978 - lava_callback - DEBUG - Processing node 69dd90d4c2164e674d71faf3: baseline-arm-clabbe 2026-04-16 00:57:08,978 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd90d4c2164e674d71faf3 2026-04-16 00:57:08,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:57:09,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd90d4c2164e674d71faf3 HTTP/1.1" 200 None 2026-04-16 00:57:09,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:57:09,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 00:57:09,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:57:09,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd90d4c2164e674d71faf3 HTTP/1.1" 200 None 2026-04-16 00:57:09,067 - lava_callback - ERROR - Error processing callback for node 69dd90d4c2164e674d71faf3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36020 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:57:40,366 - lava_callback - INFO - Received callback for node 69e02f1a1fb14b744a548ccb INFO: 172.21.0.1:44640 - "POST /node/69e02f1a1fb14b744a548ccb HTTP/1.0" 202 Accepted 2026-04-16 00:57:40,378 - lava_callback - INFO - Starting async job submit for node 69e02f1a1fb14b744a548ccb 2026-04-16 00:57:40,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:57:40,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02f1a1fb14b744a548ccb HTTP/1.1" 200 None 2026-04-16 00:57:40,511 - lava_callback - DEBUG - Processing node 69e02f1a1fb14b744a548ccb: ltp-smoke 2026-04-16 00:57:41,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:57:41,453 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:57:41,455 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69e02f1a1fb14b744a548ccb/log.txt.gz 2026-04-16 00:57:41,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:57:42,353 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:57:42,356 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69e02f1a1fb14b744a548ccb/lava-logs.yaml 2026-04-16 00:57:42,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:57:42,508 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:57:42,510 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69e02f1a1fb14b744a548ccb/lava_callback.json.gz 2026-04-16 00:57:42,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:57:42,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02f1a1fb14b744a548ccb HTTP/1.1" 200 None 2026-04-16 00:57:42,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:57:42,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a2e1fb14b744a54889b HTTP/1.1" 200 None 2026-04-16 00:57:42,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:57:42,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e02f1a1fb14b744a548ccb HTTP/1.1" 200 None 2026-04-16 00:57:42,941 - lava_callback - INFO - Completed processing callback for node 69e02f1a1fb14b744a548ccb INFO: 172.21.0.1:44644 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:57:49,022 - lava_callback - INFO - Received callback for node 69dd90f9c2164e674d71fb14 INFO: 172.21.0.1:44652 - "POST /node/69dd90f9c2164e674d71fb14 HTTP/1.0" 202 Accepted 2026-04-16 00:57:49,028 - lava_callback - INFO - Starting async job submit for node 69dd90f9c2164e674d71fb14 2026-04-16 00:57:49,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:57:49,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd90f9c2164e674d71fb14 HTTP/1.1" 200 None 2026-04-16 00:57:49,044 - lava_callback - DEBUG - Processing node 69dd90f9c2164e674d71fb14: baseline-arm-clabbe 2026-04-16 00:57:49,044 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd90f9c2164e674d71fb14 2026-04-16 00:57:49,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:57:49,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd90f9c2164e674d71fb14 HTTP/1.1" 200 None 2026-04-16 00:57:49,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:57:49,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-16 00:57:49,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:57:49,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd90f9c2164e674d71fb14 HTTP/1.1" 200 None 2026-04-16 00:57:49,117 - lava_callback - ERROR - Error processing callback for node 69dd90f9c2164e674d71fb14: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42616 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:58:07,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:58:08,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-16 00:58:09,022 - lava_callback - INFO - Received callback for node 69dd911ec2164e674d71fb50 INFO: 172.21.0.1:42626 - "POST /node/69dd911ec2164e674d71fb50 HTTP/1.0" 202 Accepted 2026-04-16 00:58:09,031 - lava_callback - INFO - Starting async job submit for node 69dd911ec2164e674d71fb50 2026-04-16 00:58:09,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:58:09,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd911ec2164e674d71fb50 HTTP/1.1" 200 None 2026-04-16 00:58:09,049 - lava_callback - DEBUG - Processing node 69dd911ec2164e674d71fb50: baseline-arm-clabbe 2026-04-16 00:58:09,050 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd911ec2164e674d71fb50 2026-04-16 00:58:09,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:58:09,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd911ec2164e674d71fb50 HTTP/1.1" 200 None 2026-04-16 00:58:09,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:58:09,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-16 00:58:09,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:58:09,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd911ec2164e674d71fb50 HTTP/1.1" 200 None 2026-04-16 00:58:09,109 - lava_callback - ERROR - Error processing callback for node 69dd911ec2164e674d71fb50: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33226 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:58:49,022 - lava_callback - INFO - Received callback for node 69dd9142c2164e674d71fb6d INFO: 172.21.0.1:33228 - "POST /node/69dd9142c2164e674d71fb6d HTTP/1.0" 202 Accepted 2026-04-16 00:58:49,031 - lava_callback - INFO - Starting async job submit for node 69dd9142c2164e674d71fb6d 2026-04-16 00:58:49,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:58:49,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9142c2164e674d71fb6d HTTP/1.1" 200 None 2026-04-16 00:58:49,047 - lava_callback - DEBUG - Processing node 69dd9142c2164e674d71fb6d: baseline-arm-clabbe 2026-04-16 00:58:49,047 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9142c2164e674d71fb6d 2026-04-16 00:58:49,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:58:49,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9142c2164e674d71fb6d HTTP/1.1" 200 None 2026-04-16 00:58:49,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:58:49,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-16 00:58:49,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:58:49,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9142c2164e674d71fb6d HTTP/1.1" 200 None 2026-04-16 00:58:49,110 - lava_callback - ERROR - Error processing callback for node 69dd9142c2164e674d71fb6d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45990 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:59:29,039 - lava_callback - INFO - Received callback for node 69dd9162c2164e674d71fb9c INFO: 172.21.0.1:46002 - "POST /node/69dd9162c2164e674d71fb9c HTTP/1.0" 202 Accepted 2026-04-16 00:59:29,045 - lava_callback - INFO - Starting async job submit for node 69dd9162c2164e674d71fb9c 2026-04-16 00:59:29,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:59:29,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9162c2164e674d71fb9c HTTP/1.1" 200 None 2026-04-16 00:59:29,062 - lava_callback - DEBUG - Processing node 69dd9162c2164e674d71fb9c: baseline-arm-clabbe 2026-04-16 00:59:29,062 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9162c2164e674d71fb9c 2026-04-16 00:59:29,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:59:29,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9162c2164e674d71fb9c HTTP/1.1" 200 None 2026-04-16 00:59:29,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:59:29,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-16 00:59:29,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:59:29,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9162c2164e674d71fb9c HTTP/1.1" 200 None 2026-04-16 00:59:29,124 - lava_callback - ERROR - Error processing callback for node 69dd9162c2164e674d71fb9c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43160 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:00:09,353 - lava_callback - INFO - Received callback for node 69dd9185c2164e674d71fbd7 INFO: 172.21.0.1:43162 - "POST /node/69dd9185c2164e674d71fbd7 HTTP/1.0" 202 Accepted 2026-04-16 01:00:09,358 - lava_callback - INFO - Starting async job submit for node 69dd9185c2164e674d71fbd7 2026-04-16 01:00:09,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:00:09,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9185c2164e674d71fbd7 HTTP/1.1" 200 None 2026-04-16 01:00:09,377 - lava_callback - DEBUG - Processing node 69dd9185c2164e674d71fbd7: baseline-arm-clabbe 2026-04-16 01:00:09,378 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9185c2164e674d71fbd7 2026-04-16 01:00:09,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:00:09,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9185c2164e674d71fbd7 HTTP/1.1" 200 None 2026-04-16 01:00:09,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:00:09,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-16 01:00:09,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:00:09,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9185c2164e674d71fbd7 HTTP/1.1" 200 None 2026-04-16 01:00:09,425 - lava_callback - ERROR - Error processing callback for node 69dd9185c2164e674d71fbd7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43206 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:00:29,086 - lava_callback - INFO - Received callback for node 69dd91a7c2164e674d71fc2a INFO: 172.21.0.1:43216 - "POST /node/69dd91a7c2164e674d71fc2a HTTP/1.0" 202 Accepted 2026-04-16 01:00:29,092 - lava_callback - INFO - Starting async job submit for node 69dd91a7c2164e674d71fc2a 2026-04-16 01:00:29,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:00:29,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd91a7c2164e674d71fc2a HTTP/1.1" 200 None 2026-04-16 01:00:29,126 - lava_callback - DEBUG - Processing node 69dd91a7c2164e674d71fc2a: baseline-arm-clabbe 2026-04-16 01:00:29,126 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd91a7c2164e674d71fc2a 2026-04-16 01:00:29,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:00:29,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd91a7c2164e674d71fc2a HTTP/1.1" 200 None 2026-04-16 01:00:29,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:00:29,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-16 01:00:29,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:00:29,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd91a7c2164e674d71fc2a HTTP/1.1" 200 None 2026-04-16 01:00:29,174 - lava_callback - ERROR - Error processing callback for node 69dd91a7c2164e674d71fc2a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48062 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:01:09,169 - lava_callback - INFO - Received callback for node 69dd91cbc2164e674d71fc41 INFO: 172.21.0.1:48076 - "POST /node/69dd91cbc2164e674d71fc41 HTTP/1.0" 202 Accepted 2026-04-16 01:01:09,174 - lava_callback - INFO - Starting async job submit for node 69dd91cbc2164e674d71fc41 2026-04-16 01:01:09,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:01:09,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd91cbc2164e674d71fc41 HTTP/1.1" 200 None 2026-04-16 01:01:09,190 - lava_callback - DEBUG - Processing node 69dd91cbc2164e674d71fc41: baseline-arm-clabbe 2026-04-16 01:01:09,190 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd91cbc2164e674d71fc41 2026-04-16 01:01:09,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:01:09,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd91cbc2164e674d71fc41 HTTP/1.1" 200 None 2026-04-16 01:01:09,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:01:09,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-16 01:01:09,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:01:09,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd91cbc2164e674d71fc41 HTTP/1.1" 200 None 2026-04-16 01:01:09,258 - lava_callback - ERROR - Error processing callback for node 69dd91cbc2164e674d71fc41: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42030 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:01:49,110 - lava_callback - INFO - Received callback for node 69dd91edc2164e674d71fc70 INFO: 172.21.0.1:42046 - "POST /node/69dd91edc2164e674d71fc70 HTTP/1.0" 202 Accepted 2026-04-16 01:01:49,116 - lava_callback - INFO - Starting async job submit for node 69dd91edc2164e674d71fc70 2026-04-16 01:01:49,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:01:49,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd91edc2164e674d71fc70 HTTP/1.1" 200 None 2026-04-16 01:01:49,132 - lava_callback - DEBUG - Processing node 69dd91edc2164e674d71fc70: baseline-arm-clabbe 2026-04-16 01:01:49,132 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd91edc2164e674d71fc70 2026-04-16 01:01:49,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:01:49,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd91edc2164e674d71fc70 HTTP/1.1" 200 None 2026-04-16 01:01:49,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:01:49,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-16 01:01:49,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:01:49,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd91edc2164e674d71fc70 HTTP/1.1" 200 None 2026-04-16 01:01:49,211 - lava_callback - ERROR - Error processing callback for node 69dd91edc2164e674d71fc70: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36032 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:02:09,208 - lava_callback - INFO - Received callback for node 69dd920ec2164e674d71fcc8 INFO: 172.21.0.1:36046 - "POST /node/69dd920ec2164e674d71fcc8 HTTP/1.0" 202 Accepted 2026-04-16 01:02:09,213 - lava_callback - INFO - Starting async job submit for node 69dd920ec2164e674d71fcc8 2026-04-16 01:02:09,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:02:09,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd920ec2164e674d71fcc8 HTTP/1.1" 200 None 2026-04-16 01:02:09,229 - lava_callback - DEBUG - Processing node 69dd920ec2164e674d71fcc8: baseline-arm-clabbe 2026-04-16 01:02:09,230 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd920ec2164e674d71fcc8 2026-04-16 01:02:09,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:02:09,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd920ec2164e674d71fcc8 HTTP/1.1" 200 None 2026-04-16 01:02:09,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:02:09,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 01:02:09,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:02:09,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd920ec2164e674d71fcc8 HTTP/1.1" 200 None 2026-04-16 01:02:09,276 - lava_callback - ERROR - Error processing callback for node 69dd920ec2164e674d71fcc8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48122 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:04:49,260 - lava_callback - INFO - Received callback for node 69dd929bc2164e674d71fd59 INFO: 172.21.0.1:48130 - "POST /node/69dd929bc2164e674d71fd59 HTTP/1.0" 202 Accepted 2026-04-16 01:04:49,266 - lava_callback - INFO - Starting async job submit for node 69dd929bc2164e674d71fd59 2026-04-16 01:04:49,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:04:49,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd929bc2164e674d71fd59 HTTP/1.1" 200 None 2026-04-16 01:04:49,282 - lava_callback - DEBUG - Processing node 69dd929bc2164e674d71fd59: baseline-arm-clabbe 2026-04-16 01:04:49,282 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd929bc2164e674d71fd59 2026-04-16 01:04:49,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:04:49,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd929bc2164e674d71fd59 HTTP/1.1" 200 None 2026-04-16 01:04:49,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:04:49,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 01:04:49,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:04:49,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd929bc2164e674d71fd59 HTTP/1.1" 200 None 2026-04-16 01:04:49,332 - lava_callback - ERROR - Error processing callback for node 69dd929bc2164e674d71fd59: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49396 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49398 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:06:17,732 - lava_callback - INFO - Received callback for node 69e02f071fb14b744a548c9f INFO: 172.21.0.1:49402 - "POST /node/69e02f071fb14b744a548c9f HTTP/1.0" 202 Accepted 2026-04-16 01:06:17,778 - lava_callback - INFO - Starting async job submit for node 69e02f071fb14b744a548c9f 2026-04-16 01:06:17,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:06:17,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02f071fb14b744a548c9f HTTP/1.1" 200 None 2026-04-16 01:06:17,831 - lava_callback - DEBUG - Processing node 69e02f071fb14b744a548c9f: ltp-fsx 2026-04-16 01:06:17,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:06:18,110 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:06:18,112 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fsx-69e02f071fb14b744a548c9f/log.txt.gz 2026-04-16 01:06:18,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:06:18,376 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:06:18,378 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fsx-69e02f071fb14b744a548c9f/lava-logs.yaml 2026-04-16 01:06:18,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:06:18,521 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:06:18,523 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fsx-69e02f071fb14b744a548c9f/lava_callback.json.gz 2026-04-16 01:06:18,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:06:18,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02f071fb14b744a548c9f HTTP/1.1" 200 None 2026-04-16 01:06:18,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:06:18,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 01:06:18,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:06:18,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e02f071fb14b744a548c9f HTTP/1.1" 200 None 2026-04-16 01:06:18,687 - lava_callback - INFO - Completed processing callback for node 69e02f071fb14b744a548c9f INFO: 172.21.0.1:57796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43802 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:06:38,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:06:38,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45240 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:08:09,412 - lava_callback - INFO - Received callback for node 69dd9367c2164e674d71fe47 INFO: 172.21.0.1:45252 - "POST /node/69dd9367c2164e674d71fe47 HTTP/1.0" 202 Accepted 2026-04-16 01:08:09,422 - lava_callback - INFO - Starting async job submit for node 69dd9367c2164e674d71fe47 2026-04-16 01:08:09,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:08:09,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9367c2164e674d71fe47 HTTP/1.1" 200 None 2026-04-16 01:08:09,454 - lava_callback - DEBUG - Processing node 69dd9367c2164e674d71fe47: baseline-arm-clabbe 2026-04-16 01:08:09,454 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9367c2164e674d71fe47 2026-04-16 01:08:09,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:08:09,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9367c2164e674d71fe47 HTTP/1.1" 200 None 2026-04-16 01:08:09,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:08:09,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 01:08:09,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:08:09,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9367c2164e674d71fe47 HTTP/1.1" 200 None 2026-04-16 01:08:09,525 - lava_callback - ERROR - Error processing callback for node 69dd9367c2164e674d71fe47: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57634 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:08:24,944 - lava_callback - INFO - Received callback for node 69e0365d1fb14b744a5495ac INFO: 172.21.0.1:34312 - "POST /node/69e0365d1fb14b744a5495ac HTTP/1.0" 202 Accepted 2026-04-16 01:08:24,950 - lava_callback - INFO - Starting async job submit for node 69e0365d1fb14b744a5495ac 2026-04-16 01:08:24,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:08:24,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0365d1fb14b744a5495ac HTTP/1.1" 200 None 2026-04-16 01:08:24,985 - lava_callback - DEBUG - Processing node 69e0365d1fb14b744a5495ac: baseline-arm64 2026-04-16 01:08:25,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:08:25,272 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:08:25,273 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e0365d1fb14b744a5495ac/log.txt.gz 2026-04-16 01:08:25,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:08:25,602 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:08:25,604 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e0365d1fb14b744a5495ac/lava-logs.yaml 2026-04-16 01:08:25,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:08:25,745 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:08:25,747 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e0365d1fb14b744a5495ac/lava_callback.json.gz 2026-04-16 01:08:25,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:08:25,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0365d1fb14b744a5495ac HTTP/1.1" 200 None 2026-04-16 01:08:25,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:08:25,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:08:25,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:08:25,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e0365d1fb14b744a5495ac HTTP/1.1" 200 None 2026-04-16 01:08:25,837 - lava_callback - INFO - Completed processing callback for node 69e0365d1fb14b744a5495ac INFO: 172.21.0.1:34326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34334 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:08:29,927 - lava_callback - INFO - Received callback for node 69e0366a1fb14b744a5495ee INFO: 172.21.0.1:33890 - "POST /node/69e0366a1fb14b744a5495ee HTTP/1.0" 202 Accepted 2026-04-16 01:08:29,934 - lava_callback - INFO - Starting async job submit for node 69e0366a1fb14b744a5495ee 2026-04-16 01:08:29,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:08:29,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0366a1fb14b744a5495ee HTTP/1.1" 200 None 2026-04-16 01:08:29,966 - lava_callback - DEBUG - Processing node 69e0366a1fb14b744a5495ee: baseline-arm64 2026-04-16 01:08:30,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:08:30,265 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:08:30,267 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e0366a1fb14b744a5495ee/log.txt.gz 2026-04-16 01:08:30,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:08:30,617 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:08:30,618 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e0366a1fb14b744a5495ee/lava-logs.yaml 2026-04-16 01:08:30,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:08:30,761 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:08:30,763 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e0366a1fb14b744a5495ee/lava_callback.json.gz 2026-04-16 01:08:30,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:08:30,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0366a1fb14b744a5495ee HTTP/1.1" 200 None 2026-04-16 01:08:30,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:08:30,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:08:30,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:08:30,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e0366a1fb14b744a5495ee HTTP/1.1" 200 None 2026-04-16 01:08:30,844 - lava_callback - INFO - Completed processing callback for node 69e0366a1fb14b744a5495ee 2026-04-16 01:08:34,370 - lava_callback - INFO - Received callback for node 69e036791fb14b744a549618 INFO: 172.21.0.1:33892 - "POST /node/69e036791fb14b744a549618 HTTP/1.0" 202 Accepted 2026-04-16 01:08:34,376 - lava_callback - INFO - Starting async job submit for node 69e036791fb14b744a549618 2026-04-16 01:08:34,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:08:34,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036791fb14b744a549618 HTTP/1.1" 200 None 2026-04-16 01:08:34,402 - lava_callback - DEBUG - Processing node 69e036791fb14b744a549618: baseline-nfs-arm64 2026-04-16 01:08:34,403 - lava_callback - WARNING - Failed to upload log 2026-04-16 01:08:34,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:08:34,536 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:08:34,538 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e036791fb14b744a549618/lava-logs.yaml 2026-04-16 01:08:34,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:08:34,901 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:08:34,903 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e036791fb14b744a549618/lava_callback.json.gz 2026-04-16 01:08:34,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:08:34,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036791fb14b744a549618 HTTP/1.1" 200 None 2026-04-16 01:08:34,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:08:34,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:08:34,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:08:35,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e036791fb14b744a549618 HTTP/1.1" 200 None 2026-04-16 01:08:35,004 - lava_callback - INFO - Completed processing callback for node 69e036791fb14b744a549618 INFO: 172.21.0.1:33900 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:08:38,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:08:38,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-16 01:08:45,522 - lava_callback - INFO - Received callback for node 69e0365f1fb14b744a5495b2 INFO: 172.21.0.1:52850 - "POST /node/69e0365f1fb14b744a5495b2 HTTP/1.0" 202 Accepted 2026-04-16 01:08:45,533 - lava_callback - INFO - Starting async job submit for node 69e0365f1fb14b744a5495b2 2026-04-16 01:08:45,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:08:45,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0365f1fb14b744a5495b2 HTTP/1.1" 200 None 2026-04-16 01:08:45,587 - lava_callback - DEBUG - Processing node 69e0365f1fb14b744a5495b2: baseline-arm64 2026-04-16 01:08:46,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:08:46,482 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:08:46,484 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e0365f1fb14b744a5495b2/log.txt.gz INFO: 172.21.0.1:52864 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:08:46,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:08:47,334 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:08:47,336 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e0365f1fb14b744a5495b2/lava-logs.yaml 2026-04-16 01:08:47,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:08:47,495 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:08:47,496 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e0365f1fb14b744a5495b2/lava_callback.json.gz 2026-04-16 01:08:47,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:08:47,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0365f1fb14b744a5495b2 HTTP/1.1" 200 None 2026-04-16 01:08:47,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:08:47,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:08:47,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:08:47,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e0365f1fb14b744a5495b2 HTTP/1.1" 200 None 2026-04-16 01:08:47,583 - lava_callback - INFO - Completed processing callback for node 69e0365f1fb14b744a5495b2 INFO: 172.21.0.1:46172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52294 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:09:08,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:08,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34750 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34764 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:09:23,402 - lava_callback - INFO - Received callback for node 69e0365e1fb14b744a5495af INFO: 172.21.0.1:58654 - "POST /node/69e0365e1fb14b744a5495af HTTP/1.0" 202 Accepted 2026-04-16 01:09:23,408 - lava_callback - INFO - Starting async job submit for node 69e0365e1fb14b744a5495af 2026-04-16 01:09:23,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:23,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0365e1fb14b744a5495af HTTP/1.1" 200 None 2026-04-16 01:09:23,446 - lava_callback - DEBUG - Processing node 69e0365e1fb14b744a5495af: baseline-arm64 2026-04-16 01:09:23,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:09:24,024 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:09:24,027 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e0365e1fb14b744a5495af/log.txt.gz 2026-04-16 01:09:24,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:09:24,668 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:09:24,671 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e0365e1fb14b744a5495af/lava-logs.yaml 2026-04-16 01:09:24,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:09:24,882 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:09:24,884 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e0365e1fb14b744a5495af/lava_callback.json.gz 2026-04-16 01:09:24,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:24,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0365e1fb14b744a5495af HTTP/1.1" 200 None 2026-04-16 01:09:24,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:24,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:09:24,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:24,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e0365e1fb14b744a5495af HTTP/1.1" 200 None 2026-04-16 01:09:24,986 - lava_callback - INFO - Completed processing callback for node 69e0365e1fb14b744a5495af INFO: 172.21.0.1:58660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35470 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:09:38,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:38,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-16 01:09:40,744 - lava_callback - INFO - Received callback for node 69e035e91fb14b744a549538 INFO: 172.21.0.1:39262 - "POST /node/69e035e91fb14b744a549538 HTTP/1.0" 202 Accepted 2026-04-16 01:09:40,751 - lava_callback - INFO - Starting async job submit for node 69e035e91fb14b744a549538 2026-04-16 01:09:40,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:40,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e035e91fb14b744a549538 HTTP/1.1" 200 None 2026-04-16 01:09:40,800 - lava_callback - DEBUG - Processing node 69e035e91fb14b744a549538: ltp-containers 2026-04-16 01:09:41,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:09:41,548 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:09:41,550 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-containers-69e035e91fb14b744a549538/log.txt.gz 2026-04-16 01:09:41,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:09:42,158 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:09:42,160 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-containers-69e035e91fb14b744a549538/lava-logs.yaml 2026-04-16 01:09:42,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:09:42,327 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:09:42,329 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-containers-69e035e91fb14b744a549538/lava_callback.json.gz 2026-04-16 01:09:42,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:42,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e035e91fb14b744a549538 HTTP/1.1" 200 None 2026-04-16 01:09:42,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:42,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 01:09:42,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:42,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e035e91fb14b744a549538 HTTP/1.1" 200 None 2026-04-16 01:09:42,441 - lava_callback - INFO - Completed processing callback for node 69e035e91fb14b744a549538 2026-04-16 01:09:43,073 - lava_callback - INFO - Received callback for node 69e0368c1fb14b744a549676 INFO: 172.21.0.1:39266 - "POST /node/69e0368c1fb14b744a549676 HTTP/1.0" 202 Accepted 2026-04-16 01:09:43,080 - lava_callback - INFO - Starting async job submit for node 69e0368c1fb14b744a549676 2026-04-16 01:09:43,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:43,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0368c1fb14b744a549676 HTTP/1.1" 200 None 2026-04-16 01:09:43,118 - lava_callback - DEBUG - Processing node 69e0368c1fb14b744a549676: baseline-arm64-broonie 2026-04-16 01:09:43,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:09:43,676 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:09:43,677 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e0368c1fb14b744a549676/log.txt.gz 2026-04-16 01:09:43,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:09:44,206 - lava_callback - INFO - Received callback for node 69e036a31fb14b744a5496f1 INFO: 172.21.0.1:39276 - "POST /node/69e036a31fb14b744a5496f1 HTTP/1.0" 202 Accepted 2026-04-16 01:09:44,217 - lava_callback - INFO - Starting async job submit for node 69e036a31fb14b744a5496f1 2026-04-16 01:09:44,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:44,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036a31fb14b744a5496f1 HTTP/1.1" 200 None 2026-04-16 01:09:44,299 - lava_callback - DEBUG - Processing node 69e036a31fb14b744a5496f1: baseline-arm64-kontron 2026-04-16 01:09:44,359 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:09:44,372 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e0368c1fb14b744a549676/lava-logs.yaml 2026-04-16 01:09:44,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:09:44,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:09:45,054 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:09:45,056 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69e036a31fb14b744a5496f1/log.txt.gz 2026-04-16 01:09:45,068 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:09:45,081 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e0368c1fb14b744a549676/lava_callback.json.gz 2026-04-16 01:09:45,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:45,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0368c1fb14b744a549676 HTTP/1.1" 200 None 2026-04-16 01:09:45,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:45,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:09:45,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:09:45,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:45,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e0368c1fb14b744a549676 HTTP/1.1" 200 None 2026-04-16 01:09:45,329 - lava_callback - INFO - Completed processing callback for node 69e0368c1fb14b744a549676 2026-04-16 01:09:45,511 - lava_callback - INFO - Received callback for node 69e036a51fb14b744a5496f4 INFO: 172.21.0.1:39282 - "POST /node/69e036a51fb14b744a5496f4 HTTP/1.0" 202 Accepted 2026-04-16 01:09:45,521 - lava_callback - INFO - Starting async job submit for node 69e036a51fb14b744a5496f4 2026-04-16 01:09:45,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:45,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036a51fb14b744a5496f4 HTTP/1.1" 200 None 2026-04-16 01:09:45,614 - lava_callback - DEBUG - Processing node 69e036a51fb14b744a5496f4: baseline-arm64-kontron 2026-04-16 01:09:46,139 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:09:46,142 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69e036a31fb14b744a5496f1/lava-logs.yaml 2026-04-16 01:09:46,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:09:46,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:39290 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:09:46,835 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:09:46,838 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69e036a51fb14b744a5496f4/log.txt.gz 2026-04-16 01:09:46,886 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:09:46,915 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69e036a31fb14b744a5496f1/lava_callback.json.gz 2026-04-16 01:09:47,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:47,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036a31fb14b744a5496f1 HTTP/1.1" 200 None 2026-04-16 01:09:47,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:47,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:09:47,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:09:47,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:47,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e036a31fb14b744a5496f1 HTTP/1.1" 200 None 2026-04-16 01:09:47,198 - lava_callback - INFO - Completed processing callback for node 69e036a31fb14b744a5496f1 2026-04-16 01:09:47,843 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:09:47,846 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69e036a51fb14b744a5496f4/lava-logs.yaml 2026-04-16 01:09:47,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:09:48,038 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:09:48,040 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69e036a51fb14b744a5496f4/lava_callback.json.gz 2026-04-16 01:09:48,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:48,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036a51fb14b744a5496f4 HTTP/1.1" 200 None 2026-04-16 01:09:48,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:48,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:09:48,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:48,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e036a51fb14b744a5496f4 HTTP/1.1" 200 None 2026-04-16 01:09:48,210 - lava_callback - INFO - Completed processing callback for node 69e036a51fb14b744a5496f4 2026-04-16 01:09:49,472 - lava_callback - INFO - Received callback for node 69dd93cdc2164e674d71febe INFO: 172.21.0.1:39304 - "POST /node/69dd93cdc2164e674d71febe HTTP/1.0" 202 Accepted 2026-04-16 01:09:49,481 - lava_callback - INFO - Starting async job submit for node 69dd93cdc2164e674d71febe 2026-04-16 01:09:49,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:49,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd93cdc2164e674d71febe HTTP/1.1" 200 None 2026-04-16 01:09:49,498 - lava_callback - DEBUG - Processing node 69dd93cdc2164e674d71febe: baseline-arm-clabbe 2026-04-16 01:09:49,498 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd93cdc2164e674d71febe 2026-04-16 01:09:49,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:49,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd93cdc2164e674d71febe HTTP/1.1" 200 None 2026-04-16 01:09:49,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:49,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 01:09:49,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:49,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd93cdc2164e674d71febe HTTP/1.1" 200 None 2026-04-16 01:09:49,560 - lava_callback - ERROR - Error processing callback for node 69dd93cdc2164e674d71febe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 01:09:54,109 - lava_callback - INFO - Received callback for node 69e036ab1fb14b744a549704 INFO: 172.21.0.1:38268 - "POST /node/69e036ab1fb14b744a549704 HTTP/1.0" 202 Accepted 2026-04-16 01:09:54,120 - lava_callback - INFO - Starting async job submit for node 69e036ab1fb14b744a549704 2026-04-16 01:09:54,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:54,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036ab1fb14b744a549704 HTTP/1.1" 200 None 2026-04-16 01:09:54,215 - lava_callback - DEBUG - Processing node 69e036ab1fb14b744a549704: baseline-arm64-foundriesio 2026-04-16 01:09:54,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:09:55,035 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:09:55,037 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e036ab1fb14b744a549704/log.txt.gz 2026-04-16 01:09:55,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:09:55,613 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:09:55,615 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e036ab1fb14b744a549704/lava-logs.yaml 2026-04-16 01:09:55,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:09:55,705 - lava_callback - INFO - Received callback for node 69e036661fb14b744a5495e5 INFO: 172.21.0.1:38282 - "POST /node/69e036661fb14b744a5495e5 HTTP/1.0" 202 Accepted 2026-04-16 01:09:55,713 - lava_callback - INFO - Starting async job submit for node 69e036661fb14b744a5495e5 2026-04-16 01:09:55,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:55,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036661fb14b744a5495e5 HTTP/1.1" 200 None 2026-04-16 01:09:55,784 - lava_callback - DEBUG - Processing node 69e036661fb14b744a5495e5: baseline-arm64 2026-04-16 01:09:55,956 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:09:55,995 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e036ab1fb14b744a549704/lava_callback.json.gz 2026-04-16 01:09:56,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:56,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036ab1fb14b744a549704 HTTP/1.1" 200 None 2026-04-16 01:09:56,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:56,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:09:56,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:56,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:09:56,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e036ab1fb14b744a549704 HTTP/1.1" 200 None 2026-04-16 01:09:56,393 - lava_callback - INFO - Completed processing callback for node 69e036ab1fb14b744a549704 INFO: 172.21.0.1:38288 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:09:56,837 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:09:56,839 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e036661fb14b744a5495e5/log.txt.gz 2026-04-16 01:09:57,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:09:57,428 - lava_callback - INFO - Received callback for node 69e036651fb14b744a5495e2 INFO: 172.21.0.1:38300 - "POST /node/69e036651fb14b744a5495e2 HTTP/1.0" 202 Accepted 2026-04-16 01:09:57,438 - lava_callback - INFO - Starting async job submit for node 69e036651fb14b744a5495e2 2026-04-16 01:09:57,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:57,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036651fb14b744a5495e2 HTTP/1.1" 200 None 2026-04-16 01:09:57,488 - lava_callback - DEBUG - Processing node 69e036651fb14b744a5495e2: baseline-arm64 2026-04-16 01:09:57,577 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:09:57,610 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e036661fb14b744a5495e5/lava-logs.yaml 2026-04-16 01:09:57,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:09:57,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:09:58,109 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:09:58,111 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e036661fb14b744a5495e5/lava_callback.json.gz 2026-04-16 01:09:58,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:58,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036661fb14b744a5495e5 HTTP/1.1" 200 None 2026-04-16 01:09:58,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:58,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:09:58,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:58,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e036661fb14b744a5495e5 HTTP/1.1" 200 None 2026-04-16 01:09:58,250 - lava_callback - INFO - Completed processing callback for node 69e036661fb14b744a5495e5 2026-04-16 01:09:58,372 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:09:58,375 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e036651fb14b744a5495e2/log.txt.gz 2026-04-16 01:09:58,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:09:59,003 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:09:59,006 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e036651fb14b744a5495e2/lava-logs.yaml 2026-04-16 01:09:59,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:09:59,360 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:09:59,362 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e036651fb14b744a5495e2/lava_callback.json.gz 2026-04-16 01:09:59,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:59,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036651fb14b744a5495e2 HTTP/1.1" 200 None 2026-04-16 01:09:59,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:59,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:09:59,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:59,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e036651fb14b744a5495e2 HTTP/1.1" 200 None 2026-04-16 01:09:59,488 - lava_callback - INFO - Completed processing callback for node 69e036651fb14b744a5495e2 2026-04-16 01:10:00,651 - lava_callback - INFO - Received callback for node 69e036941fb14b744a54968d INFO: 172.21.0.1:42052 - "POST /node/69e036941fb14b744a54968d HTTP/1.0" 202 Accepted 2026-04-16 01:10:00,661 - lava_callback - INFO - Starting async job submit for node 69e036941fb14b744a54968d 2026-04-16 01:10:00,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:00,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036941fb14b744a54968d HTTP/1.1" 200 None 2026-04-16 01:10:00,720 - lava_callback - DEBUG - Processing node 69e036941fb14b744a54968d: baseline-arm64-broonie 2026-04-16 01:10:01,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:01,333 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:01,335 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e036941fb14b744a54968d/log.txt.gz 2026-04-16 01:10:01,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:01,879 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:01,881 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e036941fb14b744a54968d/lava-logs.yaml 2026-04-16 01:10:01,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:02,230 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:02,233 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e036941fb14b744a54968d/lava_callback.json.gz 2026-04-16 01:10:02,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:02,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036941fb14b744a54968d HTTP/1.1" 200 None 2026-04-16 01:10:02,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:02,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:10:02,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:02,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e036941fb14b744a54968d HTTP/1.1" 200 None 2026-04-16 01:10:02,349 - lava_callback - INFO - Completed processing callback for node 69e036941fb14b744a54968d 2026-04-16 01:10:03,692 - lava_callback - INFO - Received callback for node 69e036a61fb14b744a5496f7 INFO: 172.21.0.1:42056 - "POST /node/69e036a61fb14b744a5496f7 HTTP/1.0" 202 Accepted 2026-04-16 01:10:03,702 - lava_callback - INFO - Starting async job submit for node 69e036a61fb14b744a5496f7 2026-04-16 01:10:03,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:03,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036a61fb14b744a5496f7 HTTP/1.1" 200 None 2026-04-16 01:10:03,762 - lava_callback - DEBUG - Processing node 69e036a61fb14b744a5496f7: baseline-arm64-pengutronix 2026-04-16 01:10:04,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:04,143 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:04,145 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e036a61fb14b744a5496f7/log.txt.gz 2026-04-16 01:10:04,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:04,410 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:04,412 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e036a61fb14b744a5496f7/lava-logs.yaml 2026-04-16 01:10:04,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:04,538 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:04,540 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e036a61fb14b744a5496f7/lava_callback.json.gz 2026-04-16 01:10:04,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:04,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036a61fb14b744a5496f7 HTTP/1.1" 200 None 2026-04-16 01:10:04,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:04,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:10:04,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:04,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e036a61fb14b744a5496f7 HTTP/1.1" 200 None 2026-04-16 01:10:04,632 - lava_callback - INFO - Completed processing callback for node 69e036a61fb14b744a5496f7 INFO: 172.21.0.1:42070 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:10:08,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:08,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-16 01:10:10,457 - lava_callback - INFO - Received callback for node 69e0366b1fb14b744a5495f1 INFO: 172.21.0.1:43562 - "POST /node/69e0366b1fb14b744a5495f1 HTTP/1.0" 202 Accepted 2026-04-16 01:10:10,463 - lava_callback - INFO - Starting async job submit for node 69e0366b1fb14b744a5495f1 2026-04-16 01:10:10,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:10,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0366b1fb14b744a5495f1 HTTP/1.1" 200 None 2026-04-16 01:10:10,500 - lava_callback - DEBUG - Processing node 69e0366b1fb14b744a5495f1: baseline-arm64 2026-04-16 01:10:10,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:10,844 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:10,845 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e0366b1fb14b744a5495f1/log.txt.gz 2026-04-16 01:10:10,919 - lava_callback - INFO - Received callback for node 69e0366f1fb14b744a5495fe INFO: 172.21.0.1:43566 - "POST /node/69e0366f1fb14b744a5495fe HTTP/1.0" 202 Accepted 2026-04-16 01:10:10,943 - lava_callback - INFO - Starting async job submit for node 69e0366f1fb14b744a5495fe 2026-04-16 01:10:10,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:11,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:11,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0366f1fb14b744a5495fe HTTP/1.1" 200 None 2026-04-16 01:10:11,026 - lava_callback - DEBUG - Processing node 69e0366f1fb14b744a5495fe: baseline-arm64 2026-04-16 01:10:11,148 - lava_callback - INFO - Received callback for node 69e036aa1fb14b744a549701 INFO: 172.21.0.1:43568 - "POST /node/69e036aa1fb14b744a549701 HTTP/1.0" 202 Accepted 2026-04-16 01:10:11,165 - lava_callback - INFO - Starting async job submit for node 69e036aa1fb14b744a549701 2026-04-16 01:10:11,215 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:11,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:11,253 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e0366b1fb14b744a5495f1/lava-logs.yaml 2026-04-16 01:10:11,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036aa1fb14b744a549701 HTTP/1.1" 200 None 2026-04-16 01:10:11,349 - lava_callback - DEBUG - Processing node 69e036aa1fb14b744a549701: baseline-arm64-foundriesio 2026-04-16 01:10:11,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:11,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:11,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:11,665 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:11,667 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e0366f1fb14b744a5495fe/log.txt.gz 2026-04-16 01:10:11,692 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:11,724 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:11,724 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e0366b1fb14b744a5495f1/lava_callback.json.gz 2026-04-16 01:10:11,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:11,799 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e036aa1fb14b744a549701/log.txt.gz 2026-04-16 01:10:11,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0366b1fb14b744a5495f1 HTTP/1.1" 200 None 2026-04-16 01:10:11,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:12,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:12,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:12,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:10:12,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:12,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e0366b1fb14b744a5495f1 HTTP/1.1" 200 None 2026-04-16 01:10:12,072 - lava_callback - INFO - Completed processing callback for node 69e0366b1fb14b744a5495f1 2026-04-16 01:10:12,268 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:12,270 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e036aa1fb14b744a549701/lava-logs.yaml 2026-04-16 01:10:12,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:12,355 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:12,357 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e0366f1fb14b744a5495fe/lava-logs.yaml 2026-04-16 01:10:12,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:12,439 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:12,442 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e036aa1fb14b744a549701/lava_callback.json.gz 2026-04-16 01:10:12,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:12,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036aa1fb14b744a549701 HTTP/1.1" 200 None 2026-04-16 01:10:12,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:12,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:10:12,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:12,557 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:12,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e036aa1fb14b744a549701 HTTP/1.1" 200 None 2026-04-16 01:10:12,566 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e0366f1fb14b744a5495fe/lava_callback.json.gz 2026-04-16 01:10:12,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:12,647 - lava_callback - INFO - Completed processing callback for node 69e036aa1fb14b744a549701 2026-04-16 01:10:12,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0366f1fb14b744a5495fe HTTP/1.1" 200 None 2026-04-16 01:10:12,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:12,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:10:12,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:12,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e0366f1fb14b744a5495fe HTTP/1.1" 200 None 2026-04-16 01:10:12,738 - lava_callback - INFO - Completed processing callback for node 69e0366f1fb14b744a5495fe 2026-04-16 01:10:14,841 - lava_callback - INFO - Received callback for node 69e036601fb14b744a5495b5 INFO: 172.21.0.1:43580 - "POST /node/69e036601fb14b744a5495b5 HTTP/1.0" 202 Accepted 2026-04-16 01:10:14,847 - lava_callback - INFO - Starting async job submit for node 69e036601fb14b744a5495b5 2026-04-16 01:10:14,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:14,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036601fb14b744a5495b5 HTTP/1.1" 200 None 2026-04-16 01:10:14,883 - lava_callback - DEBUG - Processing node 69e036601fb14b744a5495b5: baseline-arm64 2026-04-16 01:10:15,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:43588 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-16 01:10:15,263 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:15,265 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e036601fb14b744a5495b5/log.txt.gz 2026-04-16 01:10:15,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:15,445 - lava_callback - INFO - Received callback for node 69e036a81fb14b744a5496fa INFO: 172.21.0.1:43600 - "POST /node/69e036a81fb14b744a5496fa HTTP/1.0" 202 Accepted 2026-04-16 01:10:15,452 - lava_callback - INFO - Starting async job submit for node 69e036a81fb14b744a5496fa 2026-04-16 01:10:15,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:15,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036a81fb14b744a5496fa HTTP/1.1" 200 None 2026-04-16 01:10:15,495 - lava_callback - DEBUG - Processing node 69e036a81fb14b744a5496fa: baseline-arm64-pengutronix 2026-04-16 01:10:15,631 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:15,663 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e036601fb14b744a5495b5/lava-logs.yaml 2026-04-16 01:10:15,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:15,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:15,840 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:15,841 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e036a81fb14b744a5496fa/log.txt.gz 2026-04-16 01:10:15,874 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:15,907 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e036601fb14b744a5495b5/lava_callback.json.gz 2026-04-16 01:10:15,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:15,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:16,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036601fb14b744a5495b5 HTTP/1.1" 200 None 2026-04-16 01:10:16,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:16,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:10:16,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:16,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e036601fb14b744a5495b5 HTTP/1.1" 200 None 2026-04-16 01:10:16,044 - lava_callback - INFO - Completed processing callback for node 69e036601fb14b744a5495b5 2026-04-16 01:10:16,238 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:16,241 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e036a81fb14b744a5496fa/lava-logs.yaml 2026-04-16 01:10:16,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:16,402 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:16,404 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e036a81fb14b744a5496fa/lava_callback.json.gz 2026-04-16 01:10:16,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:16,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036a81fb14b744a5496fa HTTP/1.1" 200 None 2026-04-16 01:10:16,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:16,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:10:16,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:16,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e036a81fb14b744a5496fa HTTP/1.1" 200 None 2026-04-16 01:10:16,503 - lava_callback - INFO - Completed processing callback for node 69e036a81fb14b744a5496fa INFO: 172.21.0.1:43616 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:10:17,993 - lava_callback - INFO - Received callback for node 69e036991fb14b744a54969e INFO: 172.21.0.1:43630 - "POST /node/69e036991fb14b744a54969e HTTP/1.0" 202 Accepted 2026-04-16 01:10:17,999 - lava_callback - INFO - Starting async job submit for node 69e036991fb14b744a54969e 2026-04-16 01:10:18,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:18,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036991fb14b744a54969e HTTP/1.1" 200 None 2026-04-16 01:10:18,048 - lava_callback - DEBUG - Processing node 69e036991fb14b744a54969e: baseline-arm64-broonie 2026-04-16 01:10:18,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:18,442 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:18,444 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e036991fb14b744a54969e/log.txt.gz 2026-04-16 01:10:18,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:18,770 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:18,772 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e036991fb14b744a54969e/lava-logs.yaml 2026-04-16 01:10:18,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:18,913 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:18,915 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e036991fb14b744a54969e/lava_callback.json.gz 2026-04-16 01:10:18,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:18,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036991fb14b744a54969e HTTP/1.1" 200 None 2026-04-16 01:10:18,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:18,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:10:18,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:19,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e036991fb14b744a54969e HTTP/1.1" 200 None 2026-04-16 01:10:19,011 - lava_callback - INFO - Completed processing callback for node 69e036991fb14b744a54969e 2026-04-16 01:10:19,419 - lava_callback - INFO - Received callback for node 69e0366d1fb14b744a5495f7 INFO: 172.21.0.1:43644 - "POST /node/69e0366d1fb14b744a5495f7 HTTP/1.0" 202 Accepted 2026-04-16 01:10:19,429 - lava_callback - INFO - Starting async job submit for node 69e0366d1fb14b744a5495f7 2026-04-16 01:10:19,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:19,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0366d1fb14b744a5495f7 HTTP/1.1" 200 None 2026-04-16 01:10:19,474 - lava_callback - DEBUG - Processing node 69e0366d1fb14b744a5495f7: baseline-arm64 2026-04-16 01:10:19,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:19,858 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:19,859 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e0366d1fb14b744a5495f7/log.txt.gz 2026-04-16 01:10:20,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:20,206 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:20,208 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e0366d1fb14b744a5495f7/lava-logs.yaml 2026-04-16 01:10:20,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:20,341 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:20,342 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e0366d1fb14b744a5495f7/lava_callback.json.gz 2026-04-16 01:10:20,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:20,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0366d1fb14b744a5495f7 HTTP/1.1" 200 None 2026-04-16 01:10:20,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:20,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:10:20,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:20,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e0366d1fb14b744a5495f7 HTTP/1.1" 200 None 2026-04-16 01:10:20,418 - lava_callback - INFO - Completed processing callback for node 69e0366d1fb14b744a5495f7 2026-04-16 01:10:21,487 - lava_callback - INFO - Received callback for node 69e036a91fb14b744a5496fd INFO: 172.21.0.1:41760 - "POST /node/69e036a91fb14b744a5496fd HTTP/1.0" 202 Accepted 2026-04-16 01:10:21,493 - lava_callback - INFO - Starting async job submit for node 69e036a91fb14b744a5496fd 2026-04-16 01:10:21,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:21,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036a91fb14b744a5496fd HTTP/1.1" 200 None 2026-04-16 01:10:21,528 - lava_callback - DEBUG - Processing node 69e036a91fb14b744a5496fd: baseline-arm64-pengutronix 2026-04-16 01:10:21,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:21,879 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:21,880 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e036a91fb14b744a5496fd/log.txt.gz 2026-04-16 01:10:22,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:22,194 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:22,197 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e036a91fb14b744a5496fd/lava-logs.yaml 2026-04-16 01:10:22,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:22,330 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:22,332 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e036a91fb14b744a5496fd/lava_callback.json.gz 2026-04-16 01:10:22,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:22,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036a91fb14b744a5496fd HTTP/1.1" 200 None 2026-04-16 01:10:22,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:22,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:10:22,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:22,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e036a91fb14b744a5496fd HTTP/1.1" 200 None 2026-04-16 01:10:22,409 - lava_callback - INFO - Completed processing callback for node 69e036a91fb14b744a5496fd 2026-04-16 01:10:22,636 - lava_callback - INFO - Received callback for node 69e036771fb14b744a549610 INFO: 172.21.0.1:41764 - "POST /node/69e036771fb14b744a549610 HTTP/1.0" 202 Accepted 2026-04-16 01:10:22,643 - lava_callback - INFO - Starting async job submit for node 69e036771fb14b744a549610 2026-04-16 01:10:22,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:22,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036771fb14b744a549610 HTTP/1.1" 200 None 2026-04-16 01:10:22,690 - lava_callback - DEBUG - Processing node 69e036771fb14b744a549610: baseline-nfs-arm64 2026-04-16 01:10:23,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:23,237 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:23,239 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e036771fb14b744a549610/log.txt.gz 2026-04-16 01:10:23,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:23,687 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:23,689 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e036771fb14b744a549610/lava-logs.yaml 2026-04-16 01:10:23,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:23,840 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:23,841 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e036771fb14b744a549610/lava_callback.json.gz 2026-04-16 01:10:23,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:23,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036771fb14b744a549610 HTTP/1.1" 200 None 2026-04-16 01:10:23,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:23,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:10:23,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:23,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e036771fb14b744a549610 HTTP/1.1" 200 None 2026-04-16 01:10:23,941 - lava_callback - INFO - Completed processing callback for node 69e036771fb14b744a549610 2026-04-16 01:10:24,382 - lava_callback - INFO - Received callback for node 69e0367b1fb14b744a54961d INFO: 172.21.0.1:41768 - "POST /node/69e0367b1fb14b744a54961d HTTP/1.0" 202 Accepted 2026-04-16 01:10:24,389 - lava_callback - INFO - Starting async job submit for node 69e0367b1fb14b744a54961d 2026-04-16 01:10:24,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:24,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0367b1fb14b744a54961d HTTP/1.1" 200 None 2026-04-16 01:10:24,428 - lava_callback - DEBUG - Processing node 69e0367b1fb14b744a54961d: baseline-nfs-arm64 2026-04-16 01:10:24,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:24,883 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:24,884 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e0367b1fb14b744a54961d/log.txt.gz 2026-04-16 01:10:25,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:25,260 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:25,262 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e0367b1fb14b744a54961d/lava-logs.yaml 2026-04-16 01:10:25,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:25,400 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:25,402 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e0367b1fb14b744a54961d/lava_callback.json.gz 2026-04-16 01:10:25,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:25,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0367b1fb14b744a54961d HTTP/1.1" 200 None 2026-04-16 01:10:25,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:25,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:10:25,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:25,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e0367b1fb14b744a54961d HTTP/1.1" 200 None 2026-04-16 01:10:25,488 - lava_callback - INFO - Completed processing callback for node 69e0367b1fb14b744a54961d INFO: 172.21.0.1:41778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41790 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:10:29,481 - lava_callback - INFO - Received callback for node 69dd93f1c2164e674d71ff01 INFO: 172.21.0.1:41792 - "POST /node/69dd93f1c2164e674d71ff01 HTTP/1.0" 202 Accepted 2026-04-16 01:10:29,487 - lava_callback - INFO - Starting async job submit for node 69dd93f1c2164e674d71ff01 2026-04-16 01:10:29,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:29,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd93f1c2164e674d71ff01 HTTP/1.1" 200 None 2026-04-16 01:10:29,505 - lava_callback - DEBUG - Processing node 69dd93f1c2164e674d71ff01: baseline-arm-clabbe 2026-04-16 01:10:29,505 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd93f1c2164e674d71ff01 2026-04-16 01:10:29,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:29,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd93f1c2164e674d71ff01 HTTP/1.1" 200 None 2026-04-16 01:10:29,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:29,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 01:10:29,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:29,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd93f1c2164e674d71ff01 HTTP/1.1" 200 None 2026-04-16 01:10:29,554 - lava_callback - ERROR - Error processing callback for node 69dd93f1c2164e674d71ff01: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 01:10:31,559 - lava_callback - INFO - Received callback for node 69e036781fb14b744a549613 INFO: 172.21.0.1:35246 - "POST /node/69e036781fb14b744a549613 HTTP/1.0" 202 Accepted 2026-04-16 01:10:31,566 - lava_callback - INFO - Starting async job submit for node 69e036781fb14b744a549613 2026-04-16 01:10:31,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:31,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036781fb14b744a549613 HTTP/1.1" 200 None 2026-04-16 01:10:31,604 - lava_callback - DEBUG - Processing node 69e036781fb14b744a549613: baseline-nfs-arm64 2026-04-16 01:10:32,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:32,181 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:32,182 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e036781fb14b744a549613/log.txt.gz 2026-04-16 01:10:32,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:32,666 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:32,668 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e036781fb14b744a549613/lava-logs.yaml 2026-04-16 01:10:32,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:32,836 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:32,838 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e036781fb14b744a549613/lava_callback.json.gz 2026-04-16 01:10:32,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:32,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036781fb14b744a549613 HTTP/1.1" 200 None 2026-04-16 01:10:32,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:32,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:10:32,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:32,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e036781fb14b744a549613 HTTP/1.1" 200 None 2026-04-16 01:10:32,923 - lava_callback - INFO - Completed processing callback for node 69e036781fb14b744a549613 2026-04-16 01:10:34,765 - lava_callback - INFO - Received callback for node 69e0367d1fb14b744a549625 INFO: 172.21.0.1:35248 - "POST /node/69e0367d1fb14b744a549625 HTTP/1.0" 202 Accepted 2026-04-16 01:10:34,772 - lava_callback - INFO - Starting async job submit for node 69e0367d1fb14b744a549625 2026-04-16 01:10:34,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:34,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0367d1fb14b744a549625 HTTP/1.1" 200 None 2026-04-16 01:10:34,811 - lava_callback - DEBUG - Processing node 69e0367d1fb14b744a549625: baseline-nfs-arm64 2026-04-16 01:10:35,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:35,295 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:35,297 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e0367d1fb14b744a549625/log.txt.gz 2026-04-16 01:10:35,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:35,707 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:35,709 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e0367d1fb14b744a549625/lava-logs.yaml 2026-04-16 01:10:35,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:35,876 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:35,878 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e0367d1fb14b744a549625/lava_callback.json.gz 2026-04-16 01:10:35,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:35,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0367d1fb14b744a549625 HTTP/1.1" 200 None 2026-04-16 01:10:35,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:35,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:10:35,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:35,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e0367d1fb14b744a549625 HTTP/1.1" 200 None 2026-04-16 01:10:35,972 - lava_callback - INFO - Completed processing callback for node 69e0367d1fb14b744a549625 INFO: 172.21.0.1:35250 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:10:38,121 - lava_callback - INFO - Received callback for node 69e0360e1fb14b744a54955e INFO: 172.21.0.1:35266 - "POST /node/69e0360e1fb14b744a54955e HTTP/1.0" 202 Accepted 2026-04-16 01:10:38,128 - lava_callback - INFO - Starting async job submit for node 69e0360e1fb14b744a54955e 2026-04-16 01:10:38,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:38,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:38,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0360e1fb14b744a54955e HTTP/1.1" 200 None 2026-04-16 01:10:38,177 - lava_callback - DEBUG - Processing node 69e0360e1fb14b744a54955e: ltp-cve 2026-04-16 01:10:38,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-16 01:10:38,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:38,693 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:38,694 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cve-69e0360e1fb14b744a54955e/log.txt.gz 2026-04-16 01:10:38,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:39,109 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:39,112 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cve-69e0360e1fb14b744a54955e/lava-logs.yaml 2026-04-16 01:10:39,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:39,271 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:39,273 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cve-69e0360e1fb14b744a54955e/lava_callback.json.gz 2026-04-16 01:10:39,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:39,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0360e1fb14b744a54955e HTTP/1.1" 200 None 2026-04-16 01:10:39,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:39,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 01:10:39,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:39,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e0360e1fb14b744a54955e HTTP/1.1" 200 None 2026-04-16 01:10:39,358 - lava_callback - INFO - Completed processing callback for node 69e0360e1fb14b744a54955e 2026-04-16 01:10:39,576 - lava_callback - INFO - Received callback for node 69e036901fb14b744a549680 INFO: 172.21.0.1:35268 - "POST /node/69e036901fb14b744a549680 HTTP/1.0" 202 Accepted 2026-04-16 01:10:39,586 - lava_callback - INFO - Starting async job submit for node 69e036901fb14b744a549680 2026-04-16 01:10:39,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:39,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036901fb14b744a549680 HTTP/1.1" 200 None 2026-04-16 01:10:39,635 - lava_callback - DEBUG - Processing node 69e036901fb14b744a549680: baseline-arm64-broonie 2026-04-16 01:10:39,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:40,032 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:40,033 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e036901fb14b744a549680/log.txt.gz 2026-04-16 01:10:40,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:40,399 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:40,401 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e036901fb14b744a549680/lava-logs.yaml 2026-04-16 01:10:40,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:40,542 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:40,543 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e036901fb14b744a549680/lava_callback.json.gz 2026-04-16 01:10:40,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:40,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036901fb14b744a549680 HTTP/1.1" 200 None 2026-04-16 01:10:40,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:40,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:10:40,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:40,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e036901fb14b744a549680 HTTP/1.1" 200 None 2026-04-16 01:10:40,620 - lava_callback - INFO - Completed processing callback for node 69e036901fb14b744a549680 2026-04-16 01:10:40,947 - lava_callback - INFO - Received callback for node 69e0369a1fb14b744a5496a1 INFO: 172.21.0.1:59454 - "POST /node/69e0369a1fb14b744a5496a1 HTTP/1.0" 202 Accepted 2026-04-16 01:10:40,953 - lava_callback - INFO - Starting async job submit for node 69e0369a1fb14b744a5496a1 2026-04-16 01:10:40,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:41,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0369a1fb14b744a5496a1 HTTP/1.1" 200 None 2026-04-16 01:10:41,012 - lava_callback - DEBUG - Processing node 69e0369a1fb14b744a5496a1: baseline-arm64-broonie 2026-04-16 01:10:41,069 - lava_callback - INFO - Received callback for node 69e036911fb14b744a549683 INFO: 172.21.0.1:59456 - "POST /node/69e036911fb14b744a549683 HTTP/1.0" 202 Accepted 2026-04-16 01:10:41,103 - lava_callback - INFO - Starting async job submit for node 69e036911fb14b744a549683 2026-04-16 01:10:41,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:41,164 - lava_callback - INFO - Received callback for node 69e0367f1fb14b744a54962c INFO: 172.21.0.1:59464 - "POST /node/69e0367f1fb14b744a54962c HTTP/1.0" 202 Accepted 2026-04-16 01:10:41,182 - lava_callback - INFO - Starting async job submit for node 69e0367f1fb14b744a54962c 2026-04-16 01:10:41,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:41,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036911fb14b744a549683 HTTP/1.1" 200 None 2026-04-16 01:10:41,341 - lava_callback - DEBUG - Processing node 69e036911fb14b744a549683: baseline-arm64-broonie 2026-04-16 01:10:41,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0367f1fb14b744a54962c HTTP/1.1" 200 None 2026-04-16 01:10:41,528 - lava_callback - DEBUG - Processing node 69e0367f1fb14b744a54962c: baseline-nfs-arm64 2026-04-16 01:10:41,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:41,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:41,993 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:42,046 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e0369a1fb14b744a5496a1/log.txt.gz 2026-04-16 01:10:42,179 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:42,311 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e036911fb14b744a549683/log.txt.gz 2026-04-16 01:10:42,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:42,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:42,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:42,638 - lava_callback - INFO - Received callback for node 69e036961fb14b744a549698 2026-04-16 01:10:42,648 - lava_callback - INFO - Starting async job submit for node 69e036961fb14b744a549698 INFO: 172.21.0.1:59470 - "POST /node/69e036961fb14b744a549698 HTTP/1.0" 202 Accepted 2026-04-16 01:10:42,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:42,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036961fb14b744a549698 HTTP/1.1" 200 None 2026-04-16 01:10:42,698 - lava_callback - DEBUG - Processing node 69e036961fb14b744a549698: baseline-arm64-broonie 2026-04-16 01:10:42,723 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:42,771 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e0367f1fb14b744a54962c/log.txt.gz 2026-04-16 01:10:42,778 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:42,865 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:42,896 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e0369a1fb14b744a5496a1/lava-logs.yaml 2026-04-16 01:10:43,057 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e036911fb14b744a549683/lava-logs.yaml 2026-04-16 01:10:43,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:43,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:43,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:43,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:43,457 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:43,459 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e036961fb14b744a549698/log.txt.gz 2026-04-16 01:10:43,476 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:43,486 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:43,511 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e0369a1fb14b744a5496a1/lava_callback.json.gz 2026-04-16 01:10:43,512 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e036911fb14b744a549683/lava_callback.json.gz 2026-04-16 01:10:43,567 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:43,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:43,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:43,603 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e0367f1fb14b744a54962c/lava-logs.yaml 2026-04-16 01:10:43,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:43,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0369a1fb14b744a5496a1 HTTP/1.1" 200 None 2026-04-16 01:10:43,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:43,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:43,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036911fb14b744a549683 HTTP/1.1" 200 None 2026-04-16 01:10:43,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:43,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:10:43,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:10:43,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:43,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:43,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e0369a1fb14b744a5496a1 HTTP/1.1" 200 None 2026-04-16 01:10:43,755 - lava_callback - INFO - Completed processing callback for node 69e0369a1fb14b744a5496a1 2026-04-16 01:10:43,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e036911fb14b744a549683 HTTP/1.1" 200 None 2026-04-16 01:10:43,807 - lava_callback - INFO - Completed processing callback for node 69e036911fb14b744a549683 2026-04-16 01:10:43,960 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:43,962 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e0367f1fb14b744a54962c/lava_callback.json.gz 2026-04-16 01:10:44,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:44,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0367f1fb14b744a54962c HTTP/1.1" 200 None 2026-04-16 01:10:44,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:44,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:10:44,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:44,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e0367f1fb14b744a54962c HTTP/1.1" 200 None 2026-04-16 01:10:44,079 - lava_callback - INFO - Completed processing callback for node 69e0367f1fb14b744a54962c 2026-04-16 01:10:44,080 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:44,083 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e036961fb14b744a549698/lava-logs.yaml 2026-04-16 01:10:44,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:44,269 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:44,271 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e036961fb14b744a549698/lava_callback.json.gz 2026-04-16 01:10:44,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:44,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036961fb14b744a549698 HTTP/1.1" 200 None 2026-04-16 01:10:44,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:44,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:10:44,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:44,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e036961fb14b744a549698 HTTP/1.1" 200 None 2026-04-16 01:10:44,371 - lava_callback - INFO - Completed processing callback for node 69e036961fb14b744a549698 2026-04-16 01:10:46,405 - lava_callback - INFO - Received callback for node 69e036671fb14b744a5495e8 INFO: 172.21.0.1:59482 - "POST /node/69e036671fb14b744a5495e8 HTTP/1.0" 202 Accepted 2026-04-16 01:10:46,411 - lava_callback - INFO - Starting async job submit for node 69e036671fb14b744a5495e8 2026-04-16 01:10:46,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:46,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036671fb14b744a5495e8 HTTP/1.1" 200 None 2026-04-16 01:10:46,451 - lava_callback - DEBUG - Processing node 69e036671fb14b744a5495e8: baseline-arm64 INFO: 172.21.0.1:59488 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:10:46,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:46,892 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:46,894 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e036671fb14b744a5495e8/log.txt.gz 2026-04-16 01:10:47,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:47,353 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:47,356 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e036671fb14b744a5495e8/lava-logs.yaml 2026-04-16 01:10:47,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:47,515 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:47,517 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e036671fb14b744a5495e8/lava_callback.json.gz 2026-04-16 01:10:47,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:47,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036671fb14b744a5495e8 HTTP/1.1" 200 None 2026-04-16 01:10:47,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:47,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:10:47,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:47,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e036671fb14b744a5495e8 HTTP/1.1" 200 None 2026-04-16 01:10:47,652 - lava_callback - INFO - Completed processing callback for node 69e036671fb14b744a5495e8 INFO: 172.21.0.1:33470 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:11:00,934 - lava_callback - INFO - Received callback for node 69e0368e1fb14b744a549679 INFO: 172.21.0.1:59866 - "POST /node/69e0368e1fb14b744a549679 HTTP/1.0" 202 Accepted 2026-04-16 01:11:00,940 - lava_callback - INFO - Starting async job submit for node 69e0368e1fb14b744a549679 2026-04-16 01:11:00,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:11:01,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0368e1fb14b744a549679 HTTP/1.1" 200 None 2026-04-16 01:11:01,003 - lava_callback - DEBUG - Processing node 69e0368e1fb14b744a549679: baseline-arm64-broonie 2026-04-16 01:11:01,063 - lava_callback - INFO - Received callback for node 69e037111fb14b744a549860 INFO: 172.21.0.1:59870 - "POST /node/69e037111fb14b744a549860 HTTP/1.0" 202 Accepted 2026-04-16 01:11:01,085 - lava_callback - INFO - Starting async job submit for node 69e037111fb14b744a549860 2026-04-16 01:11:01,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:11:01,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e037111fb14b744a549860 HTTP/1.1" 200 None 2026-04-16 01:11:01,182 - lava_callback - DEBUG - Processing node 69e037111fb14b744a549860: baseline-arm 2026-04-16 01:11:01,243 - lava_callback - WARNING - Failed to upload log 2026-04-16 01:11:01,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:11:01,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:11:01,408 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:11:01,410 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e0368e1fb14b744a549679/log.txt.gz 2026-04-16 01:11:01,437 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:11:01,468 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e037111fb14b744a549860/lava-logs.yaml 2026-04-16 01:11:01,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:11:01,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:11:01,710 - lava_callback - INFO - Received callback for node 69e036721fb14b744a549604 2026-04-16 01:11:01,716 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 INFO: 172.21.0.1:59882 - "POST /node/69e036721fb14b744a549604 HTTP/1.0" 202 Accepted 2026-04-16 01:11:01,722 - lava_callback - INFO - Starting async job submit for node 69e036721fb14b744a549604 2026-04-16 01:11:01,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:11:01,750 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e037111fb14b744a549860/lava_callback.json.gz 2026-04-16 01:11:01,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:11:01,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036721fb14b744a549604 HTTP/1.1" 200 None 2026-04-16 01:11:01,771 - lava_callback - DEBUG - Processing node 69e036721fb14b744a549604: baseline-nfs-arm64 2026-04-16 01:11:01,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e037111fb14b744a549860 HTTP/1.1" 200 None 2026-04-16 01:11:01,809 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:11:01,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:11:01,852 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e0368e1fb14b744a549679/lava-logs.yaml 2026-04-16 01:11:01,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 01:11:01,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:11:01,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:11:02,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e037111fb14b744a549860 HTTP/1.1" 200 None 2026-04-16 01:11:02,133 - lava_callback - INFO - Completed processing callback for node 69e037111fb14b744a549860 2026-04-16 01:11:02,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:11:02,365 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:11:02,366 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e0368e1fb14b744a549679/lava_callback.json.gz 2026-04-16 01:11:02,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:11:02,395 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:11:02,397 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e036721fb14b744a549604/log.txt.gz 2026-04-16 01:11:02,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0368e1fb14b744a549679 HTTP/1.1" 200 None 2026-04-16 01:11:02,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:11:02,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:11:02,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:11:02,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:11:02,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e0368e1fb14b744a549679 HTTP/1.1" 200 None 2026-04-16 01:11:02,610 - lava_callback - INFO - Completed processing callback for node 69e0368e1fb14b744a549679 2026-04-16 01:11:02,851 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:11:02,853 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e036721fb14b744a549604/lava-logs.yaml 2026-04-16 01:11:02,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:11:03,019 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:11:03,021 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e036721fb14b744a549604/lava_callback.json.gz 2026-04-16 01:11:03,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:11:03,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036721fb14b744a549604 HTTP/1.1" 200 None 2026-04-16 01:11:03,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:11:03,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:11:03,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:11:03,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e036721fb14b744a549604 HTTP/1.1" 200 None 2026-04-16 01:11:03,103 - lava_callback - INFO - Completed processing callback for node 69e036721fb14b744a549604 INFO: 172.21.0.1:59888 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:11:08,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:11:08,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:58550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58562 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:11:25,682 - lava_callback - INFO - Received callback for node 69e036741fb14b744a54960a INFO: 172.21.0.1:33554 - "POST /node/69e036741fb14b744a54960a HTTP/1.0" 202 Accepted 2026-04-16 01:11:25,689 - lava_callback - INFO - Starting async job submit for node 69e036741fb14b744a54960a 2026-04-16 01:11:25,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:11:25,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036741fb14b744a54960a HTTP/1.1" 200 None 2026-04-16 01:11:25,727 - lava_callback - DEBUG - Processing node 69e036741fb14b744a54960a: baseline-nfs-arm64 2026-04-16 01:11:26,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:11:26,164 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:11:26,166 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e036741fb14b744a54960a/log.txt.gz 2026-04-16 01:11:26,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:33566 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:11:26,557 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:11:26,559 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e036741fb14b744a54960a/lava-logs.yaml 2026-04-16 01:11:26,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:11:26,696 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:11:26,698 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e036741fb14b744a54960a/lava_callback.json.gz 2026-04-16 01:11:26,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:11:26,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036741fb14b744a54960a HTTP/1.1" 200 None 2026-04-16 01:11:26,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:11:26,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:11:26,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:11:26,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e036741fb14b744a54960a HTTP/1.1" 200 None 2026-04-16 01:11:26,813 - lava_callback - INFO - Completed processing callback for node 69e036741fb14b744a54960a INFO: 172.21.0.1:33576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54474 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:11:38,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:11:38,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35688 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:12:09,580 - lava_callback - INFO - Received callback for node 69dd945fc2164e674d71ff6b INFO: 172.21.0.1:35704 - "POST /node/69dd945fc2164e674d71ff6b HTTP/1.0" 202 Accepted 2026-04-16 01:12:09,586 - lava_callback - INFO - Starting async job submit for node 69dd945fc2164e674d71ff6b 2026-04-16 01:12:09,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:12:09,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd945fc2164e674d71ff6b HTTP/1.1" 200 None 2026-04-16 01:12:09,601 - lava_callback - DEBUG - Processing node 69dd945fc2164e674d71ff6b: baseline-arm-clabbe 2026-04-16 01:12:09,602 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd945fc2164e674d71ff6b 2026-04-16 01:12:09,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:12:09,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd945fc2164e674d71ff6b HTTP/1.1" 200 None 2026-04-16 01:12:09,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:12:09,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 01:12:09,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:12:09,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd945fc2164e674d71ff6b HTTP/1.1" 200 None 2026-04-16 01:12:09,664 - lava_callback - ERROR - Error processing callback for node 69dd945fc2164e674d71ff6b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34726 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:12:20,703 - lava_callback - INFO - Received callback for node 69e036931fb14b744a549688 INFO: 172.21.0.1:45870 - "POST /node/69e036931fb14b744a549688 HTTP/1.0" 202 Accepted 2026-04-16 01:12:20,709 - lava_callback - INFO - Starting async job submit for node 69e036931fb14b744a549688 2026-04-16 01:12:20,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:12:20,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036931fb14b744a549688 HTTP/1.1" 200 None 2026-04-16 01:12:20,749 - lava_callback - DEBUG - Processing node 69e036931fb14b744a549688: baseline-arm64-broonie 2026-04-16 01:12:21,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:12:21,197 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:12:21,198 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e036931fb14b744a549688/log.txt.gz 2026-04-16 01:12:21,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:12:21,597 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:12:21,599 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e036931fb14b744a549688/lava-logs.yaml 2026-04-16 01:12:21,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:12:21,779 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:12:21,781 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e036931fb14b744a549688/lava_callback.json.gz 2026-04-16 01:12:21,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:12:21,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036931fb14b744a549688 HTTP/1.1" 200 None 2026-04-16 01:12:21,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:12:21,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:12:21,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:12:21,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e036931fb14b744a549688 HTTP/1.1" 200 None 2026-04-16 01:12:21,876 - lava_callback - INFO - Completed processing callback for node 69e036931fb14b744a549688 2026-04-16 01:12:22,433 - lava_callback - INFO - Received callback for node 69e036641fb14b744a5495df INFO: 172.21.0.1:45874 - "POST /node/69e036641fb14b744a5495df HTTP/1.0" 202 Accepted 2026-04-16 01:12:22,440 - lava_callback - INFO - Starting async job submit for node 69e036641fb14b744a5495df 2026-04-16 01:12:22,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:12:22,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036641fb14b744a5495df HTTP/1.1" 200 None 2026-04-16 01:12:22,475 - lava_callback - DEBUG - Processing node 69e036641fb14b744a5495df: baseline-arm64 2026-04-16 01:12:22,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:12:22,971 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:12:22,973 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e036641fb14b744a5495df/log.txt.gz 2026-04-16 01:12:23,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:12:23,357 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:12:23,359 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e036641fb14b744a5495df/lava-logs.yaml 2026-04-16 01:12:23,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:12:23,688 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:12:23,689 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e036641fb14b744a5495df/lava_callback.json.gz 2026-04-16 01:12:23,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:12:23,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036641fb14b744a5495df HTTP/1.1" 200 None 2026-04-16 01:12:23,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:12:23,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:12:23,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:12:23,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e036641fb14b744a5495df HTTP/1.1" 200 None 2026-04-16 01:12:23,761 - lava_callback - INFO - Completed processing callback for node 69e036641fb14b744a5495df INFO: 172.21.0.1:45886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35828 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:12:38,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:12:38,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52958 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:12:49,608 - lava_callback - INFO - Received callback for node 69dd9485c2164e674d71ff9e INFO: 172.21.0.1:52972 - "POST /node/69dd9485c2164e674d71ff9e HTTP/1.0" 202 Accepted 2026-04-16 01:12:49,614 - lava_callback - INFO - Starting async job submit for node 69dd9485c2164e674d71ff9e 2026-04-16 01:12:49,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:12:49,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9485c2164e674d71ff9e HTTP/1.1" 200 None 2026-04-16 01:12:49,629 - lava_callback - DEBUG - Processing node 69dd9485c2164e674d71ff9e: baseline-arm-clabbe 2026-04-16 01:12:49,629 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9485c2164e674d71ff9e 2026-04-16 01:12:49,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:12:49,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9485c2164e674d71ff9e HTTP/1.1" 200 None 2026-04-16 01:12:49,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:12:49,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 01:12:49,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:12:49,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9485c2164e674d71ff9e HTTP/1.1" 200 None 2026-04-16 01:12:49,686 - lava_callback - ERROR - Error processing callback for node 69dd9485c2164e674d71ff9e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45636 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:13:28,508 - lava_callback - INFO - Received callback for node 69e036731fb14b744a549607 INFO: 172.21.0.1:45652 - "POST /node/69e036731fb14b744a549607 HTTP/1.0" 202 Accepted 2026-04-16 01:13:28,518 - lava_callback - INFO - Starting async job submit for node 69e036731fb14b744a549607 2026-04-16 01:13:28,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:13:28,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036731fb14b744a549607 HTTP/1.1" 200 None 2026-04-16 01:13:28,574 - lava_callback - DEBUG - Processing node 69e036731fb14b744a549607: baseline-nfs-arm64 2026-04-16 01:13:29,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:13:29,301 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:13:29,303 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e036731fb14b744a549607/log.txt.gz INFO: 172.21.0.1:45656 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:13:29,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:13:29,662 - lava_callback - INFO - Received callback for node 69dd94a6c2164e674d71ffcb INFO: 172.21.0.1:45662 - "POST /node/69dd94a6c2164e674d71ffcb HTTP/1.0" 202 Accepted 2026-04-16 01:13:29,669 - lava_callback - INFO - Starting async job submit for node 69dd94a6c2164e674d71ffcb 2026-04-16 01:13:29,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:13:29,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd94a6c2164e674d71ffcb HTTP/1.1" 200 None 2026-04-16 01:13:29,688 - lava_callback - DEBUG - Processing node 69dd94a6c2164e674d71ffcb: baseline-arm-clabbe 2026-04-16 01:13:29,689 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd94a6c2164e674d71ffcb 2026-04-16 01:13:29,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:13:29,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd94a6c2164e674d71ffcb HTTP/1.1" 200 None 2026-04-16 01:13:29,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:13:29,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 01:13:29,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:13:29,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd94a6c2164e674d71ffcb HTTP/1.1" 200 None 2026-04-16 01:13:29,746 - lava_callback - ERROR - Error processing callback for node 69dd94a6c2164e674d71ffcb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 01:13:29,860 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:13:29,863 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e036731fb14b744a549607/lava-logs.yaml 2026-04-16 01:13:29,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:13:30,067 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:13:30,068 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e036731fb14b744a549607/lava_callback.json.gz 2026-04-16 01:13:30,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:13:30,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036731fb14b744a549607 HTTP/1.1" 200 None 2026-04-16 01:13:30,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:13:30,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:13:30,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:13:30,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e036731fb14b744a549607 HTTP/1.1" 200 None 2026-04-16 01:13:30,146 - lava_callback - INFO - Completed processing callback for node 69e036731fb14b744a549607 INFO: 172.21.0.1:51452 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:13:38,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:13:38,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-16 01:13:40,947 - lava_callback - INFO - Received callback for node 69e036971fb14b744a54969b INFO: 172.21.0.1:40224 - "POST /node/69e036971fb14b744a54969b HTTP/1.0" 202 Accepted 2026-04-16 01:13:40,954 - lava_callback - INFO - Starting async job submit for node 69e036971fb14b744a54969b 2026-04-16 01:13:41,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:13:41,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036971fb14b744a54969b HTTP/1.1" 200 None 2026-04-16 01:13:41,034 - lava_callback - DEBUG - Processing node 69e036971fb14b744a54969b: baseline-arm64-broonie 2026-04-16 01:13:41,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:13:41,838 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:13:41,839 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e036971fb14b744a54969b/log.txt.gz 2026-04-16 01:13:42,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:13:42,323 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:13:42,325 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e036971fb14b744a54969b/lava-logs.yaml 2026-04-16 01:13:42,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:13:42,664 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:13:42,666 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e036971fb14b744a54969b/lava_callback.json.gz 2026-04-16 01:13:42,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:13:42,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036971fb14b744a54969b HTTP/1.1" 200 None 2026-04-16 01:13:42,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:13:42,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:13:42,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:13:42,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e036971fb14b744a54969b HTTP/1.1" 200 None 2026-04-16 01:13:42,897 - lava_callback - INFO - Completed processing callback for node 69e036971fb14b744a54969b INFO: 172.21.0.1:40228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41628 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:14:08,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:14:08,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51198 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:14:19,284 - lava_callback - INFO - Received callback for node 69e036701fb14b744a549601 INFO: 172.21.0.1:51200 - "POST /node/69e036701fb14b744a549601 HTTP/1.0" 202 Accepted 2026-04-16 01:14:19,291 - lava_callback - INFO - Starting async job submit for node 69e036701fb14b744a549601 2026-04-16 01:14:19,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:14:19,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036701fb14b744a549601 HTTP/1.1" 200 None 2026-04-16 01:14:19,351 - lava_callback - DEBUG - Processing node 69e036701fb14b744a549601: baseline-arm64 2026-04-16 01:14:19,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:14:19,888 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:14:19,889 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e036701fb14b744a549601/log.txt.gz 2026-04-16 01:14:20,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:14:20,292 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:14:20,294 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e036701fb14b744a549601/lava-logs.yaml 2026-04-16 01:14:20,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:14:20,470 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:14:20,472 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e036701fb14b744a549601/lava_callback.json.gz DEBUG: Setup failed for 69e036701fb14b744a549601. Transitting job node result: incomplete -> fail 2026-04-16 01:14:20,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:14:20,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036701fb14b744a549601 HTTP/1.1" 200 None 2026-04-16 01:14:20,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:14:20,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:14:20,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:14:20,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e036701fb14b744a549601 HTTP/1.1" 200 None 2026-04-16 01:14:20,701 - lava_callback - INFO - Completed processing callback for node 69e036701fb14b744a549601 INFO: 172.21.0.1:47478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41916 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:14:38,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:14:38,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42254 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57616 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:18:14,124 - lava_callback - INFO - Received callback for node 69e036611fb14b744a5495b8 INFO: 172.21.0.1:41056 - "POST /node/69e036611fb14b744a5495b8 HTTP/1.0" 202 Accepted 2026-04-16 01:18:14,130 - lava_callback - INFO - Starting async job submit for node 69e036611fb14b744a5495b8 2026-04-16 01:18:14,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:18:14,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036611fb14b744a5495b8 HTTP/1.1" 200 None 2026-04-16 01:18:14,176 - lava_callback - DEBUG - Processing node 69e036611fb14b744a5495b8: baseline-arm64 2026-04-16 01:18:14,315 - lava_callback - WARNING - Failed to upload log 2026-04-16 01:18:14,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:18:14,732 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:18:14,734 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e036611fb14b744a5495b8/lava-logs.yaml 2026-04-16 01:18:14,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:18:14,867 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:18:14,868 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e036611fb14b744a5495b8/lava_callback.json.gz 2026-04-16 01:18:14,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:18:14,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036611fb14b744a5495b8 HTTP/1.1" 200 None 2026-04-16 01:18:14,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:18:14,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:18:14,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:18:14,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e036611fb14b744a5495b8 HTTP/1.1" 200 None 2026-04-16 01:18:15,025 - lava_callback - INFO - Completed processing callback for node 69e036611fb14b744a5495b8 INFO: 172.21.0.1:41058 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59834 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:18:38,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:18:38,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52776 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-16 01:19:16,345 - lava_callback - INFO - Received callback for node 69e036621fb14b744a5495bb INFO: 172.21.0.1:52790 - "POST /node/69e036621fb14b744a5495bb HTTP/1.0" 202 Accepted 2026-04-16 01:19:16,352 - lava_callback - INFO - Starting async job submit for node 69e036621fb14b744a5495bb 2026-04-16 01:19:16,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:19:16,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036621fb14b744a5495bb HTTP/1.1" 200 None 2026-04-16 01:19:16,417 - lava_callback - DEBUG - Processing node 69e036621fb14b744a5495bb: baseline-arm64 INFO: 172.21.0.1:52802 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:19:16,563 - lava_callback - WARNING - Failed to upload log 2026-04-16 01:19:16,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:19:17,038 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:19:17,040 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e036621fb14b744a5495bb/lava-logs.yaml 2026-04-16 01:19:17,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:19:17,185 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:19:17,187 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e036621fb14b744a5495bb/lava_callback.json.gz 2026-04-16 01:19:17,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:19:17,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036621fb14b744a5495bb HTTP/1.1" 200 None 2026-04-16 01:19:17,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:19:17,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:19:17,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:19:17,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e036621fb14b744a5495bb HTTP/1.1" 200 None 2026-04-16 01:19:17,341 - lava_callback - INFO - Completed processing callback for node 69e036621fb14b744a5495bb INFO: 172.21.0.1:43754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42562 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:19:38,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:19:38,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48844 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:23:11,686 - lava_callback - INFO - Received callback for node 69e036681fb14b744a5495eb INFO: 172.21.0.1:51916 - "POST /node/69e036681fb14b744a5495eb HTTP/1.0" 202 Accepted 2026-04-16 01:23:11,694 - lava_callback - INFO - Starting async job submit for node 69e036681fb14b744a5495eb 2026-04-16 01:23:11,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:23:11,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036681fb14b744a5495eb HTTP/1.1" 200 None 2026-04-16 01:23:11,770 - lava_callback - DEBUG - Processing node 69e036681fb14b744a5495eb: baseline-arm64 2026-04-16 01:23:12,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:23:13,018 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:23:13,020 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e036681fb14b744a5495eb/log.txt.gz 2026-04-16 01:23:13,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:23:13,878 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:23:13,880 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e036681fb14b744a5495eb/lava-logs.yaml 2026-04-16 01:23:13,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:23:14,093 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:23:14,095 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e036681fb14b744a5495eb/lava_callback.json.gz 2026-04-16 01:23:14,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:23:14,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036681fb14b744a5495eb HTTP/1.1" 200 None 2026-04-16 01:23:14,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:23:14,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:23:14,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:23:14,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e036681fb14b744a5495eb HTTP/1.1" 200 None 2026-04-16 01:23:14,321 - lava_callback - INFO - Completed processing callback for node 69e036681fb14b744a5495eb INFO: 172.21.0.1:51930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53410 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:23:38,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:23:38,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50438 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:24:35,336 - lava_callback - INFO - Received callback for node 69dd9741c2164e674d720306 INFO: 172.21.0.1:34172 - "POST /node/69dd9741c2164e674d720306 HTTP/1.0" 202 Accepted 2026-04-16 01:24:35,341 - lava_callback - INFO - Starting async job submit for node 69dd9741c2164e674d720306 2026-04-16 01:24:35,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:24:35,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9741c2164e674d720306 HTTP/1.1" 200 None 2026-04-16 01:24:35,359 - lava_callback - DEBUG - Processing node 69dd9741c2164e674d720306: baseline-arm64-baylibre 2026-04-16 01:24:35,359 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9741c2164e674d720306 2026-04-16 01:24:35,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:24:35,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9741c2164e674d720306 HTTP/1.1" 200 None 2026-04-16 01:24:35,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:24:35,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-16 01:24:35,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:24:35,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9741c2164e674d720306 HTTP/1.1" 200 None 2026-04-16 01:24:35,413 - lava_callback - ERROR - Error processing callback for node 69dd9741c2164e674d720306: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33024 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:25:55,310 - lava_callback - INFO - Received callback for node 69dd9791c2164e674d720364 INFO: 172.21.0.1:41978 - "POST /node/69dd9791c2164e674d720364 HTTP/1.0" 202 Accepted 2026-04-16 01:25:55,316 - lava_callback - INFO - Starting async job submit for node 69dd9791c2164e674d720364 2026-04-16 01:25:55,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:25:55,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9791c2164e674d720364 HTTP/1.1" 200 None 2026-04-16 01:25:55,332 - lava_callback - DEBUG - Processing node 69dd9791c2164e674d720364: baseline-arm64-baylibre 2026-04-16 01:25:55,332 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9791c2164e674d720364 2026-04-16 01:25:55,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:25:55,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9791c2164e674d720364 HTTP/1.1" 200 None 2026-04-16 01:25:55,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:25:55,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-16 01:25:55,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:25:55,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9791c2164e674d720364 HTTP/1.1" 200 None 2026-04-16 01:25:55,384 - lava_callback - ERROR - Error processing callback for node 69dd9791c2164e674d720364: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41776 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-16 01:27:15,388 - lava_callback - INFO - Received callback for node 69dd97e3c2164e674d720385 INFO: 172.21.0.1:41784 - "POST /node/69dd97e3c2164e674d720385 HTTP/1.0" 202 Accepted 2026-04-16 01:27:15,394 - lava_callback - INFO - Starting async job submit for node 69dd97e3c2164e674d720385 2026-04-16 01:27:15,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:27:15,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd97e3c2164e674d720385 HTTP/1.1" 200 None 2026-04-16 01:27:15,409 - lava_callback - DEBUG - Processing node 69dd97e3c2164e674d720385: baseline-arm64-baylibre 2026-04-16 01:27:15,409 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd97e3c2164e674d720385 2026-04-16 01:27:15,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:27:15,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd97e3c2164e674d720385 HTTP/1.1" 200 None 2026-04-16 01:27:15,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:27:15,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-16 01:27:15,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:27:15,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd97e3c2164e674d720385 HTTP/1.1" 200 None 2026-04-16 01:27:15,457 - lava_callback - ERROR - Error processing callback for node 69dd97e3c2164e674d720385: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45016 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:27:51,634 - lava_callback - INFO - Received callback for node 69e0366c1fb14b744a5495f4 INFO: 172.21.0.1:55726 - "POST /node/69e0366c1fb14b744a5495f4 HTTP/1.0" 202 Accepted 2026-04-16 01:27:51,640 - lava_callback - INFO - Starting async job submit for node 69e0366c1fb14b744a5495f4 2026-04-16 01:27:51,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:27:51,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0366c1fb14b744a5495f4 HTTP/1.1" 200 None 2026-04-16 01:27:51,680 - lava_callback - DEBUG - Processing node 69e0366c1fb14b744a5495f4: baseline-arm64 2026-04-16 01:27:52,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:27:52,365 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:27:52,367 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e0366c1fb14b744a5495f4/log.txt.gz 2026-04-16 01:27:52,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:27:52,846 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:27:52,848 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e0366c1fb14b744a5495f4/lava-logs.yaml 2026-04-16 01:27:52,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:27:53,065 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:27:53,067 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e0366c1fb14b744a5495f4/lava_callback.json.gz 2026-04-16 01:27:53,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:27:53,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0366c1fb14b744a5495f4 HTTP/1.1" 200 None 2026-04-16 01:27:53,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:27:53,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:27:53,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:27:53,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e0366c1fb14b744a5495f4 HTTP/1.1" 200 None 2026-04-16 01:27:53,200 - lava_callback - INFO - Completed processing callback for node 69e0366c1fb14b744a5495f4 INFO: 172.21.0.1:55738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42156 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:28:08,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:28:08,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36336 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:28:35,470 - lava_callback - INFO - Received callback for node 69dd983ac2164e674d7203c5 INFO: 172.21.0.1:57936 - "POST /node/69dd983ac2164e674d7203c5 HTTP/1.0" 202 Accepted 2026-04-16 01:28:35,475 - lava_callback - INFO - Starting async job submit for node 69dd983ac2164e674d7203c5 2026-04-16 01:28:35,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:28:35,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd983ac2164e674d7203c5 HTTP/1.1" 200 None 2026-04-16 01:28:35,503 - lava_callback - DEBUG - Processing node 69dd983ac2164e674d7203c5: baseline-arm64-baylibre 2026-04-16 01:28:35,503 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd983ac2164e674d7203c5 2026-04-16 01:28:35,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:28:35,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd983ac2164e674d7203c5 HTTP/1.1" 200 None 2026-04-16 01:28:35,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:28:35,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-16 01:28:35,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:28:35,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd983ac2164e674d7203c5 HTTP/1.1" 200 None 2026-04-16 01:28:35,551 - lava_callback - ERROR - Error processing callback for node 69dd983ac2164e674d7203c5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57950 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:28:45,944 - lava_callback - INFO - Received callback for node 69e036761fb14b744a54960d INFO: 172.21.0.1:59494 - "POST /node/69e036761fb14b744a54960d HTTP/1.0" 202 Accepted 2026-04-16 01:28:45,952 - lava_callback - INFO - Starting async job submit for node 69e036761fb14b744a54960d 2026-04-16 01:28:45,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:28:46,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036761fb14b744a54960d HTTP/1.1" 200 None 2026-04-16 01:28:46,023 - lava_callback - DEBUG - Processing node 69e036761fb14b744a54960d: baseline-nfs-arm64 INFO: 172.21.0.1:59502 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:28:47,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:28:47,215 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:28:47,216 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e036761fb14b744a54960d/log.txt.gz 2026-04-16 01:28:47,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:28:48,018 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:28:48,021 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e036761fb14b744a54960d/lava-logs.yaml 2026-04-16 01:28:48,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:28:48,254 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:28:48,256 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e036761fb14b744a54960d/lava_callback.json.gz DEBUG: Setup failed for 69e036761fb14b744a54960d. Transitting job node result: incomplete -> fail 2026-04-16 01:28:48,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:28:48,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036761fb14b744a54960d HTTP/1.1" 200 None 2026-04-16 01:28:48,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:28:48,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:28:48,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:28:48,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e036761fb14b744a54960d HTTP/1.1" 200 None 2026-04-16 01:28:48,500 - lava_callback - INFO - Completed processing callback for node 69e036761fb14b744a54960d INFO: 172.21.0.1:39640 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:28:59,093 - lava_callback - INFO - Received callback for node 69e0367c1fb14b744a549622 INFO: 172.21.0.1:39648 - "POST /node/69e0367c1fb14b744a549622 HTTP/1.0" 202 Accepted 2026-04-16 01:28:59,101 - lava_callback - INFO - Starting async job submit for node 69e0367c1fb14b744a549622 2026-04-16 01:28:59,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:28:59,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0367c1fb14b744a549622 HTTP/1.1" 200 None 2026-04-16 01:28:59,150 - lava_callback - DEBUG - Processing node 69e0367c1fb14b744a549622: baseline-nfs-arm64 2026-04-16 01:28:59,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:28:59,932 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:28:59,934 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e0367c1fb14b744a549622/log.txt.gz 2026-04-16 01:29:00,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:29:00,513 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:29:00,515 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e0367c1fb14b744a549622/lava-logs.yaml 2026-04-16 01:29:00,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:29:00,704 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:29:00,706 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e0367c1fb14b744a549622/lava_callback.json.gz 2026-04-16 01:29:00,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:29:00,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0367c1fb14b744a549622 HTTP/1.1" 200 None 2026-04-16 01:29:00,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:29:00,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:29:00,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:29:00,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e0367c1fb14b744a549622 HTTP/1.1" 200 None 2026-04-16 01:29:00,848 - lava_callback - INFO - Completed processing callback for node 69e0367c1fb14b744a549622 INFO: 172.21.0.1:54888 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:29:08,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:29:08,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51498 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:29:55,585 - lava_callback - INFO - Received callback for node 69dd9881c2164e674d72043f INFO: 172.21.0.1:49334 - "POST /node/69dd9881c2164e674d72043f HTTP/1.0" 202 Accepted 2026-04-16 01:29:55,591 - lava_callback - INFO - Starting async job submit for node 69dd9881c2164e674d72043f 2026-04-16 01:29:55,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:29:55,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9881c2164e674d72043f HTTP/1.1" 200 None 2026-04-16 01:29:55,608 - lava_callback - DEBUG - Processing node 69dd9881c2164e674d72043f: baseline-arm64-baylibre 2026-04-16 01:29:55,608 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9881c2164e674d72043f 2026-04-16 01:29:55,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:29:55,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9881c2164e674d72043f HTTP/1.1" 200 None 2026-04-16 01:29:55,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:29:55,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-16 01:29:55,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:29:55,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9881c2164e674d72043f HTTP/1.1" 200 None 2026-04-16 01:29:55,655 - lava_callback - ERROR - Error processing callback for node 69dd9881c2164e674d72043f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40346 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-16 01:31:15,600 - lava_callback - INFO - Received callback for node 69dd98d2c2164e674d720482 INFO: 172.21.0.1:40352 - "POST /node/69dd98d2c2164e674d720482 HTTP/1.0" 202 Accepted 2026-04-16 01:31:15,606 - lava_callback - INFO - Starting async job submit for node 69dd98d2c2164e674d720482 2026-04-16 01:31:15,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:31:15,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd98d2c2164e674d720482 HTTP/1.1" 200 None 2026-04-16 01:31:15,623 - lava_callback - DEBUG - Processing node 69dd98d2c2164e674d720482: baseline-arm64-baylibre 2026-04-16 01:31:15,623 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd98d2c2164e674d720482 2026-04-16 01:31:15,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:31:15,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd98d2c2164e674d720482 HTTP/1.1" 200 None 2026-04-16 01:31:15,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:31:15,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-16 01:31:15,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:31:15,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd98d2c2164e674d720482 HTTP/1.1" 200 None 2026-04-16 01:31:15,681 - lava_callback - ERROR - Error processing callback for node 69dd98d2c2164e674d720482: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33390 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:32:30,477 - lava_callback - INFO - Received callback for node 69dd9928c2164e674d7204d0 INFO: 172.21.0.1:33396 - "POST /node/69dd9928c2164e674d7204d0 HTTP/1.0" 202 Accepted 2026-04-16 01:32:30,482 - lava_callback - INFO - Starting async job submit for node 69dd9928c2164e674d7204d0 2026-04-16 01:32:30,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:32:30,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9928c2164e674d7204d0 HTTP/1.1" 200 None 2026-04-16 01:32:30,499 - lava_callback - DEBUG - Processing node 69dd9928c2164e674d7204d0: baseline-arm64-clabbe 2026-04-16 01:32:30,499 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9928c2164e674d7204d0 2026-04-16 01:32:30,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:32:30,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9928c2164e674d7204d0 HTTP/1.1" 200 None 2026-04-16 01:32:30,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:32:30,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-16 01:32:30,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:32:30,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9928c2164e674d7204d0 HTTP/1.1" 200 None 2026-04-16 01:32:30,556 - lava_callback - ERROR - Error processing callback for node 69dd9928c2164e674d7204d0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41550 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:32:46,531 - lava_callback - INFO - Received callback for node 69e038251fb14b744a549f68 INFO: 172.21.0.1:41556 - "POST /node/69e038251fb14b744a549f68 HTTP/1.0" 202 Accepted 2026-04-16 01:32:46,538 - lava_callback - INFO - Starting async job submit for node 69e038251fb14b744a549f68 2026-04-16 01:32:46,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:32:46,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e038251fb14b744a549f68 HTTP/1.1" 200 None 2026-04-16 01:32:46,609 - lava_callback - DEBUG - Processing node 69e038251fb14b744a549f68: baseline-arm 2026-04-16 01:32:47,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:32:47,395 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:32:47,397 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e038251fb14b744a549f68/log.txt.gz 2026-04-16 01:32:47,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:32:48,180 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:32:48,182 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e038251fb14b744a549f68/lava-logs.yaml 2026-04-16 01:32:48,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:32:48,381 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:32:48,383 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e038251fb14b744a549f68/lava_callback.json.gz DEBUG: Setup failed for 69e038251fb14b744a549f68. Transitting job node result: incomplete -> fail 2026-04-16 01:32:48,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:32:48,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e038251fb14b744a549f68 HTTP/1.1" 200 None 2026-04-16 01:32:48,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:32:48,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 01:32:48,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:32:48,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e038251fb14b744a549f68 HTTP/1.1" 200 None 2026-04-16 01:32:48,660 - lava_callback - INFO - Completed processing callback for node 69e038251fb14b744a549f68 INFO: 172.21.0.1:41092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38678 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:33:08,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:33:08,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49834 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:33:50,537 - lava_callback - INFO - Received callback for node 69dd997bc2164e674d720509 INFO: 172.21.0.1:40936 - "POST /node/69dd997bc2164e674d720509 HTTP/1.0" 202 Accepted 2026-04-16 01:33:50,543 - lava_callback - INFO - Starting async job submit for node 69dd997bc2164e674d720509 2026-04-16 01:33:50,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:33:50,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd997bc2164e674d720509 HTTP/1.1" 200 None 2026-04-16 01:33:50,560 - lava_callback - DEBUG - Processing node 69dd997bc2164e674d720509: baseline-arm64-clabbe 2026-04-16 01:33:50,560 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd997bc2164e674d720509 2026-04-16 01:33:50,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:33:50,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd997bc2164e674d720509 HTTP/1.1" 200 None 2026-04-16 01:33:50,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:33:50,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-16 01:33:50,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:33:50,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd997bc2164e674d720509 HTTP/1.1" 200 None 2026-04-16 01:33:50,631 - lava_callback - ERROR - Error processing callback for node 69dd997bc2164e674d720509: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42418 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46124 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:35:10,644 - lava_callback - INFO - Received callback for node 69dd99c0c2164e674d720579 INFO: 172.21.0.1:58278 - "POST /node/69dd99c0c2164e674d720579 HTTP/1.0" 202 Accepted 2026-04-16 01:35:10,649 - lava_callback - INFO - Starting async job submit for node 69dd99c0c2164e674d720579 2026-04-16 01:35:10,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:35:10,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd99c0c2164e674d720579 HTTP/1.1" 200 None 2026-04-16 01:35:10,667 - lava_callback - DEBUG - Processing node 69dd99c0c2164e674d720579: baseline-arm64-clabbe 2026-04-16 01:35:10,667 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd99c0c2164e674d720579 2026-04-16 01:35:10,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:35:10,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd99c0c2164e674d720579 HTTP/1.1" 200 None 2026-04-16 01:35:10,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:35:10,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-16 01:35:10,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:35:10,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd99c0c2164e674d720579 HTTP/1.1" 200 None 2026-04-16 01:35:10,723 - lava_callback - ERROR - Error processing callback for node 69dd99c0c2164e674d720579: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47980 - "GET /node/6992688998a8bdb31c392217%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:47986 - "GET /node/69884c48e408e9ea60fad232%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:48000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54286 - "GET /node/69863491177ca0f097bd2a30%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:54300 - "GET /node/694bd895c19e09af58d497e9%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:54314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38722 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54978 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:36:30,659 - lava_callback - INFO - Received callback for node 69dd9a11c2164e674d7205b8 INFO: 172.21.0.1:54986 - "POST /node/69dd9a11c2164e674d7205b8 HTTP/1.0" 202 Accepted 2026-04-16 01:36:30,664 - lava_callback - INFO - Starting async job submit for node 69dd9a11c2164e674d7205b8 2026-04-16 01:36:30,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:36:30,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9a11c2164e674d7205b8 HTTP/1.1" 200 None 2026-04-16 01:36:30,680 - lava_callback - DEBUG - Processing node 69dd9a11c2164e674d7205b8: baseline-arm64-clabbe 2026-04-16 01:36:30,680 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9a11c2164e674d7205b8 2026-04-16 01:36:30,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:36:30,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9a11c2164e674d7205b8 HTTP/1.1" 200 None 2026-04-16 01:36:30,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:36:30,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-16 01:36:30,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:36:30,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9a11c2164e674d7205b8 HTTP/1.1" 200 None 2026-04-16 01:36:30,737 - lava_callback - ERROR - Error processing callback for node 69dd9a11c2164e674d7205b8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38418 - "GET /node/695301fa9912bd6bbcea6ba0%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:38432 - "GET /node/69103887f4a91d81a0ec4774%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:38440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38718 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:37:50,754 - lava_callback - INFO - Received callback for node 69dd9a5fc2164e674d7205f6 INFO: 172.21.0.1:59066 - "POST /node/69dd9a5fc2164e674d7205f6 HTTP/1.0" 202 Accepted 2026-04-16 01:37:50,760 - lava_callback - INFO - Starting async job submit for node 69dd9a5fc2164e674d7205f6 2026-04-16 01:37:50,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:37:50,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9a5fc2164e674d7205f6 HTTP/1.1" 200 None 2026-04-16 01:37:50,790 - lava_callback - DEBUG - Processing node 69dd9a5fc2164e674d7205f6: baseline-arm64-clabbe 2026-04-16 01:37:50,791 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9a5fc2164e674d7205f6 2026-04-16 01:37:50,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:37:50,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9a5fc2164e674d7205f6 HTTP/1.1" 200 None 2026-04-16 01:37:50,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:37:50,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-16 01:37:50,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:37:50,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9a5fc2164e674d7205f6 HTTP/1.1" 200 None 2026-04-16 01:37:50,840 - lava_callback - ERROR - Error processing callback for node 69dd9a5fc2164e674d7205f6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60124 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:39:10,780 - lava_callback - INFO - Received callback for node 69dd9aaac2164e674d72065c INFO: 172.21.0.1:55718 - "POST /node/69dd9aaac2164e674d72065c HTTP/1.0" 202 Accepted 2026-04-16 01:39:10,786 - lava_callback - INFO - Starting async job submit for node 69dd9aaac2164e674d72065c 2026-04-16 01:39:10,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:39:10,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9aaac2164e674d72065c HTTP/1.1" 200 None 2026-04-16 01:39:10,806 - lava_callback - DEBUG - Processing node 69dd9aaac2164e674d72065c: baseline-arm64-clabbe 2026-04-16 01:39:10,806 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9aaac2164e674d72065c 2026-04-16 01:39:10,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:39:10,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9aaac2164e674d72065c HTTP/1.1" 200 None 2026-04-16 01:39:10,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:39:10,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-16 01:39:10,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:39:10,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9aaac2164e674d72065c HTTP/1.1" 200 None 2026-04-16 01:39:10,858 - lava_callback - ERROR - Error processing callback for node 69dd9aaac2164e674d72065c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45660 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:40:10,901 - lava_callback - INFO - Received callback for node 69dd9af5c2164e674d7206ae INFO: 172.21.0.1:40136 - "POST /node/69dd9af5c2164e674d7206ae HTTP/1.0" 202 Accepted 2026-04-16 01:40:10,909 - lava_callback - INFO - Starting async job submit for node 69dd9af5c2164e674d7206ae 2026-04-16 01:40:10,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:40:10,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9af5c2164e674d7206ae HTTP/1.1" 200 None 2026-04-16 01:40:10,936 - lava_callback - DEBUG - Processing node 69dd9af5c2164e674d7206ae: baseline-arm64-clabbe 2026-04-16 01:40:10,936 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9af5c2164e674d7206ae 2026-04-16 01:40:10,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:40:10,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9af5c2164e674d7206ae HTTP/1.1" 200 None 2026-04-16 01:40:10,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:40:10,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-16 01:40:10,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:40:11,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9af5c2164e674d7206ae HTTP/1.1" 200 None 2026-04-16 01:40:11,001 - lava_callback - ERROR - Error processing callback for node 69dd9af5c2164e674d7206ae: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43722 - "GET /node/69903bf8985e4efca431df0b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:43734 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-16 01:41:16,166 - lava_callback - INFO - Received callback for node 69dd9b39c2164e674d720711 INFO: 172.21.0.1:43736 - "POST /node/69dd9b39c2164e674d720711 HTTP/1.0" 202 Accepted 2026-04-16 01:41:16,172 - lava_callback - INFO - Starting async job submit for node 69dd9b39c2164e674d720711 2026-04-16 01:41:16,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:41:16,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9b39c2164e674d720711 HTTP/1.1" 200 None 2026-04-16 01:41:16,187 - lava_callback - DEBUG - Processing node 69dd9b39c2164e674d720711: baseline-arm64-baylibre 2026-04-16 01:41:16,187 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9b39c2164e674d720711 2026-04-16 01:41:16,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:41:16,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9b39c2164e674d720711 HTTP/1.1" 200 None 2026-04-16 01:41:16,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:41:16,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d841b2b28893fa2e230976 HTTP/1.1" 200 None 2026-04-16 01:41:16,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:41:16,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9b39c2164e674d720711 HTTP/1.1" 200 None 2026-04-16 01:41:16,264 - lava_callback - ERROR - Error processing callback for node 69dd9b39c2164e674d720711: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32768 - "GET /node/6952406f5318368af0c49ddb%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:32784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47814 - "GET /node/695fe01bf1cdc0dc69d51f02%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:47828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59842 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54024 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:42:36,240 - lava_callback - INFO - Received callback for node 69dd9b8ac2164e674d720740 INFO: 172.21.0.1:54038 - "POST /node/69dd9b8ac2164e674d720740 HTTP/1.0" 202 Accepted 2026-04-16 01:42:36,246 - lava_callback - INFO - Starting async job submit for node 69dd9b8ac2164e674d720740 2026-04-16 01:42:36,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:42:36,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9b8ac2164e674d720740 HTTP/1.1" 200 None 2026-04-16 01:42:36,263 - lava_callback - DEBUG - Processing node 69dd9b8ac2164e674d720740: baseline-arm64-baylibre 2026-04-16 01:42:36,263 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9b8ac2164e674d720740 2026-04-16 01:42:36,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:42:36,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9b8ac2164e674d720740 HTTP/1.1" 200 None 2026-04-16 01:42:36,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:42:36,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d841b2b28893fa2e230976 HTTP/1.1" 200 None 2026-04-16 01:42:36,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:42:36,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9b8ac2164e674d720740 HTTP/1.1" 200 None 2026-04-16 01:42:36,327 - lava_callback - ERROR - Error processing callback for node 69dd9b8ac2164e674d720740: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50482 - "GET /node/69903e93985e4efca431e70b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:50492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45154 - "GET /node/69afe50aae557f2600f0fec5%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:40948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50244 - "GET /node/698bd8071e517752bab8b554%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:50246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50494 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-16 01:45:16,428 - lava_callback - INFO - Received callback for node 69dd9c1cc2164e674d7207eb INFO: 172.21.0.1:50508 - "POST /node/69dd9c1cc2164e674d7207eb HTTP/1.0" 202 Accepted 2026-04-16 01:45:16,434 - lava_callback - INFO - Starting async job submit for node 69dd9c1cc2164e674d7207eb 2026-04-16 01:45:16,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:45:16,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9c1cc2164e674d7207eb HTTP/1.1" 200 None 2026-04-16 01:45:16,452 - lava_callback - DEBUG - Processing node 69dd9c1cc2164e674d7207eb: baseline-arm64-baylibre 2026-04-16 01:45:16,452 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9c1cc2164e674d7207eb 2026-04-16 01:45:16,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:45:16,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9c1cc2164e674d7207eb HTTP/1.1" 200 None 2026-04-16 01:45:16,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:45:16,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d841b2b28893fa2e230976 HTTP/1.1" 200 None 2026-04-16 01:45:16,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:45:16,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9c1cc2164e674d7207eb HTTP/1.1" 200 None 2026-04-16 01:45:16,508 - lava_callback - ERROR - Error processing callback for node 69dd9c1cc2164e674d7207eb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51000 - "GET /node/693b7d4341fb4c9509763894%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-16 01:46:42,344 - lava_callback - INFO - Received callback for node 69e03e891fb14b744a54a54d INFO: 172.21.0.1:51012 - "POST /node/69e03e891fb14b744a54a54d HTTP/1.0" 202 Accepted 2026-04-16 01:46:42,354 - lava_callback - INFO - Starting async job submit for node 69e03e891fb14b744a54a54d 2026-04-16 01:46:42,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:46:42,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e03e891fb14b744a54a54d HTTP/1.1" 200 None 2026-04-16 01:46:42,396 - lava_callback - DEBUG - Processing node 69e03e891fb14b744a54a54d: ltp-fsx 2026-04-16 01:46:42,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:46:42,914 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:46:42,916 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fsx-69e03e891fb14b744a54a54d/log.txt.gz 2026-04-16 01:46:43,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:46:43,400 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:46:43,402 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fsx-69e03e891fb14b744a54a54d/lava-logs.yaml 2026-04-16 01:46:43,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:46:43,564 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:46:43,566 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fsx-69e03e891fb14b744a54a54d/lava_callback.json.gz 2026-04-16 01:46:43,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:46:43,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e03e891fb14b744a54a54d HTTP/1.1" 200 None 2026-04-16 01:46:43,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:46:43,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 01:46:43,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:46:43,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e03e891fb14b744a54a54d HTTP/1.1" 200 None 2026-04-16 01:46:43,657 - lava_callback - INFO - Completed processing callback for node 69e03e891fb14b744a54a54d INFO: 172.21.0.1:51026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58438 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:47:08,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:47:08,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40454 - "GET /node/698e31b9952a14bf500e444a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:40464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34954 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:47:30,864 - lava_callback - INFO - Received callback for node 69e03fa91fb14b744a54a695 INFO: 172.21.0.1:34962 - "POST /node/69e03fa91fb14b744a54a695 HTTP/1.0" 202 Accepted 2026-04-16 01:47:30,870 - lava_callback - INFO - Starting async job submit for node 69e03fa91fb14b744a54a695 2026-04-16 01:47:30,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:47:30,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e03fa91fb14b744a54a695 HTTP/1.1" 200 None 2026-04-16 01:47:30,894 - lava_callback - DEBUG - Processing node 69e03fa91fb14b744a54a695: baseline-nfs-arm64 2026-04-16 01:47:30,896 - lava_callback - WARNING - Failed to upload log 2026-04-16 01:47:30,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:47:31,032 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:47:31,034 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e03fa91fb14b744a54a695/lava-logs.yaml 2026-04-16 01:47:31,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:47:31,152 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:47:31,154 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e03fa91fb14b744a54a695/lava_callback.json.gz 2026-04-16 01:47:31,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:47:31,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e03fa91fb14b744a54a695 HTTP/1.1" 200 None 2026-04-16 01:47:31,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:47:31,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:47:31,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:47:31,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e03fa91fb14b744a54a695 HTTP/1.1" 200 None 2026-04-16 01:47:31,209 - lava_callback - INFO - Completed processing callback for node 69e03fa91fb14b744a54a695 INFO: 172.21.0.1:34966 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:47:36,572 - lava_callback - INFO - Received callback for node 69dd9cabc2164e674d720882 INFO: 172.21.0.1:34968 - "POST /node/69dd9cabc2164e674d720882 HTTP/1.0" 202 Accepted 2026-04-16 01:47:36,579 - lava_callback - INFO - Starting async job submit for node 69dd9cabc2164e674d720882 2026-04-16 01:47:36,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:47:36,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9cabc2164e674d720882 HTTP/1.1" 200 None 2026-04-16 01:47:36,595 - lava_callback - DEBUG - Processing node 69dd9cabc2164e674d720882: baseline-arm64-baylibre 2026-04-16 01:47:36,596 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9cabc2164e674d720882 2026-04-16 01:47:36,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:47:36,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9cabc2164e674d720882 HTTP/1.1" 200 None 2026-04-16 01:47:36,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:47:36,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d841b2b28893fa2e230976 HTTP/1.1" 200 None 2026-04-16 01:47:36,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:47:36,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9cabc2164e674d720882 HTTP/1.1" 200 None 2026-04-16 01:47:36,683 - lava_callback - ERROR - Error processing callback for node 69dd9cabc2164e674d720882: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 01:47:38,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:47:38,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54536 - "GET /node/699433c05ae459b9df3d338e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:54544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34448 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58890 - "GET /node/689ed4e7df4198951e9e3332%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:60542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60558 - "GET /node/695d2240f1251675e15aee61%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:60560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40268 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:50:03,805 - lava_callback - INFO - Received callback for node 69e0401d1fb14b744a54a703 INFO: 172.21.0.1:53990 - "POST /node/69e0401d1fb14b744a54a703 HTTP/1.0" 202 Accepted 2026-04-16 01:50:03,811 - lava_callback - INFO - Starting async job submit for node 69e0401d1fb14b744a54a703 2026-04-16 01:50:03,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:50:03,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0401d1fb14b744a54a703 HTTP/1.1" 200 None 2026-04-16 01:50:03,849 - lava_callback - DEBUG - Processing node 69e0401d1fb14b744a54a703: baseline-arm64-foundriesio 2026-04-16 01:50:04,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:50:04,213 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:50:04,215 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e0401d1fb14b744a54a703/log.txt.gz 2026-04-16 01:50:04,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:50:04,513 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:50:04,515 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e0401d1fb14b744a54a703/lava-logs.yaml 2026-04-16 01:50:04,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:50:04,647 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:50:04,649 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e0401d1fb14b744a54a703/lava_callback.json.gz 2026-04-16 01:50:04,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:50:04,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0401d1fb14b744a54a703 HTTP/1.1" 200 None 2026-04-16 01:50:04,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:50:04,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:50:04,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:50:04,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e0401d1fb14b744a54a703 HTTP/1.1" 200 None 2026-04-16 01:50:04,745 - lava_callback - INFO - Completed processing callback for node 69e0401d1fb14b744a54a703 INFO: 172.21.0.1:54000 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:50:08,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:50:08,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54120 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:50:16,720 - lava_callback - INFO - Received callback for node 69dd9d56c2164e674d72099a INFO: 172.21.0.1:54126 - "POST /node/69dd9d56c2164e674d72099a HTTP/1.0" 202 Accepted 2026-04-16 01:50:16,726 - lava_callback - INFO - Starting async job submit for node 69dd9d56c2164e674d72099a 2026-04-16 01:50:16,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:50:16,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9d56c2164e674d72099a HTTP/1.1" 200 None 2026-04-16 01:50:16,747 - lava_callback - DEBUG - Processing node 69dd9d56c2164e674d72099a: baseline-arm64-baylibre 2026-04-16 01:50:16,748 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9d56c2164e674d72099a 2026-04-16 01:50:16,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:50:16,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9d56c2164e674d72099a HTTP/1.1" 200 None 2026-04-16 01:50:16,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:50:16,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d841b2b28893fa2e230976 HTTP/1.1" 200 None 2026-04-16 01:50:16,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:50:16,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9d56c2164e674d72099a HTTP/1.1" 200 None 2026-04-16 01:50:16,808 - lava_callback - ERROR - Error processing callback for node 69dd9d56c2164e674d72099a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59430 - "GET /node/698a40ca22b4cc0f227b05cc%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:59436 - "GET /node/698af6983b3beb19e76171d0%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-16 01:50:42,677 - lava_callback - INFO - Received callback for node 69e03c4c1fb14b744a54a374 INFO: 172.21.0.1:49016 - "POST /node/69e03c4c1fb14b744a54a374 HTTP/1.0" 202 Accepted 2026-04-16 01:50:42,684 - lava_callback - INFO - Starting async job submit for node 69e03c4c1fb14b744a54a374 2026-04-16 01:50:42,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:50:42,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e03c4c1fb14b744a54a374 HTTP/1.1" 200 None 2026-04-16 01:50:42,761 - lava_callback - DEBUG - Processing node 69e03c4c1fb14b744a54a374: ltp-smoke 2026-04-16 01:50:43,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:50:43,534 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:50:43,536 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69e03c4c1fb14b744a54a374/log.txt.gz 2026-04-16 01:50:43,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:50:44,135 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:50:44,137 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69e03c4c1fb14b744a54a374/lava-logs.yaml 2026-04-16 01:50:44,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:50:44,316 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:50:44,318 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69e03c4c1fb14b744a54a374/lava_callback.json.gz 2026-04-16 01:50:44,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:50:44,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e03c4c1fb14b744a54a374 HTTP/1.1" 200 None 2026-04-16 01:50:44,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:50:44,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a2e1fb14b744a54889b HTTP/1.1" 200 None 2026-04-16 01:50:44,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:50:44,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e03c4c1fb14b744a54a374 HTTP/1.1" 200 None 2026-04-16 01:50:44,590 - lava_callback - INFO - Completed processing callback for node 69e03c4c1fb14b744a54a374 INFO: 172.21.0.1:49024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53370 - "GET /node/69107fba8b15debe9dd4ef1b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:35300 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:51:08,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:51:08,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55140 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:51:38,959 - lava_callback - INFO - Received callback for node 69e040701fb14b744a54a758 INFO: 172.21.0.1:55142 - "POST /node/69e040701fb14b744a54a758 HTTP/1.0" 202 Accepted 2026-04-16 01:51:38,969 - lava_callback - INFO - Starting async job submit for node 69e040701fb14b744a54a758 2026-04-16 01:51:38,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:51:39,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e040701fb14b744a54a758 HTTP/1.1" 200 None 2026-04-16 01:51:39,017 - lava_callback - DEBUG - Processing node 69e040701fb14b744a54a758: baseline-arm64 2026-04-16 01:51:39,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:51:39,544 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:51:39,546 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e040701fb14b744a54a758/log.txt.gz 2026-04-16 01:51:39,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:51:39,968 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:51:39,970 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e040701fb14b744a54a758/lava-logs.yaml 2026-04-16 01:51:39,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:51:40,119 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:51:40,121 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e040701fb14b744a54a758/lava_callback.json.gz 2026-04-16 01:51:40,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:51:40,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e040701fb14b744a54a758 HTTP/1.1" 200 None 2026-04-16 01:51:40,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:51:40,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:51:40,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:51:40,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e040701fb14b744a54a758 HTTP/1.1" 200 None 2026-04-16 01:51:40,209 - lava_callback - INFO - Completed processing callback for node 69e040701fb14b744a54a758 INFO: 172.21.0.1:41288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35562 - "GET /node/698fcc2a76d4b6342e9d75df%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:35568 - "GET /node/6990a484c45febfe4451ffa8%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:35578 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:52:08,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:52:08,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37196 - "GET /node/695142bc55ab4e5dcfcc07c2%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:37210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49456 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:52:51,279 - lava_callback - INFO - Received callback for node 69dd9de9c2164e674d720a2d INFO: 172.21.0.1:53846 - "POST /node/69dd9de9c2164e674d720a2d HTTP/1.0" 202 Accepted 2026-04-16 01:52:51,286 - lava_callback - INFO - Starting async job submit for node 69dd9de9c2164e674d720a2d 2026-04-16 01:52:51,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:52:51,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9de9c2164e674d720a2d HTTP/1.1" 200 None 2026-04-16 01:52:51,301 - lava_callback - DEBUG - Processing node 69dd9de9c2164e674d720a2d: baseline-arm64-clabbe 2026-04-16 01:52:51,301 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9de9c2164e674d720a2d 2026-04-16 01:52:51,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:52:51,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9de9c2164e674d720a2d HTTP/1.1" 200 None 2026-04-16 01:52:51,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:52:51,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d841b2b28893fa2e230976 HTTP/1.1" 200 None 2026-04-16 01:52:51,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:52:51,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9de9c2164e674d720a2d HTTP/1.1" 200 None 2026-04-16 01:52:51,370 - lava_callback - ERROR - Error processing callback for node 69dd9de9c2164e674d720a2d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33658 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:55:11,376 - lava_callback - INFO - Received callback for node 69dd9e73c2164e674d720ac7 INFO: 172.21.0.1:43836 - "POST /node/69dd9e73c2164e674d720ac7 HTTP/1.0" 202 Accepted 2026-04-16 01:55:11,384 - lava_callback - INFO - Starting async job submit for node 69dd9e73c2164e674d720ac7 2026-04-16 01:55:11,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:55:11,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9e73c2164e674d720ac7 HTTP/1.1" 200 None 2026-04-16 01:55:11,400 - lava_callback - DEBUG - Processing node 69dd9e73c2164e674d720ac7: baseline-arm64-clabbe 2026-04-16 01:55:11,401 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9e73c2164e674d720ac7 2026-04-16 01:55:11,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:55:11,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9e73c2164e674d720ac7 HTTP/1.1" 200 None 2026-04-16 01:55:11,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:55:11,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d841b2b28893fa2e230976 HTTP/1.1" 200 None 2026-04-16 01:55:11,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:55:11,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9e73c2164e674d720ac7 HTTP/1.1" 200 None 2026-04-16 01:55:11,472 - lava_callback - ERROR - Error processing callback for node 69dd9e73c2164e674d720ac7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36884 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:56:31,494 - lava_callback - INFO - Received callback for node 69dd9ebec2164e674d720b2a INFO: 172.21.0.1:36894 - "POST /node/69dd9ebec2164e674d720b2a HTTP/1.0" 202 Accepted 2026-04-16 01:56:31,500 - lava_callback - INFO - Starting async job submit for node 69dd9ebec2164e674d720b2a 2026-04-16 01:56:31,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:56:31,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9ebec2164e674d720b2a HTTP/1.1" 200 None 2026-04-16 01:56:31,515 - lava_callback - DEBUG - Processing node 69dd9ebec2164e674d720b2a: baseline-arm64-clabbe 2026-04-16 01:56:31,515 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9ebec2164e674d720b2a 2026-04-16 01:56:31,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:56:31,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9ebec2164e674d720b2a HTTP/1.1" 200 None 2026-04-16 01:56:31,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:56:31,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d841b2b28893fa2e230976 HTTP/1.1" 200 None 2026-04-16 01:56:31,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:56:31,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9ebec2164e674d720b2a HTTP/1.1" 200 None 2026-04-16 01:56:31,564 - lava_callback - ERROR - Error processing callback for node 69dd9ebec2164e674d720b2a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36902 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:56:40,097 - lava_callback - INFO - Received callback for node 69e041a11fb14b744a54a889 INFO: 172.21.0.1:43138 - "POST /node/69e041a11fb14b744a54a889 HTTP/1.0" 202 Accepted 2026-04-16 01:56:40,107 - lava_callback - INFO - Starting async job submit for node 69e041a11fb14b744a54a889 2026-04-16 01:56:40,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:56:40,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e041a11fb14b744a54a889 HTTP/1.1" 200 None 2026-04-16 01:56:40,155 - lava_callback - DEBUG - Processing node 69e041a11fb14b744a54a889: baseline-arm64 2026-04-16 01:56:40,303 - lava_callback - WARNING - Failed to upload log 2026-04-16 01:56:40,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:56:40,582 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:56:40,584 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e041a11fb14b744a54a889/lava-logs.yaml 2026-04-16 01:56:40,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:56:40,714 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:56:40,716 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e041a11fb14b744a54a889/lava_callback.json.gz 2026-04-16 01:56:40,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:56:40,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e041a11fb14b744a54a889 HTTP/1.1" 200 None 2026-04-16 01:56:40,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:56:40,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:56:40,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:56:40,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e041a11fb14b744a54a889 HTTP/1.1" 200 None 2026-04-16 01:56:40,874 - lava_callback - INFO - Completed processing callback for node 69e041a11fb14b744a54a889 INFO: 172.21.0.1:43154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46942 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:57:08,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:57:08,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54400 - "GET /node/6992f8b031166481c8ddd71f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:54410 - "GET /node/698fd72876d4b6342e9d8f49%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:54416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58626 - "GET /node/698af0243b3beb19e76161d6%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:58634 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:57:51,512 - lava_callback - INFO - Received callback for node 69dd9f11c2164e674d720b73 INFO: 172.21.0.1:48734 - "POST /node/69dd9f11c2164e674d720b73 HTTP/1.0" 202 Accepted 2026-04-16 01:57:51,518 - lava_callback - INFO - Starting async job submit for node 69dd9f11c2164e674d720b73 2026-04-16 01:57:51,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:57:51,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9f11c2164e674d720b73 HTTP/1.1" 200 None 2026-04-16 01:57:51,534 - lava_callback - DEBUG - Processing node 69dd9f11c2164e674d720b73: baseline-arm64-clabbe 2026-04-16 01:57:51,534 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9f11c2164e674d720b73 2026-04-16 01:57:51,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:57:51,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9f11c2164e674d720b73 HTTP/1.1" 200 None 2026-04-16 01:57:51,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:57:51,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d841b2b28893fa2e230976 HTTP/1.1" 200 None 2026-04-16 01:57:51,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:57:51,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9f11c2164e674d720b73 HTTP/1.1" 200 None 2026-04-16 01:57:51,594 - lava_callback - ERROR - Error processing callback for node 69dd9f11c2164e674d720b73: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 01:57:54,105 - lava_callback - INFO - Received callback for node 69e041e81fb14b744a54a8dc INFO: 172.21.0.1:48742 - "POST /node/69e041e81fb14b744a54a8dc HTTP/1.0" 202 Accepted 2026-04-16 01:57:54,112 - lava_callback - INFO - Starting async job submit for node 69e041e81fb14b744a54a8dc 2026-04-16 01:57:54,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:57:54,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e041e81fb14b744a54a8dc HTTP/1.1" 200 None 2026-04-16 01:57:54,157 - lava_callback - DEBUG - Processing node 69e041e81fb14b744a54a8dc: baseline-arm64 2026-04-16 01:57:54,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:57:54,430 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:57:54,431 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e041e81fb14b744a54a8dc/log.txt.gz 2026-04-16 01:57:54,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:57:54,697 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:57:54,699 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e041e81fb14b744a54a8dc/lava-logs.yaml 2026-04-16 01:57:54,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:57:54,851 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:57:54,853 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e041e81fb14b744a54a8dc/lava_callback.json.gz 2026-04-16 01:57:54,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:57:54,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e041e81fb14b744a54a8dc HTTP/1.1" 200 None 2026-04-16 01:57:54,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:57:54,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:57:54,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:57:54,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e041e81fb14b744a54a8dc HTTP/1.1" 200 None 2026-04-16 01:57:55,034 - lava_callback - INFO - Completed processing callback for node 69e041e81fb14b744a54a8dc INFO: 172.21.0.1:48748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58332 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:58:08,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:58:08,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40040 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54694 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:59:21,233 - lava_callback - INFO - Received callback for node 69e0422f1fb14b744a54a90e INFO: 172.21.0.1:33200 - "POST /node/69e0422f1fb14b744a54a90e HTTP/1.0" 202 Accepted 2026-04-16 01:59:21,241 - lava_callback - INFO - Starting async job submit for node 69e0422f1fb14b744a54a90e 2026-04-16 01:59:21,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:59:21,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0422f1fb14b744a54a90e HTTP/1.1" 200 None 2026-04-16 01:59:21,315 - lava_callback - DEBUG - Processing node 69e0422f1fb14b744a54a90e: baseline-arm64 2026-04-16 01:59:21,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:59:21,938 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:59:21,940 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e0422f1fb14b744a54a90e/log.txt.gz 2026-04-16 01:59:22,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:59:22,405 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:59:22,408 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e0422f1fb14b744a54a90e/lava-logs.yaml 2026-04-16 01:59:22,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:59:22,536 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:59:22,538 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e0422f1fb14b744a54a90e/lava_callback.json.gz 2026-04-16 01:59:22,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:59:22,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0422f1fb14b744a54a90e HTTP/1.1" 200 None 2026-04-16 01:59:22,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:59:22,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:59:22,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:59:22,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e0422f1fb14b744a54a90e HTTP/1.1" 200 None 2026-04-16 01:59:22,689 - lava_callback - INFO - Completed processing callback for node 69e0422f1fb14b744a54a90e INFO: 172.21.0.1:33210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60274 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:59:38,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:59:38,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50466 - "GET /node/6985b73271989fb141496aea%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:50474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36424 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:59:58,738 - lava_callback - INFO - Received callback for node 69e0415f1fb14b744a54a853 INFO: 172.21.0.1:36430 - "POST /node/69e0415f1fb14b744a54a853 HTTP/1.0" 202 Accepted 2026-04-16 01:59:58,745 - lava_callback - INFO - Starting async job submit for node 69e0415f1fb14b744a54a853 2026-04-16 01:59:58,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:59:58,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0415f1fb14b744a54a853 HTTP/1.1" 200 None 2026-04-16 01:59:58,798 - lava_callback - DEBUG - Processing node 69e0415f1fb14b744a54a853: baseline-arm64 2026-04-16 01:59:59,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:59:59,321 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:59:59,323 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e0415f1fb14b744a54a853/log.txt.gz 2026-04-16 01:59:59,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:59:59,743 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:59:59,746 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e0415f1fb14b744a54a853/lava-logs.yaml 2026-04-16 01:59:59,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:59:59,908 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:59:59,910 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e0415f1fb14b744a54a853/lava_callback.json.gz DEBUG: Setup failed for 69e0415f1fb14b744a54a853. Transitting job node result: incomplete -> fail 2026-04-16 01:59:59,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:59:59,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0415f1fb14b744a54a853 HTTP/1.1" 200 None 2026-04-16 02:00:00,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:00:00,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 02:00:00,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:00:00,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e0415f1fb14b744a54a853 HTTP/1.1" 200 None 2026-04-16 02:00:00,133 - lava_callback - INFO - Completed processing callback for node 69e0415f1fb14b744a54a853 INFO: 172.21.0.1:42816 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:00:08,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:00:08,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60312 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:00:51,634 - lava_callback - INFO - Received callback for node 69dd9fc1c2164e674d720bc9 INFO: 172.21.0.1:51646 - "POST /node/69dd9fc1c2164e674d720bc9 HTTP/1.0" 202 Accepted 2026-04-16 02:00:51,640 - lava_callback - INFO - Starting async job submit for node 69dd9fc1c2164e674d720bc9 2026-04-16 02:00:51,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:00:51,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9fc1c2164e674d720bc9 HTTP/1.1" 200 None 2026-04-16 02:00:51,656 - lava_callback - DEBUG - Processing node 69dd9fc1c2164e674d720bc9: baseline-arm64-clabbe 2026-04-16 02:00:51,656 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9fc1c2164e674d720bc9 2026-04-16 02:00:51,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:00:51,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9fc1c2164e674d720bc9 HTTP/1.1" 200 None 2026-04-16 02:00:51,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:00:51,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d841b2b28893fa2e230976 HTTP/1.1" 200 None 2026-04-16 02:00:51,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:00:51,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9fc1c2164e674d720bc9 HTTP/1.1" 200 None 2026-04-16 02:00:51,707 - lava_callback - ERROR - Error processing callback for node 69dd9fc1c2164e674d720bc9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47668 - "GET /node/6986fafa6e077e4126a7d39e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:47684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57342 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:01:51,657 - lava_callback - INFO - Received callback for node 69dda008c2164e674d720c4e INFO: 172.21.0.1:43516 - "POST /node/69dda008c2164e674d720c4e HTTP/1.0" 202 Accepted 2026-04-16 02:01:51,662 - lava_callback - INFO - Starting async job submit for node 69dda008c2164e674d720c4e 2026-04-16 02:01:51,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:01:51,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda008c2164e674d720c4e HTTP/1.1" 200 None 2026-04-16 02:01:51,678 - lava_callback - DEBUG - Processing node 69dda008c2164e674d720c4e: baseline-arm64-clabbe 2026-04-16 02:01:51,678 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dda008c2164e674d720c4e 2026-04-16 02:01:51,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:01:51,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda008c2164e674d720c4e HTTP/1.1" 200 None 2026-04-16 02:01:51,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:01:51,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d841b2b28893fa2e230976 HTTP/1.1" 200 None 2026-04-16 02:01:51,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:01:51,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dda008c2164e674d720c4e HTTP/1.1" 200 None 2026-04-16 02:01:51,735 - lava_callback - ERROR - Error processing callback for node 69dda008c2164e674d720c4e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53896 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:03:11,696 - lava_callback - INFO - Received callback for node 69dda05ac2164e674d720c80 INFO: 172.21.0.1:45250 - "POST /node/69dda05ac2164e674d720c80 HTTP/1.0" 202 Accepted 2026-04-16 02:03:11,702 - lava_callback - INFO - Starting async job submit for node 69dda05ac2164e674d720c80 2026-04-16 02:03:11,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:03:11,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda05ac2164e674d720c80 HTTP/1.1" 200 None 2026-04-16 02:03:11,724 - lava_callback - DEBUG - Processing node 69dda05ac2164e674d720c80: baseline-arm64-clabbe 2026-04-16 02:03:11,724 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dda05ac2164e674d720c80 2026-04-16 02:03:11,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:03:11,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda05ac2164e674d720c80 HTTP/1.1" 200 None 2026-04-16 02:03:11,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:03:11,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d841b2b28893fa2e230976 HTTP/1.1" 200 None 2026-04-16 02:03:11,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:03:11,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dda05ac2164e674d720c80 HTTP/1.1" 200 None 2026-04-16 02:03:11,784 - lava_callback - ERROR - Error processing callback for node 69dda05ac2164e674d720c80: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36460 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:09:17,764 - lava_callback - INFO - Received callback for node 69dda1c9c2164e674d720e27 INFO: 172.21.0.1:36468 - "POST /node/69dda1c9c2164e674d720e27 HTTP/1.0" 202 Accepted 2026-04-16 02:09:17,769 - lava_callback - INFO - Starting async job submit for node 69dda1c9c2164e674d720e27 2026-04-16 02:09:17,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:09:17,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda1c9c2164e674d720e27 HTTP/1.1" 200 None 2026-04-16 02:09:17,808 - lava_callback - DEBUG - Processing node 69dda1c9c2164e674d720e27: baseline-arm-baylibre 2026-04-16 02:09:17,809 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dda1c9c2164e674d720e27 2026-04-16 02:09:17,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:09:17,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda1c9c2164e674d720e27 HTTP/1.1" 200 None 2026-04-16 02:09:17,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:09:17,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-16 02:09:17,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:09:17,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dda1c9c2164e674d720e27 HTTP/1.1" 200 None 2026-04-16 02:09:17,862 - lava_callback - ERROR - Error processing callback for node 69dda1c9c2164e674d720e27: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44230 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:11:17,881 - lava_callback - INFO - Received callback for node 69dda239c2164e674d720e6e INFO: 172.21.0.1:44240 - "POST /node/69dda239c2164e674d720e6e HTTP/1.0" 202 Accepted 2026-04-16 02:11:17,887 - lava_callback - INFO - Starting async job submit for node 69dda239c2164e674d720e6e 2026-04-16 02:11:17,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:11:17,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda239c2164e674d720e6e HTTP/1.1" 200 None 2026-04-16 02:11:17,904 - lava_callback - DEBUG - Processing node 69dda239c2164e674d720e6e: baseline-arm-baylibre 2026-04-16 02:11:17,904 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dda239c2164e674d720e6e 2026-04-16 02:11:17,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:11:17,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda239c2164e674d720e6e HTTP/1.1" 200 None 2026-04-16 02:11:17,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:11:17,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-16 02:11:17,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:11:17,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dda239c2164e674d720e6e HTTP/1.1" 200 None 2026-04-16 02:11:17,953 - lava_callback - ERROR - Error processing callback for node 69dda239c2164e674d720e6e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43580 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:12:57,899 - lava_callback - INFO - Received callback for node 69dda29dc2164e674d720f27 INFO: 172.21.0.1:43590 - "POST /node/69dda29dc2164e674d720f27 HTTP/1.0" 202 Accepted 2026-04-16 02:12:57,904 - lava_callback - INFO - Starting async job submit for node 69dda29dc2164e674d720f27 2026-04-16 02:12:57,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:12:57,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda29dc2164e674d720f27 HTTP/1.1" 200 None 2026-04-16 02:12:57,920 - lava_callback - DEBUG - Processing node 69dda29dc2164e674d720f27: baseline-arm-baylibre 2026-04-16 02:12:57,921 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dda29dc2164e674d720f27 2026-04-16 02:12:57,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:12:57,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda29dc2164e674d720f27 HTTP/1.1" 200 None 2026-04-16 02:12:57,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:12:57,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-16 02:12:57,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:12:57,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dda29dc2164e674d720f27 HTTP/1.1" 200 None 2026-04-16 02:12:57,981 - lava_callback - ERROR - Error processing callback for node 69dda29dc2164e674d720f27: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56830 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:13:37,949 - lava_callback - INFO - Received callback for node 69dda2bfc2164e674d720f42 INFO: 172.21.0.1:56846 - "POST /node/69dda2bfc2164e674d720f42 HTTP/1.0" 202 Accepted 2026-04-16 02:13:37,955 - lava_callback - INFO - Starting async job submit for node 69dda2bfc2164e674d720f42 2026-04-16 02:13:37,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:13:37,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda2bfc2164e674d720f42 HTTP/1.1" 200 None 2026-04-16 02:13:37,987 - lava_callback - DEBUG - Processing node 69dda2bfc2164e674d720f42: baseline-arm-baylibre 2026-04-16 02:13:37,987 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dda2bfc2164e674d720f42 2026-04-16 02:13:37,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:13:38,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda2bfc2164e674d720f42 HTTP/1.1" 200 None 2026-04-16 02:13:38,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:13:38,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-16 02:13:38,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:13:38,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dda2bfc2164e674d720f42 HTTP/1.1" 200 None 2026-04-16 02:13:38,048 - lava_callback - ERROR - Error processing callback for node 69dda2bfc2164e674d720f42: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52404 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:13:47,202 - lava_callback - INFO - Received callback for node 69e043491fb14b744a54aa24 INFO: 172.21.0.1:52420 - "POST /node/69e043491fb14b744a54aa24 HTTP/1.0" 202 Accepted 2026-04-16 02:13:47,209 - lava_callback - INFO - Starting async job submit for node 69e043491fb14b744a54aa24 2026-04-16 02:13:47,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:13:47,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e043491fb14b744a54aa24 HTTP/1.1" 200 None 2026-04-16 02:13:47,251 - lava_callback - DEBUG - Processing node 69e043491fb14b744a54aa24: baseline-arm64 2026-04-16 02:13:47,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:13:47,947 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:13:47,949 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e043491fb14b744a54aa24/log.txt.gz 2026-04-16 02:13:48,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:13:48,413 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:13:48,415 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e043491fb14b744a54aa24/lava-logs.yaml 2026-04-16 02:13:48,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:13:48,584 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:13:48,586 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e043491fb14b744a54aa24/lava_callback.json.gz 2026-04-16 02:13:48,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:13:48,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e043491fb14b744a54aa24 HTTP/1.1" 200 None 2026-04-16 02:13:48,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:13:48,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 02:13:48,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:13:48,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e043491fb14b744a54aa24 HTTP/1.1" 200 None 2026-04-16 02:13:48,714 - lava_callback - INFO - Completed processing callback for node 69e043491fb14b744a54aa24 INFO: 172.21.0.1:52638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40676 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:14:08,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:14:08,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46254 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46270 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:15:18,015 - lava_callback - INFO - Received callback for node 69dda32cc2164e674d720fc3 INFO: 172.21.0.1:46278 - "POST /node/69dda32cc2164e674d720fc3 HTTP/1.0" 202 Accepted 2026-04-16 02:15:18,021 - lava_callback - INFO - Starting async job submit for node 69dda32cc2164e674d720fc3 2026-04-16 02:15:18,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:15:18,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda32cc2164e674d720fc3 HTTP/1.1" 200 None 2026-04-16 02:15:18,045 - lava_callback - DEBUG - Processing node 69dda32cc2164e674d720fc3: baseline-arm-baylibre 2026-04-16 02:15:18,045 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dda32cc2164e674d720fc3 2026-04-16 02:15:18,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:15:18,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda32cc2164e674d720fc3 HTTP/1.1" 200 None 2026-04-16 02:15:18,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:15:18,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-16 02:15:18,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:15:18,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dda32cc2164e674d720fc3 HTTP/1.1" 200 None 2026-04-16 02:15:18,106 - lava_callback - ERROR - Error processing callback for node 69dda32cc2164e674d720fc3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48050 - "GET /node/69935627523507f3806a8be9%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:48056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50702 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:15:52,272 - lava_callback - INFO - Received callback for node 69dda351c2164e674d720fde INFO: 172.21.0.1:41670 - "POST /node/69dda351c2164e674d720fde HTTP/1.0" 202 Accepted 2026-04-16 02:15:52,278 - lava_callback - INFO - Starting async job submit for node 69dda351c2164e674d720fde 2026-04-16 02:15:52,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:15:52,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda351c2164e674d720fde HTTP/1.1" 200 None 2026-04-16 02:15:52,322 - lava_callback - DEBUG - Processing node 69dda351c2164e674d720fde: baseline-arm-clabbe 2026-04-16 02:15:52,322 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dda351c2164e674d720fde 2026-04-16 02:15:52,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:15:52,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda351c2164e674d720fde HTTP/1.1" 200 None 2026-04-16 02:15:52,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:15:52,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-16 02:15:52,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:15:52,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dda351c2164e674d720fde HTTP/1.1" 200 None 2026-04-16 02:15:52,373 - lava_callback - ERROR - Error processing callback for node 69dda351c2164e674d720fde: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33770 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:16:32,183 - lava_callback - INFO - Received callback for node 69dda371c2164e674d721004 INFO: 172.21.0.1:33778 - "POST /node/69dda371c2164e674d721004 HTTP/1.0" 202 Accepted 2026-04-16 02:16:32,189 - lava_callback - INFO - Starting async job submit for node 69dda371c2164e674d721004 2026-04-16 02:16:32,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:16:32,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda371c2164e674d721004 HTTP/1.1" 200 None 2026-04-16 02:16:32,205 - lava_callback - DEBUG - Processing node 69dda371c2164e674d721004: baseline-arm-clabbe 2026-04-16 02:16:32,205 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dda371c2164e674d721004 2026-04-16 02:16:32,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:16:32,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda371c2164e674d721004 HTTP/1.1" 200 None 2026-04-16 02:16:32,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:16:32,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-16 02:16:32,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:16:32,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dda371c2164e674d721004 HTTP/1.1" 200 None 2026-04-16 02:16:32,253 - lava_callback - ERROR - Error processing callback for node 69dda371c2164e674d721004: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48496 - "GET /node/6991865410b45da7d7d0fd4c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:48510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50512 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40820 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:17:32,989 - lava_callback - INFO - Received callback for node 69e0442b1fb14b744a54aabe INFO: 172.21.0.1:40828 - "POST /node/69e0442b1fb14b744a54aabe HTTP/1.0" 202 Accepted 2026-04-16 02:17:33,000 - lava_callback - INFO - Starting async job submit for node 69e0442b1fb14b744a54aabe 2026-04-16 02:17:33,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:17:33,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0442b1fb14b744a54aabe HTTP/1.1" 200 None 2026-04-16 02:17:33,062 - lava_callback - DEBUG - Processing node 69e0442b1fb14b744a54aabe: baseline-nfs-arm64 2026-04-16 02:17:33,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:17:33,743 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:17:33,745 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e0442b1fb14b744a54aabe/log.txt.gz 2026-04-16 02:17:33,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:17:34,253 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:17:34,255 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e0442b1fb14b744a54aabe/lava-logs.yaml 2026-04-16 02:17:34,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:17:34,457 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:17:34,458 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e0442b1fb14b744a54aabe/lava_callback.json.gz 2026-04-16 02:17:34,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:17:34,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0442b1fb14b744a54aabe HTTP/1.1" 200 None 2026-04-16 02:17:34,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:17:34,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 02:17:34,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:17:34,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e0442b1fb14b744a54aabe HTTP/1.1" 200 None 2026-04-16 02:17:34,623 - lava_callback - INFO - Completed processing callback for node 69e0442b1fb14b744a54aabe INFO: 172.21.0.1:40842 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:17:38,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:17:38,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60658 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:19:32,296 - lava_callback - INFO - Received callback for node 69dda421c2164e674d7210ea INFO: 172.21.0.1:60660 - "POST /node/69dda421c2164e674d7210ea HTTP/1.0" 202 Accepted 2026-04-16 02:19:32,302 - lava_callback - INFO - Starting async job submit for node 69dda421c2164e674d7210ea 2026-04-16 02:19:32,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:19:32,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda421c2164e674d7210ea HTTP/1.1" 200 None 2026-04-16 02:19:32,318 - lava_callback - DEBUG - Processing node 69dda421c2164e674d7210ea: baseline-arm-clabbe 2026-04-16 02:19:32,319 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dda421c2164e674d7210ea 2026-04-16 02:19:32,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:19:32,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda421c2164e674d7210ea HTTP/1.1" 200 None 2026-04-16 02:19:32,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:19:32,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-16 02:19:32,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:19:32,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dda421c2164e674d7210ea HTTP/1.1" 200 None 2026-04-16 02:19:32,368 - lava_callback - ERROR - Error processing callback for node 69dda421c2164e674d7210ea: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36120 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:19:52,313 - lava_callback - INFO - Received callback for node 69dda444c2164e674d721100 INFO: 172.21.0.1:57740 - "POST /node/69dda444c2164e674d721100 HTTP/1.0" 202 Accepted 2026-04-16 02:19:52,319 - lava_callback - INFO - Starting async job submit for node 69dda444c2164e674d721100 2026-04-16 02:19:52,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:19:52,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda444c2164e674d721100 HTTP/1.1" 200 None 2026-04-16 02:19:52,337 - lava_callback - DEBUG - Processing node 69dda444c2164e674d721100: baseline-arm-clabbe 2026-04-16 02:19:52,337 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dda444c2164e674d721100 2026-04-16 02:19:52,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:19:52,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda444c2164e674d721100 HTTP/1.1" 200 None 2026-04-16 02:19:52,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:19:52,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-16 02:19:52,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:19:52,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dda444c2164e674d721100 HTTP/1.1" 200 None 2026-04-16 02:19:52,389 - lava_callback - ERROR - Error processing callback for node 69dda444c2164e674d721100: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52158 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:20:32,363 - lava_callback - INFO - Received callback for node 69dda464c2164e674d721129 INFO: 172.21.0.1:52164 - "POST /node/69dda464c2164e674d721129 HTTP/1.0" 202 Accepted 2026-04-16 02:20:32,369 - lava_callback - INFO - Starting async job submit for node 69dda464c2164e674d721129 2026-04-16 02:20:32,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:20:32,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda464c2164e674d721129 HTTP/1.1" 200 None 2026-04-16 02:20:32,385 - lava_callback - DEBUG - Processing node 69dda464c2164e674d721129: baseline-arm-clabbe 2026-04-16 02:20:32,385 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dda464c2164e674d721129 2026-04-16 02:20:32,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:20:32,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda464c2164e674d721129 HTTP/1.1" 200 None 2026-04-16 02:20:32,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:20:32,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-16 02:20:32,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:20:32,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dda464c2164e674d721129 HTTP/1.1" 200 None 2026-04-16 02:20:32,443 - lava_callback - ERROR - Error processing callback for node 69dda464c2164e674d721129: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60642 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:60646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56998 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:21:12,341 - lava_callback - INFO - Received callback for node 69dda486c2164e674d721154 INFO: 172.21.0.1:52730 - "POST /node/69dda486c2164e674d721154 HTTP/1.0" 202 Accepted 2026-04-16 02:21:12,350 - lava_callback - INFO - Starting async job submit for node 69dda486c2164e674d721154 2026-04-16 02:21:12,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:21:12,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda486c2164e674d721154 HTTP/1.1" 200 None 2026-04-16 02:21:12,375 - lava_callback - DEBUG - Processing node 69dda486c2164e674d721154: baseline-arm-clabbe 2026-04-16 02:21:12,375 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dda486c2164e674d721154 2026-04-16 02:21:12,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:21:12,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda486c2164e674d721154 HTTP/1.1" 200 None 2026-04-16 02:21:12,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:21:12,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-16 02:21:12,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:21:12,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dda486c2164e674d721154 HTTP/1.1" 200 None 2026-04-16 02:21:12,433 - lava_callback - ERROR - Error processing callback for node 69dda486c2164e674d721154: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55800 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:21:32,360 - lava_callback - INFO - Received callback for node 69dda4a3c2164e674d721179 INFO: 172.21.0.1:55814 - "POST /node/69dda4a3c2164e674d721179 HTTP/1.0" 202 Accepted 2026-04-16 02:21:32,366 - lava_callback - INFO - Starting async job submit for node 69dda4a3c2164e674d721179 2026-04-16 02:21:32,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:21:32,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda4a3c2164e674d721179 HTTP/1.1" 200 None 2026-04-16 02:21:32,382 - lava_callback - DEBUG - Processing node 69dda4a3c2164e674d721179: baseline-arm-clabbe 2026-04-16 02:21:32,382 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dda4a3c2164e674d721179 2026-04-16 02:21:32,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:21:32,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda4a3c2164e674d721179 HTTP/1.1" 200 None 2026-04-16 02:21:32,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:21:32,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-16 02:21:32,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:21:32,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dda4a3c2164e674d721179 HTTP/1.1" 200 None 2026-04-16 02:21:32,438 - lava_callback - ERROR - Error processing callback for node 69dda4a3c2164e674d721179: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60532 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:22:12,387 - lava_callback - INFO - Received callback for node 69dda4c8c2164e674d721196 INFO: 172.21.0.1:51316 - "POST /node/69dda4c8c2164e674d721196 HTTP/1.0" 202 Accepted 2026-04-16 02:22:12,392 - lava_callback - INFO - Starting async job submit for node 69dda4c8c2164e674d721196 2026-04-16 02:22:12,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:22:12,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda4c8c2164e674d721196 HTTP/1.1" 200 None 2026-04-16 02:22:12,417 - lava_callback - DEBUG - Processing node 69dda4c8c2164e674d721196: baseline-arm-clabbe 2026-04-16 02:22:12,417 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dda4c8c2164e674d721196 2026-04-16 02:22:12,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:22:12,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda4c8c2164e674d721196 HTTP/1.1" 200 None 2026-04-16 02:22:12,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:22:12,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-16 02:22:12,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:22:12,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dda4c8c2164e674d721196 HTTP/1.1" 200 None 2026-04-16 02:22:12,473 - lava_callback - ERROR - Error processing callback for node 69dda4c8c2164e674d721196: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50362 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:22:52,411 - lava_callback - INFO - Received callback for node 69dda4e9c2164e674d7211b2 INFO: 172.21.0.1:53256 - "POST /node/69dda4e9c2164e674d7211b2 HTTP/1.0" 202 Accepted 2026-04-16 02:22:52,417 - lava_callback - INFO - Starting async job submit for node 69dda4e9c2164e674d7211b2 2026-04-16 02:22:52,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:22:52,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda4e9c2164e674d7211b2 HTTP/1.1" 200 None 2026-04-16 02:22:52,433 - lava_callback - DEBUG - Processing node 69dda4e9c2164e674d7211b2: baseline-arm-clabbe 2026-04-16 02:22:52,434 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dda4e9c2164e674d7211b2 2026-04-16 02:22:52,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:22:52,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda4e9c2164e674d7211b2 HTTP/1.1" 200 None 2026-04-16 02:22:52,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:22:52,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-16 02:22:52,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:22:52,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dda4e9c2164e674d7211b2 HTTP/1.1" 200 None 2026-04-16 02:22:52,482 - lava_callback - ERROR - Error processing callback for node 69dda4e9c2164e674d7211b2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55770 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:25:08,418 - lava_callback - INFO - Received callback for node 69e043e21fb14b744a54aa89 INFO: 172.21.0.1:55784 - "POST /node/69e043e21fb14b744a54aa89 HTTP/1.0" 202 Accepted 2026-04-16 02:25:08,426 - lava_callback - INFO - Starting async job submit for node 69e043e21fb14b744a54aa89 2026-04-16 02:25:08,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:25:08,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e043e21fb14b744a54aa89 HTTP/1.1" 200 None 2026-04-16 02:25:08,486 - lava_callback - DEBUG - Processing node 69e043e21fb14b744a54aa89: baseline-nfs-arm64 2026-04-16 02:25:09,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:25:09,732 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:25:09,733 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e043e21fb14b744a54aa89/log.txt.gz 2026-04-16 02:25:10,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:25:10,562 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:25:10,565 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e043e21fb14b744a54aa89/lava-logs.yaml 2026-04-16 02:25:10,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:25:10,786 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:25:10,788 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e043e21fb14b744a54aa89/lava_callback.json.gz DEBUG: Setup failed for 69e043e21fb14b744a54aa89. Transitting job node result: incomplete -> fail 2026-04-16 02:25:10,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:25:10,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e043e21fb14b744a54aa89 HTTP/1.1" 200 None 2026-04-16 02:25:10,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:25:10,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 02:25:10,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:25:10,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e043e21fb14b744a54aa89 HTTP/1.1" 200 None 2026-04-16 02:25:11,030 - lava_callback - INFO - Completed processing callback for node 69e043e21fb14b744a54aa89 INFO: 172.21.0.1:42816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46562 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:25:38,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:25:38,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43046 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:27:17,513 - lava_callback - INFO - Received callback for node 69e048ee1fb14b744a54af68 INFO: 172.21.0.1:43056 - "POST /node/69e048ee1fb14b744a54af68 HTTP/1.0" 202 Accepted 2026-04-16 02:27:17,519 - lava_callback - INFO - Starting async job submit for node 69e048ee1fb14b744a54af68 2026-04-16 02:27:17,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:27:17,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e048ee1fb14b744a54af68 HTTP/1.1" 200 None 2026-04-16 02:27:17,536 - lava_callback - DEBUG - Processing node 69e048ee1fb14b744a54af68: baseline-nfs-arm64 2026-04-16 02:27:17,538 - lava_callback - WARNING - Failed to upload log 2026-04-16 02:27:17,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:27:17,705 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:27:17,706 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e048ee1fb14b744a54af68/lava-logs.yaml 2026-04-16 02:27:17,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:27:17,837 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:27:17,838 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e048ee1fb14b744a54af68/lava_callback.json.gz 2026-04-16 02:27:17,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:27:17,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e048ee1fb14b744a54af68 HTTP/1.1" 200 None 2026-04-16 02:27:17,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:27:17,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 02:27:17,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:27:17,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e048ee1fb14b744a54af68 HTTP/1.1" 200 None 2026-04-16 02:27:17,901 - lava_callback - INFO - Completed processing callback for node 69e048ee1fb14b744a54af68 2026-04-16 02:27:24,214 - lava_callback - INFO - Received callback for node 69e045421fb14b744a54aba2 INFO: 172.21.0.1:47378 - "POST /node/69e045421fb14b744a54aba2 HTTP/1.0" 202 Accepted 2026-04-16 02:27:24,221 - lava_callback - INFO - Starting async job submit for node 69e045421fb14b744a54aba2 2026-04-16 02:27:24,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:27:24,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e045421fb14b744a54aba2 HTTP/1.1" 200 None 2026-04-16 02:27:24,293 - lava_callback - DEBUG - Processing node 69e045421fb14b744a54aba2: baseline-arm 2026-04-16 02:27:24,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:27:25,094 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:27:25,096 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e045421fb14b744a54aba2/log.txt.gz 2026-04-16 02:27:25,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:27:25,714 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:27:25,717 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e045421fb14b744a54aba2/lava-logs.yaml 2026-04-16 02:27:25,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:27:25,883 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:27:25,885 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e045421fb14b744a54aba2/lava_callback.json.gz DEBUG: Setup failed for 69e045421fb14b744a54aba2. Transitting job node result: incomplete -> fail 2026-04-16 02:27:25,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:27:26,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e045421fb14b744a54aba2 HTTP/1.1" 200 None 2026-04-16 02:27:26,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:27:26,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 02:27:26,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:27:26,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e045421fb14b744a54aba2 HTTP/1.1" 200 None 2026-04-16 02:27:26,159 - lava_callback - INFO - Completed processing callback for node 69e045421fb14b744a54aba2 INFO: 172.21.0.1:47382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34594 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:27:38,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:27:38,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44394 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:31:38,924 - lava_callback - INFO - Received callback for node 69dda6fac2164e674d7213d3 INFO: 172.21.0.1:44400 - "POST /node/69dda6fac2164e674d7213d3 HTTP/1.0" 202 Accepted 2026-04-16 02:31:38,930 - lava_callback - INFO - Starting async job submit for node 69dda6fac2164e674d7213d3 2026-04-16 02:31:38,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:31:38,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda6fac2164e674d7213d3 HTTP/1.1" 200 None 2026-04-16 02:31:38,947 - lava_callback - DEBUG - Processing node 69dda6fac2164e674d7213d3: baseline-arm64-baylibre 2026-04-16 02:31:38,947 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dda6fac2164e674d7213d3 2026-04-16 02:31:38,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:31:38,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda6fac2164e674d7213d3 HTTP/1.1" 200 None 2026-04-16 02:31:38,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:31:38,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-16 02:31:38,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:31:39,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dda6fac2164e674d7213d3 HTTP/1.1" 200 None 2026-04-16 02:31:39,023 - lava_callback - ERROR - Error processing callback for node 69dda6fac2164e674d7213d3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44952 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:34:19,046 - lava_callback - INFO - Received callback for node 69dda796c2164e674d721452 INFO: 172.21.0.1:44960 - "POST /node/69dda796c2164e674d721452 HTTP/1.0" 202 Accepted 2026-04-16 02:34:19,051 - lava_callback - INFO - Starting async job submit for node 69dda796c2164e674d721452 2026-04-16 02:34:19,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:34:19,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda796c2164e674d721452 HTTP/1.1" 200 None 2026-04-16 02:34:19,074 - lava_callback - DEBUG - Processing node 69dda796c2164e674d721452: baseline-arm64-baylibre 2026-04-16 02:34:19,074 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dda796c2164e674d721452 2026-04-16 02:34:19,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:34:19,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda796c2164e674d721452 HTTP/1.1" 200 None 2026-04-16 02:34:19,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:34:19,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-16 02:34:19,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:34:19,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dda796c2164e674d721452 HTTP/1.1" 200 None 2026-04-16 02:34:19,124 - lava_callback - ERROR - Error processing callback for node 69dda796c2164e674d721452: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56086 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:34:47,769 - lava_callback - INFO - Received callback for node 69e04a911fb14b744a54b106 INFO: 172.21.0.1:56092 - "POST /node/69e04a911fb14b744a54b106 HTTP/1.0" 202 Accepted 2026-04-16 02:34:47,780 - lava_callback - INFO - Starting async job submit for node 69e04a911fb14b744a54b106 2026-04-16 02:34:47,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:34:47,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e04a911fb14b744a54b106 HTTP/1.1" 200 None 2026-04-16 02:34:47,835 - lava_callback - DEBUG - Processing node 69e04a911fb14b744a54b106: baseline-arm64 2026-04-16 02:34:47,970 - lava_callback - WARNING - Failed to upload log 2026-04-16 02:34:48,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:34:48,220 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:34:48,222 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e04a911fb14b744a54b106/lava-logs.yaml 2026-04-16 02:34:48,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:34:48,335 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:34:48,336 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e04a911fb14b744a54b106/lava_callback.json.gz 2026-04-16 02:34:48,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:34:48,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e04a911fb14b744a54b106 HTTP/1.1" 200 None 2026-04-16 02:34:48,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:34:48,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 02:34:48,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:34:48,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e04a911fb14b744a54b106 HTTP/1.1" 200 None 2026-04-16 02:34:48,500 - lava_callback - INFO - Completed processing callback for node 69e04a911fb14b744a54b106 INFO: 172.21.0.1:39370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43954 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:35:08,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:35:08,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34828 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34830 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:35:19,106 - lava_callback - INFO - Received callback for node 69dda7e0c2164e674d7214ab INFO: 172.21.0.1:34842 - "POST /node/69dda7e0c2164e674d7214ab HTTP/1.0" 202 Accepted 2026-04-16 02:35:19,111 - lava_callback - INFO - Starting async job submit for node 69dda7e0c2164e674d7214ab 2026-04-16 02:35:19,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:35:19,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda7e0c2164e674d7214ab HTTP/1.1" 200 None 2026-04-16 02:35:19,127 - lava_callback - DEBUG - Processing node 69dda7e0c2164e674d7214ab: baseline-arm64-baylibre 2026-04-16 02:35:19,128 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dda7e0c2164e674d7214ab 2026-04-16 02:35:19,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:35:19,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda7e0c2164e674d7214ab HTTP/1.1" 200 None 2026-04-16 02:35:19,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:35:19,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-16 02:35:19,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:35:19,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dda7e0c2164e674d7214ab HTTP/1.1" 200 None 2026-04-16 02:35:19,182 - lava_callback - ERROR - Error processing callback for node 69dda7e0c2164e674d7214ab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34752 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:37:34,254 - lava_callback - INFO - Received callback for node 69e04b1f1fb14b744a54b18e INFO: 172.21.0.1:34760 - "POST /node/69e04b1f1fb14b744a54b18e HTTP/1.0" 202 Accepted 2026-04-16 02:37:34,261 - lava_callback - INFO - Starting async job submit for node 69e04b1f1fb14b744a54b18e 2026-04-16 02:37:34,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:37:34,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e04b1f1fb14b744a54b18e HTTP/1.1" 200 None 2026-04-16 02:37:34,306 - lava_callback - DEBUG - Processing node 69e04b1f1fb14b744a54b18e: baseline-arm64 2026-04-16 02:37:34,552 - lava_callback - WARNING - Failed to upload log 2026-04-16 02:37:34,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:37:34,900 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:37:34,902 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e04b1f1fb14b744a54b18e/lava-logs.yaml 2026-04-16 02:37:34,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:37:35,050 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:37:35,052 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e04b1f1fb14b744a54b18e/lava_callback.json.gz 2026-04-16 02:37:35,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:37:35,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e04b1f1fb14b744a54b18e HTTP/1.1" 200 None 2026-04-16 02:37:35,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:37:35,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 02:37:35,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:37:35,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e04b1f1fb14b744a54b18e HTTP/1.1" 200 None 2026-04-16 02:37:35,239 - lava_callback - INFO - Completed processing callback for node 69e04b1f1fb14b744a54b18e INFO: 172.21.0.1:34762 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:37:38,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:37:38,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43360 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:37:59,266 - lava_callback - INFO - Received callback for node 69dda877c2164e674d72154d INFO: 172.21.0.1:43368 - "POST /node/69dda877c2164e674d72154d HTTP/1.0" 202 Accepted 2026-04-16 02:37:59,271 - lava_callback - INFO - Starting async job submit for node 69dda877c2164e674d72154d 2026-04-16 02:37:59,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:37:59,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda877c2164e674d72154d HTTP/1.1" 200 None 2026-04-16 02:37:59,287 - lava_callback - DEBUG - Processing node 69dda877c2164e674d72154d: baseline-arm64-baylibre 2026-04-16 02:37:59,288 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dda877c2164e674d72154d 2026-04-16 02:37:59,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:37:59,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda877c2164e674d72154d HTTP/1.1" 200 None 2026-04-16 02:37:59,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:37:59,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-16 02:37:59,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:37:59,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dda877c2164e674d72154d HTTP/1.1" 200 None 2026-04-16 02:37:59,365 - lava_callback - ERROR - Error processing callback for node 69dda877c2164e674d72154d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58014 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:38:42,935 - lava_callback - INFO - Received callback for node 69e04b651fb14b744a54b1f1 INFO: 172.21.0.1:52870 - "POST /node/69e04b651fb14b744a54b1f1 HTTP/1.0" 202 Accepted 2026-04-16 02:38:42,941 - lava_callback - INFO - Starting async job submit for node 69e04b651fb14b744a54b1f1 2026-04-16 02:38:42,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:38:42,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e04b651fb14b744a54b1f1 HTTP/1.1" 200 None 2026-04-16 02:38:42,981 - lava_callback - DEBUG - Processing node 69e04b651fb14b744a54b1f1: baseline-arm64 2026-04-16 02:38:43,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:38:43,536 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:38:43,537 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e04b651fb14b744a54b1f1/log.txt.gz 2026-04-16 02:38:43,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:38:43,985 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:38:43,987 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e04b651fb14b744a54b1f1/lava-logs.yaml 2026-04-16 02:38:43,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:38:44,165 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:38:44,166 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e04b651fb14b744a54b1f1/lava_callback.json.gz 2026-04-16 02:38:44,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:38:44,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e04b651fb14b744a54b1f1 HTTP/1.1" 200 None 2026-04-16 02:38:44,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:38:44,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 02:38:44,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:38:44,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e04b651fb14b744a54b1f1 HTTP/1.1" 200 None 2026-04-16 02:38:44,309 - lava_callback - INFO - Completed processing callback for node 69e04b651fb14b744a54b1f1 INFO: 172.21.0.1:52878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48472 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:39:08,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:39:08,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55606 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38134 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54448 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:40:39,405 - lava_callback - INFO - Received callback for node 69dda91ac2164e674d7215b6 INFO: 172.21.0.1:54450 - "POST /node/69dda91ac2164e674d7215b6 HTTP/1.0" 202 Accepted 2026-04-16 02:40:39,410 - lava_callback - INFO - Starting async job submit for node 69dda91ac2164e674d7215b6 2026-04-16 02:40:39,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:40:39,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda91ac2164e674d7215b6 HTTP/1.1" 200 None 2026-04-16 02:40:39,426 - lava_callback - DEBUG - Processing node 69dda91ac2164e674d7215b6: baseline-arm64-baylibre 2026-04-16 02:40:39,426 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dda91ac2164e674d7215b6 2026-04-16 02:40:39,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:40:39,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda91ac2164e674d7215b6 HTTP/1.1" 200 None 2026-04-16 02:40:39,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:40:39,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-16 02:40:39,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:40:39,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dda91ac2164e674d7215b6 HTTP/1.1" 200 None 2026-04-16 02:40:39,477 - lava_callback - ERROR - Error processing callback for node 69dda91ac2164e674d7215b6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39320 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:42:00,207 - lava_callback - INFO - Received callback for node 69dda963c2164e674d721622 INFO: 172.21.0.1:35808 - "POST /node/69dda963c2164e674d721622 HTTP/1.0" 202 Accepted 2026-04-16 02:42:00,217 - lava_callback - INFO - Starting async job submit for node 69dda963c2164e674d721622 2026-04-16 02:42:00,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:42:00,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda963c2164e674d721622 HTTP/1.1" 200 None 2026-04-16 02:42:00,246 - lava_callback - DEBUG - Processing node 69dda963c2164e674d721622: baseline-arm64-baylibre 2026-04-16 02:42:00,246 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dda963c2164e674d721622 2026-04-16 02:42:00,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:42:00,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda963c2164e674d721622 HTTP/1.1" 200 None 2026-04-16 02:42:00,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:42:00,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-16 02:42:00,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:42:00,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dda963c2164e674d721622 HTTP/1.1" 200 None 2026-04-16 02:42:00,304 - lava_callback - ERROR - Error processing callback for node 69dda963c2164e674d721622: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57850 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:45:53,444 - lava_callback - INFO - Received callback for node 69ddaa4dc2164e674d72171a INFO: 172.21.0.1:49594 - "POST /node/69ddaa4dc2164e674d72171a HTTP/1.0" 202 Accepted 2026-04-16 02:45:53,450 - lava_callback - INFO - Starting async job submit for node 69ddaa4dc2164e674d72171a 2026-04-16 02:45:53,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:45:53,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddaa4dc2164e674d72171a HTTP/1.1" 200 None 2026-04-16 02:45:53,476 - lava_callback - DEBUG - Processing node 69ddaa4dc2164e674d72171a: baseline-arm64-clabbe 2026-04-16 02:45:53,477 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddaa4dc2164e674d72171a 2026-04-16 02:45:53,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:45:53,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddaa4dc2164e674d72171a HTTP/1.1" 200 None 2026-04-16 02:45:53,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:45:53,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-16 02:45:53,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:45:53,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddaa4dc2164e674d72171a HTTP/1.1" 200 None 2026-04-16 02:45:53,526 - lava_callback - ERROR - Error processing callback for node 69ddaa4dc2164e674d72171a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49598 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:46:00,199 - lava_callback - INFO - Received callback for node 69e04ba91fb14b744a54b24a INFO: 172.21.0.1:37362 - "POST /node/69e04ba91fb14b744a54b24a HTTP/1.0" 202 Accepted 2026-04-16 02:46:00,206 - lava_callback - INFO - Starting async job submit for node 69e04ba91fb14b744a54b24a 2026-04-16 02:46:00,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:46:00,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e04ba91fb14b744a54b24a HTTP/1.1" 200 None 2026-04-16 02:46:00,267 - lava_callback - DEBUG - Processing node 69e04ba91fb14b744a54b24a: baseline-arm64 2026-04-16 02:46:00,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:46:00,830 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:46:00,832 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e04ba91fb14b744a54b24a/log.txt.gz 2026-04-16 02:46:01,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:46:01,331 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:46:01,333 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e04ba91fb14b744a54b24a/lava-logs.yaml 2026-04-16 02:46:01,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:46:01,523 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:46:01,525 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e04ba91fb14b744a54b24a/lava_callback.json.gz DEBUG: Setup failed for 69e04ba91fb14b744a54b24a. Transitting job node result: incomplete -> fail 2026-04-16 02:46:01,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:46:01,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e04ba91fb14b744a54b24a HTTP/1.1" 200 None 2026-04-16 02:46:01,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:46:01,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 02:46:01,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:46:01,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e04ba91fb14b744a54b24a HTTP/1.1" 200 None 2026-04-16 02:46:01,726 - lava_callback - INFO - Completed processing callback for node 69e04ba91fb14b744a54b24a INFO: 172.21.0.1:37366 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:46:08,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:46:08,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42034 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:46:53,464 - lava_callback - INFO - Received callback for node 69ddaa98c2164e674d721788 INFO: 172.21.0.1:58924 - "POST /node/69ddaa98c2164e674d721788 HTTP/1.0" 202 Accepted 2026-04-16 02:46:53,470 - lava_callback - INFO - Starting async job submit for node 69ddaa98c2164e674d721788 2026-04-16 02:46:53,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:46:53,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddaa98c2164e674d721788 HTTP/1.1" 200 None 2026-04-16 02:46:53,486 - lava_callback - DEBUG - Processing node 69ddaa98c2164e674d721788: baseline-arm64-clabbe 2026-04-16 02:46:53,486 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddaa98c2164e674d721788 2026-04-16 02:46:53,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:46:53,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddaa98c2164e674d721788 HTTP/1.1" 200 None 2026-04-16 02:46:53,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:46:53,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-16 02:46:53,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:46:53,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddaa98c2164e674d721788 HTTP/1.1" 200 None 2026-04-16 02:46:53,571 - lava_callback - ERROR - Error processing callback for node 69ddaa98c2164e674d721788: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60230 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:48:04,821 - lava_callback - INFO - Received callback for node 69e049ba1fb14b744a54b01d INFO: 172.21.0.1:49256 - "POST /node/69e049ba1fb14b744a54b01d HTTP/1.0" 202 Accepted 2026-04-16 02:48:04,828 - lava_callback - INFO - Starting async job submit for node 69e049ba1fb14b744a54b01d 2026-04-16 02:48:04,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:48:04,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e049ba1fb14b744a54b01d HTTP/1.1" 200 None 2026-04-16 02:48:04,902 - lava_callback - DEBUG - Processing node 69e049ba1fb14b744a54b01d: ltp-smoke 2026-04-16 02:48:05,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:48:05,799 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:48:05,801 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69e049ba1fb14b744a54b01d/log.txt.gz 2026-04-16 02:48:06,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:48:06,288 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:48:06,290 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69e049ba1fb14b744a54b01d/lava-logs.yaml 2026-04-16 02:48:06,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:48:06,476 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:48:06,478 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69e049ba1fb14b744a54b01d/lava_callback.json.gz INFO: 172.21.0.1:49272 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:48:06,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:48:06,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e049ba1fb14b744a54b01d HTTP/1.1" 200 None 2026-04-16 02:48:06,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:48:06,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a2e1fb14b744a54889b HTTP/1.1" 200 None 2026-04-16 02:48:06,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:48:06,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e049ba1fb14b744a54b01d HTTP/1.1" 200 None 2026-04-16 02:48:06,782 - lava_callback - INFO - Completed processing callback for node 69e049ba1fb14b744a54b01d 2026-04-16 02:48:08,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:48:08,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43354 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:48:33,562 - lava_callback - INFO - Received callback for node 69ddaaedc2164e674d7217dd INFO: 172.21.0.1:43360 - "POST /node/69ddaaedc2164e674d7217dd HTTP/1.0" 202 Accepted 2026-04-16 02:48:33,567 - lava_callback - INFO - Starting async job submit for node 69ddaaedc2164e674d7217dd 2026-04-16 02:48:33,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:48:33,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddaaedc2164e674d7217dd HTTP/1.1" 200 None 2026-04-16 02:48:33,584 - lava_callback - DEBUG - Processing node 69ddaaedc2164e674d7217dd: baseline-arm64-clabbe 2026-04-16 02:48:33,584 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddaaedc2164e674d7217dd 2026-04-16 02:48:33,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:48:33,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddaaedc2164e674d7217dd HTTP/1.1" 200 None 2026-04-16 02:48:33,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:48:33,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-16 02:48:33,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:48:33,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddaaedc2164e674d7217dd HTTP/1.1" 200 None 2026-04-16 02:48:33,641 - lava_callback - ERROR - Error processing callback for node 69ddaaedc2164e674d7217dd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32908 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:49:33,601 - lava_callback - INFO - Received callback for node 69ddab39c2164e674d721831 INFO: 172.21.0.1:32910 - "POST /node/69ddab39c2164e674d721831 HTTP/1.0" 202 Accepted 2026-04-16 02:49:33,607 - lava_callback - INFO - Starting async job submit for node 69ddab39c2164e674d721831 2026-04-16 02:49:33,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:49:33,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddab39c2164e674d721831 HTTP/1.1" 200 None 2026-04-16 02:49:33,627 - lava_callback - DEBUG - Processing node 69ddab39c2164e674d721831: baseline-arm64-clabbe 2026-04-16 02:49:33,627 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddab39c2164e674d721831 2026-04-16 02:49:33,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:49:33,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddab39c2164e674d721831 HTTP/1.1" 200 None 2026-04-16 02:49:33,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:49:33,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-16 02:49:33,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:49:33,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddab39c2164e674d721831 HTTP/1.1" 200 None 2026-04-16 02:49:33,677 - lava_callback - ERROR - Error processing callback for node 69ddab39c2164e674d721831: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44032 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:50:53,697 - lava_callback - INFO - Received callback for node 69ddab8bc2164e674d721872 INFO: 172.21.0.1:48110 - "POST /node/69ddab8bc2164e674d721872 HTTP/1.0" 202 Accepted 2026-04-16 02:50:53,703 - lava_callback - INFO - Starting async job submit for node 69ddab8bc2164e674d721872 2026-04-16 02:50:53,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:50:53,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddab8bc2164e674d721872 HTTP/1.1" 200 None 2026-04-16 02:50:53,719 - lava_callback - DEBUG - Processing node 69ddab8bc2164e674d721872: baseline-arm64-clabbe 2026-04-16 02:50:53,719 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddab8bc2164e674d721872 2026-04-16 02:50:53,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:50:53,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddab8bc2164e674d721872 HTTP/1.1" 200 None 2026-04-16 02:50:53,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:50:53,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-16 02:50:53,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:50:53,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddab8bc2164e674d721872 HTTP/1.1" 200 None 2026-04-16 02:50:53,769 - lava_callback - ERROR - Error processing callback for node 69ddab8bc2164e674d721872: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 02:50:53,960 - lava_callback - INFO - Received callback for node 69e04e751fb14b744a54b4cc INFO: 172.21.0.1:48120 - "POST /node/69e04e751fb14b744a54b4cc HTTP/1.0" 202 Accepted 2026-04-16 02:50:53,966 - lava_callback - INFO - Starting async job submit for node 69e04e751fb14b744a54b4cc 2026-04-16 02:50:53,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:50:53,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e04e751fb14b744a54b4cc HTTP/1.1" 200 None 2026-04-16 02:50:53,984 - lava_callback - DEBUG - Processing node 69e04e751fb14b744a54b4cc: baseline-nfs-arm64 2026-04-16 02:50:53,986 - lava_callback - WARNING - Failed to upload log 2026-04-16 02:50:53,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:50:54,132 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:50:54,134 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e04e751fb14b744a54b4cc/lava-logs.yaml 2026-04-16 02:50:54,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:50:54,249 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:50:54,250 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e04e751fb14b744a54b4cc/lava_callback.json.gz 2026-04-16 02:50:54,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:50:54,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e04e751fb14b744a54b4cc HTTP/1.1" 200 None 2026-04-16 02:50:54,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:50:54,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 02:50:54,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:50:54,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e04e751fb14b744a54b4cc HTTP/1.1" 200 None 2026-04-16 02:50:54,329 - lava_callback - INFO - Completed processing callback for node 69e04e751fb14b744a54b4cc INFO: 172.21.0.1:48134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50322 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:51:08,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:51:08,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44692 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:52:33,746 - lava_callback - INFO - Received callback for node 69ddabdec2164e674d7218c4 INFO: 172.21.0.1:44694 - "POST /node/69ddabdec2164e674d7218c4 HTTP/1.0" 202 Accepted 2026-04-16 02:52:33,752 - lava_callback - INFO - Starting async job submit for node 69ddabdec2164e674d7218c4 2026-04-16 02:52:33,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:52:33,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddabdec2164e674d7218c4 HTTP/1.1" 200 None 2026-04-16 02:52:33,780 - lava_callback - DEBUG - Processing node 69ddabdec2164e674d7218c4: baseline-arm64-clabbe 2026-04-16 02:52:33,780 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddabdec2164e674d7218c4 2026-04-16 02:52:33,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:52:33,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddabdec2164e674d7218c4 HTTP/1.1" 200 None 2026-04-16 02:52:33,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:52:33,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-16 02:52:33,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:52:33,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddabdec2164e674d7218c4 HTTP/1.1" 200 None 2026-04-16 02:52:33,829 - lava_callback - ERROR - Error processing callback for node 69ddabdec2164e674d7218c4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51814 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:53:33,837 - lava_callback - INFO - Received callback for node 69ddac27c2164e674d721919 INFO: 172.21.0.1:51818 - "POST /node/69ddac27c2164e674d721919 HTTP/1.0" 202 Accepted 2026-04-16 02:53:33,843 - lava_callback - INFO - Starting async job submit for node 69ddac27c2164e674d721919 2026-04-16 02:53:33,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:53:33,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddac27c2164e674d721919 HTTP/1.1" 200 None 2026-04-16 02:53:33,864 - lava_callback - DEBUG - Processing node 69ddac27c2164e674d721919: baseline-arm64-clabbe 2026-04-16 02:53:33,864 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddac27c2164e674d721919 2026-04-16 02:53:33,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:53:33,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddac27c2164e674d721919 HTTP/1.1" 200 None 2026-04-16 02:53:33,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:53:33,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-16 02:53:33,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:53:33,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddac27c2164e674d721919 HTTP/1.1" 200 None 2026-04-16 02:53:33,924 - lava_callback - ERROR - Error processing callback for node 69ddac27c2164e674d721919: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46888 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:53:55,351 - lava_callback - INFO - Received callback for node 69e04f111fb14b744a54b558 INFO: 172.21.0.1:46184 - "POST /node/69e04f111fb14b744a54b558 HTTP/1.0" 202 Accepted 2026-04-16 02:53:55,358 - lava_callback - INFO - Starting async job submit for node 69e04f111fb14b744a54b558 2026-04-16 02:53:55,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:53:55,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e04f111fb14b744a54b558 HTTP/1.1" 200 None 2026-04-16 02:53:55,404 - lava_callback - DEBUG - Processing node 69e04f111fb14b744a54b558: baseline-arm64 2026-04-16 02:53:55,538 - lava_callback - WARNING - Failed to upload log 2026-04-16 02:53:55,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:53:55,787 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:53:55,788 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e04f111fb14b744a54b558/lava-logs.yaml 2026-04-16 02:53:55,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:53:55,915 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:53:55,916 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e04f111fb14b744a54b558/lava_callback.json.gz 2026-04-16 02:53:55,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:53:55,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e04f111fb14b744a54b558 HTTP/1.1" 200 None 2026-04-16 02:53:55,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:53:55,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 02:53:55,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:53:55,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e04f111fb14b744a54b558 HTTP/1.1" 200 None 2026-04-16 02:53:56,063 - lava_callback - INFO - Completed processing callback for node 69e04f111fb14b744a54b558 INFO: 172.21.0.1:46192 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:54:01,712 - lava_callback - INFO - Received callback for node 69e04ccc1fb14b744a54b33d INFO: 172.21.0.1:37034 - "POST /node/69e04ccc1fb14b744a54b33d HTTP/1.0" 202 Accepted 2026-04-16 02:54:01,718 - lava_callback - INFO - Starting async job submit for node 69e04ccc1fb14b744a54b33d 2026-04-16 02:54:01,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:54:01,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e04ccc1fb14b744a54b33d HTTP/1.1" 200 None 2026-04-16 02:54:01,762 - lava_callback - DEBUG - Processing node 69e04ccc1fb14b744a54b33d: baseline-arm64 2026-04-16 02:54:02,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:54:02,453 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:54:02,454 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e04ccc1fb14b744a54b33d/log.txt.gz 2026-04-16 02:54:02,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:54:02,930 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:54:02,932 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e04ccc1fb14b744a54b33d/lava-logs.yaml 2026-04-16 02:54:02,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:54:03,111 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:54:03,113 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e04ccc1fb14b744a54b33d/lava_callback.json.gz 2026-04-16 02:54:03,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:54:03,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e04ccc1fb14b744a54b33d HTTP/1.1" 200 None 2026-04-16 02:54:03,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:54:03,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 02:54:03,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:54:03,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e04ccc1fb14b744a54b33d HTTP/1.1" 200 None 2026-04-16 02:54:03,237 - lava_callback - INFO - Completed processing callback for node 69e04ccc1fb14b744a54b33d INFO: 172.21.0.1:37038 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:54:08,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:54:08,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48508 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:55:35,841 - lava_callback - INFO - Received callback for node 69e04f761fb14b744a54b5e0 INFO: 172.21.0.1:48524 - "POST /node/69e04f761fb14b744a54b5e0 HTTP/1.0" 202 Accepted 2026-04-16 02:55:35,848 - lava_callback - INFO - Starting async job submit for node 69e04f761fb14b744a54b5e0 2026-04-16 02:55:35,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:55:35,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e04f761fb14b744a54b5e0 HTTP/1.1" 200 None 2026-04-16 02:55:35,892 - lava_callback - DEBUG - Processing node 69e04f761fb14b744a54b5e0: baseline-arm64 2026-04-16 02:55:36,060 - lava_callback - WARNING - Failed to upload log 2026-04-16 02:55:36,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:55:36,334 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:55:36,336 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e04f761fb14b744a54b5e0/lava-logs.yaml 2026-04-16 02:55:36,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:55:36,481 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:55:36,483 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e04f761fb14b744a54b5e0/lava_callback.json.gz 2026-04-16 02:55:36,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:48540 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:55:36,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e04f761fb14b744a54b5e0 HTTP/1.1" 200 None 2026-04-16 02:55:36,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:55:36,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 02:55:36,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:55:36,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e04f761fb14b744a54b5e0 HTTP/1.1" 200 None 2026-04-16 02:55:36,659 - lava_callback - INFO - Completed processing callback for node 69e04f761fb14b744a54b5e0 2026-04-16 02:55:38,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:55:38,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58076 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:56:52,343 - lava_callback - INFO - Received callback for node 69e04d1c1fb14b744a54b366 INFO: 172.21.0.1:34812 - "POST /node/69e04d1c1fb14b744a54b366 HTTP/1.0" 202 Accepted 2026-04-16 02:56:52,351 - lava_callback - INFO - Starting async job submit for node 69e04d1c1fb14b744a54b366 2026-04-16 02:56:52,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:56:52,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e04d1c1fb14b744a54b366 HTTP/1.1" 200 None 2026-04-16 02:56:52,398 - lava_callback - DEBUG - Processing node 69e04d1c1fb14b744a54b366: baseline-nfs-arm64 2026-04-16 02:56:52,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:56:53,072 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:56:53,074 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e04d1c1fb14b744a54b366/log.txt.gz 2026-04-16 02:56:53,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:56:53,576 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:56:53,578 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e04d1c1fb14b744a54b366/lava-logs.yaml 2026-04-16 02:56:53,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:56:53,771 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:56:53,773 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e04d1c1fb14b744a54b366/lava_callback.json.gz 2026-04-16 02:56:53,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:56:53,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e04d1c1fb14b744a54b366 HTTP/1.1" 200 None 2026-04-16 02:56:53,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:56:53,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 02:56:53,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:56:53,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e04d1c1fb14b744a54b366 HTTP/1.1" 200 None 2026-04-16 02:56:53,969 - lava_callback - INFO - Completed processing callback for node 69e04d1c1fb14b744a54b366 INFO: 172.21.0.1:34816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39332 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:57:08,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:57:08,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51882 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33214 - "GET / HTTP/1.0" 200 OK 2026-04-16 03:03:28,715 - lava_callback - INFO - Received callback for node 69e04fbf1fb14b744a54b625 INFO: 172.21.0.1:33226 - "POST /node/69e04fbf1fb14b744a54b625 HTTP/1.0" 202 Accepted 2026-04-16 03:03:28,723 - lava_callback - INFO - Starting async job submit for node 69e04fbf1fb14b744a54b625 2026-04-16 03:03:28,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:03:28,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e04fbf1fb14b744a54b625 HTTP/1.1" 200 None 2026-04-16 03:03:28,770 - lava_callback - DEBUG - Processing node 69e04fbf1fb14b744a54b625: baseline-arm64 2026-04-16 03:03:29,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 03:03:29,570 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 03:03:29,572 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e04fbf1fb14b744a54b625/log.txt.gz 2026-04-16 03:03:30,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 03:03:30,271 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 03:03:30,273 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e04fbf1fb14b744a54b625/lava-logs.yaml 2026-04-16 03:03:30,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 03:03:30,443 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 03:03:30,445 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e04fbf1fb14b744a54b625/lava_callback.json.gz 2026-04-16 03:03:30,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:03:30,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e04fbf1fb14b744a54b625 HTTP/1.1" 200 None 2026-04-16 03:03:30,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:03:30,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 03:03:30,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:03:30,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e04fbf1fb14b744a54b625 HTTP/1.1" 200 None 2026-04-16 03:03:30,529 - lava_callback - INFO - Completed processing callback for node 69e04fbf1fb14b744a54b625 INFO: 172.21.0.1:36138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36148 - "GET / HTTP/1.0" 200 OK 2026-04-16 03:03:38,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:03:38,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57192 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42026 - "GET / HTTP/1.0" 200 OK 2026-04-16 03:07:59,875 - lava_callback - INFO - Received callback for node 69e04de71fb14b744a54b447 INFO: 172.21.0.1:36716 - "POST /node/69e04de71fb14b744a54b447 HTTP/1.0" 202 Accepted 2026-04-16 03:07:59,882 - lava_callback - INFO - Starting async job submit for node 69e04de71fb14b744a54b447 2026-04-16 03:07:59,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:07:59,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e04de71fb14b744a54b447 HTTP/1.1" 200 None 2026-04-16 03:07:59,942 - lava_callback - DEBUG - Processing node 69e04de71fb14b744a54b447: baseline-nfs-arm64 2026-04-16 03:08:01,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 03:08:01,219 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 03:08:01,221 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e04de71fb14b744a54b447/log.txt.gz 2026-04-16 03:08:01,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 03:08:02,031 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 03:08:02,033 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e04de71fb14b744a54b447/lava-logs.yaml 2026-04-16 03:08:02,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 03:08:02,281 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 03:08:02,283 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e04de71fb14b744a54b447/lava_callback.json.gz DEBUG: Setup failed for 69e04de71fb14b744a54b447. Transitting job node result: incomplete -> fail 2026-04-16 03:08:02,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:08:02,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e04de71fb14b744a54b447 HTTP/1.1" 200 None 2026-04-16 03:08:02,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:08:02,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 03:08:02,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:08:02,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e04de71fb14b744a54b447 HTTP/1.1" 200 None 2026-04-16 03:08:02,583 - lava_callback - INFO - Completed processing callback for node 69e04de71fb14b744a54b447 INFO: 172.21.0.1:36722 - "GET / HTTP/1.0" 200 OK 2026-04-16 03:08:08,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:08:08,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-16 03:08:12,634 - lava_callback - INFO - Received callback for node 69e04eb01fb14b744a54b516 INFO: 172.21.0.1:52274 - "POST /node/69e04eb01fb14b744a54b516 HTTP/1.0" 202 Accepted 2026-04-16 03:08:12,641 - lava_callback - INFO - Starting async job submit for node 69e04eb01fb14b744a54b516 2026-04-16 03:08:12,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:08:12,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e04eb01fb14b744a54b516 HTTP/1.1" 200 None 2026-04-16 03:08:12,728 - lava_callback - DEBUG - Processing node 69e04eb01fb14b744a54b516: baseline-arm 2026-04-16 03:08:13,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 03:08:13,540 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 03:08:13,542 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e04eb01fb14b744a54b516/log.txt.gz 2026-04-16 03:08:13,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 03:08:14,195 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 03:08:14,197 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e04eb01fb14b744a54b516/lava-logs.yaml 2026-04-16 03:08:14,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 03:08:14,364 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 03:08:14,366 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e04eb01fb14b744a54b516/lava_callback.json.gz DEBUG: Setup failed for 69e04eb01fb14b744a54b516. Transitting job node result: incomplete -> fail 2026-04-16 03:08:14,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:08:14,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e04eb01fb14b744a54b516 HTTP/1.1" 200 None 2026-04-16 03:08:14,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:08:14,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 03:08:14,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:08:14,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e04eb01fb14b744a54b516 HTTP/1.1" 200 None 2026-04-16 03:08:14,681 - lava_callback - INFO - Completed processing callback for node 69e04eb01fb14b744a54b516 INFO: 172.21.0.1:52290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47028 - "GET / HTTP/1.0" 200 OK 2026-04-16 03:08:38,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:08:38,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53970 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49690 - "GET / HTTP/1.0" 200 OK 2026-04-16 03:12:19,181 - lava_callback - INFO - Received callback for node 69e051dc1fb14b744a54b84e INFO: 172.21.0.1:49704 - "POST /node/69e051dc1fb14b744a54b84e HTTP/1.0" 202 Accepted 2026-04-16 03:12:19,189 - lava_callback - INFO - Starting async job submit for node 69e051dc1fb14b744a54b84e 2026-04-16 03:12:19,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:12:19,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e051dc1fb14b744a54b84e HTTP/1.1" 200 None 2026-04-16 03:12:19,250 - lava_callback - DEBUG - Processing node 69e051dc1fb14b744a54b84e: baseline-arm64 2026-04-16 03:12:19,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 03:12:19,761 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 03:12:19,763 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e051dc1fb14b744a54b84e/log.txt.gz 2026-04-16 03:12:19,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 03:12:20,176 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 03:12:20,178 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e051dc1fb14b744a54b84e/lava-logs.yaml 2026-04-16 03:12:20,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 03:12:20,363 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 03:12:20,365 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e051dc1fb14b744a54b84e/lava_callback.json.gz DEBUG: Setup failed for 69e051dc1fb14b744a54b84e. Transitting job node result: incomplete -> fail 2026-04-16 03:12:20,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:12:20,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e051dc1fb14b744a54b84e HTTP/1.1" 200 None 2026-04-16 03:12:20,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:12:20,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 03:12:20,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:12:20,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e051dc1fb14b744a54b84e HTTP/1.1" 200 None 2026-04-16 03:12:20,653 - lava_callback - INFO - Completed processing callback for node 69e051dc1fb14b744a54b84e INFO: 172.21.0.1:45214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59646 - "GET / HTTP/1.0" 200 OK 2026-04-16 03:12:38,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:12:38,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59308 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43212 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49046 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50728 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58856 - "GET / HTTP/1.0" 200 OK 2026-04-16 03:22:22,646 - lava_callback - INFO - Received callback for node 69e053711fb14b744a54ba13 INFO: 172.21.0.1:46822 - "POST /node/69e053711fb14b744a54ba13 HTTP/1.0" 202 Accepted 2026-04-16 03:22:22,652 - lava_callback - INFO - Starting async job submit for node 69e053711fb14b744a54ba13 2026-04-16 03:22:22,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:22:22,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e053711fb14b744a54ba13 HTTP/1.1" 200 None 2026-04-16 03:22:22,693 - lava_callback - DEBUG - Processing node 69e053711fb14b744a54ba13: baseline-arm64 2026-04-16 03:22:23,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 03:22:23,362 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 03:22:23,363 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e053711fb14b744a54ba13/log.txt.gz 2026-04-16 03:22:23,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 03:22:23,819 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 03:22:23,821 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e053711fb14b744a54ba13/lava-logs.yaml 2026-04-16 03:22:23,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 03:22:23,998 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 03:22:24,000 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e053711fb14b744a54ba13/lava_callback.json.gz 2026-04-16 03:22:24,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:22:24,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e053711fb14b744a54ba13 HTTP/1.1" 200 None 2026-04-16 03:22:24,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:22:24,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 03:22:24,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:22:24,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e053711fb14b744a54ba13 HTTP/1.1" 200 None 2026-04-16 03:22:24,160 - lava_callback - INFO - Completed processing callback for node 69e053711fb14b744a54ba13 INFO: 172.21.0.1:46828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57234 - "GET / HTTP/1.0" 200 OK 2026-04-16 03:22:38,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:22:38,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40076 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42090 - "GET / HTTP/1.0" 200 OK 2026-04-16 03:24:53,340 - lava_callback - INFO - Received callback for node 69e054011fb14b744a54bab2 INFO: 172.21.0.1:58346 - "POST /node/69e054011fb14b744a54bab2 HTTP/1.0" 202 Accepted 2026-04-16 03:24:53,347 - lava_callback - INFO - Starting async job submit for node 69e054011fb14b744a54bab2 2026-04-16 03:24:53,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:24:53,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e054011fb14b744a54bab2 HTTP/1.1" 200 None 2026-04-16 03:24:53,395 - lava_callback - DEBUG - Processing node 69e054011fb14b744a54bab2: baseline-nfs-arm64 2026-04-16 03:24:53,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 03:24:54,060 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 03:24:54,062 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e054011fb14b744a54bab2/log.txt.gz 2026-04-16 03:24:54,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 03:24:54,562 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 03:24:54,565 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e054011fb14b744a54bab2/lava-logs.yaml 2026-04-16 03:24:54,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 03:24:54,769 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 03:24:54,770 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e054011fb14b744a54bab2/lava_callback.json.gz 2026-04-16 03:24:54,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:24:54,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e054011fb14b744a54bab2 HTTP/1.1" 200 None 2026-04-16 03:24:54,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:24:54,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 03:24:54,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:24:54,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e054011fb14b744a54bab2 HTTP/1.1" 200 None 2026-04-16 03:24:54,910 - lava_callback - INFO - Completed processing callback for node 69e054011fb14b744a54bab2 INFO: 172.21.0.1:58362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52814 - "GET / HTTP/1.0" 200 OK 2026-04-16 03:25:08,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:25:09,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44084 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52922 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34090 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59938 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58828 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33296 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36132 - "GET /node/69562ef816d33f8361befc51%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:36138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39072 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42036 - "GET / HTTP/1.0" 200 OK 2026-04-16 03:45:50,842 - lava_callback - INFO - Received callback for node 69e056d31fb14b744a54bd2d INFO: 172.21.0.1:51882 - "POST /node/69e056d31fb14b744a54bd2d HTTP/1.0" 202 Accepted 2026-04-16 03:45:50,850 - lava_callback - INFO - Starting async job submit for node 69e056d31fb14b744a54bd2d 2026-04-16 03:45:50,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:45:50,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e056d31fb14b744a54bd2d HTTP/1.1" 200 None 2026-04-16 03:45:50,929 - lava_callback - DEBUG - Processing node 69e056d31fb14b744a54bd2d: baseline-nfs-arm64 2026-04-16 03:45:51,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 03:45:52,145 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 03:45:52,147 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e056d31fb14b744a54bd2d/log.txt.gz 2026-04-16 03:45:52,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 03:45:52,965 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 03:45:52,967 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e056d31fb14b744a54bd2d/lava-logs.yaml 2026-04-16 03:45:52,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 03:45:53,358 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 03:45:53,360 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e056d31fb14b744a54bd2d/lava_callback.json.gz DEBUG: Setup failed for 69e056d31fb14b744a54bd2d. Transitting job node result: incomplete -> fail 2026-04-16 03:45:53,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:45:53,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e056d31fb14b744a54bd2d HTTP/1.1" 200 None 2026-04-16 03:45:53,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:45:53,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 03:45:53,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:45:53,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e056d31fb14b744a54bd2d HTTP/1.1" 200 None 2026-04-16 03:45:53,597 - lava_callback - INFO - Completed processing callback for node 69e056d31fb14b744a54bd2d INFO: 172.21.0.1:51892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46864 - "GET / HTTP/1.0" 200 OK 2026-04-16 03:46:09,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:46:09,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53590 - "GET /node/698bd0561e517752bab8adb7%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:53600 - "GET /node/6993281b31166481c8de8efa%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:53616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34022 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59812 - "GET /node/698a8f14d9a1cfa777a242d6%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:59816 - "GET /node/695be6f45dac150a0e83773b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:59820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55898 - "GET /node/6985d54971989fb14149a0c0%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:37670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59410 - "GET /node/69b90f330ec88e58bad0d13c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:59426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32924 - "GET /node/69865c6c177ca0f097bd453c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:39200 - "GET /node/693b7c5f41fb4c9509763474%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:39212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39510 - "GET /node/695323b631522df6df79b354%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:50902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41520 - "GET /node/6952c33f9912bd6bbcea3b3a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:59468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37996 - "GET /node/698ef632f0e3ffbba67d2f35%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:38010 - "GET /node/691b512dac5847a394495fac%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:38016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42168 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35832 - "GET /node/69afdb6fae557f2600f0f770%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:35836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33338 - "GET /node/69a0e73e9f52b1b460a4693d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:33352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37528 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43486 - "GET /node/693ae380fee8383e92b64166%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:43496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38810 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54014 - "GET /node/698491f73a8748f282087b1d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:54024 - "GET /node/6993221531166481c8de76a1%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:39106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37266 - "GET /node/693f97910d8ce4018da9859c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:47986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58626 - "GET /node/693f5b610d8ce4018da8c7c4%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:58634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37062 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:40:06,057 - lava_callback - INFO - Received callback for node 69ddc51cc2164e674d7220c3 INFO: 172.21.0.1:47216 - "POST /node/69ddc51cc2164e674d7220c3 HTTP/1.0" 202 Accepted 2026-04-16 04:40:06,063 - lava_callback - INFO - Starting async job submit for node 69ddc51cc2164e674d7220c3 2026-04-16 04:40:06,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:40:06,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc51cc2164e674d7220c3 HTTP/1.1" 200 None 2026-04-16 04:40:06,088 - lava_callback - DEBUG - Processing node 69ddc51cc2164e674d7220c3: baseline-arm-baylibre 2026-04-16 04:40:06,088 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc51cc2164e674d7220c3 2026-04-16 04:40:06,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:40:06,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc51cc2164e674d7220c3 HTTP/1.1" 200 None 2026-04-16 04:40:06,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:40:06,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd170117c944d2f17d8b31 HTTP/1.1" 200 None 2026-04-16 04:40:06,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:40:06,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc51cc2164e674d7220c3 HTTP/1.1" 200 None 2026-04-16 04:40:06,144 - lava_callback - ERROR - Error processing callback for node 69ddc51cc2164e674d7220c3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36640 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:40:25,998 - lava_callback - INFO - Received callback for node 69ddc537c2164e674d722102 INFO: 172.21.0.1:41408 - "POST /node/69ddc537c2164e674d722102 HTTP/1.0" 202 Accepted 2026-04-16 04:40:26,004 - lava_callback - INFO - Starting async job submit for node 69ddc537c2164e674d722102 2026-04-16 04:40:26,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:40:26,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc537c2164e674d722102 HTTP/1.1" 200 None 2026-04-16 04:40:26,021 - lava_callback - DEBUG - Processing node 69ddc537c2164e674d722102: baseline-arm-baylibre 2026-04-16 04:40:26,021 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc537c2164e674d722102 2026-04-16 04:40:26,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:40:26,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc537c2164e674d722102 HTTP/1.1" 200 None 2026-04-16 04:40:26,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:40:26,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd170117c944d2f17d8b31 HTTP/1.1" 200 None 2026-04-16 04:40:26,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:40:26,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc537c2164e674d722102 HTTP/1.1" 200 None 2026-04-16 04:40:26,077 - lava_callback - ERROR - Error processing callback for node 69ddc537c2164e674d722102: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53676 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:41:06,014 - lava_callback - INFO - Received callback for node 69ddc559c2164e674d722132 INFO: 172.21.0.1:43742 - "POST /node/69ddc559c2164e674d722132 HTTP/1.0" 202 Accepted 2026-04-16 04:41:06,019 - lava_callback - INFO - Starting async job submit for node 69ddc559c2164e674d722132 2026-04-16 04:41:06,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:41:06,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc559c2164e674d722132 HTTP/1.1" 200 None 2026-04-16 04:41:06,036 - lava_callback - DEBUG - Processing node 69ddc559c2164e674d722132: baseline-arm-baylibre 2026-04-16 04:41:06,036 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc559c2164e674d722132 2026-04-16 04:41:06,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:41:06,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc559c2164e674d722132 HTTP/1.1" 200 None 2026-04-16 04:41:06,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:41:06,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd170117c944d2f17d8b31 HTTP/1.1" 200 None 2026-04-16 04:41:06,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:41:06,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc559c2164e674d722132 HTTP/1.1" 200 None 2026-04-16 04:41:06,099 - lava_callback - ERROR - Error processing callback for node 69ddc559c2164e674d722132: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58140 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:42:06,097 - lava_callback - INFO - Received callback for node 69ddc594c2164e674d722173 INFO: 172.21.0.1:43460 - "POST /node/69ddc594c2164e674d722173 HTTP/1.0" 202 Accepted 2026-04-16 04:42:06,102 - lava_callback - INFO - Starting async job submit for node 69ddc594c2164e674d722173 2026-04-16 04:42:06,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:42:06,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc594c2164e674d722173 HTTP/1.1" 200 None 2026-04-16 04:42:06,118 - lava_callback - DEBUG - Processing node 69ddc594c2164e674d722173: baseline-arm-baylibre 2026-04-16 04:42:06,118 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc594c2164e674d722173 2026-04-16 04:42:06,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:42:06,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc594c2164e674d722173 HTTP/1.1" 200 None 2026-04-16 04:42:06,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:42:06,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd170117c944d2f17d8b31 HTTP/1.1" 200 None 2026-04-16 04:42:06,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:42:06,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc594c2164e674d722173 HTTP/1.1" 200 None 2026-04-16 04:42:06,168 - lava_callback - ERROR - Error processing callback for node 69ddc594c2164e674d722173: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47060 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:42:46,106 - lava_callback - INFO - Received callback for node 69ddc5b3c2164e674d72218d INFO: 172.21.0.1:59358 - "POST /node/69ddc5b3c2164e674d72218d HTTP/1.0" 202 Accepted 2026-04-16 04:42:46,112 - lava_callback - INFO - Starting async job submit for node 69ddc5b3c2164e674d72218d 2026-04-16 04:42:46,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:42:46,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc5b3c2164e674d72218d HTTP/1.1" 200 None 2026-04-16 04:42:46,128 - lava_callback - DEBUG - Processing node 69ddc5b3c2164e674d72218d: baseline-arm-baylibre 2026-04-16 04:42:46,129 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc5b3c2164e674d72218d 2026-04-16 04:42:46,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:42:46,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc5b3c2164e674d72218d HTTP/1.1" 200 None 2026-04-16 04:42:46,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:42:46,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd170117c944d2f17d8b31 HTTP/1.1" 200 None 2026-04-16 04:42:46,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:42:46,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc5b3c2164e674d72218d HTTP/1.1" 200 None 2026-04-16 04:42:46,201 - lava_callback - ERROR - Error processing callback for node 69ddc5b3c2164e674d72218d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41752 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:43:06,123 - lava_callback - INFO - Received callback for node 69ddc5d2c2164e674d7221d2 INFO: 172.21.0.1:36742 - "POST /node/69ddc5d2c2164e674d7221d2 HTTP/1.0" 202 Accepted 2026-04-16 04:43:06,129 - lava_callback - INFO - Starting async job submit for node 69ddc5d2c2164e674d7221d2 2026-04-16 04:43:06,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:43:06,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc5d2c2164e674d7221d2 HTTP/1.1" 200 None 2026-04-16 04:43:06,149 - lava_callback - DEBUG - Processing node 69ddc5d2c2164e674d7221d2: baseline-arm-baylibre 2026-04-16 04:43:06,149 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc5d2c2164e674d7221d2 2026-04-16 04:43:06,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:43:06,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc5d2c2164e674d7221d2 HTTP/1.1" 200 None 2026-04-16 04:43:06,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:43:06,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd170117c944d2f17d8b31 HTTP/1.1" 200 None 2026-04-16 04:43:06,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:43:06,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc5d2c2164e674d7221d2 HTTP/1.1" 200 None 2026-04-16 04:43:06,217 - lava_callback - ERROR - Error processing callback for node 69ddc5d2c2164e674d7221d2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34918 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58800 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:44:06,195 - lava_callback - INFO - Received callback for node 69ddc611c2164e674d722228 INFO: 172.21.0.1:39634 - "POST /node/69ddc611c2164e674d722228 HTTP/1.0" 202 Accepted 2026-04-16 04:44:06,201 - lava_callback - INFO - Starting async job submit for node 69ddc611c2164e674d722228 2026-04-16 04:44:06,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:44:06,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc611c2164e674d722228 HTTP/1.1" 200 None 2026-04-16 04:44:06,216 - lava_callback - DEBUG - Processing node 69ddc611c2164e674d722228: baseline-arm-baylibre 2026-04-16 04:44:06,216 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc611c2164e674d722228 2026-04-16 04:44:06,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:44:06,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc611c2164e674d722228 HTTP/1.1" 200 None 2026-04-16 04:44:06,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:44:06,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 04:44:06,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:44:06,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc611c2164e674d722228 HTTP/1.1" 200 None 2026-04-16 04:44:06,289 - lava_callback - ERROR - Error processing callback for node 69ddc611c2164e674d722228: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33614 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:44:46,181 - lava_callback - INFO - Received callback for node 69ddc632c2164e674d722246 INFO: 172.21.0.1:43124 - "POST /node/69ddc632c2164e674d722246 HTTP/1.0" 202 Accepted 2026-04-16 04:44:46,187 - lava_callback - INFO - Starting async job submit for node 69ddc632c2164e674d722246 2026-04-16 04:44:46,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:44:46,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc632c2164e674d722246 HTTP/1.1" 200 None 2026-04-16 04:44:46,202 - lava_callback - DEBUG - Processing node 69ddc632c2164e674d722246: baseline-arm-baylibre 2026-04-16 04:44:46,202 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc632c2164e674d722246 2026-04-16 04:44:46,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:44:46,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc632c2164e674d722246 HTTP/1.1" 200 None 2026-04-16 04:44:46,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:44:46,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 04:44:46,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:44:46,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc632c2164e674d722246 HTTP/1.1" 200 None 2026-04-16 04:44:46,259 - lava_callback - ERROR - Error processing callback for node 69ddc632c2164e674d722246: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50622 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:45:58,577 - lava_callback - INFO - Received callback for node 69ddc676c2164e674d7222cb INFO: 172.21.0.1:50632 - "POST /node/69ddc676c2164e674d7222cb HTTP/1.0" 202 Accepted 2026-04-16 04:45:58,583 - lava_callback - INFO - Starting async job submit for node 69ddc676c2164e674d7222cb 2026-04-16 04:45:58,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:45:58,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc676c2164e674d7222cb HTTP/1.1" 200 None 2026-04-16 04:45:58,599 - lava_callback - DEBUG - Processing node 69ddc676c2164e674d7222cb: baseline-arm-clabbe 2026-04-16 04:45:58,600 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc676c2164e674d7222cb 2026-04-16 04:45:58,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:45:58,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc676c2164e674d7222cb HTTP/1.1" 200 None 2026-04-16 04:45:58,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:45:58,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd170117c944d2f17d8b31 HTTP/1.1" 200 None 2026-04-16 04:45:58,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:45:58,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc676c2164e674d7222cb HTTP/1.1" 200 None 2026-04-16 04:45:58,652 - lava_callback - ERROR - Error processing callback for node 69ddc676c2164e674d7222cb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55606 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55608 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:46:26,368 - lava_callback - INFO - Received callback for node 69ddc691c2164e674d7222d4 INFO: 172.21.0.1:49216 - "POST /node/69ddc691c2164e674d7222d4 HTTP/1.0" 202 Accepted 2026-04-16 04:46:26,373 - lava_callback - INFO - Starting async job submit for node 69ddc691c2164e674d7222d4 2026-04-16 04:46:26,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:46:26,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc691c2164e674d7222d4 HTTP/1.1" 200 None 2026-04-16 04:46:26,390 - lava_callback - DEBUG - Processing node 69ddc691c2164e674d7222d4: baseline-arm-baylibre 2026-04-16 04:46:26,390 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc691c2164e674d7222d4 2026-04-16 04:46:26,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:46:26,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc691c2164e674d7222d4 HTTP/1.1" 200 None 2026-04-16 04:46:26,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:46:26,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 04:46:26,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:46:26,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc691c2164e674d7222d4 HTTP/1.1" 200 None 2026-04-16 04:46:26,466 - lava_callback - ERROR - Error processing callback for node 69ddc691c2164e674d7222d4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47212 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:46:58,595 - lava_callback - INFO - Received callback for node 69ddc6b5c2164e674d72232e INFO: 172.21.0.1:47214 - "POST /node/69ddc6b5c2164e674d72232e HTTP/1.0" 202 Accepted 2026-04-16 04:46:58,600 - lava_callback - INFO - Starting async job submit for node 69ddc6b5c2164e674d72232e 2026-04-16 04:46:58,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:46:58,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc6b5c2164e674d72232e HTTP/1.1" 200 None 2026-04-16 04:46:58,616 - lava_callback - DEBUG - Processing node 69ddc6b5c2164e674d72232e: baseline-arm-clabbe 2026-04-16 04:46:58,616 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc6b5c2164e674d72232e 2026-04-16 04:46:58,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:46:58,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc6b5c2164e674d72232e HTTP/1.1" 200 None 2026-04-16 04:46:58,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:46:58,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd170117c944d2f17d8b31 HTTP/1.1" 200 None 2026-04-16 04:46:58,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:46:58,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc6b5c2164e674d72232e HTTP/1.1" 200 None 2026-04-16 04:46:58,663 - lava_callback - ERROR - Error processing callback for node 69ddc6b5c2164e674d72232e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35134 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51820 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:47:38,568 - lava_callback - INFO - Received callback for node 69ddc6dac2164e674d722345 INFO: 172.21.0.1:51836 - "POST /node/69ddc6dac2164e674d722345 HTTP/1.0" 202 Accepted 2026-04-16 04:47:38,574 - lava_callback - INFO - Starting async job submit for node 69ddc6dac2164e674d722345 2026-04-16 04:47:38,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:47:38,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc6dac2164e674d722345 HTTP/1.1" 200 None 2026-04-16 04:47:38,590 - lava_callback - DEBUG - Processing node 69ddc6dac2164e674d722345: baseline-arm-clabbe 2026-04-16 04:47:38,590 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc6dac2164e674d722345 2026-04-16 04:47:38,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:47:38,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc6dac2164e674d722345 HTTP/1.1" 200 None 2026-04-16 04:47:38,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:47:38,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd170117c944d2f17d8b31 HTTP/1.1" 200 None 2026-04-16 04:47:38,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:47:38,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc6dac2164e674d722345 HTTP/1.1" 200 None 2026-04-16 04:47:38,648 - lava_callback - ERROR - Error processing callback for node 69ddc6dac2164e674d722345: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39102 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:48:06,502 - lava_callback - INFO - Received callback for node 69ddc6fac2164e674d722359 INFO: 172.21.0.1:56670 - "POST /node/69ddc6fac2164e674d722359 HTTP/1.0" 202 Accepted 2026-04-16 04:48:06,508 - lava_callback - INFO - Starting async job submit for node 69ddc6fac2164e674d722359 2026-04-16 04:48:06,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:48:06,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc6fac2164e674d722359 HTTP/1.1" 200 None 2026-04-16 04:48:06,523 - lava_callback - DEBUG - Processing node 69ddc6fac2164e674d722359: baseline-arm-baylibre 2026-04-16 04:48:06,523 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc6fac2164e674d722359 2026-04-16 04:48:06,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:48:06,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc6fac2164e674d722359 HTTP/1.1" 200 None 2026-04-16 04:48:06,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:56680 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:48:06,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 04:48:06,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:48:06,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc6fac2164e674d722359 HTTP/1.1" 200 None 2026-04-16 04:48:06,572 - lava_callback - ERROR - Error processing callback for node 69ddc6fac2164e674d722359: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41338 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:48:46,433 - lava_callback - INFO - Received callback for node 69ddc71dc2164e674d722377 INFO: 172.21.0.1:60660 - "POST /node/69ddc71dc2164e674d722377 HTTP/1.0" 202 Accepted 2026-04-16 04:48:46,439 - lava_callback - INFO - Starting async job submit for node 69ddc71dc2164e674d722377 2026-04-16 04:48:46,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:48:46,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc71dc2164e674d722377 HTTP/1.1" 200 None 2026-04-16 04:48:46,481 - lava_callback - DEBUG - Processing node 69ddc71dc2164e674d722377: baseline-arm-baylibre 2026-04-16 04:48:46,481 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc71dc2164e674d722377 2026-04-16 04:48:46,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:48:46,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc71dc2164e674d722377 HTTP/1.1" 200 None 2026-04-16 04:48:46,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:48:46,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None INFO: 172.21.0.1:60662 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:48:46,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:48:46,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc71dc2164e674d722377 HTTP/1.1" 200 None 2026-04-16 04:48:46,535 - lava_callback - ERROR - Error processing callback for node 69ddc71dc2164e674d722377: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53734 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:49:18,684 - lava_callback - INFO - Received callback for node 69ddc742c2164e674d7223a3 INFO: 172.21.0.1:53740 - "POST /node/69ddc742c2164e674d7223a3 HTTP/1.0" 202 Accepted 2026-04-16 04:49:18,690 - lava_callback - INFO - Starting async job submit for node 69ddc742c2164e674d7223a3 2026-04-16 04:49:18,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:49:18,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc742c2164e674d7223a3 HTTP/1.1" 200 None 2026-04-16 04:49:18,705 - lava_callback - DEBUG - Processing node 69ddc742c2164e674d7223a3: baseline-arm-clabbe 2026-04-16 04:49:18,706 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc742c2164e674d7223a3 2026-04-16 04:49:18,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:49:18,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc742c2164e674d7223a3 HTTP/1.1" 200 None 2026-04-16 04:49:18,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:49:18,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd170117c944d2f17d8b31 HTTP/1.1" 200 None 2026-04-16 04:49:18,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:49:18,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc742c2164e674d7223a3 HTTP/1.1" 200 None 2026-04-16 04:49:18,783 - lava_callback - ERROR - Error processing callback for node 69ddc742c2164e674d7223a3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39752 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:49:58,637 - lava_callback - INFO - Received callback for node 69ddc766c2164e674d7223bb INFO: 172.21.0.1:39762 - "POST /node/69ddc766c2164e674d7223bb HTTP/1.0" 202 Accepted 2026-04-16 04:49:58,643 - lava_callback - INFO - Starting async job submit for node 69ddc766c2164e674d7223bb 2026-04-16 04:49:58,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:49:58,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc766c2164e674d7223bb HTTP/1.1" 200 None 2026-04-16 04:49:58,659 - lava_callback - DEBUG - Processing node 69ddc766c2164e674d7223bb: baseline-arm-clabbe 2026-04-16 04:49:58,659 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc766c2164e674d7223bb 2026-04-16 04:49:58,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:49:58,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc766c2164e674d7223bb HTTP/1.1" 200 None 2026-04-16 04:49:58,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:49:58,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd170117c944d2f17d8b31 HTTP/1.1" 200 None 2026-04-16 04:49:58,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:49:58,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc766c2164e674d7223bb HTTP/1.1" 200 None 2026-04-16 04:49:58,710 - lava_callback - ERROR - Error processing callback for node 69ddc766c2164e674d7223bb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40540 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40336 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:50:38,943 - lava_callback - INFO - Received callback for node 69ddc78bc2164e674d7223d6 INFO: 172.21.0.1:40346 - "POST /node/69ddc78bc2164e674d7223d6 HTTP/1.0" 202 Accepted 2026-04-16 04:50:38,949 - lava_callback - INFO - Starting async job submit for node 69ddc78bc2164e674d7223d6 2026-04-16 04:50:38,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:50:38,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc78bc2164e674d7223d6 HTTP/1.1" 200 None 2026-04-16 04:50:38,965 - lava_callback - DEBUG - Processing node 69ddc78bc2164e674d7223d6: baseline-arm-clabbe 2026-04-16 04:50:38,965 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc78bc2164e674d7223d6 2026-04-16 04:50:38,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:50:38,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc78bc2164e674d7223d6 HTTP/1.1" 200 None 2026-04-16 04:50:38,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:50:38,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd170117c944d2f17d8b31 HTTP/1.1" 200 None 2026-04-16 04:50:38,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:50:39,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc78bc2164e674d7223d6 HTTP/1.1" 200 None 2026-04-16 04:50:39,022 - lava_callback - ERROR - Error processing callback for node 69ddc78bc2164e674d7223d6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36980 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:50:58,692 - lava_callback - INFO - Received callback for node 69ddc7aac2164e674d722407 INFO: 172.21.0.1:36984 - "POST /node/69ddc7aac2164e674d722407 HTTP/1.0" 202 Accepted 2026-04-16 04:50:58,698 - lava_callback - INFO - Starting async job submit for node 69ddc7aac2164e674d722407 2026-04-16 04:50:58,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:50:58,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc7aac2164e674d722407 HTTP/1.1" 200 None 2026-04-16 04:50:58,714 - lava_callback - DEBUG - Processing node 69ddc7aac2164e674d722407: baseline-arm-clabbe 2026-04-16 04:50:58,714 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc7aac2164e674d722407 2026-04-16 04:50:58,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:50:58,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc7aac2164e674d722407 HTTP/1.1" 200 None 2026-04-16 04:50:58,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:50:58,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 04:50:58,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:50:58,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc7aac2164e674d722407 HTTP/1.1" 200 None 2026-04-16 04:50:58,760 - lava_callback - ERROR - Error processing callback for node 69ddc7aac2164e674d722407: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41506 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:51:38,761 - lava_callback - INFO - Received callback for node 69ddc7cdc2164e674d722430 INFO: 172.21.0.1:41512 - "POST /node/69ddc7cdc2164e674d722430 HTTP/1.0" 202 Accepted 2026-04-16 04:51:38,767 - lava_callback - INFO - Starting async job submit for node 69ddc7cdc2164e674d722430 2026-04-16 04:51:38,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:51:38,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc7cdc2164e674d722430 HTTP/1.1" 200 None 2026-04-16 04:51:38,791 - lava_callback - DEBUG - Processing node 69ddc7cdc2164e674d722430: baseline-arm-clabbe 2026-04-16 04:51:38,791 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc7cdc2164e674d722430 2026-04-16 04:51:38,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:51:38,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc7cdc2164e674d722430 HTTP/1.1" 200 None 2026-04-16 04:51:38,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:51:38,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd170117c944d2f17d8b31 HTTP/1.1" 200 None 2026-04-16 04:51:38,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:51:38,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc7cdc2164e674d722430 HTTP/1.1" 200 None 2026-04-16 04:51:38,839 - lava_callback - ERROR - Error processing callback for node 69ddc7cdc2164e674d722430: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51274 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:52:18,726 - lava_callback - INFO - Received callback for node 69ddc7f1c2164e674d722447 INFO: 172.21.0.1:51286 - "POST /node/69ddc7f1c2164e674d722447 HTTP/1.0" 202 Accepted 2026-04-16 04:52:18,731 - lava_callback - INFO - Starting async job submit for node 69ddc7f1c2164e674d722447 2026-04-16 04:52:18,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:52:18,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc7f1c2164e674d722447 HTTP/1.1" 200 None 2026-04-16 04:52:18,748 - lava_callback - DEBUG - Processing node 69ddc7f1c2164e674d722447: baseline-arm-clabbe 2026-04-16 04:52:18,748 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc7f1c2164e674d722447 2026-04-16 04:52:18,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:52:18,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc7f1c2164e674d722447 HTTP/1.1" 200 None 2026-04-16 04:52:18,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:52:18,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd170117c944d2f17d8b31 HTTP/1.1" 200 None 2026-04-16 04:52:18,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:52:18,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc7f1c2164e674d722447 HTTP/1.1" 200 None 2026-04-16 04:52:18,828 - lava_callback - ERROR - Error processing callback for node 69ddc7f1c2164e674d722447: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37394 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:52:58,809 - lava_callback - INFO - Received callback for node 69ddc815c2164e674d72245c INFO: 172.21.0.1:37406 - "POST /node/69ddc815c2164e674d72245c HTTP/1.0" 202 Accepted 2026-04-16 04:52:58,814 - lava_callback - INFO - Starting async job submit for node 69ddc815c2164e674d72245c 2026-04-16 04:52:58,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:52:58,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc815c2164e674d72245c HTTP/1.1" 200 None 2026-04-16 04:52:58,830 - lava_callback - DEBUG - Processing node 69ddc815c2164e674d72245c: baseline-arm-clabbe 2026-04-16 04:52:58,831 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc815c2164e674d72245c 2026-04-16 04:52:58,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:52:58,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc815c2164e674d72245c HTTP/1.1" 200 None 2026-04-16 04:52:58,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:52:58,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 04:52:58,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:52:58,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc815c2164e674d72245c HTTP/1.1" 200 None 2026-04-16 04:52:58,881 - lava_callback - ERROR - Error processing callback for node 69ddc815c2164e674d72245c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60698 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:53:18,822 - lava_callback - INFO - Received callback for node 69ddc837c2164e674d722494 INFO: 172.21.0.1:60712 - "POST /node/69ddc837c2164e674d722494 HTTP/1.0" 202 Accepted 2026-04-16 04:53:18,828 - lava_callback - INFO - Starting async job submit for node 69ddc837c2164e674d722494 2026-04-16 04:53:18,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:53:18,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc837c2164e674d722494 HTTP/1.1" 200 None 2026-04-16 04:53:18,844 - lava_callback - DEBUG - Processing node 69ddc837c2164e674d722494: baseline-arm-clabbe 2026-04-16 04:53:18,845 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc837c2164e674d722494 2026-04-16 04:53:18,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:53:18,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc837c2164e674d722494 HTTP/1.1" 200 None 2026-04-16 04:53:18,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:53:18,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 04:53:18,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:53:18,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc837c2164e674d722494 HTTP/1.1" 200 None 2026-04-16 04:53:18,895 - lava_callback - ERROR - Error processing callback for node 69ddc837c2164e674d722494: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36088 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:53:58,843 - lava_callback - INFO - Received callback for node 69ddc85ac2164e674d7224ad INFO: 172.21.0.1:36104 - "POST /node/69ddc85ac2164e674d7224ad HTTP/1.0" 202 Accepted 2026-04-16 04:53:58,849 - lava_callback - INFO - Starting async job submit for node 69ddc85ac2164e674d7224ad 2026-04-16 04:53:58,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:53:58,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc85ac2164e674d7224ad HTTP/1.1" 200 None 2026-04-16 04:53:58,865 - lava_callback - DEBUG - Processing node 69ddc85ac2164e674d7224ad: baseline-arm-clabbe 2026-04-16 04:53:58,865 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc85ac2164e674d7224ad 2026-04-16 04:53:58,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:53:58,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc85ac2164e674d7224ad HTTP/1.1" 200 None 2026-04-16 04:53:58,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:53:58,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd170117c944d2f17d8b31 HTTP/1.1" 200 None 2026-04-16 04:53:58,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:53:58,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc85ac2164e674d7224ad HTTP/1.1" 200 None 2026-04-16 04:53:58,918 - lava_callback - ERROR - Error processing callback for node 69ddc85ac2164e674d7224ad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48248 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:54:26,786 - lava_callback - INFO - Received callback for node 69ddc873c2164e674d7224e9 INFO: 172.21.0.1:48260 - "POST /node/69ddc873c2164e674d7224e9 HTTP/1.0" 202 Accepted 2026-04-16 04:54:26,791 - lava_callback - INFO - Starting async job submit for node 69ddc873c2164e674d7224e9 2026-04-16 04:54:26,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:54:26,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc873c2164e674d7224e9 HTTP/1.1" 200 None 2026-04-16 04:54:26,818 - lava_callback - DEBUG - Processing node 69ddc873c2164e674d7224e9: baseline-arm-baylibre 2026-04-16 04:54:26,818 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc873c2164e674d7224e9 2026-04-16 04:54:26,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:54:26,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc873c2164e674d7224e9 HTTP/1.1" 200 None 2026-04-16 04:54:26,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:54:26,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 04:54:26,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:54:26,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc873c2164e674d7224e9 HTTP/1.1" 200 None 2026-04-16 04:54:26,866 - lava_callback - ERROR - Error processing callback for node 69ddc873c2164e674d7224e9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46422 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:54:58,911 - lava_callback - INFO - Received callback for node 69ddc895c2164e674d72251b INFO: 172.21.0.1:46426 - "POST /node/69ddc895c2164e674d72251b HTTP/1.0" 202 Accepted 2026-04-16 04:54:58,917 - lava_callback - INFO - Starting async job submit for node 69ddc895c2164e674d72251b 2026-04-16 04:54:58,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:54:58,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc895c2164e674d72251b HTTP/1.1" 200 None 2026-04-16 04:54:58,934 - lava_callback - DEBUG - Processing node 69ddc895c2164e674d72251b: baseline-arm-clabbe 2026-04-16 04:54:58,935 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc895c2164e674d72251b 2026-04-16 04:54:58,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:54:58,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc895c2164e674d72251b HTTP/1.1" 200 None 2026-04-16 04:54:58,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:54:58,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 04:54:58,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:54:58,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc895c2164e674d72251b HTTP/1.1" 200 None 2026-04-16 04:54:58,986 - lava_callback - ERROR - Error processing callback for node 69ddc895c2164e674d72251b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59598 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59608 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:55:18,892 - lava_callback - INFO - Received callback for node 69ddc8b4c2164e674d72254b INFO: 172.21.0.1:59624 - "POST /node/69ddc8b4c2164e674d72254b HTTP/1.0" 202 Accepted 2026-04-16 04:55:18,897 - lava_callback - INFO - Starting async job submit for node 69ddc8b4c2164e674d72254b 2026-04-16 04:55:18,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:55:18,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc8b4c2164e674d72254b HTTP/1.1" 200 None 2026-04-16 04:55:18,913 - lava_callback - DEBUG - Processing node 69ddc8b4c2164e674d72254b: baseline-arm-clabbe 2026-04-16 04:55:18,914 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc8b4c2164e674d72254b 2026-04-16 04:55:18,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:55:18,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc8b4c2164e674d72254b HTTP/1.1" 200 None 2026-04-16 04:55:18,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:55:18,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 04:55:18,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:55:18,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc8b4c2164e674d72254b HTTP/1.1" 200 None 2026-04-16 04:55:18,965 - lava_callback - ERROR - Error processing callback for node 69ddc8b4c2164e674d72254b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35564 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:56:06,889 - lava_callback - INFO - Received callback for node 69ddc8d1c2164e674d722562 INFO: 172.21.0.1:35566 - "POST /node/69ddc8d1c2164e674d722562 HTTP/1.0" 202 Accepted 2026-04-16 04:56:06,895 - lava_callback - INFO - Starting async job submit for node 69ddc8d1c2164e674d722562 2026-04-16 04:56:06,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:56:06,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc8d1c2164e674d722562 HTTP/1.1" 200 None 2026-04-16 04:56:06,911 - lava_callback - DEBUG - Processing node 69ddc8d1c2164e674d722562: baseline-arm-baylibre 2026-04-16 04:56:06,911 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc8d1c2164e674d722562 2026-04-16 04:56:06,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:56:06,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc8d1c2164e674d722562 HTTP/1.1" 200 None 2026-04-16 04:56:06,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:56:06,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 04:56:06,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:56:06,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc8d1c2164e674d722562 HTTP/1.1" 200 None 2026-04-16 04:56:06,959 - lava_callback - ERROR - Error processing callback for node 69ddc8d1c2164e674d722562: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50206 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:56:26,829 - lava_callback - INFO - Received callback for node 69ddc8eec2164e674d7225a3 INFO: 172.21.0.1:50220 - "POST /node/69ddc8eec2164e674d7225a3 HTTP/1.0" 202 Accepted 2026-04-16 04:56:26,835 - lava_callback - INFO - Starting async job submit for node 69ddc8eec2164e674d7225a3 2026-04-16 04:56:26,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:56:26,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc8eec2164e674d7225a3 HTTP/1.1" 200 None 2026-04-16 04:56:26,851 - lava_callback - DEBUG - Processing node 69ddc8eec2164e674d7225a3: baseline-arm-baylibre 2026-04-16 04:56:26,852 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc8eec2164e674d7225a3 2026-04-16 04:56:26,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:56:26,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc8eec2164e674d7225a3 HTTP/1.1" 200 None 2026-04-16 04:56:26,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:56:26,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 04:56:26,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:56:26,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc8eec2164e674d7225a3 HTTP/1.1" 200 None 2026-04-16 04:56:26,912 - lava_callback - ERROR - Error processing callback for node 69ddc8eec2164e674d7225a3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56838 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:56:59,002 - lava_callback - INFO - Received callback for node 69ddc910c2164e674d7225c9 INFO: 172.21.0.1:56850 - "POST /node/69ddc910c2164e674d7225c9 HTTP/1.0" 202 Accepted 2026-04-16 04:56:59,007 - lava_callback - INFO - Starting async job submit for node 69ddc910c2164e674d7225c9 2026-04-16 04:56:59,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:56:59,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc910c2164e674d7225c9 HTTP/1.1" 200 None 2026-04-16 04:56:59,023 - lava_callback - DEBUG - Processing node 69ddc910c2164e674d7225c9: baseline-arm-clabbe 2026-04-16 04:56:59,023 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc910c2164e674d7225c9 2026-04-16 04:56:59,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:56:59,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc910c2164e674d7225c9 HTTP/1.1" 200 None 2026-04-16 04:56:59,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:56:59,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 04:56:59,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:56:59,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc910c2164e674d7225c9 HTTP/1.1" 200 None 2026-04-16 04:56:59,104 - lava_callback - ERROR - Error processing callback for node 69ddc910c2164e674d7225c9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34068 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:57:26,900 - lava_callback - INFO - Received callback for node 69ddc92cc2164e674d7225fb INFO: 172.21.0.1:34080 - "POST /node/69ddc92cc2164e674d7225fb HTTP/1.0" 202 Accepted 2026-04-16 04:57:26,905 - lava_callback - INFO - Starting async job submit for node 69ddc92cc2164e674d7225fb 2026-04-16 04:57:26,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:57:26,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc92cc2164e674d7225fb HTTP/1.1" 200 None 2026-04-16 04:57:26,921 - lava_callback - DEBUG - Processing node 69ddc92cc2164e674d7225fb: baseline-arm-baylibre 2026-04-16 04:57:26,921 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc92cc2164e674d7225fb 2026-04-16 04:57:26,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:57:26,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc92cc2164e674d7225fb HTTP/1.1" 200 None 2026-04-16 04:57:26,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:57:26,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 04:57:26,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:57:26,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc92cc2164e674d7225fb HTTP/1.1" 200 None 2026-04-16 04:57:26,968 - lava_callback - ERROR - Error processing callback for node 69ddc92cc2164e674d7225fb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36528 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:58:06,878 - lava_callback - INFO - Received callback for node 69ddc94fc2164e674d72260e INFO: 172.21.0.1:36530 - "POST /node/69ddc94fc2164e674d72260e HTTP/1.0" 202 Accepted 2026-04-16 04:58:06,884 - lava_callback - INFO - Starting async job submit for node 69ddc94fc2164e674d72260e 2026-04-16 04:58:06,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:58:06,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc94fc2164e674d72260e HTTP/1.1" 200 None 2026-04-16 04:58:06,900 - lava_callback - DEBUG - Processing node 69ddc94fc2164e674d72260e: baseline-arm-baylibre 2026-04-16 04:58:06,901 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc94fc2164e674d72260e 2026-04-16 04:58:06,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:58:06,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc94fc2164e674d72260e HTTP/1.1" 200 None 2026-04-16 04:58:06,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:58:06,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 04:58:06,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:58:06,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc94fc2164e674d72260e HTTP/1.1" 200 None 2026-04-16 04:58:06,952 - lava_callback - ERROR - Error processing callback for node 69ddc94fc2164e674d72260e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44364 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:58:39,065 - lava_callback - INFO - Received callback for node 69ddc970c2164e674d72262e INFO: 172.21.0.1:44366 - "POST /node/69ddc970c2164e674d72262e HTTP/1.0" 202 Accepted 2026-04-16 04:58:39,071 - lava_callback - INFO - Starting async job submit for node 69ddc970c2164e674d72262e 2026-04-16 04:58:39,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:58:39,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc970c2164e674d72262e HTTP/1.1" 200 None 2026-04-16 04:58:39,087 - lava_callback - DEBUG - Processing node 69ddc970c2164e674d72262e: baseline-arm-clabbe 2026-04-16 04:58:39,087 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc970c2164e674d72262e 2026-04-16 04:58:39,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:58:39,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc970c2164e674d72262e HTTP/1.1" 200 None 2026-04-16 04:58:39,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:58:39,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 04:58:39,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:58:39,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc970c2164e674d72262e HTTP/1.1" 200 None 2026-04-16 04:58:39,139 - lava_callback - ERROR - Error processing callback for node 69ddc970c2164e674d72262e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48006 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:59:19,062 - lava_callback - INFO - Received callback for node 69ddc999c2164e674d722675 INFO: 172.21.0.1:48012 - "POST /node/69ddc999c2164e674d722675 HTTP/1.0" 202 Accepted 2026-04-16 04:59:19,067 - lava_callback - INFO - Starting async job submit for node 69ddc999c2164e674d722675 2026-04-16 04:59:19,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:59:19,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc999c2164e674d722675 HTTP/1.1" 200 None 2026-04-16 04:59:19,083 - lava_callback - DEBUG - Processing node 69ddc999c2164e674d722675: baseline-arm-clabbe 2026-04-16 04:59:19,084 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc999c2164e674d722675 2026-04-16 04:59:19,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:59:19,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc999c2164e674d722675 HTTP/1.1" 200 None 2026-04-16 04:59:19,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:59:19,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 04:59:19,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:59:19,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc999c2164e674d722675 HTTP/1.1" 200 None 2026-04-16 04:59:19,132 - lava_callback - ERROR - Error processing callback for node 69ddc999c2164e674d722675: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53904 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:59:59,164 - lava_callback - INFO - Received callback for node 69ddc9bac2164e674d72268b INFO: 172.21.0.1:53906 - "POST /node/69ddc9bac2164e674d72268b HTTP/1.0" 202 Accepted 2026-04-16 04:59:59,170 - lava_callback - INFO - Starting async job submit for node 69ddc9bac2164e674d72268b 2026-04-16 04:59:59,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:59:59,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc9bac2164e674d72268b HTTP/1.1" 200 None 2026-04-16 04:59:59,186 - lava_callback - DEBUG - Processing node 69ddc9bac2164e674d72268b: baseline-arm-clabbe 2026-04-16 04:59:59,187 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc9bac2164e674d72268b 2026-04-16 04:59:59,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:59:59,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc9bac2164e674d72268b HTTP/1.1" 200 None 2026-04-16 04:59:59,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:59:59,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 04:59:59,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:59:59,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc9bac2164e674d72268b HTTP/1.1" 200 None 2026-04-16 04:59:59,271 - lava_callback - ERROR - Error processing callback for node 69ddc9bac2164e674d72268b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37312 - "GET / HTTP/1.0" 200 OK 2026-04-16 05:00:19,165 - lava_callback - INFO - Received callback for node 69ddc9d9c2164e674d7226af INFO: 172.21.0.1:37326 - "POST /node/69ddc9d9c2164e674d7226af HTTP/1.0" 202 Accepted 2026-04-16 05:00:19,171 - lava_callback - INFO - Starting async job submit for node 69ddc9d9c2164e674d7226af 2026-04-16 05:00:19,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:00:19,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc9d9c2164e674d7226af HTTP/1.1" 200 None 2026-04-16 05:00:19,187 - lava_callback - DEBUG - Processing node 69ddc9d9c2164e674d7226af: baseline-arm-clabbe 2026-04-16 05:00:19,188 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc9d9c2164e674d7226af 2026-04-16 05:00:19,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:00:19,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc9d9c2164e674d7226af HTTP/1.1" 200 None 2026-04-16 05:00:19,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:00:19,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 05:00:19,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:00:19,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc9d9c2164e674d7226af HTTP/1.1" 200 None 2026-04-16 05:00:19,240 - lava_callback - ERROR - Error processing callback for node 69ddc9d9c2164e674d7226af: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57808 - "GET / HTTP/1.0" 200 OK 2026-04-16 05:01:19,164 - lava_callback - INFO - Received callback for node 69ddca19c2164e674d72272b INFO: 172.21.0.1:57820 - "POST /node/69ddca19c2164e674d72272b HTTP/1.0" 202 Accepted 2026-04-16 05:01:19,169 - lava_callback - INFO - Starting async job submit for node 69ddca19c2164e674d72272b 2026-04-16 05:01:19,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:01:19,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddca19c2164e674d72272b HTTP/1.1" 200 None 2026-04-16 05:01:19,823 - lava_callback - DEBUG - Processing node 69ddca19c2164e674d72272b: baseline-arm-clabbe 2026-04-16 05:01:19,823 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddca19c2164e674d72272b 2026-04-16 05:01:19,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:01:19,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddca19c2164e674d72272b HTTP/1.1" 200 None 2026-04-16 05:01:19,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:01:19,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 05:01:19,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:01:19,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddca19c2164e674d72272b HTTP/1.1" 200 None 2026-04-16 05:01:19,978 - lava_callback - ERROR - Error processing callback for node 69ddca19c2164e674d72272b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50434 - "GET / HTTP/1.0" 200 OK 2026-04-16 05:01:59,172 - lava_callback - INFO - Received callback for node 69ddca38c2164e674d722750 INFO: 172.21.0.1:50436 - "POST /node/69ddca38c2164e674d722750 HTTP/1.0" 202 Accepted 2026-04-16 05:01:59,177 - lava_callback - INFO - Starting async job submit for node 69ddca38c2164e674d722750 2026-04-16 05:01:59,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:01:59,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddca38c2164e674d722750 HTTP/1.1" 200 None 2026-04-16 05:01:59,194 - lava_callback - DEBUG - Processing node 69ddca38c2164e674d722750: baseline-arm-clabbe 2026-04-16 05:01:59,194 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddca38c2164e674d722750 2026-04-16 05:01:59,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:01:59,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddca38c2164e674d722750 HTTP/1.1" 200 None 2026-04-16 05:01:59,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:01:59,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 05:01:59,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:01:59,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddca38c2164e674d722750 HTTP/1.1" 200 None 2026-04-16 05:01:59,249 - lava_callback - ERROR - Error processing callback for node 69ddca38c2164e674d722750: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53814 - "GET / HTTP/1.0" 200 OK 2026-04-16 05:02:19,215 - lava_callback - INFO - Received callback for node 69ddca57c2164e674d722786 INFO: 172.21.0.1:53830 - "POST /node/69ddca57c2164e674d722786 HTTP/1.0" 202 Accepted 2026-04-16 05:02:19,221 - lava_callback - INFO - Starting async job submit for node 69ddca57c2164e674d722786 2026-04-16 05:02:19,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:02:19,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddca57c2164e674d722786 HTTP/1.1" 200 None 2026-04-16 05:02:19,237 - lava_callback - DEBUG - Processing node 69ddca57c2164e674d722786: baseline-arm-clabbe 2026-04-16 05:02:19,237 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddca57c2164e674d722786 2026-04-16 05:02:19,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:02:19,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddca57c2164e674d722786 HTTP/1.1" 200 None 2026-04-16 05:02:19,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:02:19,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 05:02:19,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:02:19,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddca57c2164e674d722786 HTTP/1.1" 200 None 2026-04-16 05:02:19,310 - lava_callback - ERROR - Error processing callback for node 69ddca57c2164e674d722786: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59128 - "GET / HTTP/1.0" 200 OK 2026-04-16 05:02:47,246 - lava_callback - INFO - Received callback for node 69ddca6dc2164e674d7227bc INFO: 172.21.0.1:59138 - "POST /node/69ddca6dc2164e674d7227bc HTTP/1.0" 202 Accepted 2026-04-16 05:02:47,251 - lava_callback - INFO - Starting async job submit for node 69ddca6dc2164e674d7227bc 2026-04-16 05:02:47,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:02:47,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddca6dc2164e674d7227bc HTTP/1.1" 200 None 2026-04-16 05:02:47,267 - lava_callback - DEBUG - Processing node 69ddca6dc2164e674d7227bc: baseline-arm-baylibre 2026-04-16 05:02:47,267 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddca6dc2164e674d7227bc 2026-04-16 05:02:47,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:02:47,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddca6dc2164e674d7227bc HTTP/1.1" 200 None 2026-04-16 05:02:47,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:02:47,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 05:02:47,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:02:47,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddca6dc2164e674d7227bc HTTP/1.1" 200 None 2026-04-16 05:02:47,317 - lava_callback - ERROR - Error processing callback for node 69ddca6dc2164e674d7227bc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52850 - "GET / HTTP/1.0" 200 OK 2026-04-16 05:03:27,203 - lava_callback - INFO - Received callback for node 69ddca8ac2164e674d7227ce INFO: 172.21.0.1:52856 - "POST /node/69ddca8ac2164e674d7227ce HTTP/1.0" 202 Accepted 2026-04-16 05:03:27,208 - lava_callback - INFO - Starting async job submit for node 69ddca8ac2164e674d7227ce 2026-04-16 05:03:27,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:03:27,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddca8ac2164e674d7227ce HTTP/1.1" 200 None 2026-04-16 05:03:27,228 - lava_callback - DEBUG - Processing node 69ddca8ac2164e674d7227ce: baseline-arm-baylibre 2026-04-16 05:03:27,228 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddca8ac2164e674d7227ce 2026-04-16 05:03:27,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:03:27,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddca8ac2164e674d7227ce HTTP/1.1" 200 None 2026-04-16 05:03:27,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:03:27,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 05:03:27,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:03:27,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddca8ac2164e674d7227ce HTTP/1.1" 200 None 2026-04-16 05:03:27,274 - lava_callback - ERROR - Error processing callback for node 69ddca8ac2164e674d7227ce: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40892 - "GET / HTTP/1.0" 200 OK 2026-04-16 05:03:59,306 - lava_callback - INFO - Received callback for node 69ddcaaec2164e674d72282b INFO: 172.21.0.1:40896 - "POST /node/69ddcaaec2164e674d72282b HTTP/1.0" 202 Accepted 2026-04-16 05:03:59,311 - lava_callback - INFO - Starting async job submit for node 69ddcaaec2164e674d72282b 2026-04-16 05:03:59,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:03:59,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddcaaec2164e674d72282b HTTP/1.1" 200 None 2026-04-16 05:03:59,328 - lava_callback - DEBUG - Processing node 69ddcaaec2164e674d72282b: baseline-arm-clabbe 2026-04-16 05:03:59,328 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddcaaec2164e674d72282b 2026-04-16 05:03:59,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:03:59,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddcaaec2164e674d72282b HTTP/1.1" 200 None 2026-04-16 05:03:59,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:03:59,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 05:03:59,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:03:59,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddcaaec2164e674d72282b HTTP/1.1" 200 None 2026-04-16 05:03:59,376 - lava_callback - ERROR - Error processing callback for node 69ddcaaec2164e674d72282b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59856 - "GET / HTTP/1.0" 200 OK 2026-04-16 05:04:19,262 - lava_callback - INFO - Received callback for node 69ddcacfc2164e674d722852 INFO: 172.21.0.1:59870 - "POST /node/69ddcacfc2164e674d722852 HTTP/1.0" 202 Accepted 2026-04-16 05:04:19,268 - lava_callback - INFO - Starting async job submit for node 69ddcacfc2164e674d722852 2026-04-16 05:04:19,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:04:19,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddcacfc2164e674d722852 HTTP/1.1" 200 None 2026-04-16 05:04:19,289 - lava_callback - DEBUG - Processing node 69ddcacfc2164e674d722852: baseline-arm-clabbe 2026-04-16 05:04:19,289 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddcacfc2164e674d722852 2026-04-16 05:04:19,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:04:19,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddcacfc2164e674d722852 HTTP/1.1" 200 None 2026-04-16 05:04:19,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:04:19,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 05:04:19,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:04:19,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddcacfc2164e674d722852 HTTP/1.1" 200 None 2026-04-16 05:04:19,344 - lava_callback - ERROR - Error processing callback for node 69ddcacfc2164e674d722852: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59476 - "GET / HTTP/1.0" 200 OK 2026-04-16 05:05:27,370 - lava_callback - INFO - Received callback for node 69ddcb06c2164e674d7228ab INFO: 172.21.0.1:59484 - "POST /node/69ddcb06c2164e674d7228ab HTTP/1.0" 202 Accepted 2026-04-16 05:05:27,375 - lava_callback - INFO - Starting async job submit for node 69ddcb06c2164e674d7228ab 2026-04-16 05:05:27,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:05:27,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddcb06c2164e674d7228ab HTTP/1.1" 200 None 2026-04-16 05:05:27,407 - lava_callback - DEBUG - Processing node 69ddcb06c2164e674d7228ab: baseline-arm-baylibre 2026-04-16 05:05:27,407 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddcb06c2164e674d7228ab 2026-04-16 05:05:27,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:05:27,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddcb06c2164e674d7228ab HTTP/1.1" 200 None 2026-04-16 05:05:27,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:05:27,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 05:05:27,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:05:27,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddcb06c2164e674d7228ab HTTP/1.1" 200 None 2026-04-16 05:05:27,499 - lava_callback - ERROR - Error processing callback for node 69ddcb06c2164e674d7228ab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38026 - "GET / HTTP/1.0" 200 OK 2026-04-16 05:05:59,354 - lava_callback - INFO - Received callback for node 69ddcb2bc2164e674d7228d7 INFO: 172.21.0.1:38036 - "POST /node/69ddcb2bc2164e674d7228d7 HTTP/1.0" 202 Accepted 2026-04-16 05:05:59,360 - lava_callback - INFO - Starting async job submit for node 69ddcb2bc2164e674d7228d7 2026-04-16 05:05:59,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:05:59,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddcb2bc2164e674d7228d7 HTTP/1.1" 200 None 2026-04-16 05:05:59,376 - lava_callback - DEBUG - Processing node 69ddcb2bc2164e674d7228d7: baseline-arm-clabbe 2026-04-16 05:05:59,377 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddcb2bc2164e674d7228d7 2026-04-16 05:05:59,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:05:59,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddcb2bc2164e674d7228d7 HTTP/1.1" 200 None 2026-04-16 05:05:59,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:05:59,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 05:05:59,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:05:59,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddcb2bc2164e674d7228d7 HTTP/1.1" 200 None 2026-04-16 05:05:59,425 - lava_callback - ERROR - Error processing callback for node 69ddcb2bc2164e674d7228d7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49600 - "GET / HTTP/1.0" 200 OK 2026-04-16 05:06:39,358 - lava_callback - INFO - Received callback for node 69ddcb4cc2164e674d722904 INFO: 172.21.0.1:49602 - "POST /node/69ddcb4cc2164e674d722904 HTTP/1.0" 202 Accepted 2026-04-16 05:06:39,364 - lava_callback - INFO - Starting async job submit for node 69ddcb4cc2164e674d722904 2026-04-16 05:06:39,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:06:39,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddcb4cc2164e674d722904 HTTP/1.1" 200 None 2026-04-16 05:06:39,380 - lava_callback - DEBUG - Processing node 69ddcb4cc2164e674d722904: baseline-arm-clabbe 2026-04-16 05:06:39,380 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddcb4cc2164e674d722904 2026-04-16 05:06:39,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:06:39,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddcb4cc2164e674d722904 HTTP/1.1" 200 None 2026-04-16 05:06:39,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:06:39,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 05:06:39,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:06:39,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddcb4cc2164e674d722904 HTTP/1.1" 200 None 2026-04-16 05:06:39,430 - lava_callback - ERROR - Error processing callback for node 69ddcb4cc2164e674d722904: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54080 - "GET / HTTP/1.0" 200 OK 2026-04-16 05:06:59,466 - lava_callback - INFO - Received callback for node 69ddcb6cc2164e674d722925 INFO: 172.21.0.1:54096 - "POST /node/69ddcb6cc2164e674d722925 HTTP/1.0" 202 Accepted 2026-04-16 05:06:59,472 - lava_callback - INFO - Starting async job submit for node 69ddcb6cc2164e674d722925 2026-04-16 05:06:59,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:06:59,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddcb6cc2164e674d722925 HTTP/1.1" 200 None 2026-04-16 05:06:59,495 - lava_callback - DEBUG - Processing node 69ddcb6cc2164e674d722925: baseline-arm-clabbe 2026-04-16 05:06:59,496 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddcb6cc2164e674d722925 2026-04-16 05:06:59,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:06:59,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddcb6cc2164e674d722925 HTTP/1.1" 200 None 2026-04-16 05:06:59,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:06:59,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 05:06:59,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:06:59,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddcb6cc2164e674d722925 HTTP/1.1" 200 None 2026-04-16 05:06:59,545 - lava_callback - ERROR - Error processing callback for node 69ddcb6cc2164e674d722925: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50338 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49774 - "GET / HTTP/1.0" 200 OK 2026-04-16 05:07:39,390 - lava_callback - INFO - Received callback for node 69ddcb89c2164e674d72295e INFO: 172.21.0.1:49782 - "POST /node/69ddcb89c2164e674d72295e HTTP/1.0" 202 Accepted 2026-04-16 05:07:39,396 - lava_callback - INFO - Starting async job submit for node 69ddcb89c2164e674d72295e 2026-04-16 05:07:39,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:07:39,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddcb89c2164e674d72295e HTTP/1.1" 200 None 2026-04-16 05:07:39,426 - lava_callback - DEBUG - Processing node 69ddcb89c2164e674d72295e: baseline-arm-clabbe 2026-04-16 05:07:39,426 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddcb89c2164e674d72295e 2026-04-16 05:07:39,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:07:39,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddcb89c2164e674d72295e HTTP/1.1" 200 None 2026-04-16 05:07:39,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:07:39,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 05:07:39,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:07:39,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddcb89c2164e674d72295e HTTP/1.1" 200 None 2026-04-16 05:07:39,558 - lava_callback - ERROR - Error processing callback for node 69ddcb89c2164e674d72295e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49298 - "GET / HTTP/1.0" 200 OK 2026-04-16 05:07:59,469 - lava_callback - INFO - Received callback for node 69ddcbacc2164e674d722981 INFO: 172.21.0.1:49308 - "POST /node/69ddcbacc2164e674d722981 HTTP/1.0" 202 Accepted 2026-04-16 05:07:59,475 - lava_callback - INFO - Starting async job submit for node 69ddcbacc2164e674d722981 2026-04-16 05:07:59,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:07:59,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddcbacc2164e674d722981 HTTP/1.1" 200 None 2026-04-16 05:07:59,495 - lava_callback - DEBUG - Processing node 69ddcbacc2164e674d722981: baseline-arm-clabbe 2026-04-16 05:07:59,495 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddcbacc2164e674d722981 2026-04-16 05:07:59,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:07:59,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddcbacc2164e674d722981 HTTP/1.1" 200 None 2026-04-16 05:07:59,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:07:59,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 05:07:59,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:07:59,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddcbacc2164e674d722981 HTTP/1.1" 200 None 2026-04-16 05:07:59,561 - lava_callback - ERROR - Error processing callback for node 69ddcbacc2164e674d722981: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60878 - "GET / HTTP/1.0" 200 OK 2026-04-16 05:08:39,455 - lava_callback - INFO - Received callback for node 69ddcbd4c2164e674d72299b INFO: 172.21.0.1:60882 - "POST /node/69ddcbd4c2164e674d72299b HTTP/1.0" 202 Accepted 2026-04-16 05:08:39,460 - lava_callback - INFO - Starting async job submit for node 69ddcbd4c2164e674d72299b 2026-04-16 05:08:39,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:08:39,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddcbd4c2164e674d72299b HTTP/1.1" 200 None 2026-04-16 05:08:39,481 - lava_callback - DEBUG - Processing node 69ddcbd4c2164e674d72299b: baseline-arm-clabbe 2026-04-16 05:08:39,481 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddcbd4c2164e674d72299b 2026-04-16 05:08:39,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:08:39,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddcbd4c2164e674d72299b HTTP/1.1" 200 None 2026-04-16 05:08:39,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:08:39,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 05:08:39,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:08:39,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddcbd4c2164e674d72299b HTTP/1.1" 200 None 2026-04-16 05:08:39,531 - lava_callback - ERROR - Error processing callback for node 69ddcbd4c2164e674d72299b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35204 - "GET / HTTP/1.0" 200 OK 2026-04-16 05:09:19,523 - lava_callback - INFO - Received callback for node 69ddcbf1c2164e674d7229e6 INFO: 172.21.0.1:35210 - "POST /node/69ddcbf1c2164e674d7229e6 HTTP/1.0" 202 Accepted 2026-04-16 05:09:19,533 - lava_callback - INFO - Starting async job submit for node 69ddcbf1c2164e674d7229e6 2026-04-16 05:09:19,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:09:19,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddcbf1c2164e674d7229e6 HTTP/1.1" 200 None 2026-04-16 05:09:19,600 - lava_callback - DEBUG - Processing node 69ddcbf1c2164e674d7229e6: baseline-arm-clabbe 2026-04-16 05:09:19,600 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddcbf1c2164e674d7229e6 2026-04-16 05:09:19,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:09:19,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddcbf1c2164e674d7229e6 HTTP/1.1" 200 None 2026-04-16 05:09:19,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:09:19,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 05:09:19,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:09:19,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddcbf1c2164e674d7229e6 HTTP/1.1" 200 None 2026-04-16 05:09:19,664 - lava_callback - ERROR - Error processing callback for node 69ddcbf1c2164e674d7229e6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34058 - "GET / HTTP/1.0" 200 OK 2026-04-16 05:09:59,519 - lava_callback - INFO - Received callback for node 69ddcc14c2164e674d7229f6 INFO: 172.21.0.1:34060 - "POST /node/69ddcc14c2164e674d7229f6 HTTP/1.0" 202 Accepted 2026-04-16 05:09:59,524 - lava_callback - INFO - Starting async job submit for node 69ddcc14c2164e674d7229f6 2026-04-16 05:09:59,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:09:59,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddcc14c2164e674d7229f6 HTTP/1.1" 200 None 2026-04-16 05:09:59,550 - lava_callback - DEBUG - Processing node 69ddcc14c2164e674d7229f6: baseline-arm-clabbe 2026-04-16 05:09:59,550 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddcc14c2164e674d7229f6 2026-04-16 05:09:59,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:09:59,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddcc14c2164e674d7229f6 HTTP/1.1" 200 None 2026-04-16 05:09:59,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:09:59,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 05:09:59,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:09:59,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddcc14c2164e674d7229f6 HTTP/1.1" 200 None 2026-04-16 05:09:59,600 - lava_callback - ERROR - Error processing callback for node 69ddcc14c2164e674d7229f6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32816 - "GET / HTTP/1.0" 200 OK 2026-04-16 05:10:19,502 - lava_callback - INFO - Received callback for node 69ddcc36c2164e674d722a29 INFO: 172.21.0.1:32828 - "POST /node/69ddcc36c2164e674d722a29 HTTP/1.0" 202 Accepted 2026-04-16 05:10:19,508 - lava_callback - INFO - Starting async job submit for node 69ddcc36c2164e674d722a29 2026-04-16 05:10:19,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:10:19,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddcc36c2164e674d722a29 HTTP/1.1" 200 None 2026-04-16 05:10:19,524 - lava_callback - DEBUG - Processing node 69ddcc36c2164e674d722a29: baseline-arm-clabbe 2026-04-16 05:10:19,524 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddcc36c2164e674d722a29 2026-04-16 05:10:19,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:10:19,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddcc36c2164e674d722a29 HTTP/1.1" 200 None 2026-04-16 05:10:19,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:10:19,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 05:10:19,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:10:19,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddcc36c2164e674d722a29 HTTP/1.1" 200 None 2026-04-16 05:10:19,588 - lava_callback - ERROR - Error processing callback for node 69ddcc36c2164e674d722a29: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58500 - "GET / HTTP/1.0" 200 OK 2026-04-16 05:10:59,573 - lava_callback - INFO - Received callback for node 69ddcc5bc2164e674d722a3b INFO: 172.21.0.1:58512 - "POST /node/69ddcc5bc2164e674d722a3b HTTP/1.0" 202 Accepted 2026-04-16 05:10:59,579 - lava_callback - INFO - Starting async job submit for node 69ddcc5bc2164e674d722a3b 2026-04-16 05:10:59,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:10:59,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddcc5bc2164e674d722a3b HTTP/1.1" 200 None 2026-04-16 05:10:59,595 - lava_callback - DEBUG - Processing node 69ddcc5bc2164e674d722a3b: baseline-arm-clabbe 2026-04-16 05:10:59,595 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddcc5bc2164e674d722a3b 2026-04-16 05:10:59,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:10:59,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddcc5bc2164e674d722a3b HTTP/1.1" 200 None 2026-04-16 05:10:59,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:10:59,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 05:10:59,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:10:59,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddcc5bc2164e674d722a3b HTTP/1.1" 200 None 2026-04-16 05:10:59,672 - lava_callback - ERROR - Error processing callback for node 69ddcc5bc2164e674d722a3b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36736 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34794 - "GET / HTTP/1.0" 200 OK 2026-04-16 05:11:39,614 - lava_callback - INFO - Received callback for node 69ddcc7cc2164e674d722a65 INFO: 172.21.0.1:34804 - "POST /node/69ddcc7cc2164e674d722a65 HTTP/1.0" 202 Accepted 2026-04-16 05:11:39,620 - lava_callback - INFO - Starting async job submit for node 69ddcc7cc2164e674d722a65 2026-04-16 05:11:39,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:11:39,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddcc7cc2164e674d722a65 HTTP/1.1" 200 None 2026-04-16 05:11:39,636 - lava_callback - DEBUG - Processing node 69ddcc7cc2164e674d722a65: baseline-arm-clabbe 2026-04-16 05:11:39,636 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddcc7cc2164e674d722a65 2026-04-16 05:11:39,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:11:39,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddcc7cc2164e674d722a65 HTTP/1.1" 200 None 2026-04-16 05:11:39,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:11:39,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 05:11:39,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:11:39,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddcc7cc2164e674d722a65 HTTP/1.1" 200 None 2026-04-16 05:11:39,697 - lava_callback - ERROR - Error processing callback for node 69ddcc7cc2164e674d722a65: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34810 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34820 - "GET / HTTP/1.0" 200 OK 2026-04-16 05:12:19,637 - lava_callback - INFO - Received callback for node 69ddcc9fc2164e674d722a7c INFO: 172.21.0.1:34824 - "POST /node/69ddcc9fc2164e674d722a7c HTTP/1.0" 202 Accepted 2026-04-16 05:12:19,642 - lava_callback - INFO - Starting async job submit for node 69ddcc9fc2164e674d722a7c 2026-04-16 05:12:19,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:12:19,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddcc9fc2164e674d722a7c HTTP/1.1" 200 None 2026-04-16 05:12:19,685 - lava_callback - DEBUG - Processing node 69ddcc9fc2164e674d722a7c: baseline-arm-clabbe 2026-04-16 05:12:19,686 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddcc9fc2164e674d722a7c 2026-04-16 05:12:19,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:12:19,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddcc9fc2164e674d722a7c HTTP/1.1" 200 None 2026-04-16 05:12:19,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:12:19,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 05:12:19,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:12:19,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddcc9fc2164e674d722a7c HTTP/1.1" 200 None 2026-04-16 05:12:19,801 - lava_callback - ERROR - Error processing callback for node 69ddcc9fc2164e674d722a7c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50416 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45642 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54708 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49244 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46192 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53496 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38968 - "GET / HTTP/1.0" 200 OK 2026-04-16 05:46:29,661 - lava_callback - INFO - Received callback for node 69ddd4a6c2164e674d722b37 INFO: 172.21.0.1:38984 - "POST /node/69ddd4a6c2164e674d722b37 HTTP/1.0" 202 Accepted 2026-04-16 05:46:29,667 - lava_callback - INFO - Starting async job submit for node 69ddd4a6c2164e674d722b37 2026-04-16 05:46:29,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:46:29,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd4a6c2164e674d722b37 HTTP/1.1" 200 None 2026-04-16 05:46:29,683 - lava_callback - DEBUG - Processing node 69ddd4a6c2164e674d722b37: baseline-arm64-baylibre 2026-04-16 05:46:29,684 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddd4a6c2164e674d722b37 2026-04-16 05:46:29,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:46:29,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd4a6c2164e674d722b37 HTTP/1.1" 200 None 2026-04-16 05:46:29,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:46:29,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-16 05:46:29,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:46:29,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddd4a6c2164e674d722b37 HTTP/1.1" 200 None 2026-04-16 05:46:29,751 - lava_callback - ERROR - Error processing callback for node 69ddd4a6c2164e674d722b37: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48342 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37366 - "GET / HTTP/1.0" 200 OK 2026-04-16 05:48:29,640 - lava_callback - INFO - Received callback for node 69ddd51ec2164e674d722b7a INFO: 172.21.0.1:37376 - "POST /node/69ddd51ec2164e674d722b7a HTTP/1.0" 202 Accepted 2026-04-16 05:48:29,646 - lava_callback - INFO - Starting async job submit for node 69ddd51ec2164e674d722b7a 2026-04-16 05:48:29,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:48:29,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd51ec2164e674d722b7a HTTP/1.1" 200 None 2026-04-16 05:48:29,662 - lava_callback - DEBUG - Processing node 69ddd51ec2164e674d722b7a: baseline-arm64-baylibre 2026-04-16 05:48:29,663 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddd51ec2164e674d722b7a 2026-04-16 05:48:29,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:48:29,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd51ec2164e674d722b7a HTTP/1.1" 200 None 2026-04-16 05:48:29,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:48:29,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-16 05:48:29,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:48:29,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddd51ec2164e674d722b7a HTTP/1.1" 200 None 2026-04-16 05:48:29,731 - lava_callback - ERROR - Error processing callback for node 69ddd51ec2164e674d722b7a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51178 - "GET / HTTP/1.0" 200 OK 2026-04-16 05:50:29,749 - lava_callback - INFO - Received callback for node 69ddd596c2164e674d722bba INFO: 172.21.0.1:36268 - "POST /node/69ddd596c2164e674d722bba HTTP/1.0" 202 Accepted 2026-04-16 05:50:29,755 - lava_callback - INFO - Starting async job submit for node 69ddd596c2164e674d722bba 2026-04-16 05:50:29,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:50:29,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd596c2164e674d722bba HTTP/1.1" 200 None 2026-04-16 05:50:29,771 - lava_callback - DEBUG - Processing node 69ddd596c2164e674d722bba: baseline-arm64-baylibre 2026-04-16 05:50:29,771 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddd596c2164e674d722bba 2026-04-16 05:50:29,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:50:29,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd596c2164e674d722bba HTTP/1.1" 200 None 2026-04-16 05:50:29,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:50:29,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-16 05:50:29,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:50:29,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddd596c2164e674d722bba HTTP/1.1" 200 None 2026-04-16 05:50:29,996 - lava_callback - ERROR - Error processing callback for node 69ddd596c2164e674d722bba: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50582 - "GET / HTTP/1.0" 200 OK 2026-04-16 05:51:50,071 - lava_callback - INFO - Received callback for node 69ddd5e6c2164e674d722beb INFO: 172.21.0.1:57810 - "POST /node/69ddd5e6c2164e674d722beb HTTP/1.0" 202 Accepted 2026-04-16 05:51:50,077 - lava_callback - INFO - Starting async job submit for node 69ddd5e6c2164e674d722beb 2026-04-16 05:51:50,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:51:50,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd5e6c2164e674d722beb HTTP/1.1" 200 None 2026-04-16 05:51:50,104 - lava_callback - DEBUG - Processing node 69ddd5e6c2164e674d722beb: baseline-arm64-baylibre 2026-04-16 05:51:50,105 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddd5e6c2164e674d722beb 2026-04-16 05:51:50,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:51:50,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd5e6c2164e674d722beb HTTP/1.1" 200 None 2026-04-16 05:51:50,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:51:50,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-16 05:51:50,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:51:50,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddd5e6c2164e674d722beb HTTP/1.1" 200 None 2026-04-16 05:51:50,156 - lava_callback - ERROR - Error processing callback for node 69ddd5e6c2164e674d722beb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49258 - "GET /node/69903c97985e4efca431e043%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:49268 - "GET /node/69401a6d575bc060ce1525f9%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:41872 - "GET / HTTP/1.0" 200 OK 2026-04-16 05:52:49,862 - lava_callback - INFO - Received callback for node 69ddd62ac2164e674d722c62 INFO: 172.21.0.1:42598 - "POST /node/69ddd62ac2164e674d722c62 HTTP/1.0" 202 Accepted 2026-04-16 05:52:49,868 - lava_callback - INFO - Starting async job submit for node 69ddd62ac2164e674d722c62 2026-04-16 05:52:49,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:52:49,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd62ac2164e674d722c62 HTTP/1.1" 200 None 2026-04-16 05:52:49,885 - lava_callback - DEBUG - Processing node 69ddd62ac2164e674d722c62: baseline-arm64-baylibre 2026-04-16 05:52:49,886 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddd62ac2164e674d722c62 2026-04-16 05:52:49,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:52:49,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd62ac2164e674d722c62 HTTP/1.1" 200 None 2026-04-16 05:52:49,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:52:49,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-16 05:52:49,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:52:49,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddd62ac2164e674d722c62 HTTP/1.1" 200 None 2026-04-16 05:52:49,939 - lava_callback - ERROR - Error processing callback for node 69ddd62ac2164e674d722c62: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42610 - "GET /node/693f9ea00d8ce4018da99712%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:42618 - "GET /node/6992fd7831166481c8dded81%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:55878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52370 - "GET / HTTP/1.0" 200 OK 2026-04-16 05:54:09,979 - lava_callback - INFO - Received callback for node 69ddd677c2164e674d722ca2 INFO: 172.21.0.1:48462 - "POST /node/69ddd677c2164e674d722ca2 HTTP/1.0" 202 Accepted 2026-04-16 05:54:09,986 - lava_callback - INFO - Starting async job submit for node 69ddd677c2164e674d722ca2 2026-04-16 05:54:09,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:54:10,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd677c2164e674d722ca2 HTTP/1.1" 200 None 2026-04-16 05:54:10,005 - lava_callback - DEBUG - Processing node 69ddd677c2164e674d722ca2: baseline-arm64-baylibre 2026-04-16 05:54:10,005 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddd677c2164e674d722ca2 2026-04-16 05:54:10,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:54:10,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd677c2164e674d722ca2 HTTP/1.1" 200 None 2026-04-16 05:54:10,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:54:10,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-16 05:54:10,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:54:10,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddd677c2164e674d722ca2 HTTP/1.1" 200 None 2026-04-16 05:54:10,064 - lava_callback - ERROR - Error processing callback for node 69ddd677c2164e674d722ca2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33008 - "GET /node/69938431cebe99dd8e06f870%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:35234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42150 - "GET /node/693f6eca0d8ce4018da92b81%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:42160 - "GET /node/698bd8091e517752bab8b567%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:38102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54170 - "GET / HTTP/1.0" 200 OK 2026-04-16 05:55:30,082 - lava_callback - INFO - Received callback for node 69ddd6c3c2164e674d722cf9 INFO: 172.21.0.1:36774 - "POST /node/69ddd6c3c2164e674d722cf9 HTTP/1.0" 202 Accepted 2026-04-16 05:55:30,088 - lava_callback - INFO - Starting async job submit for node 69ddd6c3c2164e674d722cf9 2026-04-16 05:55:30,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:55:30,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd6c3c2164e674d722cf9 HTTP/1.1" 200 None 2026-04-16 05:55:30,110 - lava_callback - DEBUG - Processing node 69ddd6c3c2164e674d722cf9: baseline-arm64-baylibre 2026-04-16 05:55:30,110 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddd6c3c2164e674d722cf9 2026-04-16 05:55:30,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:55:30,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd6c3c2164e674d722cf9 HTTP/1.1" 200 None 2026-04-16 05:55:30,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:55:30,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-16 05:55:30,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:55:30,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddd6c3c2164e674d722cf9 HTTP/1.1" 200 None 2026-04-16 05:55:30,157 - lava_callback - ERROR - Error processing callback for node 69ddd6c3c2164e674d722cf9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57676 - "GET / HTTP/1.0" 200 OK 2026-04-16 05:56:30,019 - lava_callback - INFO - Received callback for node 69ddd706c2164e674d722d5e INFO: 172.21.0.1:51756 - "POST /node/69ddd706c2164e674d722d5e HTTP/1.0" 202 Accepted 2026-04-16 05:56:30,028 - lava_callback - INFO - Starting async job submit for node 69ddd706c2164e674d722d5e 2026-04-16 05:56:30,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:56:30,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd706c2164e674d722d5e HTTP/1.1" 200 None 2026-04-16 05:56:30,047 - lava_callback - DEBUG - Processing node 69ddd706c2164e674d722d5e: baseline-arm64-baylibre 2026-04-16 05:56:30,048 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddd706c2164e674d722d5e 2026-04-16 05:56:30,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:56:30,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd706c2164e674d722d5e HTTP/1.1" 200 None 2026-04-16 05:56:30,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:56:30,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-16 05:56:30,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:56:30,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddd706c2164e674d722d5e HTTP/1.1" 200 None 2026-04-16 05:56:30,106 - lava_callback - ERROR - Error processing callback for node 69ddd706c2164e674d722d5e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33306 - "GET /node/69a46f72a327b98156690292%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:40190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42696 - "GET /node/6992d9f531166481c8dd422b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:42708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34868 - "GET / HTTP/1.0" 200 OK 2026-04-16 05:57:50,231 - lava_callback - INFO - Received callback for node 69ddd751c2164e674d722d94 INFO: 172.21.0.1:50964 - "POST /node/69ddd751c2164e674d722d94 HTTP/1.0" 202 Accepted 2026-04-16 05:57:50,236 - lava_callback - INFO - Starting async job submit for node 69ddd751c2164e674d722d94 2026-04-16 05:57:50,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:57:50,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd751c2164e674d722d94 HTTP/1.1" 200 None 2026-04-16 05:57:50,261 - lava_callback - DEBUG - Processing node 69ddd751c2164e674d722d94: baseline-arm64-baylibre 2026-04-16 05:57:50,262 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddd751c2164e674d722d94 2026-04-16 05:57:50,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:57:50,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd751c2164e674d722d94 HTTP/1.1" 200 None 2026-04-16 05:57:50,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:57:50,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-16 05:57:50,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:57:50,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddd751c2164e674d722d94 HTTP/1.1" 200 None 2026-04-16 05:57:50,316 - lava_callback - ERROR - Error processing callback for node 69ddd751c2164e674d722d94: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49392 - "GET / HTTP/1.0" 200 OK 2026-04-16 05:59:01,544 - lava_callback - INFO - Received callback for node 69ddd7a2c2164e674d722df0 INFO: 172.21.0.1:43272 - "POST /node/69ddd7a2c2164e674d722df0 HTTP/1.0" 202 Accepted 2026-04-16 05:59:01,550 - lava_callback - INFO - Starting async job submit for node 69ddd7a2c2164e674d722df0 2026-04-16 05:59:01,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:59:01,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd7a2c2164e674d722df0 HTTP/1.1" 200 None 2026-04-16 05:59:01,566 - lava_callback - DEBUG - Processing node 69ddd7a2c2164e674d722df0: baseline-arm64-clabbe 2026-04-16 05:59:01,567 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddd7a2c2164e674d722df0 2026-04-16 05:59:01,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:59:01,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd7a2c2164e674d722df0 HTTP/1.1" 200 None 2026-04-16 05:59:01,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:59:01,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-16 05:59:01,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:59:01,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddd7a2c2164e674d722df0 HTTP/1.1" 200 None 2026-04-16 05:59:01,615 - lava_callback - ERROR - Error processing callback for node 69ddd7a2c2164e674d722df0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35776 - "GET /node/69937335cebe99dd8e069dfb%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:35782 - "GET /node/693f3f2024745582e399f177%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-16 06:00:21,595 - lava_callback - INFO - Received callback for node 69ddd7f2c2164e674d722e42 INFO: 172.21.0.1:41214 - "POST /node/69ddd7f2c2164e674d722e42 HTTP/1.0" 202 Accepted 2026-04-16 06:00:21,601 - lava_callback - INFO - Starting async job submit for node 69ddd7f2c2164e674d722e42 2026-04-16 06:00:21,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:00:21,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd7f2c2164e674d722e42 HTTP/1.1" 200 None 2026-04-16 06:00:21,617 - lava_callback - DEBUG - Processing node 69ddd7f2c2164e674d722e42: baseline-arm64-clabbe 2026-04-16 06:00:21,617 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddd7f2c2164e674d722e42 2026-04-16 06:00:21,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:00:21,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd7f2c2164e674d722e42 HTTP/1.1" 200 None 2026-04-16 06:00:21,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:00:21,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-16 06:00:21,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:00:21,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddd7f2c2164e674d722e42 HTTP/1.1" 200 None 2026-04-16 06:00:21,675 - lava_callback - ERROR - Error processing callback for node 69ddd7f2c2164e674d722e42: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59122 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:01:41,638 - lava_callback - INFO - Received callback for node 69ddd83dc2164e674d722e8d INFO: 172.21.0.1:35454 - "POST /node/69ddd83dc2164e674d722e8d HTTP/1.0" 202 Accepted 2026-04-16 06:01:41,643 - lava_callback - INFO - Starting async job submit for node 69ddd83dc2164e674d722e8d 2026-04-16 06:01:41,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:01:41,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd83dc2164e674d722e8d HTTP/1.1" 200 None 2026-04-16 06:01:41,659 - lava_callback - DEBUG - Processing node 69ddd83dc2164e674d722e8d: baseline-arm64-clabbe 2026-04-16 06:01:41,659 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddd83dc2164e674d722e8d 2026-04-16 06:01:41,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:01:41,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd83dc2164e674d722e8d HTTP/1.1" 200 None 2026-04-16 06:01:41,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:01:41,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-16 06:01:41,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:01:41,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddd83dc2164e674d722e8d HTTP/1.1" 200 None 2026-04-16 06:01:41,706 - lava_callback - ERROR - Error processing callback for node 69ddd83dc2164e674d722e8d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35460 - "GET /node/69cf7f5f000c489abc2c01da%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:35466 - "GET /node/6983ed38969566dcb0d29a7f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:35474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48902 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:03:01,704 - lava_callback - INFO - Received callback for node 69ddd885c2164e674d722ee8 INFO: 172.21.0.1:42864 - "POST /node/69ddd885c2164e674d722ee8 HTTP/1.0" 202 Accepted 2026-04-16 06:03:01,710 - lava_callback - INFO - Starting async job submit for node 69ddd885c2164e674d722ee8 2026-04-16 06:03:01,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:03:01,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd885c2164e674d722ee8 HTTP/1.1" 200 None 2026-04-16 06:03:01,726 - lava_callback - DEBUG - Processing node 69ddd885c2164e674d722ee8: baseline-arm64-clabbe 2026-04-16 06:03:01,727 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddd885c2164e674d722ee8 2026-04-16 06:03:01,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:03:01,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd885c2164e674d722ee8 HTTP/1.1" 200 None 2026-04-16 06:03:01,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:03:01,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-16 06:03:01,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:03:01,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddd885c2164e674d722ee8 HTTP/1.1" 200 None 2026-04-16 06:03:01,773 - lava_callback - ERROR - Error processing callback for node 69ddd885c2164e674d722ee8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54960 - "GET /node/6988bbe39fc35f969e1eccf8%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:54972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45562 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:04:21,879 - lava_callback - INFO - Received callback for node 69ddd8d7c2164e674d722f28 INFO: 172.21.0.1:54276 - "POST /node/69ddd8d7c2164e674d722f28 HTTP/1.0" 202 Accepted 2026-04-16 06:04:21,885 - lava_callback - INFO - Starting async job submit for node 69ddd8d7c2164e674d722f28 2026-04-16 06:04:21,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:04:21,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd8d7c2164e674d722f28 HTTP/1.1" 200 None 2026-04-16 06:04:21,901 - lava_callback - DEBUG - Processing node 69ddd8d7c2164e674d722f28: baseline-arm64-clabbe 2026-04-16 06:04:21,901 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddd8d7c2164e674d722f28 2026-04-16 06:04:21,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:04:21,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd8d7c2164e674d722f28 HTTP/1.1" 200 None 2026-04-16 06:04:21,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:04:21,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-16 06:04:21,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:04:21,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddd8d7c2164e674d722f28 HTTP/1.1" 200 None 2026-04-16 06:04:21,950 - lava_callback - ERROR - Error processing callback for node 69ddd8d7c2164e674d722f28: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35892 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:05:30,555 - lava_callback - INFO - Received callback for node 69ddd91ec2164e674d722f61 INFO: 172.21.0.1:49344 - "POST /node/69ddd91ec2164e674d722f61 HTTP/1.0" 202 Accepted 2026-04-16 06:05:30,561 - lava_callback - INFO - Starting async job submit for node 69ddd91ec2164e674d722f61 2026-04-16 06:05:30,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:05:30,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd91ec2164e674d722f61 HTTP/1.1" 200 None 2026-04-16 06:05:30,576 - lava_callback - DEBUG - Processing node 69ddd91ec2164e674d722f61: baseline-arm64-baylibre 2026-04-16 06:05:30,576 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddd91ec2164e674d722f61 2026-04-16 06:05:30,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:05:30,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd91ec2164e674d722f61 HTTP/1.1" 200 None 2026-04-16 06:05:30,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:05:30,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-16 06:05:30,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:05:30,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddd91ec2164e674d722f61 HTTP/1.1" 200 None 2026-04-16 06:05:30,626 - lava_callback - ERROR - Error processing callback for node 69ddd91ec2164e674d722f61: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49348 - "GET /node/6992d95531166481c8dd3fbb%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:49358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36292 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:07:01,848 - lava_callback - INFO - Received callback for node 69ddd979c2164e674d722f96 INFO: 172.21.0.1:54904 - "POST /node/69ddd979c2164e674d722f96 HTTP/1.0" 202 Accepted 2026-04-16 06:07:01,854 - lava_callback - INFO - Starting async job submit for node 69ddd979c2164e674d722f96 2026-04-16 06:07:01,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:07:01,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd979c2164e674d722f96 HTTP/1.1" 200 None 2026-04-16 06:07:01,870 - lava_callback - DEBUG - Processing node 69ddd979c2164e674d722f96: baseline-arm64-clabbe 2026-04-16 06:07:01,870 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddd979c2164e674d722f96 2026-04-16 06:07:01,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:07:01,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd979c2164e674d722f96 HTTP/1.1" 200 None 2026-04-16 06:07:01,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:07:01,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-16 06:07:01,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:07:01,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddd979c2164e674d722f96 HTTP/1.1" 200 None 2026-04-16 06:07:01,925 - lava_callback - ERROR - Error processing callback for node 69ddd979c2164e674d722f96: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52180 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:08:21,861 - lava_callback - INFO - Received callback for node 69ddd9c4c2164e674d722fdf INFO: 172.21.0.1:53502 - "POST /node/69ddd9c4c2164e674d722fdf HTTP/1.0" 202 Accepted 2026-04-16 06:08:21,867 - lava_callback - INFO - Starting async job submit for node 69ddd9c4c2164e674d722fdf 2026-04-16 06:08:21,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:08:21,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd9c4c2164e674d722fdf HTTP/1.1" 200 None 2026-04-16 06:08:21,894 - lava_callback - DEBUG - Processing node 69ddd9c4c2164e674d722fdf: baseline-arm64-clabbe 2026-04-16 06:08:21,894 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddd9c4c2164e674d722fdf 2026-04-16 06:08:21,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:08:21,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd9c4c2164e674d722fdf HTTP/1.1" 200 None 2026-04-16 06:08:21,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:08:21,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-16 06:08:21,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:08:21,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddd9c4c2164e674d722fdf HTTP/1.1" 200 None 2026-04-16 06:08:21,944 - lava_callback - ERROR - Error processing callback for node 69ddd9c4c2164e674d722fdf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48142 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:09:21,938 - lava_callback - INFO - Received callback for node 69ddda0cc2164e674d723049 INFO: 172.21.0.1:35826 - "POST /node/69ddda0cc2164e674d723049 HTTP/1.0" 202 Accepted 2026-04-16 06:09:21,943 - lava_callback - INFO - Starting async job submit for node 69ddda0cc2164e674d723049 2026-04-16 06:09:21,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:09:21,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddda0cc2164e674d723049 HTTP/1.1" 200 None 2026-04-16 06:09:21,968 - lava_callback - DEBUG - Processing node 69ddda0cc2164e674d723049: baseline-arm64-clabbe 2026-04-16 06:09:21,968 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddda0cc2164e674d723049 2026-04-16 06:09:21,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:09:21,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddda0cc2164e674d723049 HTTP/1.1" 200 None 2026-04-16 06:09:21,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:09:21,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-16 06:09:21,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:09:22,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddda0cc2164e674d723049 HTTP/1.1" 200 None 2026-04-16 06:09:22,018 - lava_callback - ERROR - Error processing callback for node 69ddda0cc2164e674d723049: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41074 - "GET /node/695370da31522df6df79dcdd%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:41088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49330 - "GET /node/69846a683a8748f282086cea%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:47190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43812 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:10:42,021 - lava_callback - INFO - Received callback for node 69ddda59c2164e674d723070 INFO: 172.21.0.1:38244 - "POST /node/69ddda59c2164e674d723070 HTTP/1.0" 202 Accepted 2026-04-16 06:10:42,026 - lava_callback - INFO - Starting async job submit for node 69ddda59c2164e674d723070 2026-04-16 06:10:42,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:10:42,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddda59c2164e674d723070 HTTP/1.1" 200 None 2026-04-16 06:10:42,058 - lava_callback - DEBUG - Processing node 69ddda59c2164e674d723070: baseline-arm64-clabbe 2026-04-16 06:10:42,059 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddda59c2164e674d723070 2026-04-16 06:10:42,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:10:42,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddda59c2164e674d723070 HTTP/1.1" 200 None 2026-04-16 06:10:42,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:10:42,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-16 06:10:42,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:10:42,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddda59c2164e674d723070 HTTP/1.1" 200 None 2026-04-16 06:10:42,112 - lava_callback - ERROR - Error processing callback for node 69ddda59c2164e674d723070: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43258 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:13:10,933 - lava_callback - INFO - Received callback for node 69dddae2c2164e674d72311b INFO: 172.21.0.1:48766 - "POST /node/69dddae2c2164e674d72311b HTTP/1.0" 202 Accepted 2026-04-16 06:13:10,939 - lava_callback - INFO - Starting async job submit for node 69dddae2c2164e674d72311b 2026-04-16 06:13:10,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:13:10,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dddae2c2164e674d72311b HTTP/1.1" 200 None 2026-04-16 06:13:10,955 - lava_callback - DEBUG - Processing node 69dddae2c2164e674d72311b: baseline-arm64-baylibre 2026-04-16 06:13:10,955 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dddae2c2164e674d72311b 2026-04-16 06:13:10,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:13:10,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dddae2c2164e674d72311b HTTP/1.1" 200 None 2026-04-16 06:13:10,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:13:10,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-16 06:13:10,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:13:11,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dddae2c2164e674d72311b HTTP/1.1" 200 None 2026-04-16 06:13:11,006 - lava_callback - ERROR - Error processing callback for node 69dddae2c2164e674d72311b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48778 - "GET /node/6992fd7531166481c8dded66%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:48786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55632 - "GET /node/6937dd8ca4c94886b94bee8a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:55634 - "GET /node/693e2dc9407f32424eb594b0%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:55646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33996 - "GET /node/695f75724e4af301aa86457a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:34010 - "GET /node/698a0f0a22b4cc0f227ad8dd%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:35416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34786 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:14:22,120 - lava_callback - INFO - Received callback for node 69dddb33c2164e674d723164 INFO: 172.21.0.1:51028 - "POST /node/69dddb33c2164e674d723164 HTTP/1.0" 202 Accepted 2026-04-16 06:14:22,125 - lava_callback - INFO - Starting async job submit for node 69dddb33c2164e674d723164 2026-04-16 06:14:22,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:14:22,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dddb33c2164e674d723164 HTTP/1.1" 200 None 2026-04-16 06:14:22,144 - lava_callback - DEBUG - Processing node 69dddb33c2164e674d723164: baseline-arm64-clabbe 2026-04-16 06:14:22,144 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dddb33c2164e674d723164 2026-04-16 06:14:22,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:14:22,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dddb33c2164e674d723164 HTTP/1.1" 200 None 2026-04-16 06:14:22,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:14:22,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-16 06:14:22,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:14:22,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dddb33c2164e674d723164 HTTP/1.1" 200 None 2026-04-16 06:14:22,198 - lava_callback - ERROR - Error processing callback for node 69dddb33c2164e674d723164: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58866 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:15:42,200 - lava_callback - INFO - Received callback for node 69dddb7bc2164e674d7231ca INFO: 172.21.0.1:40422 - "POST /node/69dddb7bc2164e674d7231ca HTTP/1.0" 202 Accepted 2026-04-16 06:15:42,206 - lava_callback - INFO - Starting async job submit for node 69dddb7bc2164e674d7231ca 2026-04-16 06:15:42,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:15:42,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dddb7bc2164e674d7231ca HTTP/1.1" 200 None 2026-04-16 06:15:42,229 - lava_callback - DEBUG - Processing node 69dddb7bc2164e674d7231ca: baseline-arm64-clabbe 2026-04-16 06:15:42,229 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dddb7bc2164e674d7231ca 2026-04-16 06:15:42,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:15:42,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dddb7bc2164e674d7231ca HTTP/1.1" 200 None 2026-04-16 06:15:42,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:15:42,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-16 06:15:42,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:15:42,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dddb7bc2164e674d7231ca HTTP/1.1" 200 None 2026-04-16 06:15:42,287 - lava_callback - ERROR - Error processing callback for node 69dddb7bc2164e674d7231ca: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35712 - "GET /node/69a1be5669d5b6151c03ae23%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:35720 - "GET /node/698f915e3013abef95d033f7%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:35734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58412 - "GET /node/69867d94177ca0f097bd5210%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:58424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58192 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:16:42,229 - lava_callback - INFO - Received callback for node 69dddbc4c2164e674d72320b INFO: 172.21.0.1:38240 - "POST /node/69dddbc4c2164e674d72320b HTTP/1.0" 202 Accepted 2026-04-16 06:16:42,234 - lava_callback - INFO - Starting async job submit for node 69dddbc4c2164e674d72320b 2026-04-16 06:16:42,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:16:42,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dddbc4c2164e674d72320b HTTP/1.1" 200 None 2026-04-16 06:16:42,250 - lava_callback - DEBUG - Processing node 69dddbc4c2164e674d72320b: baseline-arm64-clabbe 2026-04-16 06:16:42,250 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dddbc4c2164e674d72320b 2026-04-16 06:16:42,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:16:42,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dddbc4c2164e674d72320b HTTP/1.1" 200 None 2026-04-16 06:16:42,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:16:42,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-16 06:16:42,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:16:42,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dddbc4c2164e674d72320b HTTP/1.1" 200 None 2026-04-16 06:16:42,307 - lava_callback - ERROR - Error processing callback for node 69dddbc4c2164e674d72320b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51518 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:17:51,173 - lava_callback - INFO - Received callback for node 69dddc08c2164e674d723260 INFO: 172.21.0.1:52272 - "POST /node/69dddc08c2164e674d723260 HTTP/1.0" 202 Accepted 2026-04-16 06:17:51,178 - lava_callback - INFO - Starting async job submit for node 69dddc08c2164e674d723260 2026-04-16 06:17:51,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:17:51,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dddc08c2164e674d723260 HTTP/1.1" 200 None 2026-04-16 06:17:51,194 - lava_callback - DEBUG - Processing node 69dddc08c2164e674d723260: baseline-arm64-baylibre 2026-04-16 06:17:51,194 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dddc08c2164e674d723260 2026-04-16 06:17:51,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:17:51,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dddc08c2164e674d723260 HTTP/1.1" 200 None 2026-04-16 06:17:51,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:17:51,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-16 06:17:51,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:17:51,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dddc08c2164e674d723260 HTTP/1.1" 200 None 2026-04-16 06:17:51,243 - lava_callback - ERROR - Error processing callback for node 69dddc08c2164e674d723260: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53998 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:19:22,269 - lava_callback - INFO - Received callback for node 69dddc59c2164e674d7232aa INFO: 172.21.0.1:42246 - "POST /node/69dddc59c2164e674d7232aa HTTP/1.0" 202 Accepted 2026-04-16 06:19:22,275 - lava_callback - INFO - Starting async job submit for node 69dddc59c2164e674d7232aa 2026-04-16 06:19:22,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:19:22,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dddc59c2164e674d7232aa HTTP/1.1" 200 None 2026-04-16 06:19:22,291 - lava_callback - DEBUG - Processing node 69dddc59c2164e674d7232aa: baseline-arm64-clabbe 2026-04-16 06:19:22,291 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dddc59c2164e674d7232aa 2026-04-16 06:19:22,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:19:22,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dddc59c2164e674d7232aa HTTP/1.1" 200 None 2026-04-16 06:19:22,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:19:22,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-16 06:19:22,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:19:22,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dddc59c2164e674d7232aa HTTP/1.1" 200 None 2026-04-16 06:19:22,338 - lava_callback - ERROR - Error processing callback for node 69dddc59c2164e674d7232aa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42178 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:20:31,356 - lava_callback - INFO - Received callback for node 69dddca6c2164e674d7232dd INFO: 172.21.0.1:50180 - "POST /node/69dddca6c2164e674d7232dd HTTP/1.0" 202 Accepted 2026-04-16 06:20:31,363 - lava_callback - INFO - Starting async job submit for node 69dddca6c2164e674d7232dd 2026-04-16 06:20:31,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:20:31,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dddca6c2164e674d7232dd HTTP/1.1" 200 None 2026-04-16 06:20:31,380 - lava_callback - DEBUG - Processing node 69dddca6c2164e674d7232dd: baseline-arm64-baylibre 2026-04-16 06:20:31,380 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dddca6c2164e674d7232dd 2026-04-16 06:20:31,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:20:31,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dddca6c2164e674d7232dd HTTP/1.1" 200 None 2026-04-16 06:20:31,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:20:31,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-16 06:20:31,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:20:31,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dddca6c2164e674d7232dd HTTP/1.1" 200 None 2026-04-16 06:20:31,436 - lava_callback - ERROR - Error processing callback for node 69dddca6c2164e674d7232dd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37052 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:21:51,420 - lava_callback - INFO - Received callback for node 69dddcf3c2164e674d723316 INFO: 172.21.0.1:48936 - "POST /node/69dddcf3c2164e674d723316 HTTP/1.0" 202 Accepted 2026-04-16 06:21:51,426 - lava_callback - INFO - Starting async job submit for node 69dddcf3c2164e674d723316 2026-04-16 06:21:51,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:21:51,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dddcf3c2164e674d723316 HTTP/1.1" 200 None 2026-04-16 06:21:51,441 - lava_callback - DEBUG - Processing node 69dddcf3c2164e674d723316: baseline-arm64-baylibre 2026-04-16 06:21:51,441 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dddcf3c2164e674d723316 2026-04-16 06:21:51,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:21:51,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dddcf3c2164e674d723316 HTTP/1.1" 200 None 2026-04-16 06:21:51,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:21:51,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-16 06:21:51,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:21:51,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dddcf3c2164e674d723316 HTTP/1.1" 200 None 2026-04-16 06:21:51,674 - lava_callback - ERROR - Error processing callback for node 69dddcf3c2164e674d723316: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58860 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:23:22,477 - lava_callback - INFO - Received callback for node 69dddd44c2164e674d72335b INFO: 172.21.0.1:39688 - "POST /node/69dddd44c2164e674d72335b HTTP/1.0" 202 Accepted 2026-04-16 06:23:22,483 - lava_callback - INFO - Starting async job submit for node 69dddd44c2164e674d72335b 2026-04-16 06:23:22,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:23:22,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dddd44c2164e674d72335b HTTP/1.1" 200 None 2026-04-16 06:23:22,502 - lava_callback - DEBUG - Processing node 69dddd44c2164e674d72335b: baseline-arm64-clabbe 2026-04-16 06:23:22,502 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dddd44c2164e674d72335b 2026-04-16 06:23:22,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:23:22,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dddd44c2164e674d72335b HTTP/1.1" 200 None 2026-04-16 06:23:22,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:23:22,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-16 06:23:22,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:23:22,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dddd44c2164e674d72335b HTTP/1.1" 200 None 2026-04-16 06:23:22,553 - lava_callback - ERROR - Error processing callback for node 69dddd44c2164e674d72335b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33816 - "GET /node/695f75734e4af301aa86457d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:33826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45436 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50680 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36092 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:35:52,414 - lava_callback - INFO - Received callback for node 69dde033c2164e674d723528 INFO: 172.21.0.1:42186 - "POST /node/69dde033c2164e674d723528 HTTP/1.0" 202 Accepted 2026-04-16 06:35:52,419 - lava_callback - INFO - Starting async job submit for node 69dde033c2164e674d723528 2026-04-16 06:35:52,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:35:52,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde033c2164e674d723528 HTTP/1.1" 200 None 2026-04-16 06:35:52,436 - lava_callback - DEBUG - Processing node 69dde033c2164e674d723528: baseline-arm64-baylibre 2026-04-16 06:35:52,436 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde033c2164e674d723528 2026-04-16 06:35:52,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:35:52,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde033c2164e674d723528 HTTP/1.1" 200 None 2026-04-16 06:35:52,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:35:52,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd171917c944d2f17d8b46 HTTP/1.1" 200 None 2026-04-16 06:35:52,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:35:52,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde033c2164e674d723528 HTTP/1.1" 200 None 2026-04-16 06:35:52,487 - lava_callback - ERROR - Error processing callback for node 69dde033c2164e674d723528: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53174 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:36:52,143 - lava_callback - INFO - Received callback for node 69dde076c2164e674d723558 INFO: 172.21.0.1:40484 - "POST /node/69dde076c2164e674d723558 HTTP/1.0" 202 Accepted 2026-04-16 06:36:52,149 - lava_callback - INFO - Starting async job submit for node 69dde076c2164e674d723558 2026-04-16 06:36:52,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:36:52,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde076c2164e674d723558 HTTP/1.1" 200 None 2026-04-16 06:36:52,166 - lava_callback - DEBUG - Processing node 69dde076c2164e674d723558: baseline-arm-baylibre 2026-04-16 06:36:52,166 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde076c2164e674d723558 2026-04-16 06:36:52,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:36:52,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde076c2164e674d723558 HTTP/1.1" 200 None 2026-04-16 06:36:52,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:36:52,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 06:36:52,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:36:52,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde076c2164e674d723558 HTTP/1.1" 200 None 2026-04-16 06:36:52,214 - lava_callback - ERROR - Error processing callback for node 69dde076c2164e674d723558: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33308 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49754 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:38:32,275 - lava_callback - INFO - Received callback for node 69dde0dac2164e674d723589 INFO: 172.21.0.1:55764 - "POST /node/69dde0dac2164e674d723589 HTTP/1.0" 202 Accepted 2026-04-16 06:38:32,280 - lava_callback - INFO - Starting async job submit for node 69dde0dac2164e674d723589 2026-04-16 06:38:32,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:38:32,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde0dac2164e674d723589 HTTP/1.1" 200 None 2026-04-16 06:38:32,297 - lava_callback - DEBUG - Processing node 69dde0dac2164e674d723589: baseline-arm-baylibre 2026-04-16 06:38:32,297 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde0dac2164e674d723589 2026-04-16 06:38:32,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:38:32,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde0dac2164e674d723589 HTTP/1.1" 200 None 2026-04-16 06:38:32,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:38:32,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 06:38:32,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:38:32,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde0dac2164e674d723589 HTTP/1.1" 200 None 2026-04-16 06:38:32,346 - lava_callback - ERROR - Error processing callback for node 69dde0dac2164e674d723589: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42386 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:39:12,253 - lava_callback - INFO - Received callback for node 69dde103c2164e674d7235b3 INFO: 172.21.0.1:43468 - "POST /node/69dde103c2164e674d7235b3 HTTP/1.0" 202 Accepted 2026-04-16 06:39:12,259 - lava_callback - INFO - Starting async job submit for node 69dde103c2164e674d7235b3 2026-04-16 06:39:12,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:39:12,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde103c2164e674d7235b3 HTTP/1.1" 200 None 2026-04-16 06:39:12,276 - lava_callback - DEBUG - Processing node 69dde103c2164e674d7235b3: baseline-arm-baylibre 2026-04-16 06:39:12,276 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde103c2164e674d7235b3 2026-04-16 06:39:12,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:39:12,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde103c2164e674d7235b3 HTTP/1.1" 200 None 2026-04-16 06:39:12,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:39:12,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 06:39:12,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:39:12,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde103c2164e674d7235b3 HTTP/1.1" 200 None 2026-04-16 06:39:12,330 - lava_callback - ERROR - Error processing callback for node 69dde103c2164e674d7235b3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37196 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:39:52,368 - lava_callback - INFO - Received callback for node 69dde131c2164e674d7235f7 INFO: 172.21.0.1:39188 - "POST /node/69dde131c2164e674d7235f7 HTTP/1.0" 202 Accepted 2026-04-16 06:39:52,374 - lava_callback - INFO - Starting async job submit for node 69dde131c2164e674d7235f7 2026-04-16 06:39:52,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:39:52,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde131c2164e674d7235f7 HTTP/1.1" 200 None 2026-04-16 06:39:52,390 - lava_callback - DEBUG - Processing node 69dde131c2164e674d7235f7: baseline-arm64-baylibre 2026-04-16 06:39:52,391 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde131c2164e674d7235f7 2026-04-16 06:39:52,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:39:52,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde131c2164e674d7235f7 HTTP/1.1" 200 None 2026-04-16 06:39:52,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:39:52,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd171917c944d2f17d8b46 HTTP/1.1" 200 None 2026-04-16 06:39:52,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:39:52,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde131c2164e674d7235f7 HTTP/1.1" 200 None 2026-04-16 06:39:52,440 - lava_callback - ERROR - Error processing callback for node 69dde131c2164e674d7235f7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44076 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:43:12,553 - lava_callback - INFO - Received callback for node 69dde1f3c2164e674d7236c9 INFO: 172.21.0.1:34248 - "POST /node/69dde1f3c2164e674d7236c9 HTTP/1.0" 202 Accepted 2026-04-16 06:43:12,561 - lava_callback - INFO - Starting async job submit for node 69dde1f3c2164e674d7236c9 2026-04-16 06:43:12,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:43:12,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde1f3c2164e674d7236c9 HTTP/1.1" 200 None 2026-04-16 06:43:12,611 - lava_callback - DEBUG - Processing node 69dde1f3c2164e674d7236c9: baseline-arm-baylibre 2026-04-16 06:43:12,611 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde1f3c2164e674d7236c9 2026-04-16 06:43:12,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:43:12,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde1f3c2164e674d7236c9 HTTP/1.1" 200 None 2026-04-16 06:43:12,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:43:12,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-16 06:43:12,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:43:12,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde1f3c2164e674d7236c9 HTTP/1.1" 200 None 2026-04-16 06:43:12,683 - lava_callback - ERROR - Error processing callback for node 69dde1f3c2164e674d7236c9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49980 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:43:32,510 - lava_callback - INFO - Received callback for node 69dde212c2164e674d7236ef INFO: 172.21.0.1:48572 - "POST /node/69dde212c2164e674d7236ef HTTP/1.0" 202 Accepted 2026-04-16 06:43:32,515 - lava_callback - INFO - Starting async job submit for node 69dde212c2164e674d7236ef 2026-04-16 06:43:32,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:43:32,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde212c2164e674d7236ef HTTP/1.1" 200 None 2026-04-16 06:43:32,541 - lava_callback - DEBUG - Processing node 69dde212c2164e674d7236ef: baseline-arm-baylibre 2026-04-16 06:43:32,541 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde212c2164e674d7236ef 2026-04-16 06:43:32,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:43:32,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde212c2164e674d7236ef HTTP/1.1" 200 None 2026-04-16 06:43:32,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:43:32,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-16 06:43:32,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:43:32,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde212c2164e674d7236ef HTTP/1.1" 200 None 2026-04-16 06:43:32,597 - lava_callback - ERROR - Error processing callback for node 69dde212c2164e674d7236ef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48610 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:44:52,666 - lava_callback - INFO - Received callback for node 69dde257c2164e674d723736 INFO: 172.21.0.1:44380 - "POST /node/69dde257c2164e674d723736 HTTP/1.0" 202 Accepted 2026-04-16 06:44:52,672 - lava_callback - INFO - Starting async job submit for node 69dde257c2164e674d723736 2026-04-16 06:44:52,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:44:52,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde257c2164e674d723736 HTTP/1.1" 200 None 2026-04-16 06:44:52,698 - lava_callback - DEBUG - Processing node 69dde257c2164e674d723736: baseline-arm-baylibre 2026-04-16 06:44:52,698 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde257c2164e674d723736 2026-04-16 06:44:52,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:44:52,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde257c2164e674d723736 HTTP/1.1" 200 None 2026-04-16 06:44:52,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:44:52,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-16 06:44:52,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:44:52,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde257c2164e674d723736 HTTP/1.1" 200 None 2026-04-16 06:44:52,751 - lava_callback - ERROR - Error processing callback for node 69dde257c2164e674d723736: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41090 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:46:23,468 - lava_callback - INFO - Received callback for node 69dde2bbc2164e674d7237bc INFO: 172.21.0.1:50538 - "POST /node/69dde2bbc2164e674d7237bc HTTP/1.0" 202 Accepted 2026-04-16 06:46:23,474 - lava_callback - INFO - Starting async job submit for node 69dde2bbc2164e674d7237bc 2026-04-16 06:46:23,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:46:23,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde2bbc2164e674d7237bc HTTP/1.1" 200 None 2026-04-16 06:46:23,489 - lava_callback - DEBUG - Processing node 69dde2bbc2164e674d7237bc: baseline-arm-clabbe 2026-04-16 06:46:23,489 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde2bbc2164e674d7237bc 2026-04-16 06:46:23,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:46:23,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde2bbc2164e674d7237bc HTTP/1.1" 200 None 2026-04-16 06:46:23,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:46:23,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-16 06:46:23,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:46:23,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde2bbc2164e674d7237bc HTTP/1.1" 200 None 2026-04-16 06:46:23,536 - lava_callback - ERROR - Error processing callback for node 69dde2bbc2164e674d7237bc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51408 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:47:03,473 - lava_callback - INFO - Received callback for node 69dde2dec2164e674d7237db INFO: 172.21.0.1:59160 - "POST /node/69dde2dec2164e674d7237db HTTP/1.0" 202 Accepted 2026-04-16 06:47:03,478 - lava_callback - INFO - Starting async job submit for node 69dde2dec2164e674d7237db 2026-04-16 06:47:03,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:47:03,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde2dec2164e674d7237db HTTP/1.1" 200 None 2026-04-16 06:47:03,495 - lava_callback - DEBUG - Processing node 69dde2dec2164e674d7237db: baseline-arm-clabbe 2026-04-16 06:47:03,495 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde2dec2164e674d7237db 2026-04-16 06:47:03,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:47:03,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde2dec2164e674d7237db HTTP/1.1" 200 None 2026-04-16 06:47:03,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:47:03,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-16 06:47:03,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:47:03,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde2dec2164e674d7237db HTTP/1.1" 200 None 2026-04-16 06:47:03,545 - lava_callback - ERROR - Error processing callback for node 69dde2dec2164e674d7237db: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44508 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:47:43,589 - lava_callback - INFO - Received callback for node 69dde301c2164e674d723800 INFO: 172.21.0.1:40972 - "POST /node/69dde301c2164e674d723800 HTTP/1.0" 202 Accepted 2026-04-16 06:47:43,594 - lava_callback - INFO - Starting async job submit for node 69dde301c2164e674d723800 2026-04-16 06:47:43,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:47:43,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde301c2164e674d723800 HTTP/1.1" 200 None 2026-04-16 06:47:43,616 - lava_callback - DEBUG - Processing node 69dde301c2164e674d723800: baseline-arm-clabbe 2026-04-16 06:47:43,616 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde301c2164e674d723800 2026-04-16 06:47:43,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:47:43,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde301c2164e674d723800 HTTP/1.1" 200 None 2026-04-16 06:47:43,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:47:43,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-16 06:47:43,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:47:43,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde301c2164e674d723800 HTTP/1.1" 200 None 2026-04-16 06:47:43,667 - lava_callback - ERROR - Error processing callback for node 69dde301c2164e674d723800: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56594 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:48:23,549 - lava_callback - INFO - Received callback for node 69dde321c2164e674d723827 INFO: 172.21.0.1:57574 - "POST /node/69dde321c2164e674d723827 HTTP/1.0" 202 Accepted 2026-04-16 06:48:23,555 - lava_callback - INFO - Starting async job submit for node 69dde321c2164e674d723827 2026-04-16 06:48:23,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:48:23,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde321c2164e674d723827 HTTP/1.1" 200 None 2026-04-16 06:48:23,571 - lava_callback - DEBUG - Processing node 69dde321c2164e674d723827: baseline-arm-clabbe 2026-04-16 06:48:23,572 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde321c2164e674d723827 2026-04-16 06:48:23,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:48:23,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde321c2164e674d723827 HTTP/1.1" 200 None 2026-04-16 06:48:23,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:48:23,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-16 06:48:23,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:48:23,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde321c2164e674d723827 HTTP/1.1" 200 None 2026-04-16 06:48:23,627 - lava_callback - ERROR - Error processing callback for node 69dde321c2164e674d723827: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43162 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:48:43,596 - lava_callback - INFO - Received callback for node 69dde343c2164e674d723853 INFO: 172.21.0.1:53258 - "POST /node/69dde343c2164e674d723853 HTTP/1.0" 202 Accepted 2026-04-16 06:48:43,602 - lava_callback - INFO - Starting async job submit for node 69dde343c2164e674d723853 2026-04-16 06:48:43,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:48:43,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde343c2164e674d723853 HTTP/1.1" 200 None 2026-04-16 06:48:43,618 - lava_callback - DEBUG - Processing node 69dde343c2164e674d723853: baseline-arm-clabbe 2026-04-16 06:48:43,618 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde343c2164e674d723853 2026-04-16 06:48:43,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:48:43,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde343c2164e674d723853 HTTP/1.1" 200 None 2026-04-16 06:48:43,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:48:43,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-16 06:48:43,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:48:43,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde343c2164e674d723853 HTTP/1.1" 200 None 2026-04-16 06:48:43,674 - lava_callback - ERROR - Error processing callback for node 69dde343c2164e674d723853: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53286 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:49:23,561 - lava_callback - INFO - Received callback for node 69dde364c2164e674d723875 INFO: 172.21.0.1:39974 - "POST /node/69dde364c2164e674d723875 HTTP/1.0" 202 Accepted 2026-04-16 06:49:23,567 - lava_callback - INFO - Starting async job submit for node 69dde364c2164e674d723875 2026-04-16 06:49:23,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:49:23,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde364c2164e674d723875 HTTP/1.1" 200 None 2026-04-16 06:49:23,583 - lava_callback - DEBUG - Processing node 69dde364c2164e674d723875: baseline-arm-clabbe 2026-04-16 06:49:23,583 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde364c2164e674d723875 2026-04-16 06:49:23,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:49:23,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde364c2164e674d723875 HTTP/1.1" 200 None 2026-04-16 06:49:23,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:49:23,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-16 06:49:23,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:49:23,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde364c2164e674d723875 HTTP/1.1" 200 None 2026-04-16 06:49:23,649 - lava_callback - ERROR - Error processing callback for node 69dde364c2164e674d723875: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39704 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:49:43,580 - lava_callback - INFO - Received callback for node 69dde383c2164e674d7238a5 INFO: 172.21.0.1:60012 - "POST /node/69dde383c2164e674d7238a5 HTTP/1.0" 202 Accepted 2026-04-16 06:49:43,585 - lava_callback - INFO - Starting async job submit for node 69dde383c2164e674d7238a5 2026-04-16 06:49:43,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:49:43,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde383c2164e674d7238a5 HTTP/1.1" 200 None 2026-04-16 06:49:43,601 - lava_callback - DEBUG - Processing node 69dde383c2164e674d7238a5: baseline-arm-clabbe 2026-04-16 06:49:43,602 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde383c2164e674d7238a5 2026-04-16 06:49:43,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:49:43,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde383c2164e674d7238a5 HTTP/1.1" 200 None 2026-04-16 06:49:43,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:49:43,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-16 06:49:43,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:49:43,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde383c2164e674d7238a5 HTTP/1.1" 200 None 2026-04-16 06:49:43,661 - lava_callback - ERROR - Error processing callback for node 69dde383c2164e674d7238a5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54836 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:50:23,624 - lava_callback - INFO - Received callback for node 69dde3a7c2164e674d7238f0 INFO: 172.21.0.1:48022 - "POST /node/69dde3a7c2164e674d7238f0 HTTP/1.0" 202 Accepted 2026-04-16 06:50:23,630 - lava_callback - INFO - Starting async job submit for node 69dde3a7c2164e674d7238f0 2026-04-16 06:50:23,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:50:23,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde3a7c2164e674d7238f0 HTTP/1.1" 200 None 2026-04-16 06:50:23,646 - lava_callback - DEBUG - Processing node 69dde3a7c2164e674d7238f0: baseline-arm-clabbe 2026-04-16 06:50:23,646 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde3a7c2164e674d7238f0 2026-04-16 06:50:23,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:50:23,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde3a7c2164e674d7238f0 HTTP/1.1" 200 None 2026-04-16 06:50:23,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:50:23,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-16 06:50:23,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:50:23,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde3a7c2164e674d7238f0 HTTP/1.1" 200 None 2026-04-16 06:50:23,703 - lava_callback - ERROR - Error processing callback for node 69dde3a7c2164e674d7238f0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45070 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:51:03,678 - lava_callback - INFO - Received callback for node 69dde3c8c2164e674d723920 INFO: 172.21.0.1:59976 - "POST /node/69dde3c8c2164e674d723920 HTTP/1.0" 202 Accepted 2026-04-16 06:51:03,684 - lava_callback - INFO - Starting async job submit for node 69dde3c8c2164e674d723920 2026-04-16 06:51:03,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:51:03,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde3c8c2164e674d723920 HTTP/1.1" 200 None 2026-04-16 06:51:03,700 - lava_callback - DEBUG - Processing node 69dde3c8c2164e674d723920: baseline-arm-clabbe 2026-04-16 06:51:03,700 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde3c8c2164e674d723920 2026-04-16 06:51:03,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:51:03,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde3c8c2164e674d723920 HTTP/1.1" 200 None 2026-04-16 06:51:03,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:51:03,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-16 06:51:03,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:51:03,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde3c8c2164e674d723920 HTTP/1.1" 200 None 2026-04-16 06:51:03,747 - lava_callback - ERROR - Error processing callback for node 69dde3c8c2164e674d723920: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36810 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:53:43,816 - lava_callback - INFO - Received callback for node 69dde462c2164e674d7239e0 INFO: 172.21.0.1:45992 - "POST /node/69dde462c2164e674d7239e0 HTTP/1.0" 202 Accepted 2026-04-16 06:53:43,822 - lava_callback - INFO - Starting async job submit for node 69dde462c2164e674d7239e0 2026-04-16 06:53:43,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:53:43,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde462c2164e674d7239e0 HTTP/1.1" 200 None 2026-04-16 06:53:43,838 - lava_callback - DEBUG - Processing node 69dde462c2164e674d7239e0: baseline-arm64-clabbe 2026-04-16 06:53:43,838 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde462c2164e674d7239e0 2026-04-16 06:53:43,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:53:43,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde462c2164e674d7239e0 HTTP/1.1" 200 None 2026-04-16 06:53:43,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:53:43,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd171917c944d2f17d8b46 HTTP/1.1" 200 None 2026-04-16 06:53:43,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:53:43,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde462c2164e674d7239e0 HTTP/1.1" 200 None 2026-04-16 06:53:43,887 - lava_callback - ERROR - Error processing callback for node 69dde462c2164e674d7239e0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55820 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:54:23,735 - lava_callback - INFO - Received callback for node 69dde49cc2164e674d723a47 INFO: 172.21.0.1:60150 - "POST /node/69dde49cc2164e674d723a47 HTTP/1.0" 202 Accepted 2026-04-16 06:54:23,741 - lava_callback - INFO - Starting async job submit for node 69dde49cc2164e674d723a47 2026-04-16 06:54:23,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:54:23,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde49cc2164e674d723a47 HTTP/1.1" 200 None 2026-04-16 06:54:23,757 - lava_callback - DEBUG - Processing node 69dde49cc2164e674d723a47: baseline-arm-clabbe 2026-04-16 06:54:23,757 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde49cc2164e674d723a47 2026-04-16 06:54:23,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:54:23,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde49cc2164e674d723a47 HTTP/1.1" 200 None 2026-04-16 06:54:23,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:54:23,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-16 06:54:23,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:54:23,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde49cc2164e674d723a47 HTTP/1.1" 200 None 2026-04-16 06:54:23,814 - lava_callback - ERROR - Error processing callback for node 69dde49cc2164e674d723a47: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41714 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:55:03,817 - lava_callback - INFO - Received callback for node 69dde4c2c2164e674d723a60 INFO: 172.21.0.1:54226 - "POST /node/69dde4c2c2164e674d723a60 HTTP/1.0" 202 Accepted 2026-04-16 06:55:03,823 - lava_callback - INFO - Starting async job submit for node 69dde4c2c2164e674d723a60 2026-04-16 06:55:03,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:55:03,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde4c2c2164e674d723a60 HTTP/1.1" 200 None 2026-04-16 06:55:03,840 - lava_callback - DEBUG - Processing node 69dde4c2c2164e674d723a60: baseline-arm-clabbe 2026-04-16 06:55:03,840 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde4c2c2164e674d723a60 2026-04-16 06:55:03,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:55:03,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde4c2c2164e674d723a60 HTTP/1.1" 200 None 2026-04-16 06:55:03,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:55:03,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-16 06:55:03,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:55:03,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde4c2c2164e674d723a60 HTTP/1.1" 200 None 2026-04-16 06:55:03,890 - lava_callback - ERROR - Error processing callback for node 69dde4c2c2164e674d723a60: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35984 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:56:03,923 - lava_callback - INFO - Received callback for node 69dde4f1c2164e674d723ab7 INFO: 172.21.0.1:49750 - "POST /node/69dde4f1c2164e674d723ab7 HTTP/1.0" 202 Accepted 2026-04-16 06:56:03,929 - lava_callback - INFO - Starting async job submit for node 69dde4f1c2164e674d723ab7 2026-04-16 06:56:03,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:56:03,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde4f1c2164e674d723ab7 HTTP/1.1" 200 None 2026-04-16 06:56:03,945 - lava_callback - DEBUG - Processing node 69dde4f1c2164e674d723ab7: baseline-arm64-clabbe 2026-04-16 06:56:03,945 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde4f1c2164e674d723ab7 2026-04-16 06:56:03,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:56:03,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde4f1c2164e674d723ab7 HTTP/1.1" 200 None 2026-04-16 06:56:03,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:56:03,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd171917c944d2f17d8b46 HTTP/1.1" 200 None 2026-04-16 06:56:03,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:56:03,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde4f1c2164e674d723ab7 HTTP/1.1" 200 None 2026-04-16 06:56:03,998 - lava_callback - ERROR - Error processing callback for node 69dde4f1c2164e674d723ab7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43732 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:57:03,977 - lava_callback - INFO - Received callback for node 69dde529c2164e674d723b14 INFO: 172.21.0.1:51088 - "POST /node/69dde529c2164e674d723b14 HTTP/1.0" 202 Accepted 2026-04-16 06:57:03,982 - lava_callback - INFO - Starting async job submit for node 69dde529c2164e674d723b14 2026-04-16 06:57:03,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:57:03,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde529c2164e674d723b14 HTTP/1.1" 200 None 2026-04-16 06:57:03,998 - lava_callback - DEBUG - Processing node 69dde529c2164e674d723b14: baseline-arm-clabbe 2026-04-16 06:57:03,998 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde529c2164e674d723b14 2026-04-16 06:57:03,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:57:04,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde529c2164e674d723b14 HTTP/1.1" 200 None 2026-04-16 06:57:04,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:57:04,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-16 06:57:04,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:57:04,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde529c2164e674d723b14 HTTP/1.1" 200 None 2026-04-16 06:57:04,054 - lava_callback - ERROR - Error processing callback for node 69dde529c2164e674d723b14: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33288 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:57:23,886 - lava_callback - INFO - Received callback for node 69dde54bc2164e674d723b42 INFO: 172.21.0.1:40114 - "POST /node/69dde54bc2164e674d723b42 HTTP/1.0" 202 Accepted 2026-04-16 06:57:23,892 - lava_callback - INFO - Starting async job submit for node 69dde54bc2164e674d723b42 2026-04-16 06:57:23,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:57:23,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde54bc2164e674d723b42 HTTP/1.1" 200 None 2026-04-16 06:57:23,908 - lava_callback - DEBUG - Processing node 69dde54bc2164e674d723b42: baseline-arm-clabbe 2026-04-16 06:57:23,909 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde54bc2164e674d723b42 2026-04-16 06:57:23,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:57:23,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde54bc2164e674d723b42 HTTP/1.1" 200 None 2026-04-16 06:57:23,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:57:23,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-16 06:57:23,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:57:23,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde54bc2164e674d723b42 HTTP/1.1" 200 None 2026-04-16 06:57:23,959 - lava_callback - ERROR - Error processing callback for node 69dde54bc2164e674d723b42: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38604 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:58:24,145 - lava_callback - INFO - Received callback for node 69dde57ac2164e674d723b6d INFO: 172.21.0.1:44366 - "POST /node/69dde57ac2164e674d723b6d HTTP/1.0" 202 Accepted 2026-04-16 06:58:24,151 - lava_callback - INFO - Starting async job submit for node 69dde57ac2164e674d723b6d 2026-04-16 06:58:24,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:58:24,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde57ac2164e674d723b6d HTTP/1.1" 200 None 2026-04-16 06:58:24,167 - lava_callback - DEBUG - Processing node 69dde57ac2164e674d723b6d: baseline-arm64-clabbe 2026-04-16 06:58:24,167 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde57ac2164e674d723b6d 2026-04-16 06:58:24,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:58:24,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde57ac2164e674d723b6d HTTP/1.1" 200 None 2026-04-16 06:58:24,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:58:24,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd171917c944d2f17d8b46 HTTP/1.1" 200 None 2026-04-16 06:58:24,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:58:24,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde57ac2164e674d723b6d HTTP/1.1" 200 None 2026-04-16 06:58:24,231 - lava_callback - ERROR - Error processing callback for node 69dde57ac2164e674d723b6d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48584 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:59:03,996 - lava_callback - INFO - Received callback for node 69dde5b3c2164e674d723bbb INFO: 172.21.0.1:46460 - "POST /node/69dde5b3c2164e674d723bbb HTTP/1.0" 202 Accepted 2026-04-16 06:59:04,002 - lava_callback - INFO - Starting async job submit for node 69dde5b3c2164e674d723bbb 2026-04-16 06:59:04,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:59:04,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde5b3c2164e674d723bbb HTTP/1.1" 200 None 2026-04-16 06:59:04,017 - lava_callback - DEBUG - Processing node 69dde5b3c2164e674d723bbb: baseline-arm-clabbe 2026-04-16 06:59:04,017 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde5b3c2164e674d723bbb 2026-04-16 06:59:04,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:59:04,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde5b3c2164e674d723bbb HTTP/1.1" 200 None 2026-04-16 06:59:04,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:59:04,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-16 06:59:04,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:59:04,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde5b3c2164e674d723bbb HTTP/1.1" 200 None 2026-04-16 06:59:04,067 - lava_callback - ERROR - Error processing callback for node 69dde5b3c2164e674d723bbb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54468 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34436 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:59:44,015 - lava_callback - INFO - Received callback for node 69dde5d5c2164e674d723be8 INFO: 172.21.0.1:48736 - "POST /node/69dde5d5c2164e674d723be8 HTTP/1.0" 202 Accepted 2026-04-16 06:59:44,020 - lava_callback - INFO - Starting async job submit for node 69dde5d5c2164e674d723be8 2026-04-16 06:59:44,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:59:44,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde5d5c2164e674d723be8 HTTP/1.1" 200 None 2026-04-16 06:59:44,037 - lava_callback - DEBUG - Processing node 69dde5d5c2164e674d723be8: baseline-arm-clabbe 2026-04-16 06:59:44,037 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde5d5c2164e674d723be8 2026-04-16 06:59:44,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:59:44,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde5d5c2164e674d723be8 HTTP/1.1" 200 None 2026-04-16 06:59:44,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:59:44,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 06:59:44,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:59:44,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde5d5c2164e674d723be8 HTTP/1.1" 200 None 2026-04-16 06:59:44,086 - lava_callback - ERROR - Error processing callback for node 69dde5d5c2164e674d723be8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59294 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32796 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:00:44,082 - lava_callback - INFO - Received callback for node 69dde607c2164e674d723c20 INFO: 172.21.0.1:56914 - "POST /node/69dde607c2164e674d723c20 HTTP/1.0" 202 Accepted 2026-04-16 07:00:44,088 - lava_callback - INFO - Starting async job submit for node 69dde607c2164e674d723c20 2026-04-16 07:00:44,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:00:44,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde607c2164e674d723c20 HTTP/1.1" 200 None 2026-04-16 07:00:44,110 - lava_callback - DEBUG - Processing node 69dde607c2164e674d723c20: baseline-arm64-clabbe 2026-04-16 07:00:44,111 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde607c2164e674d723c20 2026-04-16 07:00:44,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:00:44,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde607c2164e674d723c20 HTTP/1.1" 200 None 2026-04-16 07:00:44,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:00:44,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd171917c944d2f17d8b46 HTTP/1.1" 200 None 2026-04-16 07:00:44,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:00:44,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde607c2164e674d723c20 HTTP/1.1" 200 None 2026-04-16 07:00:44,164 - lava_callback - ERROR - Error processing callback for node 69dde607c2164e674d723c20: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54996 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:01:24,090 - lava_callback - INFO - Received callback for node 69dde640c2164e674d723c89 INFO: 172.21.0.1:55642 - "POST /node/69dde640c2164e674d723c89 HTTP/1.0" 202 Accepted 2026-04-16 07:01:24,096 - lava_callback - INFO - Starting async job submit for node 69dde640c2164e674d723c89 2026-04-16 07:01:24,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:01:24,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde640c2164e674d723c89 HTTP/1.1" 200 None 2026-04-16 07:01:24,111 - lava_callback - DEBUG - Processing node 69dde640c2164e674d723c89: baseline-arm-clabbe 2026-04-16 07:01:24,111 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde640c2164e674d723c89 2026-04-16 07:01:24,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:01:24,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde640c2164e674d723c89 HTTP/1.1" 200 None 2026-04-16 07:01:24,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:01:24,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-16 07:01:24,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:01:24,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde640c2164e674d723c89 HTTP/1.1" 200 None 2026-04-16 07:01:24,159 - lava_callback - ERROR - Error processing callback for node 69dde640c2164e674d723c89: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51382 - "GET /node/69bcaaafb4744551b27fd2e9%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:51392 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51408 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:02:24,145 - lava_callback - INFO - Received callback for node 69dde671c2164e674d723ca2 INFO: 172.21.0.1:38828 - "POST /node/69dde671c2164e674d723ca2 HTTP/1.0" 202 Accepted 2026-04-16 07:02:24,151 - lava_callback - INFO - Starting async job submit for node 69dde671c2164e674d723ca2 2026-04-16 07:02:24,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:02:24,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde671c2164e674d723ca2 HTTP/1.1" 200 None 2026-04-16 07:02:24,168 - lava_callback - DEBUG - Processing node 69dde671c2164e674d723ca2: baseline-arm64-clabbe 2026-04-16 07:02:24,168 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde671c2164e674d723ca2 2026-04-16 07:02:24,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:02:24,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde671c2164e674d723ca2 HTTP/1.1" 200 None 2026-04-16 07:02:24,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:02:24,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd171917c944d2f17d8b46 HTTP/1.1" 200 None 2026-04-16 07:02:24,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:02:24,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde671c2164e674d723ca2 HTTP/1.1" 200 None 2026-04-16 07:02:24,220 - lava_callback - ERROR - Error processing callback for node 69dde671c2164e674d723ca2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60810 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60818 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:03:24,191 - lava_callback - INFO - Received callback for node 69dde6adc2164e674d723cdd INFO: 172.21.0.1:40672 - "POST /node/69dde6adc2164e674d723cdd HTTP/1.0" 202 Accepted 2026-04-16 07:03:24,197 - lava_callback - INFO - Starting async job submit for node 69dde6adc2164e674d723cdd 2026-04-16 07:03:24,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:03:24,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde6adc2164e674d723cdd HTTP/1.1" 200 None 2026-04-16 07:03:24,213 - lava_callback - DEBUG - Processing node 69dde6adc2164e674d723cdd: baseline-arm-clabbe 2026-04-16 07:03:24,213 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde6adc2164e674d723cdd 2026-04-16 07:03:24,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:03:24,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde6adc2164e674d723cdd HTTP/1.1" 200 None 2026-04-16 07:03:24,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:03:24,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-16 07:03:24,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:03:24,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde6adc2164e674d723cdd HTTP/1.1" 200 None 2026-04-16 07:03:24,287 - lava_callback - ERROR - Error processing callback for node 69dde6adc2164e674d723cdd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33522 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:04:04,206 - lava_callback - INFO - Received callback for node 69dde6d1c2164e674d723d1a INFO: 172.21.0.1:39236 - "POST /node/69dde6d1c2164e674d723d1a HTTP/1.0" 202 Accepted 2026-04-16 07:04:04,215 - lava_callback - INFO - Starting async job submit for node 69dde6d1c2164e674d723d1a 2026-04-16 07:04:04,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:04:04,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde6d1c2164e674d723d1a HTTP/1.1" 200 None 2026-04-16 07:04:04,238 - lava_callback - DEBUG - Processing node 69dde6d1c2164e674d723d1a: baseline-arm-clabbe 2026-04-16 07:04:04,238 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde6d1c2164e674d723d1a 2026-04-16 07:04:04,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:04:04,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde6d1c2164e674d723d1a HTTP/1.1" 200 None 2026-04-16 07:04:04,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:04:04,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-16 07:04:04,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:04:04,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde6d1c2164e674d723d1a HTTP/1.1" 200 None 2026-04-16 07:04:04,288 - lava_callback - ERROR - Error processing callback for node 69dde6d1c2164e674d723d1a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46512 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46528 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:04:24,280 - lava_callback - INFO - Received callback for node 69dde6f4c2164e674d723d2f INFO: 172.21.0.1:45394 - "POST /node/69dde6f4c2164e674d723d2f HTTP/1.0" 202 Accepted 2026-04-16 07:04:24,285 - lava_callback - INFO - Starting async job submit for node 69dde6f4c2164e674d723d2f 2026-04-16 07:04:24,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:04:24,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde6f4c2164e674d723d2f HTTP/1.1" 200 None 2026-04-16 07:04:24,303 - lava_callback - DEBUG - Processing node 69dde6f4c2164e674d723d2f: baseline-arm-clabbe 2026-04-16 07:04:24,303 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde6f4c2164e674d723d2f 2026-04-16 07:04:24,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:04:24,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde6f4c2164e674d723d2f HTTP/1.1" 200 None 2026-04-16 07:04:24,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:04:24,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-16 07:04:24,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:04:24,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde6f4c2164e674d723d2f HTTP/1.1" 200 None 2026-04-16 07:04:24,353 - lava_callback - ERROR - Error processing callback for node 69dde6f4c2164e674d723d2f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59334 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:05:24,291 - lava_callback - INFO - Received callback for node 69dde723c2164e674d723d49 INFO: 172.21.0.1:58944 - "POST /node/69dde723c2164e674d723d49 HTTP/1.0" 202 Accepted 2026-04-16 07:05:24,296 - lava_callback - INFO - Starting async job submit for node 69dde723c2164e674d723d49 2026-04-16 07:05:24,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:05:24,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde723c2164e674d723d49 HTTP/1.1" 200 None 2026-04-16 07:05:24,312 - lava_callback - DEBUG - Processing node 69dde723c2164e674d723d49: baseline-arm64-clabbe 2026-04-16 07:05:24,313 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde723c2164e674d723d49 2026-04-16 07:05:24,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:05:24,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde723c2164e674d723d49 HTTP/1.1" 200 None 2026-04-16 07:05:24,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:05:24,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd171917c944d2f17d8b46 HTTP/1.1" 200 None 2026-04-16 07:05:24,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:05:24,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde723c2164e674d723d49 HTTP/1.1" 200 None 2026-04-16 07:05:24,362 - lava_callback - ERROR - Error processing callback for node 69dde723c2164e674d723d49: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60170 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:06:24,359 - lava_callback - INFO - Received callback for node 69dde75cc2164e674d723da5 INFO: 172.21.0.1:33644 - "POST /node/69dde75cc2164e674d723da5 HTTP/1.0" 202 Accepted 2026-04-16 07:06:24,365 - lava_callback - INFO - Starting async job submit for node 69dde75cc2164e674d723da5 2026-04-16 07:06:24,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:06:24,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde75cc2164e674d723da5 HTTP/1.1" 200 None 2026-04-16 07:06:24,381 - lava_callback - DEBUG - Processing node 69dde75cc2164e674d723da5: baseline-arm-clabbe 2026-04-16 07:06:24,382 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde75cc2164e674d723da5 2026-04-16 07:06:24,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:06:24,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde75cc2164e674d723da5 HTTP/1.1" 200 None 2026-04-16 07:06:24,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:06:24,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 07:06:24,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:06:24,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde75cc2164e674d723da5 HTTP/1.1" 200 None 2026-04-16 07:06:24,457 - lava_callback - ERROR - Error processing callback for node 69dde75cc2164e674d723da5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41992 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:06:44,326 - lava_callback - INFO - Received callback for node 69dde77ac2164e674d723dce INFO: 172.21.0.1:39542 - "POST /node/69dde77ac2164e674d723dce HTTP/1.0" 202 Accepted 2026-04-16 07:06:44,331 - lava_callback - INFO - Starting async job submit for node 69dde77ac2164e674d723dce 2026-04-16 07:06:44,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:06:44,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde77ac2164e674d723dce HTTP/1.1" 200 None 2026-04-16 07:06:44,351 - lava_callback - DEBUG - Processing node 69dde77ac2164e674d723dce: baseline-arm-clabbe 2026-04-16 07:06:44,351 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde77ac2164e674d723dce 2026-04-16 07:06:44,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:06:44,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde77ac2164e674d723dce HTTP/1.1" 200 None 2026-04-16 07:06:44,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:06:44,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 07:06:44,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:06:44,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde77ac2164e674d723dce HTTP/1.1" 200 None 2026-04-16 07:06:44,400 - lava_callback - ERROR - Error processing callback for node 69dde77ac2164e674d723dce: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52564 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:07:24,400 - lava_callback - INFO - Received callback for node 69dde7a9c2164e674d723e0b INFO: 172.21.0.1:41392 - "POST /node/69dde7a9c2164e674d723e0b HTTP/1.0" 202 Accepted 2026-04-16 07:07:24,406 - lava_callback - INFO - Starting async job submit for node 69dde7a9c2164e674d723e0b 2026-04-16 07:07:24,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:07:24,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde7a9c2164e674d723e0b HTTP/1.1" 200 None 2026-04-16 07:07:24,422 - lava_callback - DEBUG - Processing node 69dde7a9c2164e674d723e0b: baseline-arm64-clabbe 2026-04-16 07:07:24,422 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde7a9c2164e674d723e0b 2026-04-16 07:07:24,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:07:24,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde7a9c2164e674d723e0b HTTP/1.1" 200 None 2026-04-16 07:07:24,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:07:24,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd171917c944d2f17d8b46 HTTP/1.1" 200 None 2026-04-16 07:07:24,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:07:24,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde7a9c2164e674d723e0b HTTP/1.1" 200 None 2026-04-16 07:07:24,478 - lava_callback - ERROR - Error processing callback for node 69dde7a9c2164e674d723e0b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49360 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53406 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:08:33,878 - lava_callback - INFO - Received callback for node 69dde7ddc2164e674d723e47 INFO: 172.21.0.1:56738 - "POST /node/69dde7ddc2164e674d723e47 HTTP/1.0" 202 Accepted 2026-04-16 07:08:33,884 - lava_callback - INFO - Starting async job submit for node 69dde7ddc2164e674d723e47 2026-04-16 07:08:33,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:08:33,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde7ddc2164e674d723e47 HTTP/1.1" 200 None 2026-04-16 07:08:33,900 - lava_callback - DEBUG - Processing node 69dde7ddc2164e674d723e47: baseline-arm-baylibre 2026-04-16 07:08:33,900 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde7ddc2164e674d723e47 2026-04-16 07:08:33,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:08:33,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde7ddc2164e674d723e47 HTTP/1.1" 200 None 2026-04-16 07:08:33,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:08:33,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 07:08:33,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:08:33,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde7ddc2164e674d723e47 HTTP/1.1" 200 None 2026-04-16 07:08:33,950 - lava_callback - ERROR - Error processing callback for node 69dde7ddc2164e674d723e47: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49132 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:09:04,429 - lava_callback - INFO - Received callback for node 69dde802c2164e674d723e89 INFO: 172.21.0.1:42624 - "POST /node/69dde802c2164e674d723e89 HTTP/1.0" 202 Accepted 2026-04-16 07:09:04,435 - lava_callback - INFO - Starting async job submit for node 69dde802c2164e674d723e89 2026-04-16 07:09:04,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:09:04,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde802c2164e674d723e89 HTTP/1.1" 200 None 2026-04-16 07:09:04,453 - lava_callback - DEBUG - Processing node 69dde802c2164e674d723e89: baseline-arm-clabbe 2026-04-16 07:09:04,454 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde802c2164e674d723e89 2026-04-16 07:09:04,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:09:04,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde802c2164e674d723e89 HTTP/1.1" 200 None 2026-04-16 07:09:04,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:09:04,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 07:09:04,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:09:04,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde802c2164e674d723e89 HTTP/1.1" 200 None 2026-04-16 07:09:04,503 - lava_callback - ERROR - Error processing callback for node 69dde802c2164e674d723e89: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57942 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36616 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:09:44,521 - lava_callback - INFO - Received callback for node 69dde823c2164e674d723ea7 INFO: 172.21.0.1:37380 - "POST /node/69dde823c2164e674d723ea7 HTTP/1.0" 202 Accepted 2026-04-16 07:09:44,527 - lava_callback - INFO - Starting async job submit for node 69dde823c2164e674d723ea7 2026-04-16 07:09:44,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:09:44,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde823c2164e674d723ea7 HTTP/1.1" 200 None 2026-04-16 07:09:44,544 - lava_callback - DEBUG - Processing node 69dde823c2164e674d723ea7: baseline-arm-clabbe 2026-04-16 07:09:44,544 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde823c2164e674d723ea7 2026-04-16 07:09:44,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:09:44,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde823c2164e674d723ea7 HTTP/1.1" 200 None 2026-04-16 07:09:44,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:09:44,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 07:09:44,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:09:44,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde823c2164e674d723ea7 HTTP/1.1" 200 None 2026-04-16 07:09:44,605 - lava_callback - ERROR - Error processing callback for node 69dde823c2164e674d723ea7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51074 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:15:44,744 - lava_callback - INFO - Received callback for node 69dde98fc2164e674d72404d INFO: 172.21.0.1:56712 - "POST /node/69dde98fc2164e674d72404d HTTP/1.0" 202 Accepted 2026-04-16 07:15:44,749 - lava_callback - INFO - Starting async job submit for node 69dde98fc2164e674d72404d 2026-04-16 07:15:44,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:15:44,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde98fc2164e674d72404d HTTP/1.1" 200 None 2026-04-16 07:15:44,766 - lava_callback - DEBUG - Processing node 69dde98fc2164e674d72404d: baseline-arm-clabbe 2026-04-16 07:15:44,766 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde98fc2164e674d72404d 2026-04-16 07:15:44,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:15:44,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde98fc2164e674d72404d HTTP/1.1" 200 None 2026-04-16 07:15:44,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:15:44,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 07:15:44,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:15:44,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde98fc2164e674d72404d HTTP/1.1" 200 None 2026-04-16 07:15:44,824 - lava_callback - ERROR - Error processing callback for node 69dde98fc2164e674d72404d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56570 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:16:14,316 - lava_callback - INFO - Received callback for node 69dde9adc2164e674d72406d INFO: 172.21.0.1:39288 - "POST /node/69dde9adc2164e674d72406d HTTP/1.0" 202 Accepted 2026-04-16 07:16:14,321 - lava_callback - INFO - Starting async job submit for node 69dde9adc2164e674d72406d 2026-04-16 07:16:14,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:16:14,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde9adc2164e674d72406d HTTP/1.1" 200 None 2026-04-16 07:16:14,338 - lava_callback - DEBUG - Processing node 69dde9adc2164e674d72406d: baseline-arm-baylibre 2026-04-16 07:16:14,338 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde9adc2164e674d72406d 2026-04-16 07:16:14,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:16:14,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde9adc2164e674d72406d HTTP/1.1" 200 None 2026-04-16 07:16:14,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:16:14,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 07:16:14,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:16:14,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde9adc2164e674d72406d HTTP/1.1" 200 None 2026-04-16 07:16:14,387 - lava_callback - ERROR - Error processing callback for node 69dde9adc2164e674d72406d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59392 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58726 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:17:34,409 - lava_callback - INFO - Received callback for node 69dde9fac2164e674d7240b6 INFO: 172.21.0.1:38970 - "POST /node/69dde9fac2164e674d7240b6 HTTP/1.0" 202 Accepted 2026-04-16 07:17:34,415 - lava_callback - INFO - Starting async job submit for node 69dde9fac2164e674d7240b6 2026-04-16 07:17:34,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:17:34,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde9fac2164e674d7240b6 HTTP/1.1" 200 None 2026-04-16 07:17:34,432 - lava_callback - DEBUG - Processing node 69dde9fac2164e674d7240b6: baseline-arm64-baylibre 2026-04-16 07:17:34,432 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde9fac2164e674d7240b6 2026-04-16 07:17:34,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:17:34,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde9fac2164e674d7240b6 HTTP/1.1" 200 None 2026-04-16 07:17:34,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:17:34,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-16 07:17:34,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:17:34,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde9fac2164e674d7240b6 HTTP/1.1" 200 None 2026-04-16 07:17:34,480 - lava_callback - ERROR - Error processing callback for node 69dde9fac2164e674d7240b6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49952 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:18:54,485 - lava_callback - INFO - Received callback for node 69ddea49c2164e674d7240e9 INFO: 172.21.0.1:40312 - "POST /node/69ddea49c2164e674d7240e9 HTTP/1.0" 202 Accepted 2026-04-16 07:18:54,492 - lava_callback - INFO - Starting async job submit for node 69ddea49c2164e674d7240e9 2026-04-16 07:18:54,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:18:54,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddea49c2164e674d7240e9 HTTP/1.1" 200 None 2026-04-16 07:18:54,522 - lava_callback - DEBUG - Processing node 69ddea49c2164e674d7240e9: baseline-arm64-baylibre 2026-04-16 07:18:54,522 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddea49c2164e674d7240e9 2026-04-16 07:18:54,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:18:54,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddea49c2164e674d7240e9 HTTP/1.1" 200 None 2026-04-16 07:18:54,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:18:54,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-16 07:18:54,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:18:54,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddea49c2164e674d7240e9 HTTP/1.1" 200 None 2026-04-16 07:18:54,571 - lava_callback - ERROR - Error processing callback for node 69ddea49c2164e674d7240e9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55948 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:20:14,453 - lava_callback - INFO - Received callback for node 69ddea99c2164e674d72414c INFO: 172.21.0.1:41706 - "POST /node/69ddea99c2164e674d72414c HTTP/1.0" 202 Accepted 2026-04-16 07:20:14,461 - lava_callback - INFO - Starting async job submit for node 69ddea99c2164e674d72414c 2026-04-16 07:20:14,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:20:14,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddea99c2164e674d72414c HTTP/1.1" 200 None 2026-04-16 07:20:14,479 - lava_callback - DEBUG - Processing node 69ddea99c2164e674d72414c: baseline-arm64-baylibre 2026-04-16 07:20:14,479 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddea99c2164e674d72414c 2026-04-16 07:20:14,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:20:14,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddea99c2164e674d72414c HTTP/1.1" 200 None 2026-04-16 07:20:14,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:20:14,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-16 07:20:14,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:20:14,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddea99c2164e674d72414c HTTP/1.1" 200 None 2026-04-16 07:20:14,535 - lava_callback - ERROR - Error processing callback for node 69ddea99c2164e674d72414c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53210 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:22:24,930 - lava_callback - INFO - Received callback for node 69ddeb26c2164e674d7241d1 INFO: 172.21.0.1:54982 - "POST /node/69ddeb26c2164e674d7241d1 HTTP/1.0" 202 Accepted 2026-04-16 07:22:24,939 - lava_callback - INFO - Starting async job submit for node 69ddeb26c2164e674d7241d1 2026-04-16 07:22:24,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:22:24,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddeb26c2164e674d7241d1 HTTP/1.1" 200 None 2026-04-16 07:22:24,956 - lava_callback - DEBUG - Processing node 69ddeb26c2164e674d7241d1: baseline-arm-clabbe 2026-04-16 07:22:24,956 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddeb26c2164e674d7241d1 2026-04-16 07:22:24,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:22:24,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddeb26c2164e674d7241d1 HTTP/1.1" 200 None 2026-04-16 07:22:24,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:22:24,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 07:22:24,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:22:25,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddeb26c2164e674d7241d1 HTTP/1.1" 200 None 2026-04-16 07:22:25,022 - lava_callback - ERROR - Error processing callback for node 69ddeb26c2164e674d7241d1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56592 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:23:04,980 - lava_callback - INFO - Received callback for node 69ddeb48c2164e674d724213 INFO: 172.21.0.1:44466 - "POST /node/69ddeb48c2164e674d724213 HTTP/1.0" 202 Accepted 2026-04-16 07:23:04,986 - lava_callback - INFO - Starting async job submit for node 69ddeb48c2164e674d724213 2026-04-16 07:23:04,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:23:05,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddeb48c2164e674d724213 HTTP/1.1" 200 None 2026-04-16 07:23:05,002 - lava_callback - DEBUG - Processing node 69ddeb48c2164e674d724213: baseline-arm-clabbe 2026-04-16 07:23:05,003 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddeb48c2164e674d724213 2026-04-16 07:23:05,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:23:05,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddeb48c2164e674d724213 HTTP/1.1" 200 None 2026-04-16 07:23:05,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:23:05,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 07:23:05,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:23:05,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddeb48c2164e674d724213 HTTP/1.1" 200 None 2026-04-16 07:23:05,060 - lava_callback - ERROR - Error processing callback for node 69ddeb48c2164e674d724213: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60374 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58946 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:23:45,024 - lava_callback - INFO - Received callback for node 69ddeb78c2164e674d724227 INFO: 172.21.0.1:35190 - "POST /node/69ddeb78c2164e674d724227 HTTP/1.0" 202 Accepted 2026-04-16 07:23:45,030 - lava_callback - INFO - Starting async job submit for node 69ddeb78c2164e674d724227 2026-04-16 07:23:45,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:23:45,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddeb78c2164e674d724227 HTTP/1.1" 200 None 2026-04-16 07:23:45,050 - lava_callback - DEBUG - Processing node 69ddeb78c2164e674d724227: baseline-arm64-clabbe 2026-04-16 07:23:45,051 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddeb78c2164e674d724227 2026-04-16 07:23:45,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:23:45,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddeb78c2164e674d724227 HTTP/1.1" 200 None 2026-04-16 07:23:45,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:23:45,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-16 07:23:45,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:23:45,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddeb78c2164e674d724227 HTTP/1.1" 200 None 2026-04-16 07:23:45,106 - lava_callback - ERROR - Error processing callback for node 69ddeb78c2164e674d724227: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50488 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:25:05,128 - lava_callback - INFO - Received callback for node 69ddebc5c2164e674d724274 INFO: 172.21.0.1:45342 - "POST /node/69ddebc5c2164e674d724274 HTTP/1.0" 202 Accepted 2026-04-16 07:25:05,133 - lava_callback - INFO - Starting async job submit for node 69ddebc5c2164e674d724274 2026-04-16 07:25:05,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:25:05,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddebc5c2164e674d724274 HTTP/1.1" 200 None 2026-04-16 07:25:05,149 - lava_callback - DEBUG - Processing node 69ddebc5c2164e674d724274: baseline-arm64-clabbe 2026-04-16 07:25:05,150 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddebc5c2164e674d724274 2026-04-16 07:25:05,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:25:05,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddebc5c2164e674d724274 HTTP/1.1" 200 None 2026-04-16 07:25:05,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:25:05,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-16 07:25:05,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:25:05,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddebc5c2164e674d724274 HTTP/1.1" 200 None 2026-04-16 07:25:05,208 - lava_callback - ERROR - Error processing callback for node 69ddebc5c2164e674d724274: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35336 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39284 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39290 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:26:25,226 - lava_callback - INFO - Received callback for node 69ddec15c2164e674d7242b6 INFO: 172.21.0.1:46334 - "POST /node/69ddec15c2164e674d7242b6 HTTP/1.0" 202 Accepted 2026-04-16 07:26:25,234 - lava_callback - INFO - Starting async job submit for node 69ddec15c2164e674d7242b6 2026-04-16 07:26:25,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:26:25,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddec15c2164e674d7242b6 HTTP/1.1" 200 None 2026-04-16 07:26:25,260 - lava_callback - DEBUG - Processing node 69ddec15c2164e674d7242b6: baseline-arm64-clabbe 2026-04-16 07:26:25,260 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddec15c2164e674d7242b6 2026-04-16 07:26:25,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:26:25,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddec15c2164e674d7242b6 HTTP/1.1" 200 None 2026-04-16 07:26:25,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:26:25,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-16 07:26:25,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:26:25,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddec15c2164e674d7242b6 HTTP/1.1" 200 None 2026-04-16 07:26:25,329 - lava_callback - ERROR - Error processing callback for node 69ddec15c2164e674d7242b6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34148 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:27:45,232 - lava_callback - INFO - Received callback for node 69ddec64c2164e674d7242fc INFO: 172.21.0.1:34290 - "POST /node/69ddec64c2164e674d7242fc HTTP/1.0" 202 Accepted 2026-04-16 07:27:45,238 - lava_callback - INFO - Starting async job submit for node 69ddec64c2164e674d7242fc 2026-04-16 07:27:45,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:27:45,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddec64c2164e674d7242fc HTTP/1.1" 200 None 2026-04-16 07:27:45,253 - lava_callback - DEBUG - Processing node 69ddec64c2164e674d7242fc: baseline-arm64-clabbe 2026-04-16 07:27:45,253 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddec64c2164e674d7242fc 2026-04-16 07:27:45,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:27:45,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddec64c2164e674d7242fc HTTP/1.1" 200 None 2026-04-16 07:27:45,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:27:45,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-16 07:27:45,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:27:45,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddec64c2164e674d7242fc HTTP/1.1" 200 None 2026-04-16 07:27:45,309 - lava_callback - ERROR - Error processing callback for node 69ddec64c2164e674d7242fc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47274 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:29:05,322 - lava_callback - INFO - Received callback for node 69ddecafc2164e674d724351 INFO: 172.21.0.1:47494 - "POST /node/69ddecafc2164e674d724351 HTTP/1.0" 202 Accepted 2026-04-16 07:29:05,328 - lava_callback - INFO - Starting async job submit for node 69ddecafc2164e674d724351 2026-04-16 07:29:05,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:29:05,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddecafc2164e674d724351 HTTP/1.1" 200 None 2026-04-16 07:29:05,345 - lava_callback - DEBUG - Processing node 69ddecafc2164e674d724351: baseline-arm64-clabbe 2026-04-16 07:29:05,345 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddecafc2164e674d724351 2026-04-16 07:29:05,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:29:05,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddecafc2164e674d724351 HTTP/1.1" 200 None 2026-04-16 07:29:05,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:29:05,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-16 07:29:05,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:29:05,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddecafc2164e674d724351 HTTP/1.1" 200 None 2026-04-16 07:29:05,403 - lava_callback - ERROR - Error processing callback for node 69ddecafc2164e674d724351: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59708 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59720 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:30:25,334 - lava_callback - INFO - Received callback for node 69dded02c2164e674d72437f INFO: 172.21.0.1:47448 - "POST /node/69dded02c2164e674d72437f HTTP/1.0" 202 Accepted 2026-04-16 07:30:25,340 - lava_callback - INFO - Starting async job submit for node 69dded02c2164e674d72437f 2026-04-16 07:30:25,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:30:25,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dded02c2164e674d72437f HTTP/1.1" 200 None 2026-04-16 07:30:25,356 - lava_callback - DEBUG - Processing node 69dded02c2164e674d72437f: baseline-arm64-clabbe 2026-04-16 07:30:25,357 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dded02c2164e674d72437f 2026-04-16 07:30:25,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:30:25,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dded02c2164e674d72437f HTTP/1.1" 200 None 2026-04-16 07:30:25,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:30:25,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-16 07:30:25,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:30:25,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dded02c2164e674d72437f HTTP/1.1" 200 None 2026-04-16 07:30:25,409 - lava_callback - ERROR - Error processing callback for node 69dded02c2164e674d72437f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38958 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:31:25,360 - lava_callback - INFO - Received callback for node 69dded48c2164e674d7243ee INFO: 172.21.0.1:38604 - "POST /node/69dded48c2164e674d7243ee HTTP/1.0" 202 Accepted 2026-04-16 07:31:25,366 - lava_callback - INFO - Starting async job submit for node 69dded48c2164e674d7243ee 2026-04-16 07:31:25,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:31:25,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dded48c2164e674d7243ee HTTP/1.1" 200 None 2026-04-16 07:31:25,381 - lava_callback - DEBUG - Processing node 69dded48c2164e674d7243ee: baseline-arm64-clabbe 2026-04-16 07:31:25,381 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dded48c2164e674d7243ee 2026-04-16 07:31:25,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:31:25,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dded48c2164e674d7243ee HTTP/1.1" 200 None 2026-04-16 07:31:25,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:31:25,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-16 07:31:25,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:31:25,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dded48c2164e674d7243ee HTTP/1.1" 200 None 2026-04-16 07:31:25,437 - lava_callback - ERROR - Error processing callback for node 69dded48c2164e674d7243ee: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37726 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:33:05,422 - lava_callback - INFO - Received callback for node 69ddeda6c2164e674d72444e INFO: 172.21.0.1:54016 - "POST /node/69ddeda6c2164e674d72444e HTTP/1.0" 202 Accepted 2026-04-16 07:33:05,430 - lava_callback - INFO - Starting async job submit for node 69ddeda6c2164e674d72444e 2026-04-16 07:33:05,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:33:05,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddeda6c2164e674d72444e HTTP/1.1" 200 None 2026-04-16 07:33:05,458 - lava_callback - DEBUG - Processing node 69ddeda6c2164e674d72444e: baseline-arm-clabbe 2026-04-16 07:33:05,459 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddeda6c2164e674d72444e 2026-04-16 07:33:05,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:33:05,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddeda6c2164e674d72444e HTTP/1.1" 200 None 2026-04-16 07:33:05,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:33:05,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 07:33:05,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:33:05,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddeda6c2164e674d72444e HTTP/1.1" 200 None 2026-04-16 07:33:05,516 - lava_callback - ERROR - Error processing callback for node 69ddeda6c2164e674d72444e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36254 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:33:45,409 - lava_callback - INFO - Received callback for node 69ddedcac2164e674d724465 INFO: 172.21.0.1:59086 - "POST /node/69ddedcac2164e674d724465 HTTP/1.0" 202 Accepted 2026-04-16 07:33:45,415 - lava_callback - INFO - Starting async job submit for node 69ddedcac2164e674d724465 2026-04-16 07:33:45,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:33:45,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddedcac2164e674d724465 HTTP/1.1" 200 None 2026-04-16 07:33:45,432 - lava_callback - DEBUG - Processing node 69ddedcac2164e674d724465: baseline-arm-clabbe 2026-04-16 07:33:45,432 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddedcac2164e674d724465 2026-04-16 07:33:45,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:33:45,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddedcac2164e674d724465 HTTP/1.1" 200 None 2026-04-16 07:33:45,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:33:45,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 07:33:45,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:33:45,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddedcac2164e674d724465 HTTP/1.1" 200 None 2026-04-16 07:33:45,484 - lava_callback - ERROR - Error processing callback for node 69ddedcac2164e674d724465: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40974 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:34:45,515 - lava_callback - INFO - Received callback for node 69ddee06c2164e674d7244a7 INFO: 172.21.0.1:37148 - "POST /node/69ddee06c2164e674d7244a7 HTTP/1.0" 202 Accepted 2026-04-16 07:34:45,521 - lava_callback - INFO - Starting async job submit for node 69ddee06c2164e674d7244a7 2026-04-16 07:34:45,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:34:45,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddee06c2164e674d7244a7 HTTP/1.1" 200 None 2026-04-16 07:34:45,538 - lava_callback - DEBUG - Processing node 69ddee06c2164e674d7244a7: baseline-arm-clabbe 2026-04-16 07:34:45,538 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddee06c2164e674d7244a7 2026-04-16 07:34:45,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:34:45,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddee06c2164e674d7244a7 HTTP/1.1" 200 None 2026-04-16 07:34:45,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:34:45,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 07:34:45,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:34:45,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddee06c2164e674d7244a7 HTTP/1.1" 200 None 2026-04-16 07:34:45,596 - lava_callback - ERROR - Error processing callback for node 69ddee06c2164e674d7244a7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36652 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:35:05,516 - lava_callback - INFO - Received callback for node 69ddee24c2164e674d7244eb INFO: 172.21.0.1:38346 - "POST /node/69ddee24c2164e674d7244eb HTTP/1.0" 202 Accepted 2026-04-16 07:35:05,525 - lava_callback - INFO - Starting async job submit for node 69ddee24c2164e674d7244eb 2026-04-16 07:35:05,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:35:05,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddee24c2164e674d7244eb HTTP/1.1" 200 None 2026-04-16 07:35:05,543 - lava_callback - DEBUG - Processing node 69ddee24c2164e674d7244eb: baseline-arm-clabbe 2026-04-16 07:35:05,543 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddee24c2164e674d7244eb 2026-04-16 07:35:05,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:35:05,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddee24c2164e674d7244eb HTTP/1.1" 200 None 2026-04-16 07:35:05,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:35:05,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 07:35:05,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:35:05,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddee24c2164e674d7244eb HTTP/1.1" 200 None 2026-04-16 07:35:05,603 - lava_callback - ERROR - Error processing callback for node 69ddee24c2164e674d7244eb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56614 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:35:45,510 - lava_callback - INFO - Received callback for node 69ddee45c2164e674d724517 INFO: 172.21.0.1:47304 - "POST /node/69ddee45c2164e674d724517 HTTP/1.0" 202 Accepted 2026-04-16 07:35:45,517 - lava_callback - INFO - Starting async job submit for node 69ddee45c2164e674d724517 2026-04-16 07:35:45,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:35:45,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddee45c2164e674d724517 HTTP/1.1" 200 None 2026-04-16 07:35:45,539 - lava_callback - DEBUG - Processing node 69ddee45c2164e674d724517: baseline-arm-clabbe 2026-04-16 07:35:45,539 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddee45c2164e674d724517 2026-04-16 07:35:45,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:35:45,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddee45c2164e674d724517 HTTP/1.1" 200 None 2026-04-16 07:35:45,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:35:45,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-16 07:35:45,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:35:45,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddee45c2164e674d724517 HTTP/1.1" 200 None 2026-04-16 07:35:45,601 - lava_callback - ERROR - Error processing callback for node 69ddee45c2164e674d724517: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37374 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:36:25,525 - lava_callback - INFO - Received callback for node 69ddee6ac2164e674d724538 INFO: 172.21.0.1:53490 - "POST /node/69ddee6ac2164e674d724538 HTTP/1.0" 202 Accepted 2026-04-16 07:36:25,530 - lava_callback - INFO - Starting async job submit for node 69ddee6ac2164e674d724538 2026-04-16 07:36:25,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:36:25,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddee6ac2164e674d724538 HTTP/1.1" 200 None 2026-04-16 07:36:25,547 - lava_callback - DEBUG - Processing node 69ddee6ac2164e674d724538: baseline-arm-clabbe 2026-04-16 07:36:25,547 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddee6ac2164e674d724538 2026-04-16 07:36:25,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:36:25,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddee6ac2164e674d724538 HTTP/1.1" 200 None 2026-04-16 07:36:25,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:36:25,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 07:36:25,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:36:25,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddee6ac2164e674d724538 HTTP/1.1" 200 None 2026-04-16 07:36:25,610 - lava_callback - ERROR - Error processing callback for node 69ddee6ac2164e674d724538: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37878 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:37:05,616 - lava_callback - INFO - Received callback for node 69ddee8bc2164e674d724546 INFO: 172.21.0.1:39336 - "POST /node/69ddee8bc2164e674d724546 HTTP/1.0" 202 Accepted 2026-04-16 07:37:05,626 - lava_callback - INFO - Starting async job submit for node 69ddee8bc2164e674d724546 2026-04-16 07:37:05,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:37:05,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddee8bc2164e674d724546 HTTP/1.1" 200 None 2026-04-16 07:37:05,642 - lava_callback - DEBUG - Processing node 69ddee8bc2164e674d724546: baseline-arm-clabbe 2026-04-16 07:37:05,642 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddee8bc2164e674d724546 2026-04-16 07:37:05,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:37:05,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddee8bc2164e674d724546 HTTP/1.1" 200 None 2026-04-16 07:37:05,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:37:05,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 07:37:05,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:37:05,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddee8bc2164e674d724546 HTTP/1.1" 200 None 2026-04-16 07:37:05,700 - lava_callback - ERROR - Error processing callback for node 69ddee8bc2164e674d724546: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58362 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:37:25,565 - lava_callback - INFO - Received callback for node 69ddeeaac2164e674d724572 INFO: 172.21.0.1:36698 - "POST /node/69ddeeaac2164e674d724572 HTTP/1.0" 202 Accepted 2026-04-16 07:37:25,571 - lava_callback - INFO - Starting async job submit for node 69ddeeaac2164e674d724572 2026-04-16 07:37:25,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:37:25,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddeeaac2164e674d724572 HTTP/1.1" 200 None 2026-04-16 07:37:25,587 - lava_callback - DEBUG - Processing node 69ddeeaac2164e674d724572: baseline-arm-clabbe 2026-04-16 07:37:25,587 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddeeaac2164e674d724572 2026-04-16 07:37:25,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:37:25,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddeeaac2164e674d724572 HTTP/1.1" 200 None 2026-04-16 07:37:25,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:37:25,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 07:37:25,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:37:25,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddeeaac2164e674d724572 HTTP/1.1" 200 None 2026-04-16 07:37:25,635 - lava_callback - ERROR - Error processing callback for node 69ddeeaac2164e674d724572: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38972 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:38:05,619 - lava_callback - INFO - Received callback for node 69ddeecfc2164e674d7245a9 INFO: 172.21.0.1:55422 - "POST /node/69ddeecfc2164e674d7245a9 HTTP/1.0" 202 Accepted 2026-04-16 07:38:05,625 - lava_callback - INFO - Starting async job submit for node 69ddeecfc2164e674d7245a9 2026-04-16 07:38:05,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:38:05,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddeecfc2164e674d7245a9 HTTP/1.1" 200 None 2026-04-16 07:38:05,677 - lava_callback - DEBUG - Processing node 69ddeecfc2164e674d7245a9: baseline-arm-clabbe 2026-04-16 07:38:05,678 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddeecfc2164e674d7245a9 2026-04-16 07:38:05,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:38:05,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddeecfc2164e674d7245a9 HTTP/1.1" 200 None 2026-04-16 07:38:05,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:38:05,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-16 07:38:05,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:38:05,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddeecfc2164e674d7245a9 HTTP/1.1" 200 None 2026-04-16 07:38:05,731 - lava_callback - ERROR - Error processing callback for node 69ddeecfc2164e674d7245a9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39212 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:38:45,650 - lava_callback - INFO - Received callback for node 69ddeeefc2164e674d7245d2 INFO: 172.21.0.1:45220 - "POST /node/69ddeeefc2164e674d7245d2 HTTP/1.0" 202 Accepted 2026-04-16 07:38:45,656 - lava_callback - INFO - Starting async job submit for node 69ddeeefc2164e674d7245d2 2026-04-16 07:38:45,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:38:45,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddeeefc2164e674d7245d2 HTTP/1.1" 200 None 2026-04-16 07:38:45,674 - lava_callback - DEBUG - Processing node 69ddeeefc2164e674d7245d2: baseline-arm-clabbe 2026-04-16 07:38:45,675 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddeeefc2164e674d7245d2 2026-04-16 07:38:45,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:38:45,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddeeefc2164e674d7245d2 HTTP/1.1" 200 None 2026-04-16 07:38:45,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:38:45,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-16 07:38:45,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:38:45,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddeeefc2164e674d7245d2 HTTP/1.1" 200 None 2026-04-16 07:38:45,736 - lava_callback - ERROR - Error processing callback for node 69ddeeefc2164e674d7245d2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39790 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:39:05,679 - lava_callback - INFO - Received callback for node 69ddef14c2164e674d7245e6 INFO: 172.21.0.1:49778 - "POST /node/69ddef14c2164e674d7245e6 HTTP/1.0" 202 Accepted 2026-04-16 07:39:05,688 - lava_callback - INFO - Starting async job submit for node 69ddef14c2164e674d7245e6 2026-04-16 07:39:05,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:39:05,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddef14c2164e674d7245e6 HTTP/1.1" 200 None 2026-04-16 07:39:05,706 - lava_callback - DEBUG - Processing node 69ddef14c2164e674d7245e6: baseline-arm-clabbe 2026-04-16 07:39:05,706 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddef14c2164e674d7245e6 2026-04-16 07:39:05,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:39:05,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddef14c2164e674d7245e6 HTTP/1.1" 200 None 2026-04-16 07:39:05,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:39:05,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 07:39:05,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:39:05,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddef14c2164e674d7245e6 HTTP/1.1" 200 None 2026-04-16 07:39:05,775 - lava_callback - ERROR - Error processing callback for node 69ddef14c2164e674d7245e6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44328 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:39:45,669 - lava_callback - INFO - Received callback for node 69ddef36c2164e674d724602 INFO: 172.21.0.1:53532 - "POST /node/69ddef36c2164e674d724602 HTTP/1.0" 202 Accepted 2026-04-16 07:39:45,678 - lava_callback - INFO - Starting async job submit for node 69ddef36c2164e674d724602 2026-04-16 07:39:45,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:39:45,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddef36c2164e674d724602 HTTP/1.1" 200 None 2026-04-16 07:39:45,719 - lava_callback - DEBUG - Processing node 69ddef36c2164e674d724602: baseline-arm-clabbe 2026-04-16 07:39:45,719 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddef36c2164e674d724602 2026-04-16 07:39:45,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:39:45,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddef36c2164e674d724602 HTTP/1.1" 200 None 2026-04-16 07:39:45,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:39:45,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 07:39:45,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:39:45,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddef36c2164e674d724602 HTTP/1.1" 200 None 2026-04-16 07:39:45,778 - lava_callback - ERROR - Error processing callback for node 69ddef36c2164e674d724602: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47090 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:40:25,759 - lava_callback - INFO - Received callback for node 69ddef58c2164e674d72461f INFO: 172.21.0.1:53342 - "POST /node/69ddef58c2164e674d72461f HTTP/1.0" 202 Accepted 2026-04-16 07:40:25,765 - lava_callback - INFO - Starting async job submit for node 69ddef58c2164e674d72461f 2026-04-16 07:40:25,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:40:25,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddef58c2164e674d72461f HTTP/1.1" 200 None 2026-04-16 07:40:25,781 - lava_callback - DEBUG - Processing node 69ddef58c2164e674d72461f: baseline-arm-clabbe 2026-04-16 07:40:25,781 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddef58c2164e674d72461f 2026-04-16 07:40:25,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:40:25,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddef58c2164e674d72461f HTTP/1.1" 200 None 2026-04-16 07:40:25,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:40:25,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-16 07:40:25,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:40:25,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddef58c2164e674d72461f HTTP/1.1" 200 None 2026-04-16 07:40:25,841 - lava_callback - ERROR - Error processing callback for node 69ddef58c2164e674d72461f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51834 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:40:45,738 - lava_callback - INFO - Received callback for node 69ddef78c2164e674d724642 INFO: 172.21.0.1:51618 - "POST /node/69ddef78c2164e674d724642 HTTP/1.0" 202 Accepted 2026-04-16 07:40:45,747 - lava_callback - INFO - Starting async job submit for node 69ddef78c2164e674d724642 2026-04-16 07:40:45,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:40:45,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddef78c2164e674d724642 HTTP/1.1" 200 None 2026-04-16 07:40:45,763 - lava_callback - DEBUG - Processing node 69ddef78c2164e674d724642: baseline-arm-clabbe 2026-04-16 07:40:45,763 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddef78c2164e674d724642 2026-04-16 07:40:45,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:40:45,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddef78c2164e674d724642 HTTP/1.1" 200 None 2026-04-16 07:40:45,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:40:45,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 07:40:45,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:40:45,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddef78c2164e674d724642 HTTP/1.1" 200 None 2026-04-16 07:40:45,833 - lava_callback - ERROR - Error processing callback for node 69ddef78c2164e674d724642: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44970 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44982 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:41:25,757 - lava_callback - INFO - Received callback for node 69ddef9ac2164e674d724676 INFO: 172.21.0.1:37128 - "POST /node/69ddef9ac2164e674d724676 HTTP/1.0" 202 Accepted 2026-04-16 07:41:25,766 - lava_callback - INFO - Starting async job submit for node 69ddef9ac2164e674d724676 2026-04-16 07:41:25,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:41:25,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddef9ac2164e674d724676 HTTP/1.1" 200 None 2026-04-16 07:41:25,783 - lava_callback - DEBUG - Processing node 69ddef9ac2164e674d724676: baseline-arm-clabbe 2026-04-16 07:41:25,783 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddef9ac2164e674d724676 2026-04-16 07:41:25,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:41:25,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddef9ac2164e674d724676 HTTP/1.1" 200 None 2026-04-16 07:41:25,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:41:25,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-16 07:41:25,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:41:25,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddef9ac2164e674d724676 HTTP/1.1" 200 None 2026-04-16 07:41:25,847 - lava_callback - ERROR - Error processing callback for node 69ddef9ac2164e674d724676: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59704 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:42:05,761 - lava_callback - INFO - Received callback for node 69ddefbac2164e674d7246b1 INFO: 172.21.0.1:48670 - "POST /node/69ddefbac2164e674d7246b1 HTTP/1.0" 202 Accepted 2026-04-16 07:42:05,767 - lava_callback - INFO - Starting async job submit for node 69ddefbac2164e674d7246b1 2026-04-16 07:42:05,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:42:05,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddefbac2164e674d7246b1 HTTP/1.1" 200 None 2026-04-16 07:42:05,788 - lava_callback - DEBUG - Processing node 69ddefbac2164e674d7246b1: baseline-arm-clabbe 2026-04-16 07:42:05,788 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddefbac2164e674d7246b1 2026-04-16 07:42:05,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:42:05,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddefbac2164e674d7246b1 HTTP/1.1" 200 None 2026-04-16 07:42:05,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:42:05,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-16 07:42:05,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:42:05,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddefbac2164e674d7246b1 HTTP/1.1" 200 None 2026-04-16 07:42:05,858 - lava_callback - ERROR - Error processing callback for node 69ddefbac2164e674d7246b1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59654 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:42:25,813 - lava_callback - INFO - Received callback for node 69ddefd8c2164e674d7246e5 INFO: 172.21.0.1:34228 - "POST /node/69ddefd8c2164e674d7246e5 HTTP/1.0" 202 Accepted 2026-04-16 07:42:25,823 - lava_callback - INFO - Starting async job submit for node 69ddefd8c2164e674d7246e5 2026-04-16 07:42:25,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:42:25,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddefd8c2164e674d7246e5 HTTP/1.1" 200 None 2026-04-16 07:42:25,840 - lava_callback - DEBUG - Processing node 69ddefd8c2164e674d7246e5: baseline-arm-clabbe 2026-04-16 07:42:25,840 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddefd8c2164e674d7246e5 2026-04-16 07:42:25,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:42:25,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddefd8c2164e674d7246e5 HTTP/1.1" 200 None 2026-04-16 07:42:25,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:42:25,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 07:42:25,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:42:25,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddefd8c2164e674d7246e5 HTTP/1.1" 200 None 2026-04-16 07:42:25,902 - lava_callback - ERROR - Error processing callback for node 69ddefd8c2164e674d7246e5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48960 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:43:05,810 - lava_callback - INFO - Received callback for node 69ddeffcc2164e674d7246fe INFO: 172.21.0.1:35462 - "POST /node/69ddeffcc2164e674d7246fe HTTP/1.0" 202 Accepted 2026-04-16 07:43:05,820 - lava_callback - INFO - Starting async job submit for node 69ddeffcc2164e674d7246fe 2026-04-16 07:43:05,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:43:05,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddeffcc2164e674d7246fe HTTP/1.1" 200 None 2026-04-16 07:43:05,837 - lava_callback - DEBUG - Processing node 69ddeffcc2164e674d7246fe: baseline-arm-clabbe 2026-04-16 07:43:05,837 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddeffcc2164e674d7246fe 2026-04-16 07:43:05,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:43:05,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddeffcc2164e674d7246fe HTTP/1.1" 200 None 2026-04-16 07:43:05,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:43:05,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-16 07:43:05,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:43:05,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddeffcc2164e674d7246fe HTTP/1.1" 200 None 2026-04-16 07:43:05,896 - lava_callback - ERROR - Error processing callback for node 69ddeffcc2164e674d7246fe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54002 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:43:45,890 - lava_callback - INFO - Received callback for node 69ddf01dc2164e674d724716 INFO: 172.21.0.1:44644 - "POST /node/69ddf01dc2164e674d724716 HTTP/1.0" 202 Accepted 2026-04-16 07:43:45,896 - lava_callback - INFO - Starting async job submit for node 69ddf01dc2164e674d724716 2026-04-16 07:43:45,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:43:45,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf01dc2164e674d724716 HTTP/1.1" 200 None 2026-04-16 07:43:45,912 - lava_callback - DEBUG - Processing node 69ddf01dc2164e674d724716: baseline-arm-clabbe 2026-04-16 07:43:45,912 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddf01dc2164e674d724716 2026-04-16 07:43:45,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:43:45,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf01dc2164e674d724716 HTTP/1.1" 200 None 2026-04-16 07:43:45,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:43:45,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-16 07:43:45,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:43:45,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddf01dc2164e674d724716 HTTP/1.1" 200 None 2026-04-16 07:43:45,960 - lava_callback - ERROR - Error processing callback for node 69ddf01dc2164e674d724716: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60288 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:44:05,809 - lava_callback - INFO - Received callback for node 69ddf03ec2164e674d724733 INFO: 172.21.0.1:37078 - "POST /node/69ddf03ec2164e674d724733 HTTP/1.0" 202 Accepted 2026-04-16 07:44:05,815 - lava_callback - INFO - Starting async job submit for node 69ddf03ec2164e674d724733 2026-04-16 07:44:05,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:44:05,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf03ec2164e674d724733 HTTP/1.1" 200 None 2026-04-16 07:44:05,838 - lava_callback - DEBUG - Processing node 69ddf03ec2164e674d724733: baseline-arm-clabbe 2026-04-16 07:44:05,838 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddf03ec2164e674d724733 2026-04-16 07:44:05,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:44:05,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf03ec2164e674d724733 HTTP/1.1" 200 None 2026-04-16 07:44:05,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:44:05,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-16 07:44:05,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:44:05,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddf03ec2164e674d724733 HTTP/1.1" 200 None 2026-04-16 07:44:05,915 - lava_callback - ERROR - Error processing callback for node 69ddf03ec2164e674d724733: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50468 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:44:45,883 - lava_callback - INFO - Received callback for node 69ddf060c2164e674d72474e INFO: 172.21.0.1:48184 - "POST /node/69ddf060c2164e674d72474e HTTP/1.0" 202 Accepted 2026-04-16 07:44:45,891 - lava_callback - INFO - Starting async job submit for node 69ddf060c2164e674d72474e 2026-04-16 07:44:45,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:44:45,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf060c2164e674d72474e HTTP/1.1" 200 None 2026-04-16 07:44:45,914 - lava_callback - DEBUG - Processing node 69ddf060c2164e674d72474e: baseline-arm-clabbe 2026-04-16 07:44:45,914 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddf060c2164e674d72474e 2026-04-16 07:44:45,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:44:45,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf060c2164e674d72474e HTTP/1.1" 200 None 2026-04-16 07:44:45,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:44:45,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 07:44:45,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:44:45,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddf060c2164e674d72474e HTTP/1.1" 200 None 2026-04-16 07:44:45,964 - lava_callback - ERROR - Error processing callback for node 69ddf060c2164e674d72474e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48698 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-16 07:45:15,996 - lava_callback - INFO - Received callback for node 69ddf086c2164e674d72476c INFO: 172.21.0.1:48704 - "POST /node/69ddf086c2164e674d72476c HTTP/1.0" 202 Accepted 2026-04-16 07:45:16,003 - lava_callback - INFO - Starting async job submit for node 69ddf086c2164e674d72476c 2026-04-16 07:45:16,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:45:16,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf086c2164e674d72476c HTTP/1.1" 200 None 2026-04-16 07:45:16,027 - lava_callback - DEBUG - Processing node 69ddf086c2164e674d72476c: baseline-arm64-baylibre 2026-04-16 07:45:16,027 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddf086c2164e674d72476c 2026-04-16 07:45:16,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:45:16,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf086c2164e674d72476c HTTP/1.1" 200 None 2026-04-16 07:45:16,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:45:16,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d841b2b28893fa2e230976 HTTP/1.1" 200 None 2026-04-16 07:45:16,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:45:16,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddf086c2164e674d72476c HTTP/1.1" 200 None 2026-04-16 07:45:16,091 - lava_callback - ERROR - Error processing callback for node 69ddf086c2164e674d72476c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45438 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:46:35,961 - lava_callback - INFO - Received callback for node 69ddf0cfc2164e674d7247dc INFO: 172.21.0.1:45916 - "POST /node/69ddf0cfc2164e674d7247dc HTTP/1.0" 202 Accepted 2026-04-16 07:46:35,967 - lava_callback - INFO - Starting async job submit for node 69ddf0cfc2164e674d7247dc 2026-04-16 07:46:35,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:46:35,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf0cfc2164e674d7247dc HTTP/1.1" 200 None 2026-04-16 07:46:35,987 - lava_callback - DEBUG - Processing node 69ddf0cfc2164e674d7247dc: baseline-arm64-baylibre 2026-04-16 07:46:35,988 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddf0cfc2164e674d7247dc 2026-04-16 07:46:35,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:46:36,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf0cfc2164e674d7247dc HTTP/1.1" 200 None 2026-04-16 07:46:36,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:46:36,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d841b2b28893fa2e230976 HTTP/1.1" 200 None 2026-04-16 07:46:36,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:46:36,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddf0cfc2164e674d7247dc HTTP/1.1" 200 None 2026-04-16 07:46:36,045 - lava_callback - ERROR - Error processing callback for node 69ddf0cfc2164e674d7247dc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48686 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:47:46,044 - lava_callback - INFO - Received callback for node 69ddf115c2164e674d724812 INFO: 172.21.0.1:54010 - "POST /node/69ddf115c2164e674d724812 HTTP/1.0" 202 Accepted 2026-04-16 07:47:46,052 - lava_callback - INFO - Starting async job submit for node 69ddf115c2164e674d724812 2026-04-16 07:47:46,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:47:46,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf115c2164e674d724812 HTTP/1.1" 200 None 2026-04-16 07:47:46,087 - lava_callback - DEBUG - Processing node 69ddf115c2164e674d724812: baseline-arm-clabbe 2026-04-16 07:47:46,087 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddf115c2164e674d724812 2026-04-16 07:47:46,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:47:46,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf115c2164e674d724812 HTTP/1.1" 200 None 2026-04-16 07:47:46,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:47:46,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 07:47:46,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:47:46,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddf115c2164e674d724812 HTTP/1.1" 200 None 2026-04-16 07:47:46,140 - lava_callback - ERROR - Error processing callback for node 69ddf115c2164e674d724812: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59456 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-16 07:48:16,007 - lava_callback - INFO - Received callback for node 69ddf13dc2164e674d724838 INFO: 172.21.0.1:59464 - "POST /node/69ddf13dc2164e674d724838 HTTP/1.0" 202 Accepted 2026-04-16 07:48:16,018 - lava_callback - INFO - Starting async job submit for node 69ddf13dc2164e674d724838 2026-04-16 07:48:16,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:48:16,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf13dc2164e674d724838 HTTP/1.1" 200 None 2026-04-16 07:48:16,048 - lava_callback - DEBUG - Processing node 69ddf13dc2164e674d724838: baseline-arm64-baylibre 2026-04-16 07:48:16,048 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddf13dc2164e674d724838 2026-04-16 07:48:16,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:48:16,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf13dc2164e674d724838 HTTP/1.1" 200 None 2026-04-16 07:48:16,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:48:16,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d841b2b28893fa2e230976 HTTP/1.1" 200 None 2026-04-16 07:48:16,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:48:16,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddf13dc2164e674d724838 HTTP/1.1" 200 None 2026-04-16 07:48:16,108 - lava_callback - ERROR - Error processing callback for node 69ddf13dc2164e674d724838: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32896 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:49:26,094 - lava_callback - INFO - Received callback for node 69ddf17dc2164e674d724899 INFO: 172.21.0.1:60040 - "POST /node/69ddf17dc2164e674d724899 HTTP/1.0" 202 Accepted 2026-04-16 07:49:26,103 - lava_callback - INFO - Starting async job submit for node 69ddf17dc2164e674d724899 2026-04-16 07:49:26,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:49:26,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf17dc2164e674d724899 HTTP/1.1" 200 None 2026-04-16 07:49:26,131 - lava_callback - DEBUG - Processing node 69ddf17dc2164e674d724899: baseline-arm-clabbe 2026-04-16 07:49:26,132 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddf17dc2164e674d724899 2026-04-16 07:49:26,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:49:26,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf17dc2164e674d724899 HTTP/1.1" 200 None 2026-04-16 07:49:26,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:49:26,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 07:49:26,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:49:26,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddf17dc2164e674d724899 HTTP/1.1" 200 None 2026-04-16 07:49:26,189 - lava_callback - ERROR - Error processing callback for node 69ddf17dc2164e674d724899: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50180 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:50:06,160 - lava_callback - INFO - Received callback for node 69ddf19ec2164e674d7248c4 INFO: 172.21.0.1:55208 - "POST /node/69ddf19ec2164e674d7248c4 HTTP/1.0" 202 Accepted 2026-04-16 07:50:06,166 - lava_callback - INFO - Starting async job submit for node 69ddf19ec2164e674d7248c4 2026-04-16 07:50:06,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:50:06,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf19ec2164e674d7248c4 HTTP/1.1" 200 None 2026-04-16 07:50:06,182 - lava_callback - DEBUG - Processing node 69ddf19ec2164e674d7248c4: baseline-arm-clabbe 2026-04-16 07:50:06,182 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddf19ec2164e674d7248c4 2026-04-16 07:50:06,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:50:06,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf19ec2164e674d7248c4 HTTP/1.1" 200 None 2026-04-16 07:50:06,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:50:06,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 07:50:06,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:50:06,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddf19ec2164e674d7248c4 HTTP/1.1" 200 None 2026-04-16 07:50:06,283 - lava_callback - ERROR - Error processing callback for node 69ddf19ec2164e674d7248c4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46602 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:50:26,181 - lava_callback - INFO - Received callback for node 69ddf1bec2164e674d7248e6 INFO: 172.21.0.1:47652 - "POST /node/69ddf1bec2164e674d7248e6 HTTP/1.0" 202 Accepted 2026-04-16 07:50:26,191 - lava_callback - INFO - Starting async job submit for node 69ddf1bec2164e674d7248e6 2026-04-16 07:50:26,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:50:26,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf1bec2164e674d7248e6 HTTP/1.1" 200 None 2026-04-16 07:50:26,206 - lava_callback - DEBUG - Processing node 69ddf1bec2164e674d7248e6: baseline-arm-clabbe 2026-04-16 07:50:26,207 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddf1bec2164e674d7248e6 2026-04-16 07:50:26,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:50:26,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf1bec2164e674d7248e6 HTTP/1.1" 200 None 2026-04-16 07:50:26,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:50:26,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 07:50:26,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:50:26,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddf1bec2164e674d7248e6 HTTP/1.1" 200 None 2026-04-16 07:50:26,256 - lava_callback - ERROR - Error processing callback for node 69ddf1bec2164e674d7248e6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44596 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:52:36,200 - lava_callback - INFO - Received callback for node 69ddf231c2164e674d724956 INFO: 172.21.0.1:42858 - "POST /node/69ddf231c2164e674d724956 HTTP/1.0" 202 Accepted 2026-04-16 07:52:36,208 - lava_callback - INFO - Starting async job submit for node 69ddf231c2164e674d724956 2026-04-16 07:52:36,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:42864 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:52:36,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf231c2164e674d724956 HTTP/1.1" 200 None 2026-04-16 07:52:36,230 - lava_callback - DEBUG - Processing node 69ddf231c2164e674d724956: baseline-arm64-baylibre 2026-04-16 07:52:36,230 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddf231c2164e674d724956 2026-04-16 07:52:36,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:52:36,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf231c2164e674d724956 HTTP/1.1" 200 None 2026-04-16 07:52:36,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:52:36,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-16 07:52:36,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:52:36,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddf231c2164e674d724956 HTTP/1.1" 200 None 2026-04-16 07:52:36,300 - lava_callback - ERROR - Error processing callback for node 69ddf231c2164e674d724956: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39056 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:53:46,282 - lava_callback - INFO - Received callback for node 69ddf27dc2164e674d724980 INFO: 172.21.0.1:40626 - "POST /node/69ddf27dc2164e674d724980 HTTP/1.0" 202 Accepted 2026-04-16 07:53:46,290 - lava_callback - INFO - Starting async job submit for node 69ddf27dc2164e674d724980 2026-04-16 07:53:46,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:53:46,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf27dc2164e674d724980 HTTP/1.1" 200 None 2026-04-16 07:53:46,317 - lava_callback - DEBUG - Processing node 69ddf27dc2164e674d724980: baseline-arm-clabbe 2026-04-16 07:53:46,317 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddf27dc2164e674d724980 2026-04-16 07:53:46,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:53:46,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf27dc2164e674d724980 HTTP/1.1" 200 None 2026-04-16 07:53:46,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:53:46,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 07:53:46,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:53:46,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddf27dc2164e674d724980 HTTP/1.1" 200 None 2026-04-16 07:53:46,384 - lava_callback - ERROR - Error processing callback for node 69ddf27dc2164e674d724980: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37374 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37390 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:54:26,272 - lava_callback - INFO - Received callback for node 69ddf2a0c2164e674d724992 INFO: 172.21.0.1:40702 - "POST /node/69ddf2a0c2164e674d724992 HTTP/1.0" 202 Accepted 2026-04-16 07:54:26,278 - lava_callback - INFO - Starting async job submit for node 69ddf2a0c2164e674d724992 2026-04-16 07:54:26,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:54:26,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf2a0c2164e674d724992 HTTP/1.1" 200 None 2026-04-16 07:54:26,300 - lava_callback - DEBUG - Processing node 69ddf2a0c2164e674d724992: baseline-arm-clabbe 2026-04-16 07:54:26,300 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddf2a0c2164e674d724992 2026-04-16 07:54:26,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:54:26,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf2a0c2164e674d724992 HTTP/1.1" 200 None 2026-04-16 07:54:26,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:54:26,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 07:54:26,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:54:26,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddf2a0c2164e674d724992 HTTP/1.1" 200 None 2026-04-16 07:54:26,369 - lava_callback - ERROR - Error processing callback for node 69ddf2a0c2164e674d724992: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40422 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:54:56,387 - lava_callback - INFO - Received callback for node 69ddf2c6c2164e674d7249c5 INFO: 172.21.0.1:37078 - "POST /node/69ddf2c6c2164e674d7249c5 HTTP/1.0" 202 Accepted 2026-04-16 07:54:56,394 - lava_callback - INFO - Starting async job submit for node 69ddf2c6c2164e674d7249c5 2026-04-16 07:54:56,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:54:56,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf2c6c2164e674d7249c5 HTTP/1.1" 200 None 2026-04-16 07:54:56,416 - lava_callback - DEBUG - Processing node 69ddf2c6c2164e674d7249c5: baseline-arm64-baylibre 2026-04-16 07:54:56,416 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddf2c6c2164e674d7249c5 2026-04-16 07:54:56,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:54:56,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf2c6c2164e674d7249c5 HTTP/1.1" 200 None 2026-04-16 07:54:56,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:54:56,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-16 07:54:56,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:54:56,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddf2c6c2164e674d7249c5 HTTP/1.1" 200 None 2026-04-16 07:54:56,481 - lava_callback - ERROR - Error processing callback for node 69ddf2c6c2164e674d7249c5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54956 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:56:06,364 - lava_callback - INFO - Received callback for node 69ddf30cc2164e674d724a04 INFO: 172.21.0.1:51902 - "POST /node/69ddf30cc2164e674d724a04 HTTP/1.0" 202 Accepted 2026-04-16 07:56:06,370 - lava_callback - INFO - Starting async job submit for node 69ddf30cc2164e674d724a04 2026-04-16 07:56:06,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:56:06,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf30cc2164e674d724a04 HTTP/1.1" 200 None 2026-04-16 07:56:06,386 - lava_callback - DEBUG - Processing node 69ddf30cc2164e674d724a04: baseline-arm-clabbe 2026-04-16 07:56:06,387 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddf30cc2164e674d724a04 2026-04-16 07:56:06,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:56:06,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf30cc2164e674d724a04 HTTP/1.1" 200 None 2026-04-16 07:56:06,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:56:06,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 07:56:06,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:56:06,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddf30cc2164e674d724a04 HTTP/1.1" 200 None 2026-04-16 07:56:06,452 - lava_callback - ERROR - Error processing callback for node 69ddf30cc2164e674d724a04: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42742 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:56:56,509 - lava_callback - INFO - Received callback for node 69ddf335c2164e674d724a2d INFO: 172.21.0.1:60720 - "POST /node/69ddf335c2164e674d724a2d HTTP/1.0" 202 Accepted 2026-04-16 07:56:56,515 - lava_callback - INFO - Starting async job submit for node 69ddf335c2164e674d724a2d 2026-04-16 07:56:56,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:60722 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:56:56,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf335c2164e674d724a2d HTTP/1.1" 200 None 2026-04-16 07:56:56,536 - lava_callback - DEBUG - Processing node 69ddf335c2164e674d724a2d: baseline-arm64-baylibre 2026-04-16 07:56:56,537 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddf335c2164e674d724a2d 2026-04-16 07:56:56,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:56:56,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf335c2164e674d724a2d HTTP/1.1" 200 None 2026-04-16 07:56:56,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:56:56,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-16 07:56:56,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:56:56,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddf335c2164e674d724a2d HTTP/1.1" 200 None 2026-04-16 07:56:56,585 - lava_callback - ERROR - Error processing callback for node 69ddf335c2164e674d724a2d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41416 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:57:56,513 - lava_callback - INFO - Received callback for node 69ddf383c2164e674d724a66 INFO: 172.21.0.1:41192 - "POST /node/69ddf383c2164e674d724a66 HTTP/1.0" 202 Accepted 2026-04-16 07:57:56,519 - lava_callback - INFO - Starting async job submit for node 69ddf383c2164e674d724a66 2026-04-16 07:57:56,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:41200 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:57:56,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf383c2164e674d724a66 HTTP/1.1" 200 None 2026-04-16 07:57:56,536 - lava_callback - DEBUG - Processing node 69ddf383c2164e674d724a66: baseline-arm64-baylibre 2026-04-16 07:57:56,536 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddf383c2164e674d724a66 2026-04-16 07:57:56,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:57:56,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf383c2164e674d724a66 HTTP/1.1" 200 None 2026-04-16 07:57:56,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:57:56,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-16 07:57:56,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:57:56,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddf383c2164e674d724a66 HTTP/1.1" 200 None 2026-04-16 07:57:56,587 - lava_callback - ERROR - Error processing callback for node 69ddf383c2164e674d724a66: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49800 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:59:26,589 - lava_callback - INFO - Received callback for node 69ddf3d5c2164e674d724abf INFO: 172.21.0.1:49806 - "POST /node/69ddf3d5c2164e674d724abf HTTP/1.0" 202 Accepted 2026-04-16 07:59:26,595 - lava_callback - INFO - Starting async job submit for node 69ddf3d5c2164e674d724abf 2026-04-16 07:59:26,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:59:26,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf3d5c2164e674d724abf HTTP/1.1" 200 None 2026-04-16 07:59:26,610 - lava_callback - DEBUG - Processing node 69ddf3d5c2164e674d724abf: baseline-arm64-clabbe 2026-04-16 07:59:26,610 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddf3d5c2164e674d724abf 2026-04-16 07:59:26,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:59:26,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf3d5c2164e674d724abf HTTP/1.1" 200 None 2026-04-16 07:59:26,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:59:26,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-16 07:59:26,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:59:26,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddf3d5c2164e674d724abf HTTP/1.1" 200 None 2026-04-16 07:59:26,669 - lava_callback - ERROR - Error processing callback for node 69ddf3d5c2164e674d724abf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36266 - "GET /node/698c5088755d7811a41414dc%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:36268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48242 - "GET / HTTP/1.0" 200 OK 2026-04-16 08:00:46,710 - lava_callback - INFO - Received callback for node 69ddf421c2164e674d724af9 INFO: 172.21.0.1:48252 - "POST /node/69ddf421c2164e674d724af9 HTTP/1.0" 202 Accepted 2026-04-16 08:00:46,720 - lava_callback - INFO - Starting async job submit for node 69ddf421c2164e674d724af9 2026-04-16 08:00:46,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 08:00:46,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf421c2164e674d724af9 HTTP/1.1" 200 None 2026-04-16 08:00:46,738 - lava_callback - DEBUG - Processing node 69ddf421c2164e674d724af9: baseline-arm64-clabbe 2026-04-16 08:00:46,738 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddf421c2164e674d724af9 2026-04-16 08:00:46,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 08:00:46,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf421c2164e674d724af9 HTTP/1.1" 200 None 2026-04-16 08:00:46,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 08:00:46,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-16 08:00:46,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 08:00:46,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddf421c2164e674d724af9 HTTP/1.1" 200 None 2026-04-16 08:00:46,793 - lava_callback - ERROR - Error processing callback for node 69ddf421c2164e674d724af9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57434 - "GET /node/693b7ec641fb4c95097640c0%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:57436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57546 - "GET /node/6910cb87699dbc4cda8e2fac%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:50506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43032 - "GET / HTTP/1.0" 200 OK 2026-04-16 08:02:06,716 - lava_callback - INFO - Received callback for node 69ddf46ec2164e674d724b46 INFO: 172.21.0.1:43038 - "POST /node/69ddf46ec2164e674d724b46 HTTP/1.0" 202 Accepted 2026-04-16 08:02:06,722 - lava_callback - INFO - Starting async job submit for node 69ddf46ec2164e674d724b46 2026-04-16 08:02:06,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 08:02:06,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf46ec2164e674d724b46 HTTP/1.1" 200 None 2026-04-16 08:02:06,738 - lava_callback - DEBUG - Processing node 69ddf46ec2164e674d724b46: baseline-arm64-clabbe 2026-04-16 08:02:06,738 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddf46ec2164e674d724b46 2026-04-16 08:02:06,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 08:02:06,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf46ec2164e674d724b46 HTTP/1.1" 200 None 2026-04-16 08:02:06,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 08:02:06,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-16 08:02:06,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 08:02:06,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddf46ec2164e674d724b46 HTTP/1.1" 200 None 2026-04-16 08:02:06,869 - lava_callback - ERROR - Error processing callback for node 69ddf46ec2164e674d724b46: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37514 - "GET /node/693e79ef3c8f1be6d3cf07a4%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:37524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54930 - "GET /node/693e25b2407f32424eb57d6f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:54944 - "GET / HTTP/1.0" 200 OK 2026-04-16 08:03:26,749 - lava_callback - INFO - Received callback for node 69ddf4b9c2164e674d724b94 INFO: 172.21.0.1:54950 - "POST /node/69ddf4b9c2164e674d724b94 HTTP/1.0" 202 Accepted 2026-04-16 08:03:26,755 - lava_callback - INFO - Starting async job submit for node 69ddf4b9c2164e674d724b94 2026-04-16 08:03:26,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 08:03:26,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf4b9c2164e674d724b94 HTTP/1.1" 200 None 2026-04-16 08:03:26,771 - lava_callback - DEBUG - Processing node 69ddf4b9c2164e674d724b94: baseline-arm64-clabbe 2026-04-16 08:03:26,771 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddf4b9c2164e674d724b94 2026-04-16 08:03:26,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 08:03:26,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf4b9c2164e674d724b94 HTTP/1.1" 200 None 2026-04-16 08:03:26,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 08:03:26,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-16 08:03:26,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 08:03:26,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddf4b9c2164e674d724b94 HTTP/1.1" 200 None 2026-04-16 08:03:26,820 - lava_callback - ERROR - Error processing callback for node 69ddf4b9c2164e674d724b94: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53294 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50620 - "GET /node/69840be0969566dcb0d2bc30%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:50632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39002 - "GET / HTTP/1.0" 200 OK 2026-04-16 08:04:46,794 - lava_callback - INFO - Received callback for node 69ddf514c2164e674d724bc1 INFO: 172.21.0.1:39006 - "POST /node/69ddf514c2164e674d724bc1 HTTP/1.0" 202 Accepted 2026-04-16 08:04:46,804 - lava_callback - INFO - Starting async job submit for node 69ddf514c2164e674d724bc1 2026-04-16 08:04:46,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 08:04:46,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf514c2164e674d724bc1 HTTP/1.1" 200 None 2026-04-16 08:04:46,821 - lava_callback - DEBUG - Processing node 69ddf514c2164e674d724bc1: baseline-arm64-clabbe 2026-04-16 08:04:46,822 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddf514c2164e674d724bc1 2026-04-16 08:04:46,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 08:04:46,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf514c2164e674d724bc1 HTTP/1.1" 200 None 2026-04-16 08:04:46,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 08:04:46,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-16 08:04:46,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 08:04:46,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddf514c2164e674d724bc1 HTTP/1.1" 200 None 2026-04-16 08:04:46,881 - lava_callback - ERROR - Error processing callback for node 69ddf514c2164e674d724bc1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40736 - "GET / HTTP/1.0" 200 OK 2026-04-16 08:06:06,832 - lava_callback - INFO - Received callback for node 69ddf55dc2164e674d724c13 INFO: 172.21.0.1:40742 - "POST /node/69ddf55dc2164e674d724c13 HTTP/1.0" 202 Accepted 2026-04-16 08:06:06,837 - lava_callback - INFO - Starting async job submit for node 69ddf55dc2164e674d724c13 2026-04-16 08:06:06,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 08:06:06,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf55dc2164e674d724c13 HTTP/1.1" 200 None 2026-04-16 08:06:06,853 - lava_callback - DEBUG - Processing node 69ddf55dc2164e674d724c13: baseline-arm64-clabbe 2026-04-16 08:06:06,853 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddf55dc2164e674d724c13 2026-04-16 08:06:06,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 08:06:06,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf55dc2164e674d724c13 HTTP/1.1" 200 None 2026-04-16 08:06:06,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 08:06:06,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-16 08:06:06,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 08:06:06,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddf55dc2164e674d724c13 HTTP/1.1" 200 None 2026-04-16 08:06:06,902 - lava_callback - ERROR - Error processing callback for node 69ddf55dc2164e674d724c13: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49124 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60498 - "GET /node/69927f2798a8bdb31c395259%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:52912 - "GET /node/6992811798a8bdb31c395a13%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:52924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42594 - "GET / HTTP/1.0" 200 OK 2026-04-16 08:07:26,899 - lava_callback - INFO - Received callback for node 69ddf5abc2164e674d724c53 INFO: 172.21.0.1:42606 - "POST /node/69ddf5abc2164e674d724c53 HTTP/1.0" 202 Accepted 2026-04-16 08:07:26,905 - lava_callback - INFO - Starting async job submit for node 69ddf5abc2164e674d724c53 2026-04-16 08:07:26,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 08:07:26,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf5abc2164e674d724c53 HTTP/1.1" 200 None 2026-04-16 08:07:26,925 - lava_callback - DEBUG - Processing node 69ddf5abc2164e674d724c53: baseline-arm64-clabbe 2026-04-16 08:07:26,926 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddf5abc2164e674d724c53 2026-04-16 08:07:26,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 08:07:26,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf5abc2164e674d724c53 HTTP/1.1" 200 None 2026-04-16 08:07:26,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 08:07:26,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-16 08:07:26,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 08:07:26,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddf5abc2164e674d724c53 HTTP/1.1" 200 None 2026-04-16 08:07:26,980 - lava_callback - ERROR - Error processing callback for node 69ddf5abc2164e674d724c53: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41868 - "GET /node/69830f3a409235c29c0de6fd%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:41878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50342 - "GET /node/698a2b0d22b4cc0f227afc98%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:50344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38442 - "GET / HTTP/1.0" 200 OK 2026-04-16 08:10:57,307 - lava_callback - INFO - Received callback for node 69ddf682c2164e674d724d19 INFO: 172.21.0.1:38444 - "POST /node/69ddf682c2164e674d724d19 HTTP/1.0" 202 Accepted 2026-04-16 08:10:57,313 - lava_callback - INFO - Starting async job submit for node 69ddf682c2164e674d724d19 2026-04-16 08:10:57,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 08:10:57,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf682c2164e674d724d19 HTTP/1.1" 200 None 2026-04-16 08:10:57,329 - lava_callback - DEBUG - Processing node 69ddf682c2164e674d724d19: baseline-arm64-baylibre 2026-04-16 08:10:57,329 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddf682c2164e674d724d19 2026-04-16 08:10:57,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 08:10:57,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf682c2164e674d724d19 HTTP/1.1" 200 None 2026-04-16 08:10:57,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 08:10:57,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-16 08:10:57,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 08:10:57,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddf682c2164e674d724d19 HTTP/1.1" 200 None 2026-04-16 08:10:57,380 - lava_callback - ERROR - Error processing callback for node 69ddf682c2164e674d724d19: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33060 - "GET /node/698b93920a16aea5a0dc90b2%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:33066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36058 - "GET / HTTP/1.0" 200 OK 2026-04-16 08:11:57,297 - lava_callback - INFO - Received callback for node 69ddf6c9c2164e674d724d85 INFO: 172.21.0.1:36064 - "POST /node/69ddf6c9c2164e674d724d85 HTTP/1.0" 202 Accepted 2026-04-16 08:11:57,303 - lava_callback - INFO - Starting async job submit for node 69ddf6c9c2164e674d724d85 2026-04-16 08:11:57,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 08:11:57,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf6c9c2164e674d724d85 HTTP/1.1" 200 None 2026-04-16 08:11:57,320 - lava_callback - DEBUG - Processing node 69ddf6c9c2164e674d724d85: baseline-arm64-baylibre 2026-04-16 08:11:57,320 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddf6c9c2164e674d724d85 2026-04-16 08:11:57,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 08:11:57,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf6c9c2164e674d724d85 HTTP/1.1" 200 None 2026-04-16 08:11:57,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 08:11:57,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-16 08:11:57,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 08:11:57,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddf6c9c2164e674d724d85 HTTP/1.1" 200 None 2026-04-16 08:11:57,381 - lava_callback - ERROR - Error processing callback for node 69ddf6c9c2164e674d724d85: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43942 - "GET / HTTP/1.0" 200 OK INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1] INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.21.0.1:53766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37742 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:12:07,044 - lava_callback - INFO - Received callback for node 69dd865317c944d2f17deac2 2026-04-16 00:12:07,051 - lava_callback - INFO - Starting async job submit for node 69dd865317c944d2f17deac2 INFO: 172.21.0.1:37746 - "POST /node/69dd865317c944d2f17deac2 HTTP/1.0" 202 Accepted 2026-04-16 00:12:07,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:12:07,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd865317c944d2f17deac2 HTTP/1.1" 200 None 2026-04-16 00:12:07,072 - lava_callback - DEBUG - Processing node 69dd865317c944d2f17deac2: baseline-arm64-clabbe 2026-04-16 00:12:07,072 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd865317c944d2f17deac2 2026-04-16 00:12:07,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:12:07,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd865317c944d2f17deac2 HTTP/1.1" 200 None 2026-04-16 00:12:07,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:12:07,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-16 00:12:07,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:12:07,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd865317c944d2f17deac2 HTTP/1.1" 200 None 2026-04-16 00:12:07,159 - lava_callback - ERROR - Error processing callback for node 69dd865317c944d2f17deac2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50254 - "GET /node/69d6fa9735ac66e13269aa87%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:50268 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38152 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:14:06,695 - lava_callback - INFO - Received callback for node 69de54dc12f38614f3ded42e INFO: 172.21.0.1:38166 - "POST /node/69de54dc12f38614f3ded42e HTTP/1.0" 202 Accepted 2026-04-16 00:14:06,702 - lava_callback - INFO - Starting async job submit for node 69de54dc12f38614f3ded42e 2026-04-16 00:14:06,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:14:06,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de54dc12f38614f3ded42e HTTP/1.1" 200 None 2026-04-16 00:14:06,738 - lava_callback - DEBUG - Processing node 69de54dc12f38614f3ded42e: baseline-x86 2026-04-16 00:14:07,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:14:07,246 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:14:07,248 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69de54dc12f38614f3ded42e/log.txt.gz 2026-04-16 00:14:07,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:14:07,648 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:14:07,650 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69de54dc12f38614f3ded42e/lava-logs.yaml 2026-04-16 00:14:07,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:14:07,793 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:14:07,795 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69de54dc12f38614f3ded42e/lava_callback.json.gz 2026-04-16 00:14:07,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:14:07,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de54dc12f38614f3ded42e HTTP/1.1" 200 None 2026-04-16 00:14:07,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:14:07,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87d4c2164e674d71ee5f HTTP/1.1" 200 None 2026-04-16 00:14:07,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:14:07,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de54dc12f38614f3ded42e HTTP/1.1" 200 None 2026-04-16 00:14:07,913 - lava_callback - INFO - Completed processing callback for node 69de54dc12f38614f3ded42e INFO: 172.21.0.1:53424 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48878 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:14:37,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:14:37,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53012 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53024 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:17:23,304 - lava_callback - INFO - Received callback for node 69de74c3f6535ffd5b3ede8c INFO: 172.21.0.1:35738 - "POST /node/69de74c3f6535ffd5b3ede8c HTTP/1.0" 202 Accepted 2026-04-16 00:17:23,310 - lava_callback - INFO - Starting async job submit for node 69de74c3f6535ffd5b3ede8c 2026-04-16 00:17:23,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:17:23,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de74c3f6535ffd5b3ede8c HTTP/1.1" 200 None 2026-04-16 00:17:23,344 - lava_callback - DEBUG - Processing node 69de74c3f6535ffd5b3ede8c: baseline-x86 2026-04-16 00:17:23,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:17:23,816 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:17:23,818 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69de74c3f6535ffd5b3ede8c/log.txt.gz 2026-04-16 00:17:24,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:17:24,225 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:17:24,228 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69de74c3f6535ffd5b3ede8c/lava-logs.yaml 2026-04-16 00:17:24,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:17:24,627 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:17:24,629 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69de74c3f6535ffd5b3ede8c/lava_callback.json.gz 2026-04-16 00:17:24,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:17:24,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de74c3f6535ffd5b3ede8c HTTP/1.1" 200 None 2026-04-16 00:17:24,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:17:24,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de68dcf6535ffd5b3ed8db HTTP/1.1" 200 None 2026-04-16 00:17:24,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:17:24,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de74c3f6535ffd5b3ede8c HTTP/1.1" 200 None 2026-04-16 00:17:24,701 - lava_callback - INFO - Completed processing callback for node 69de74c3f6535ffd5b3ede8c INFO: 172.21.0.1:35744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45216 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:17:37,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:17:37,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59980 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:19:20,534 - lava_callback - INFO - Received callback for node 69de9a55d105963562bb3be6 INFO: 172.21.0.1:42270 - "POST /node/69de9a55d105963562bb3be6 HTTP/1.0" 202 Accepted 2026-04-16 00:19:20,540 - lava_callback - INFO - Starting async job submit for node 69de9a55d105963562bb3be6 2026-04-16 00:19:20,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:19:20,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9a55d105963562bb3be6 HTTP/1.1" 200 None 2026-04-16 00:19:20,588 - lava_callback - DEBUG - Processing node 69de9a55d105963562bb3be6: baseline-x86 2026-04-16 00:19:20,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:19:21,039 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:19:21,041 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69de9a55d105963562bb3be6/log.txt.gz 2026-04-16 00:19:21,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:19:21,415 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:19:21,417 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69de9a55d105963562bb3be6/lava-logs.yaml 2026-04-16 00:19:21,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:19:21,577 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:19:21,579 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69de9a55d105963562bb3be6/lava_callback.json.gz 2026-04-16 00:19:21,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:19:21,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de9a55d105963562bb3be6 HTTP/1.1" 200 None 2026-04-16 00:19:21,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:19:21,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de962ed105963562bb3a70 HTTP/1.1" 200 None 2026-04-16 00:19:21,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:19:21,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69de9a55d105963562bb3be6 HTTP/1.1" 200 None 2026-04-16 00:19:21,663 - lava_callback - INFO - Completed processing callback for node 69de9a55d105963562bb3be6 INFO: 172.21.0.1:42280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59276 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:19:37,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:19:37,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38222 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45202 - "GET /node/69936fbfcebe99dd8e068af0%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:45212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42684 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:22:06,156 - lava_callback - INFO - Received callback for node 69deaa797a8aab7fee69e279 INFO: 172.21.0.1:51310 - "POST /node/69deaa797a8aab7fee69e279 HTTP/1.0" 202 Accepted 2026-04-16 00:22:06,161 - lava_callback - INFO - Starting async job submit for node 69deaa797a8aab7fee69e279 2026-04-16 00:22:06,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:22:06,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69deaa797a8aab7fee69e279 HTTP/1.1" 200 None 2026-04-16 00:22:06,208 - lava_callback - DEBUG - Processing node 69deaa797a8aab7fee69e279: baseline-x86 2026-04-16 00:22:06,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:51316 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:22:06,635 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:22:06,637 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69deaa797a8aab7fee69e279/log.txt.gz 2026-04-16 00:22:06,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:22:07,007 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:22:07,009 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69deaa797a8aab7fee69e279/lava-logs.yaml 2026-04-16 00:22:07,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:22:07,154 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:22:07,155 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69deaa797a8aab7fee69e279/lava_callback.json.gz 2026-04-16 00:22:07,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:22:07,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69deaa797a8aab7fee69e279 HTTP/1.1" 200 None 2026-04-16 00:22:07,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:22:07,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87d4c2164e674d71ee5f HTTP/1.1" 200 None 2026-04-16 00:22:07,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:22:07,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69deaa797a8aab7fee69e279 HTTP/1.1" 200 None 2026-04-16 00:22:07,247 - lava_callback - INFO - Completed processing callback for node 69deaa797a8aab7fee69e279 INFO: 172.21.0.1:58354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48470 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:22:37,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:22:37,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37846 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:23:54,719 - lava_callback - INFO - Received callback for node 69dec9997a8aab7fee6a19a4 INFO: 172.21.0.1:50420 - "POST /node/69dec9997a8aab7fee6a19a4 HTTP/1.0" 202 Accepted 2026-04-16 00:23:54,725 - lava_callback - INFO - Starting async job submit for node 69dec9997a8aab7fee6a19a4 2026-04-16 00:23:54,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:23:54,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dec9997a8aab7fee6a19a4 HTTP/1.1" 200 None 2026-04-16 00:23:54,775 - lava_callback - DEBUG - Processing node 69dec9997a8aab7fee6a19a4: baseline-x86 2026-04-16 00:23:55,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:23:55,254 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:23:55,256 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69dec9997a8aab7fee6a19a4/log.txt.gz 2026-04-16 00:23:55,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:23:55,698 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:23:55,700 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69dec9997a8aab7fee6a19a4/lava-logs.yaml 2026-04-16 00:23:55,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:23:55,876 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:23:55,877 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69dec9997a8aab7fee6a19a4/lava_callback.json.gz 2026-04-16 00:23:55,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:23:55,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dec9997a8aab7fee6a19a4 HTTP/1.1" 200 None 2026-04-16 00:23:55,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:23:55,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de68dcf6535ffd5b3ed8db HTTP/1.1" 200 None 2026-04-16 00:23:55,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:23:55,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dec9997a8aab7fee6a19a4 HTTP/1.1" 200 None 2026-04-16 00:23:55,950 - lava_callback - INFO - Completed processing callback for node 69dec9997a8aab7fee6a19a4 INFO: 172.21.0.1:50426 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:24:04,582 - lava_callback - INFO - Received callback for node 69dedd88f490930782fb7034 INFO: 172.21.0.1:51566 - "POST /node/69dedd88f490930782fb7034 HTTP/1.0" 202 Accepted 2026-04-16 00:24:04,588 - lava_callback - INFO - Starting async job submit for node 69dedd88f490930782fb7034 2026-04-16 00:24:04,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:24:04,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedd88f490930782fb7034 HTTP/1.1" 200 None 2026-04-16 00:24:04,621 - lava_callback - DEBUG - Processing node 69dedd88f490930782fb7034: baseline-x86 2026-04-16 00:24:04,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:24:05,065 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:24:05,067 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69dedd88f490930782fb7034/log.txt.gz 2026-04-16 00:24:05,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:24:05,444 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:24:05,446 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69dedd88f490930782fb7034/lava-logs.yaml 2026-04-16 00:24:05,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:24:05,586 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:24:05,588 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69dedd88f490930782fb7034/lava_callback.json.gz 2026-04-16 00:24:05,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:24:05,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dedd88f490930782fb7034 HTTP/1.1" 200 None 2026-04-16 00:24:05,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:24:05,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded961f490930782fb6e47 HTTP/1.1" 200 None 2026-04-16 00:24:05,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:24:05,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dedd88f490930782fb7034 HTTP/1.1" 200 None 2026-04-16 00:24:05,665 - lava_callback - INFO - Completed processing callback for node 69dedd88f490930782fb7034 INFO: 172.21.0.1:51570 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:24:07,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:24:07,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44952 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:25:46,590 - lava_callback - INFO - Received callback for node 69defaaaf490930782fbb89f INFO: 172.21.0.1:44960 - "POST /node/69defaaaf490930782fbb89f HTTP/1.0" 202 Accepted 2026-04-16 00:25:46,596 - lava_callback - INFO - Starting async job submit for node 69defaaaf490930782fbb89f 2026-04-16 00:25:46,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:25:46,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69defaaaf490930782fbb89f HTTP/1.1" 200 None 2026-04-16 00:25:46,632 - lava_callback - DEBUG - Processing node 69defaaaf490930782fbb89f: baseline-x86 2026-04-16 00:25:46,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:25:47,114 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:25:47,115 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69defaaaf490930782fbb89f/log.txt.gz 2026-04-16 00:25:47,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:25:47,504 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:25:47,506 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69defaaaf490930782fbb89f/lava-logs.yaml 2026-04-16 00:25:47,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:25:47,705 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:25:47,706 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69defaaaf490930782fbb89f/lava_callback.json.gz 2026-04-16 00:25:47,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:25:47,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69defaaaf490930782fbb89f HTTP/1.1" 200 None 2026-04-16 00:25:47,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:25:47,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de962ed105963562bb3a70 HTTP/1.1" 200 None 2026-04-16 00:25:47,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:25:47,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69defaaaf490930782fbb89f HTTP/1.1" 200 None 2026-04-16 00:25:47,784 - lava_callback - INFO - Completed processing callback for node 69defaaaf490930782fbb89f INFO: 172.21.0.1:47124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55876 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:26:07,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:26:07,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46104 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:28:06,808 - lava_callback - INFO - Received callback for node 69df1e53f490930782fbde15 INFO: 172.21.0.1:46108 - "POST /node/69df1e53f490930782fbde15 HTTP/1.0" 202 Accepted 2026-04-16 00:28:06,814 - lava_callback - INFO - Starting async job submit for node 69df1e53f490930782fbde15 2026-04-16 00:28:06,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:28:06,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df1e53f490930782fbde15 HTTP/1.1" 200 None 2026-04-16 00:28:06,848 - lava_callback - DEBUG - Processing node 69df1e53f490930782fbde15: baseline-x86 2026-04-16 00:28:07,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:28:07,305 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:28:07,307 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69df1e53f490930782fbde15/log.txt.gz 2026-04-16 00:28:07,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:28:07,741 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:28:07,743 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69df1e53f490930782fbde15/lava-logs.yaml 2026-04-16 00:28:07,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:28:07,916 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:28:07,918 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69df1e53f490930782fbde15/lava_callback.json.gz 2026-04-16 00:28:07,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:28:07,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df1e53f490930782fbde15 HTTP/1.1" 200 None 2026-04-16 00:28:07,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:28:07,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de68dcf6535ffd5b3ed8db HTTP/1.1" 200 None 2026-04-16 00:28:07,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:28:07,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df1e53f490930782fbde15 HTTP/1.1" 200 None 2026-04-16 00:28:07,991 - lava_callback - INFO - Completed processing callback for node 69df1e53f490930782fbde15 INFO: 172.21.0.1:33026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58670 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:28:37,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:28:37,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59182 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:29:08,789 - lava_callback - INFO - Received callback for node 69df329bf490930782fbec58 INFO: 172.21.0.1:59196 - "POST /node/69df329bf490930782fbec58 HTTP/1.0" 202 Accepted 2026-04-16 00:29:08,796 - lava_callback - INFO - Starting async job submit for node 69df329bf490930782fbec58 2026-04-16 00:29:08,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:29:08,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df329bf490930782fbec58 HTTP/1.1" 200 None 2026-04-16 00:29:08,832 - lava_callback - DEBUG - Processing node 69df329bf490930782fbec58: baseline-x86 2026-04-16 00:29:09,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:29:09,529 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:29:09,531 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69df329bf490930782fbec58/log.txt.gz 2026-04-16 00:29:09,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:29:10,159 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:29:10,161 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69df329bf490930782fbec58/lava-logs.yaml 2026-04-16 00:29:10,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:29:10,660 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:29:10,662 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69df329bf490930782fbec58/lava_callback.json.gz 2026-04-16 00:29:10,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:29:10,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df329bf490930782fbec58 HTTP/1.1" 200 None 2026-04-16 00:29:10,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:29:10,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded961f490930782fb6e47 HTTP/1.1" 200 None 2026-04-16 00:29:10,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:29:10,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df329bf490930782fbec58 HTTP/1.1" 200 None 2026-04-16 00:29:10,782 - lava_callback - INFO - Completed processing callback for node 69df329bf490930782fbec58 INFO: 172.21.0.1:59916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35918 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:29:37,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:29:37,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36916 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:30:34,211 - lava_callback - INFO - Received callback for node 69df50b106e8e7b15e962b5d INFO: 172.21.0.1:59002 - "POST /node/69df50b106e8e7b15e962b5d HTTP/1.0" 202 Accepted 2026-04-16 00:30:34,220 - lava_callback - INFO - Starting async job submit for node 69df50b106e8e7b15e962b5d 2026-04-16 00:30:34,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:30:34,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df50b106e8e7b15e962b5d HTTP/1.1" 200 None 2026-04-16 00:30:34,268 - lava_callback - DEBUG - Processing node 69df50b106e8e7b15e962b5d: baseline-x86 2026-04-16 00:30:34,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:30:34,965 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:30:34,967 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69df50b106e8e7b15e962b5d/log.txt.gz 2026-04-16 00:30:35,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:30:35,737 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:30:35,739 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69df50b106e8e7b15e962b5d/lava-logs.yaml 2026-04-16 00:30:35,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:30:35,904 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:30:35,906 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69df50b106e8e7b15e962b5d/lava_callback.json.gz 2026-04-16 00:30:35,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:30:35,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df50b106e8e7b15e962b5d HTTP/1.1" 200 None 2026-04-16 00:30:35,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:30:35,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de962ed105963562bb3a70 HTTP/1.1" 200 None 2026-04-16 00:30:35,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:30:35,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df50b106e8e7b15e962b5d HTTP/1.1" 200 None 2026-04-16 00:30:35,987 - lava_callback - INFO - Completed processing callback for node 69df50b106e8e7b15e962b5d INFO: 172.21.0.1:59012 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:30:37,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:30:37,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-16 00:30:43,059 - lava_callback - INFO - Received callback for node 69df53fa06e8e7b15e962f74 INFO: 172.21.0.1:60206 - "POST /node/69df53fa06e8e7b15e962f74 HTTP/1.0" 202 Accepted 2026-04-16 00:30:43,065 - lava_callback - INFO - Starting async job submit for node 69df53fa06e8e7b15e962f74 2026-04-16 00:30:43,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:30:43,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df53fa06e8e7b15e962f74 HTTP/1.1" 200 None 2026-04-16 00:30:43,098 - lava_callback - DEBUG - Processing node 69df53fa06e8e7b15e962f74: baseline-x86 2026-04-16 00:30:43,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:30:43,576 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:30:43,577 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69df53fa06e8e7b15e962f74/log.txt.gz 2026-04-16 00:30:43,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:30:43,930 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:30:43,932 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69df53fa06e8e7b15e962f74/lava-logs.yaml 2026-04-16 00:30:43,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:30:44,107 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:30:44,110 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69df53fa06e8e7b15e962f74/lava_callback.json.gz 2026-04-16 00:30:44,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:30:44,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df53fa06e8e7b15e962f74 HTTP/1.1" 200 None 2026-04-16 00:30:44,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:30:44,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49c106e8e7b15e9624ed HTTP/1.1" 200 None 2026-04-16 00:30:44,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:30:44,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df53fa06e8e7b15e962f74 HTTP/1.1" 200 None 2026-04-16 00:30:44,215 - lava_callback - INFO - Completed processing callback for node 69df53fa06e8e7b15e962f74 INFO: 172.21.0.1:60212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43468 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:31:07,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:31:07,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45528 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:32:07,758 - lava_callback - INFO - Received callback for node 69df732006e8e7b15e9647ed INFO: 172.21.0.1:45538 - "POST /node/69df732006e8e7b15e9647ed HTTP/1.0" 202 Accepted 2026-04-16 00:32:07,767 - lava_callback - INFO - Starting async job submit for node 69df732006e8e7b15e9647ed 2026-04-16 00:32:07,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:32:07,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df732006e8e7b15e9647ed HTTP/1.1" 200 None 2026-04-16 00:32:07,805 - lava_callback - DEBUG - Processing node 69df732006e8e7b15e9647ed: baseline-x86 2026-04-16 00:32:08,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:32:08,347 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:32:08,349 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69df732006e8e7b15e9647ed/log.txt.gz 2026-04-16 00:32:08,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:32:08,736 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:32:08,738 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69df732006e8e7b15e9647ed/lava-logs.yaml 2026-04-16 00:32:08,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:32:08,891 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:32:08,892 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69df732006e8e7b15e9647ed/lava_callback.json.gz 2026-04-16 00:32:08,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:32:08,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df732006e8e7b15e9647ed HTTP/1.1" 200 None 2026-04-16 00:32:08,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:32:08,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de68dcf6535ffd5b3ed8db HTTP/1.1" 200 None 2026-04-16 00:32:08,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:32:08,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df732006e8e7b15e9647ed HTTP/1.1" 200 None 2026-04-16 00:32:08,976 - lava_callback - INFO - Completed processing callback for node 69df732006e8e7b15e9647ed INFO: 172.21.0.1:35184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39900 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:32:37,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:32:37,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52202 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:33:28,962 - lava_callback - INFO - Received callback for node 69df875606e8e7b15e964aba INFO: 172.21.0.1:52204 - "POST /node/69df875606e8e7b15e964aba HTTP/1.0" 202 Accepted 2026-04-16 00:33:28,968 - lava_callback - INFO - Starting async job submit for node 69df875606e8e7b15e964aba 2026-04-16 00:33:28,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:33:29,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df875606e8e7b15e964aba HTTP/1.1" 200 None 2026-04-16 00:33:29,003 - lava_callback - DEBUG - Processing node 69df875606e8e7b15e964aba: baseline-x86 2026-04-16 00:33:29,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:33:29,440 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:33:29,442 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69df875606e8e7b15e964aba/log.txt.gz 2026-04-16 00:33:29,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:33:29,891 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:33:29,893 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69df875606e8e7b15e964aba/lava-logs.yaml 2026-04-16 00:33:29,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:33:30,059 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:33:30,061 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69df875606e8e7b15e964aba/lava_callback.json.gz 2026-04-16 00:33:30,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:33:30,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df875606e8e7b15e964aba HTTP/1.1" 200 None 2026-04-16 00:33:30,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:33:30,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded961f490930782fb6e47 HTTP/1.1" 200 None 2026-04-16 00:33:30,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:33:30,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69df875606e8e7b15e964aba HTTP/1.1" 200 None 2026-04-16 00:33:30,147 - lava_callback - INFO - Completed processing callback for node 69df875606e8e7b15e964aba 2026-04-16 00:33:32,554 - lava_callback - INFO - Received callback for node 69dd8b52c2164e674d71f0d0 INFO: 172.21.0.1:33766 - "POST /node/69dd8b52c2164e674d71f0d0 HTTP/1.0" 202 Accepted 2026-04-16 00:33:32,562 - lava_callback - INFO - Starting async job submit for node 69dd8b52c2164e674d71f0d0 2026-04-16 00:33:32,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:33:32,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8b52c2164e674d71f0d0 HTTP/1.1" 200 None 2026-04-16 00:33:32,580 - lava_callback - DEBUG - Processing node 69dd8b52c2164e674d71f0d0: baseline-arm64-baylibre 2026-04-16 00:33:32,580 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd8b52c2164e674d71f0d0 2026-04-16 00:33:32,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:33:32,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8b52c2164e674d71f0d0 HTTP/1.1" 200 None 2026-04-16 00:33:32,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:33:32,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd171917c944d2f17d8b46 HTTP/1.1" 200 None 2026-04-16 00:33:32,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:33:32,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8b52c2164e674d71f0d0 HTTP/1.1" 200 None 2026-04-16 00:33:32,652 - lava_callback - ERROR - Error processing callback for node 69dd8b52c2164e674d71f0d0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33782 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:33:37,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:33:37,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40884 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:34:52,652 - lava_callback - INFO - Received callback for node 69dd8b99c2164e674d71f13b INFO: 172.21.0.1:37480 - "POST /node/69dd8b99c2164e674d71f13b HTTP/1.0" 202 Accepted 2026-04-16 00:34:52,661 - lava_callback - INFO - Starting async job submit for node 69dd8b99c2164e674d71f13b 2026-04-16 00:34:52,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:34:52,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8b99c2164e674d71f13b HTTP/1.1" 200 None 2026-04-16 00:34:52,691 - lava_callback - DEBUG - Processing node 69dd8b99c2164e674d71f13b: baseline-arm64-baylibre 2026-04-16 00:34:52,691 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd8b99c2164e674d71f13b 2026-04-16 00:34:52,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:34:52,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8b99c2164e674d71f13b HTTP/1.1" 200 None 2026-04-16 00:34:52,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:34:52,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd171917c944d2f17d8b46 HTTP/1.1" 200 None 2026-04-16 00:34:52,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:34:52,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8b99c2164e674d71f13b HTTP/1.1" 200 None 2026-04-16 00:34:52,791 - lava_callback - ERROR - Error processing callback for node 69dd8b99c2164e674d71f13b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49942 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:35:08,167 - lava_callback - INFO - Received callback for node 69dfa99c06e8e7b15e966483 INFO: 172.21.0.1:49944 - "POST /node/69dfa99c06e8e7b15e966483 HTTP/1.0" 202 Accepted 2026-04-16 00:35:08,177 - lava_callback - INFO - Starting async job submit for node 69dfa99c06e8e7b15e966483 2026-04-16 00:35:08,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:35:08,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dfa99c06e8e7b15e966483 HTTP/1.1" 200 None 2026-04-16 00:35:08,241 - lava_callback - DEBUG - Processing node 69dfa99c06e8e7b15e966483: baseline-x86 2026-04-16 00:35:08,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:35:09,069 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:35:09,071 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69dfa99c06e8e7b15e966483/log.txt.gz 2026-04-16 00:35:09,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:35:09,915 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:35:09,918 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69dfa99c06e8e7b15e966483/lava-logs.yaml 2026-04-16 00:35:09,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:35:10,468 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:35:10,470 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69dfa99c06e8e7b15e966483/lava_callback.json.gz 2026-04-16 00:35:10,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:35:10,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dfa99c06e8e7b15e966483 HTTP/1.1" 200 None 2026-04-16 00:35:10,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:35:10,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69de962ed105963562bb3a70 HTTP/1.1" 200 None 2026-04-16 00:35:10,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:35:10,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dfa99c06e8e7b15e966483 HTTP/1.1" 200 None 2026-04-16 00:35:10,593 - lava_callback - INFO - Completed processing callback for node 69dfa99c06e8e7b15e966483 INFO: 172.21.0.1:59866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58548 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:35:30,182 - lava_callback - INFO - Received callback for node 69e02ec91fb14b744a548b9f INFO: 172.21.0.1:55244 - "POST /node/69e02ec91fb14b744a548b9f HTTP/1.0" 202 Accepted 2026-04-16 00:35:30,189 - lava_callback - INFO - Starting async job submit for node 69e02ec91fb14b744a548b9f 2026-04-16 00:35:30,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:35:30,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02ec91fb14b744a548b9f HTTP/1.1" 200 None 2026-04-16 00:35:30,213 - lava_callback - DEBUG - Processing node 69e02ec91fb14b744a548b9f: baseline-arm 2026-04-16 00:35:30,219 - lava_callback - WARNING - Failed to upload log 2026-04-16 00:35:30,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:35:30,734 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:35:30,736 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e02ec91fb14b744a548b9f/lava-logs.yaml 2026-04-16 00:35:30,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:35:31,057 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:35:31,059 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e02ec91fb14b744a548b9f/lava_callback.json.gz 2026-04-16 00:35:31,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:35:31,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02ec91fb14b744a548b9f HTTP/1.1" 200 None 2026-04-16 00:35:31,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:35:31,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 00:35:31,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:35:31,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e02ec91fb14b744a548b9f HTTP/1.1" 200 None 2026-04-16 00:35:31,121 - lava_callback - INFO - Completed processing callback for node 69e02ec91fb14b744a548b9f 2026-04-16 00:35:35,057 - lava_callback - INFO - Received callback for node 69dfaa2706e8e7b15e966499 INFO: 172.21.0.1:55256 - "POST /node/69dfaa2706e8e7b15e966499 HTTP/1.0" 202 Accepted 2026-04-16 00:35:35,069 - lava_callback - INFO - Starting async job submit for node 69dfaa2706e8e7b15e966499 2026-04-16 00:35:35,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:35:35,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dfaa2706e8e7b15e966499 HTTP/1.1" 200 None 2026-04-16 00:35:35,144 - lava_callback - DEBUG - Processing node 69dfaa2706e8e7b15e966499: baseline-x86 2026-04-16 00:35:35,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:35:35,659 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:35:35,660 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69dfaa2706e8e7b15e966499/log.txt.gz 2026-04-16 00:35:35,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:35:36,126 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:35:36,128 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69dfaa2706e8e7b15e966499/lava-logs.yaml 2026-04-16 00:35:36,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:35:36,304 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:35:36,306 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69dfaa2706e8e7b15e966499/lava_callback.json.gz 2026-04-16 00:35:36,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:35:36,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dfaa2706e8e7b15e966499 HTTP/1.1" 200 None 2026-04-16 00:35:36,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:35:36,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49c106e8e7b15e9624ed HTTP/1.1" 200 None 2026-04-16 00:35:36,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:35:36,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dfaa2706e8e7b15e966499 HTTP/1.1" 200 None 2026-04-16 00:35:36,388 - lava_callback - INFO - Completed processing callback for node 69dfaa2706e8e7b15e966499 INFO: 172.21.0.1:55268 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:35:37,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:35:37,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35410 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:36:13,584 - lava_callback - INFO - Received callback for node 69e02ecd1fb14b744a548bab INFO: 172.21.0.1:56052 - "POST /node/69e02ecd1fb14b744a548bab HTTP/1.0" 202 Accepted 2026-04-16 00:36:13,636 - lava_callback - INFO - Starting async job submit for node 69e02ecd1fb14b744a548bab 2026-04-16 00:36:13,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:36:13,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02ecd1fb14b744a548bab HTTP/1.1" 200 None 2026-04-16 00:36:13,684 - lava_callback - DEBUG - Processing node 69e02ecd1fb14b744a548bab: baseline-arm 2026-04-16 00:36:13,831 - lava_callback - INFO - Received callback for node 69e02eca1fb14b744a548ba2 2026-04-16 00:36:13,861 - lava_callback - INFO - Starting async job submit for node 69e02eca1fb14b744a548ba2 INFO: 172.21.0.1:56064 - "POST /node/69e02eca1fb14b744a548ba2 HTTP/1.0" 202 Accepted 2026-04-16 00:36:13,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:36:13,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:36:13,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02eca1fb14b744a548ba2 HTTP/1.1" 200 None 2026-04-16 00:36:13,906 - lava_callback - DEBUG - Processing node 69e02eca1fb14b744a548ba2: baseline-arm 2026-04-16 00:36:14,089 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:36:14,102 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e02ecd1fb14b744a548bab/log.txt.gz 2026-04-16 00:36:14,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:36:14,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:36:14,427 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:36:14,429 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e02eca1fb14b744a548ba2/log.txt.gz 2026-04-16 00:36:14,455 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:36:14,500 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e02ecd1fb14b744a548bab/lava-logs.yaml 2026-04-16 00:36:14,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:36:14,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:36:14,675 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:36:14,677 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e02ecd1fb14b744a548bab/lava_callback.json.gz 2026-04-16 00:36:14,699 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:36:14,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:36:14,701 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e02eca1fb14b744a548ba2/lava-logs.yaml 2026-04-16 00:36:14,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:36:14,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02ecd1fb14b744a548bab HTTP/1.1" 200 None 2026-04-16 00:36:14,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:36:14,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 00:36:14,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:36:14,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e02ecd1fb14b744a548bab HTTP/1.1" 200 None 2026-04-16 00:36:14,758 - lava_callback - INFO - Completed processing callback for node 69e02ecd1fb14b744a548bab 2026-04-16 00:36:14,840 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:36:14,842 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e02eca1fb14b744a548ba2/lava_callback.json.gz 2026-04-16 00:36:14,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:36:14,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02eca1fb14b744a548ba2 HTTP/1.1" 200 None 2026-04-16 00:36:14,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:36:14,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 00:36:14,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:36:14,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e02eca1fb14b744a548ba2 HTTP/1.1" 200 None 2026-04-16 00:36:14,977 - lava_callback - INFO - Completed processing callback for node 69e02eca1fb14b744a548ba2 INFO: 172.21.0.1:56080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58424 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:36:37,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:36:37,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-16 00:36:37,630 - lava_callback - INFO - Received callback for node 69e02ecc1fb14b744a548ba8 INFO: 172.21.0.1:58432 - "POST /node/69e02ecc1fb14b744a548ba8 HTTP/1.0" 202 Accepted 2026-04-16 00:36:37,637 - lava_callback - INFO - Starting async job submit for node 69e02ecc1fb14b744a548ba8 2026-04-16 00:36:37,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:36:37,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02ecc1fb14b744a548ba8 HTTP/1.1" 200 None 2026-04-16 00:36:37,698 - lava_callback - DEBUG - Processing node 69e02ecc1fb14b744a548ba8: baseline-arm 2026-04-16 00:36:37,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:36:38,093 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:36:38,095 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e02ecc1fb14b744a548ba8/log.txt.gz 2026-04-16 00:36:38,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:36:38,505 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:36:38,507 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e02ecc1fb14b744a548ba8/lava-logs.yaml 2026-04-16 00:36:38,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:36:38,659 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:36:38,661 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e02ecc1fb14b744a548ba8/lava_callback.json.gz 2026-04-16 00:36:38,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:36:38,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02ecc1fb14b744a548ba8 HTTP/1.1" 200 None 2026-04-16 00:36:38,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:36:38,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 00:36:38,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:36:38,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e02ecc1fb14b744a548ba8 HTTP/1.1" 200 None 2026-04-16 00:36:38,746 - lava_callback - INFO - Completed processing callback for node 69e02ecc1fb14b744a548ba8 INFO: 172.21.0.1:45566 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:36:49,262 - lava_callback - INFO - Received callback for node 69e02ec81fb14b744a548b9c INFO: 172.21.0.1:45578 - "POST /node/69e02ec81fb14b744a548b9c HTTP/1.0" 202 Accepted 2026-04-16 00:36:49,268 - lava_callback - INFO - Starting async job submit for node 69e02ec81fb14b744a548b9c 2026-04-16 00:36:49,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:36:49,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02ec81fb14b744a548b9c HTTP/1.1" 200 None 2026-04-16 00:36:49,316 - lava_callback - DEBUG - Processing node 69e02ec81fb14b744a548b9c: baseline-arm 2026-04-16 00:36:49,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:36:49,910 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:36:49,913 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e02ec81fb14b744a548b9c/log.txt.gz 2026-04-16 00:36:50,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:36:50,265 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:36:50,267 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e02ec81fb14b744a548b9c/lava-logs.yaml 2026-04-16 00:36:50,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:36:50,443 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:36:50,445 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e02ec81fb14b744a548b9c/lava_callback.json.gz 2026-04-16 00:36:50,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:36:50,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02ec81fb14b744a548b9c HTTP/1.1" 200 None 2026-04-16 00:36:50,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:36:50,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 00:36:50,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:36:50,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e02ec81fb14b744a548b9c HTTP/1.1" 200 None 2026-04-16 00:36:50,537 - lava_callback - INFO - Completed processing callback for node 69e02ec81fb14b744a548b9c INFO: 172.21.0.1:56486 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:36:59,692 - lava_callback - INFO - Received callback for node 69e02edb1fb14b744a548bd7 INFO: 172.21.0.1:56498 - "POST /node/69e02edb1fb14b744a548bd7 HTTP/1.0" 202 Accepted 2026-04-16 00:36:59,699 - lava_callback - INFO - Starting async job submit for node 69e02edb1fb14b744a548bd7 2026-04-16 00:36:59,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:36:59,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02edb1fb14b744a548bd7 HTTP/1.1" 200 None 2026-04-16 00:36:59,756 - lava_callback - DEBUG - Processing node 69e02edb1fb14b744a548bd7: baseline-arm-broonie 2026-04-16 00:37:00,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:37:00,323 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:37:00,326 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e02edb1fb14b744a548bd7/log.txt.gz 2026-04-16 00:37:00,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:37:00,729 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:37:00,732 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e02edb1fb14b744a548bd7/lava-logs.yaml 2026-04-16 00:37:00,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:37:01,468 - lava_callback - INFO - Received callback for node 69e02edd1fb14b744a548bda INFO: 172.21.0.1:54366 - "POST /node/69e02edd1fb14b744a548bda HTTP/1.0" 202 Accepted 2026-04-16 00:37:01,479 - lava_callback - INFO - Starting async job submit for node 69e02edd1fb14b744a548bda 2026-04-16 00:37:01,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:37:01,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02edd1fb14b744a548bda HTTP/1.1" 200 None 2026-04-16 00:37:01,542 - lava_callback - DEBUG - Processing node 69e02edd1fb14b744a548bda: baseline-arm-broonie 2026-04-16 00:37:01,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:37:01,872 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:37:01,874 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e02edd1fb14b744a548bda/log.txt.gz 2026-04-16 00:37:02,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:37:02,407 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:37:02,410 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e02edd1fb14b744a548bda/lava-logs.yaml 2026-04-16 00:37:02,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:37:02,530 - lava_callback - INFO - Received callback for node 69e02eef1fb14b744a548c40 2026-04-16 00:37:02,578 - lava_callback - INFO - Starting async job submit for node 69e02eef1fb14b744a548c40 INFO: 172.21.0.1:54382 - "POST /node/69e02eef1fb14b744a548c40 HTTP/1.0" 202 Accepted 2026-04-16 00:37:02,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:37:02,605 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:37:02,606 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e02edd1fb14b744a548bda/lava_callback.json.gz 2026-04-16 00:37:02,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:37:02,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02eef1fb14b744a548c40 HTTP/1.1" 200 None 2026-04-16 00:37:02,643 - lava_callback - DEBUG - Processing node 69e02eef1fb14b744a548c40: baseline-arm-pengutronix 2026-04-16 00:37:02,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02edd1fb14b744a548bda HTTP/1.1" 200 None 2026-04-16 00:37:02,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:37:02,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:37:02,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 00:37:02,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:37:02,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e02edd1fb14b744a548bda HTTP/1.1" 200 None 2026-04-16 00:37:02,815 - lava_callback - INFO - Completed processing callback for node 69e02edd1fb14b744a548bda 2026-04-16 00:37:02,961 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:37:02,963 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e02eef1fb14b744a548c40/log.txt.gz 2026-04-16 00:37:03,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:37:03,247 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:37:03,250 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e02eef1fb14b744a548c40/lava-logs.yaml 2026-04-16 00:37:03,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:37:03,650 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:37:03,652 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e02eef1fb14b744a548c40/lava_callback.json.gz 2026-04-16 00:37:03,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:37:03,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02eef1fb14b744a548c40 HTTP/1.1" 200 None 2026-04-16 00:37:03,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:37:03,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 00:37:03,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:37:03,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e02eef1fb14b744a548c40 HTTP/1.1" 200 None 2026-04-16 00:37:03,768 - lava_callback - INFO - Completed processing callback for node 69e02eef1fb14b744a548c40 2026-04-16 00:37:04,885 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:37:04,887 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e02edb1fb14b744a548bd7/lava_callback.json.gz 2026-04-16 00:37:04,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:37:04,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02edb1fb14b744a548bd7 HTTP/1.1" 200 None 2026-04-16 00:37:04,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:37:04,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 00:37:04,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:37:05,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e02edb1fb14b744a548bd7 HTTP/1.1" 200 None 2026-04-16 00:37:05,033 - lava_callback - INFO - Completed processing callback for node 69e02edb1fb14b744a548bd7 INFO: 172.21.0.1:54390 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:37:07,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:37:07,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-16 00:37:08,273 - lava_callback - INFO - Received callback for node 69e02eee1fb14b744a548c3b INFO: 172.21.0.1:54402 - "POST /node/69e02eee1fb14b744a548c3b HTTP/1.0" 202 Accepted 2026-04-16 00:37:08,283 - lava_callback - INFO - Starting async job submit for node 69e02eee1fb14b744a548c3b 2026-04-16 00:37:08,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:37:08,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02eee1fb14b744a548c3b HTTP/1.1" 200 None 2026-04-16 00:37:08,329 - lava_callback - DEBUG - Processing node 69e02eee1fb14b744a548c3b: baseline-arm-pengutronix 2026-04-16 00:37:08,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:37:08,655 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:37:08,657 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e02eee1fb14b744a548c3b/log.txt.gz 2026-04-16 00:37:08,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:37:08,951 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:37:08,954 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e02eee1fb14b744a548c3b/lava-logs.yaml 2026-04-16 00:37:08,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:37:09,217 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:37:09,219 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e02eee1fb14b744a548c3b/lava_callback.json.gz 2026-04-16 00:37:09,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:37:09,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02eee1fb14b744a548c3b HTTP/1.1" 200 None 2026-04-16 00:37:09,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:37:09,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 00:37:09,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:37:09,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e02eee1fb14b744a548c3b HTTP/1.1" 200 None 2026-04-16 00:37:09,340 - lava_callback - INFO - Completed processing callback for node 69e02eee1fb14b744a548c3b INFO: 172.21.0.1:43832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43844 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:37:22,771 - lava_callback - INFO - Received callback for node 69e02ee91fb14b744a548c2c INFO: 172.21.0.1:50464 - "POST /node/69e02ee91fb14b744a548c2c HTTP/1.0" 202 Accepted 2026-04-16 00:37:22,781 - lava_callback - INFO - Starting async job submit for node 69e02ee91fb14b744a548c2c 2026-04-16 00:37:22,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:37:22,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02ee91fb14b744a548c2c HTTP/1.1" 200 None 2026-04-16 00:37:22,855 - lava_callback - DEBUG - Processing node 69e02ee91fb14b744a548c2c: baseline-arm-kontron 2026-04-16 00:37:23,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:37:23,231 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:37:23,232 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69e02ee91fb14b744a548c2c/log.txt.gz 2026-04-16 00:37:23,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:37:23,628 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:37:23,631 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69e02ee91fb14b744a548c2c/lava-logs.yaml 2026-04-16 00:37:23,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:37:23,855 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:37:23,857 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69e02ee91fb14b744a548c2c/lava_callback.json.gz 2026-04-16 00:37:23,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:37:23,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02ee91fb14b744a548c2c HTTP/1.1" 200 None 2026-04-16 00:37:23,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:37:23,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 00:37:23,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:37:23,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e02ee91fb14b744a548c2c HTTP/1.1" 200 None 2026-04-16 00:37:23,995 - lava_callback - INFO - Completed processing callback for node 69e02ee91fb14b744a548c2c 2026-04-16 00:37:24,048 - lava_callback - INFO - Received callback for node 69e02eeb1fb14b744a548c2f INFO: 172.21.0.1:50474 - "POST /node/69e02eeb1fb14b744a548c2f HTTP/1.0" 202 Accepted 2026-04-16 00:37:24,110 - lava_callback - INFO - Starting async job submit for node 69e02eeb1fb14b744a548c2f 2026-04-16 00:37:24,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:37:24,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02eeb1fb14b744a548c2f HTTP/1.1" 200 None 2026-04-16 00:37:24,164 - lava_callback - DEBUG - Processing node 69e02eeb1fb14b744a548c2f: baseline-arm-kontron 2026-04-16 00:37:24,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:37:24,558 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:37:24,560 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69e02eeb1fb14b744a548c2f/log.txt.gz 2026-04-16 00:37:24,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:37:24,831 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:37:24,833 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69e02eeb1fb14b744a548c2f/lava-logs.yaml 2026-04-16 00:37:24,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:37:24,983 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:37:24,985 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69e02eeb1fb14b744a548c2f/lava_callback.json.gz 2026-04-16 00:37:25,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:37:25,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02eeb1fb14b744a548c2f HTTP/1.1" 200 None 2026-04-16 00:37:25,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:37:25,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 00:37:25,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:37:25,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e02eeb1fb14b744a548c2f HTTP/1.1" 200 None 2026-04-16 00:37:25,068 - lava_callback - INFO - Completed processing callback for node 69e02eeb1fb14b744a548c2f INFO: 172.21.0.1:50486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50900 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:37:37,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:37:37,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50658 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:38:08,186 - lava_callback - INFO - Received callback for node 69e02f051fb14b744a548c99 INFO: 172.21.0.1:50668 - "POST /node/69e02f051fb14b744a548c99 HTTP/1.0" 202 Accepted 2026-04-16 00:38:08,194 - lava_callback - INFO - Starting async job submit for node 69e02f051fb14b744a548c99 2026-04-16 00:38:08,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:38:08,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02f051fb14b744a548c99 HTTP/1.1" 200 None 2026-04-16 00:38:08,236 - lava_callback - DEBUG - Processing node 69e02f051fb14b744a548c99: ltp-dio 2026-04-16 00:38:08,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:38:09,079 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:38:09,081 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-69e02f051fb14b744a548c99/log.txt.gz 2026-04-16 00:38:09,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:38:09,784 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:38:09,786 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-69e02f051fb14b744a548c99/lava-logs.yaml 2026-04-16 00:38:09,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:38:09,972 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:38:09,975 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-69e02f051fb14b744a548c99/lava_callback.json.gz 2026-04-16 00:38:10,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:38:10,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02f051fb14b744a548c99 HTTP/1.1" 200 None 2026-04-16 00:38:10,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:38:10,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 00:38:10,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:38:10,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e02f051fb14b744a548c99 HTTP/1.1" 200 None 2026-04-16 00:38:10,110 - lava_callback - INFO - Completed processing callback for node 69e02f051fb14b744a548c99 INFO: 172.21.0.1:46774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46790 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:38:17,522 - lava_callback - INFO - Received callback for node 69e02ede1fb14b744a548bdd INFO: 172.21.0.1:46794 - "POST /node/69e02ede1fb14b744a548bdd HTTP/1.0" 202 Accepted 2026-04-16 00:38:17,529 - lava_callback - INFO - Starting async job submit for node 69e02ede1fb14b744a548bdd 2026-04-16 00:38:17,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:38:17,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02ede1fb14b744a548bdd HTTP/1.1" 200 None 2026-04-16 00:38:17,569 - lava_callback - DEBUG - Processing node 69e02ede1fb14b744a548bdd: baseline-arm-broonie 2026-04-16 00:38:17,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:38:18,258 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:38:18,260 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e02ede1fb14b744a548bdd/log.txt.gz 2026-04-16 00:38:18,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:38:19,031 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:38:19,033 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e02ede1fb14b744a548bdd/lava-logs.yaml 2026-04-16 00:38:19,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:38:19,215 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:38:19,217 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e02ede1fb14b744a548bdd/lava_callback.json.gz 2026-04-16 00:38:19,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:38:19,261 - lava_callback - INFO - Received callback for node 69e02f6e1fb14b744a548d7a INFO: 172.21.0.1:46800 - "POST /node/69e02f6e1fb14b744a548d7a HTTP/1.0" 202 Accepted 2026-04-16 00:38:19,288 - lava_callback - INFO - Starting async job submit for node 69e02f6e1fb14b744a548d7a 2026-04-16 00:38:19,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02ede1fb14b744a548bdd HTTP/1.1" 200 None 2026-04-16 00:38:19,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:38:19,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:38:19,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02f6e1fb14b744a548d7a HTTP/1.1" 200 None 2026-04-16 00:38:19,313 - lava_callback - DEBUG - Processing node 69e02f6e1fb14b744a548d7a: baseline-arm 2026-04-16 00:38:19,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 00:38:19,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:38:19,326 - lava_callback - WARNING - Failed to upload log 2026-04-16 00:38:19,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:38:19,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e02ede1fb14b744a548bdd HTTP/1.1" 200 None 2026-04-16 00:38:19,362 - lava_callback - INFO - Completed processing callback for node 69e02ede1fb14b744a548bdd 2026-04-16 00:38:19,919 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:38:19,921 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e02f6e1fb14b744a548d7a/lava-logs.yaml 2026-04-16 00:38:19,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:38:20,083 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:38:20,085 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e02f6e1fb14b744a548d7a/lava_callback.json.gz 2026-04-16 00:38:20,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:38:20,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02f6e1fb14b744a548d7a HTTP/1.1" 200 None 2026-04-16 00:38:20,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:38:20,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 00:38:20,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:38:20,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e02f6e1fb14b744a548d7a HTTP/1.1" 200 None 2026-04-16 00:38:20,157 - lava_callback - INFO - Completed processing callback for node 69e02f6e1fb14b744a548d7a INFO: 172.21.0.1:58988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58994 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:38:32,814 - lava_callback - INFO - Received callback for node 69dd8c74c2164e674d71f250 INFO: 172.21.0.1:36614 - "POST /node/69dd8c74c2164e674d71f250 HTTP/1.0" 202 Accepted 2026-04-16 00:38:32,828 - lava_callback - INFO - Starting async job submit for node 69dd8c74c2164e674d71f250 2026-04-16 00:38:32,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:38:32,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8c74c2164e674d71f250 HTTP/1.1" 200 None 2026-04-16 00:38:32,855 - lava_callback - DEBUG - Processing node 69dd8c74c2164e674d71f250: baseline-arm64-baylibre 2026-04-16 00:38:32,855 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd8c74c2164e674d71f250 2026-04-16 00:38:32,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:38:32,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8c74c2164e674d71f250 HTTP/1.1" 200 None 2026-04-16 00:38:32,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:38:32,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd171917c944d2f17d8b46 HTTP/1.1" 200 None 2026-04-16 00:38:32,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:38:32,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8c74c2164e674d71f250 HTTP/1.1" 200 None 2026-04-16 00:38:32,966 - lava_callback - ERROR - Error processing callback for node 69dd8c74c2164e674d71f250: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36622 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:38:37,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:38:37,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36578 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:39:12,822 - lava_callback - INFO - Received callback for node 69dd8c9dc2164e674d71f2c4 INFO: 172.21.0.1:46870 - "POST /node/69dd8c9dc2164e674d71f2c4 HTTP/1.0" 202 Accepted 2026-04-16 00:39:12,831 - lava_callback - INFO - Starting async job submit for node 69dd8c9dc2164e674d71f2c4 2026-04-16 00:39:12,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:12,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8c9dc2164e674d71f2c4 HTTP/1.1" 200 None 2026-04-16 00:39:12,848 - lava_callback - DEBUG - Processing node 69dd8c9dc2164e674d71f2c4: baseline-arm-baylibre 2026-04-16 00:39:12,848 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd8c9dc2164e674d71f2c4 2026-04-16 00:39:12,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:12,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8c9dc2164e674d71f2c4 HTTP/1.1" 200 None 2026-04-16 00:39:12,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:12,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-16 00:39:12,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:12,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8c9dc2164e674d71f2c4 HTTP/1.1" 200 None 2026-04-16 00:39:12,929 - lava_callback - ERROR - Error processing callback for node 69dd8c9dc2164e674d71f2c4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 00:39:13,493 - lava_callback - INFO - Received callback for node 69dd8c9ec2164e674d71f2c7 INFO: 172.21.0.1:46880 - "POST /node/69dd8c9ec2164e674d71f2c7 HTTP/1.0" 202 Accepted 2026-04-16 00:39:13,499 - lava_callback - INFO - Starting async job submit for node 69dd8c9ec2164e674d71f2c7 2026-04-16 00:39:13,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:13,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8c9ec2164e674d71f2c7 HTTP/1.1" 200 None 2026-04-16 00:39:13,514 - lava_callback - DEBUG - Processing node 69dd8c9ec2164e674d71f2c7: baseline-arm-baylibre 2026-04-16 00:39:13,515 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd8c9ec2164e674d71f2c7 2026-04-16 00:39:13,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:13,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8c9ec2164e674d71f2c7 HTTP/1.1" 200 None 2026-04-16 00:39:13,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:13,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-16 00:39:13,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:13,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8c9ec2164e674d71f2c7 HTTP/1.1" 200 None 2026-04-16 00:39:13,572 - lava_callback - ERROR - Error processing callback for node 69dd8c9ec2164e674d71f2c7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 00:39:14,165 - lava_callback - INFO - Received callback for node 69dd8c9fc2164e674d71f2ca INFO: 172.21.0.1:46888 - "POST /node/69dd8c9fc2164e674d71f2ca HTTP/1.0" 202 Accepted 2026-04-16 00:39:14,171 - lava_callback - INFO - Starting async job submit for node 69dd8c9fc2164e674d71f2ca 2026-04-16 00:39:14,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:14,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8c9fc2164e674d71f2ca HTTP/1.1" 200 None 2026-04-16 00:39:14,205 - lava_callback - DEBUG - Processing node 69dd8c9fc2164e674d71f2ca: baseline-arm-baylibre 2026-04-16 00:39:14,205 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd8c9fc2164e674d71f2ca 2026-04-16 00:39:14,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:14,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8c9fc2164e674d71f2ca HTTP/1.1" 200 None 2026-04-16 00:39:14,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:14,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-16 00:39:14,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:14,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8c9fc2164e674d71f2ca HTTP/1.1" 200 None 2026-04-16 00:39:14,263 - lava_callback - ERROR - Error processing callback for node 69dd8c9fc2164e674d71f2ca: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 00:39:14,863 - lava_callback - INFO - Received callback for node 69dd8ca1c2164e674d71f2cd INFO: 172.21.0.1:46896 - "POST /node/69dd8ca1c2164e674d71f2cd HTTP/1.0" 202 Accepted 2026-04-16 00:39:14,871 - lava_callback - INFO - Starting async job submit for node 69dd8ca1c2164e674d71f2cd 2026-04-16 00:39:14,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:14,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8ca1c2164e674d71f2cd HTTP/1.1" 200 None 2026-04-16 00:39:14,894 - lava_callback - DEBUG - Processing node 69dd8ca1c2164e674d71f2cd: baseline-arm-baylibre 2026-04-16 00:39:14,894 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd8ca1c2164e674d71f2cd 2026-04-16 00:39:14,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:14,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8ca1c2164e674d71f2cd HTTP/1.1" 200 None 2026-04-16 00:39:14,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:14,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-16 00:39:14,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:14,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8ca1c2164e674d71f2cd HTTP/1.1" 200 None 2026-04-16 00:39:14,952 - lava_callback - ERROR - Error processing callback for node 69dd8ca1c2164e674d71f2cd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46902 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-16 00:39:15,560 - lava_callback - INFO - Received callback for node 69dd8ca3c2164e674d71f2d8 INFO: 172.21.0.1:46918 - "POST /node/69dd8ca3c2164e674d71f2d8 HTTP/1.0" 202 Accepted 2026-04-16 00:39:15,568 - lava_callback - INFO - Starting async job submit for node 69dd8ca3c2164e674d71f2d8 2026-04-16 00:39:15,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:15,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8ca3c2164e674d71f2d8 HTTP/1.1" 200 None 2026-04-16 00:39:15,595 - lava_callback - DEBUG - Processing node 69dd8ca3c2164e674d71f2d8: baseline-arm-baylibre 2026-04-16 00:39:15,595 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd8ca3c2164e674d71f2d8 2026-04-16 00:39:15,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:15,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8ca3c2164e674d71f2d8 HTTP/1.1" 200 None 2026-04-16 00:39:15,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:15,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-16 00:39:15,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:15,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8ca3c2164e674d71f2d8 HTTP/1.1" 200 None 2026-04-16 00:39:15,654 - lava_callback - ERROR - Error processing callback for node 69dd8ca3c2164e674d71f2d8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 00:39:16,234 - lava_callback - INFO - Received callback for node 69dd8ca5c2164e674d71f2db INFO: 172.21.0.1:46924 - "POST /node/69dd8ca5c2164e674d71f2db HTTP/1.0" 202 Accepted 2026-04-16 00:39:16,243 - lava_callback - INFO - Starting async job submit for node 69dd8ca5c2164e674d71f2db 2026-04-16 00:39:16,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:16,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8ca5c2164e674d71f2db HTTP/1.1" 200 None 2026-04-16 00:39:16,280 - lava_callback - DEBUG - Processing node 69dd8ca5c2164e674d71f2db: baseline-arm-baylibre 2026-04-16 00:39:16,280 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd8ca5c2164e674d71f2db 2026-04-16 00:39:16,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:16,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8ca5c2164e674d71f2db HTTP/1.1" 200 None 2026-04-16 00:39:16,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:16,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-16 00:39:16,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:16,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8ca5c2164e674d71f2db HTTP/1.1" 200 None 2026-04-16 00:39:16,353 - lava_callback - ERROR - Error processing callback for node 69dd8ca5c2164e674d71f2db: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40714 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:39:28,471 - lava_callback - INFO - Received callback for node 69dd8cadc2164e674d71f30a INFO: 172.21.0.1:40722 - "POST /node/69dd8cadc2164e674d71f30a HTTP/1.0" 202 Accepted 2026-04-16 00:39:28,476 - lava_callback - INFO - Starting async job submit for node 69dd8cadc2164e674d71f30a 2026-04-16 00:39:28,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:28,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8cadc2164e674d71f30a HTTP/1.1" 200 None 2026-04-16 00:39:28,494 - lava_callback - DEBUG - Processing node 69dd8cadc2164e674d71f30a: baseline-arm-clabbe 2026-04-16 00:39:28,495 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd8cadc2164e674d71f30a 2026-04-16 00:39:28,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:28,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8cadc2164e674d71f30a HTTP/1.1" 200 None 2026-04-16 00:39:28,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:28,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-16 00:39:28,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:28,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8cadc2164e674d71f30a HTTP/1.1" 200 None 2026-04-16 00:39:28,543 - lava_callback - ERROR - Error processing callback for node 69dd8cadc2164e674d71f30a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40724 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:39:29,164 - lava_callback - INFO - Received callback for node 69dd8cafc2164e674d71f310 INFO: 172.21.0.1:40736 - "POST /node/69dd8cafc2164e674d71f310 HTTP/1.0" 202 Accepted 2026-04-16 00:39:29,169 - lava_callback - INFO - Starting async job submit for node 69dd8cafc2164e674d71f310 2026-04-16 00:39:29,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:29,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8cafc2164e674d71f310 HTTP/1.1" 200 None 2026-04-16 00:39:29,188 - lava_callback - DEBUG - Processing node 69dd8cafc2164e674d71f310: baseline-arm-clabbe 2026-04-16 00:39:29,188 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd8cafc2164e674d71f310 2026-04-16 00:39:29,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:29,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8cafc2164e674d71f310 HTTP/1.1" 200 None 2026-04-16 00:39:29,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:29,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-16 00:39:29,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:29,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8cafc2164e674d71f310 HTTP/1.1" 200 None 2026-04-16 00:39:29,238 - lava_callback - ERROR - Error processing callback for node 69dd8cafc2164e674d71f310: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 00:39:29,855 - lava_callback - INFO - Received callback for node 69dd8cb0c2164e674d71f314 INFO: 172.21.0.1:39530 - "POST /node/69dd8cb0c2164e674d71f314 HTTP/1.0" 202 Accepted 2026-04-16 00:39:29,862 - lava_callback - INFO - Starting async job submit for node 69dd8cb0c2164e674d71f314 2026-04-16 00:39:29,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:29,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8cb0c2164e674d71f314 HTTP/1.1" 200 None 2026-04-16 00:39:29,881 - lava_callback - DEBUG - Processing node 69dd8cb0c2164e674d71f314: baseline-arm-clabbe 2026-04-16 00:39:29,881 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd8cb0c2164e674d71f314 2026-04-16 00:39:29,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:29,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8cb0c2164e674d71f314 HTTP/1.1" 200 None 2026-04-16 00:39:29,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:29,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-16 00:39:29,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:29,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8cb0c2164e674d71f314 HTTP/1.1" 200 None 2026-04-16 00:39:29,934 - lava_callback - ERROR - Error processing callback for node 69dd8cb0c2164e674d71f314: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 00:39:30,544 - lava_callback - INFO - Received callback for node 69dd8cb1c2164e674d71f317 INFO: 172.21.0.1:39534 - "POST /node/69dd8cb1c2164e674d71f317 HTTP/1.0" 202 Accepted 2026-04-16 00:39:30,553 - lava_callback - INFO - Starting async job submit for node 69dd8cb1c2164e674d71f317 2026-04-16 00:39:30,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:30,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8cb1c2164e674d71f317 HTTP/1.1" 200 None 2026-04-16 00:39:30,570 - lava_callback - DEBUG - Processing node 69dd8cb1c2164e674d71f317: baseline-arm-clabbe 2026-04-16 00:39:30,570 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd8cb1c2164e674d71f317 2026-04-16 00:39:30,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:30,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8cb1c2164e674d71f317 HTTP/1.1" 200 None 2026-04-16 00:39:30,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:30,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-16 00:39:30,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:30,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8cb1c2164e674d71f317 HTTP/1.1" 200 None 2026-04-16 00:39:30,619 - lava_callback - ERROR - Error processing callback for node 69dd8cb1c2164e674d71f317: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 00:39:31,234 - lava_callback - INFO - Received callback for node 69dd8cb2c2164e674d71f31a INFO: 172.21.0.1:39538 - "POST /node/69dd8cb2c2164e674d71f31a HTTP/1.0" 202 Accepted 2026-04-16 00:39:31,241 - lava_callback - INFO - Starting async job submit for node 69dd8cb2c2164e674d71f31a 2026-04-16 00:39:31,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:31,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8cb2c2164e674d71f31a HTTP/1.1" 200 None 2026-04-16 00:39:31,260 - lava_callback - DEBUG - Processing node 69dd8cb2c2164e674d71f31a: baseline-arm-clabbe 2026-04-16 00:39:31,261 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd8cb2c2164e674d71f31a 2026-04-16 00:39:31,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:31,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8cb2c2164e674d71f31a HTTP/1.1" 200 None 2026-04-16 00:39:31,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:31,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-16 00:39:31,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:31,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8cb2c2164e674d71f31a HTTP/1.1" 200 None 2026-04-16 00:39:31,323 - lava_callback - ERROR - Error processing callback for node 69dd8cb2c2164e674d71f31a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 00:39:31,927 - lava_callback - INFO - Received callback for node 69dd8cb2c2164e674d71f31d INFO: 172.21.0.1:39548 - "POST /node/69dd8cb2c2164e674d71f31d HTTP/1.0" 202 Accepted 2026-04-16 00:39:31,933 - lava_callback - INFO - Starting async job submit for node 69dd8cb2c2164e674d71f31d 2026-04-16 00:39:31,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:31,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8cb2c2164e674d71f31d HTTP/1.1" 200 None 2026-04-16 00:39:31,949 - lava_callback - DEBUG - Processing node 69dd8cb2c2164e674d71f31d: baseline-arm-clabbe 2026-04-16 00:39:31,950 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd8cb2c2164e674d71f31d 2026-04-16 00:39:31,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:31,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8cb2c2164e674d71f31d HTTP/1.1" 200 None 2026-04-16 00:39:31,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:31,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-16 00:39:31,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:32,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8cb2c2164e674d71f31d HTTP/1.1" 200 None 2026-04-16 00:39:32,008 - lava_callback - ERROR - Error processing callback for node 69dd8cb2c2164e674d71f31d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 00:39:32,609 - lava_callback - INFO - Received callback for node 69dd8cb3c2164e674d71f320 INFO: 172.21.0.1:39564 - "POST /node/69dd8cb3c2164e674d71f320 HTTP/1.0" 202 Accepted 2026-04-16 00:39:32,614 - lava_callback - INFO - Starting async job submit for node 69dd8cb3c2164e674d71f320 2026-04-16 00:39:32,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:32,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8cb3c2164e674d71f320 HTTP/1.1" 200 None 2026-04-16 00:39:32,630 - lava_callback - DEBUG - Processing node 69dd8cb3c2164e674d71f320: baseline-arm-clabbe 2026-04-16 00:39:32,630 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd8cb3c2164e674d71f320 2026-04-16 00:39:32,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:32,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8cb3c2164e674d71f320 HTTP/1.1" 200 None 2026-04-16 00:39:32,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:32,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-16 00:39:32,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:32,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8cb3c2164e674d71f320 HTTP/1.1" 200 None 2026-04-16 00:39:32,678 - lava_callback - ERROR - Error processing callback for node 69dd8cb3c2164e674d71f320: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 00:39:33,321 - lava_callback - INFO - Received callback for node 69dd8cb4c2164e674d71f323 INFO: 172.21.0.1:39580 - "POST /node/69dd8cb4c2164e674d71f323 HTTP/1.0" 202 Accepted 2026-04-16 00:39:33,330 - lava_callback - INFO - Starting async job submit for node 69dd8cb4c2164e674d71f323 2026-04-16 00:39:33,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:33,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8cb4c2164e674d71f323 HTTP/1.1" 200 None 2026-04-16 00:39:33,372 - lava_callback - DEBUG - Processing node 69dd8cb4c2164e674d71f323: baseline-arm-clabbe 2026-04-16 00:39:33,372 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd8cb4c2164e674d71f323 2026-04-16 00:39:33,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:33,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8cb4c2164e674d71f323 HTTP/1.1" 200 None 2026-04-16 00:39:33,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:33,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-16 00:39:33,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:33,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8cb4c2164e674d71f323 HTTP/1.1" 200 None 2026-04-16 00:39:33,424 - lava_callback - ERROR - Error processing callback for node 69dd8cb4c2164e674d71f323: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 00:39:34,010 - lava_callback - INFO - Received callback for node 69dd8cb5c2164e674d71f326 INFO: 172.21.0.1:39584 - "POST /node/69dd8cb5c2164e674d71f326 HTTP/1.0" 202 Accepted 2026-04-16 00:39:34,016 - lava_callback - INFO - Starting async job submit for node 69dd8cb5c2164e674d71f326 2026-04-16 00:39:34,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:34,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8cb5c2164e674d71f326 HTTP/1.1" 200 None 2026-04-16 00:39:34,033 - lava_callback - DEBUG - Processing node 69dd8cb5c2164e674d71f326: baseline-arm-clabbe 2026-04-16 00:39:34,033 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd8cb5c2164e674d71f326 2026-04-16 00:39:34,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:34,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8cb5c2164e674d71f326 HTTP/1.1" 200 None 2026-04-16 00:39:34,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:34,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-16 00:39:34,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:39:34,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8cb5c2164e674d71f326 HTTP/1.1" 200 None 2026-04-16 00:39:34,097 - lava_callback - ERROR - Error processing callback for node 69dd8cb5c2164e674d71f326: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60126 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:39:59,995 - lava_callback - INFO - Received callback for node 69e02f181fb14b744a548cc8 INFO: 172.21.0.1:52098 - "POST /node/69e02f181fb14b744a548cc8 HTTP/1.0" 202 Accepted 2026-04-16 00:40:00,002 - lava_callback - INFO - Starting async job submit for node 69e02f181fb14b744a548cc8 2026-04-16 00:40:00,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:40:00,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02f181fb14b744a548cc8 HTTP/1.1" 200 None 2026-04-16 00:40:00,043 - lava_callback - DEBUG - Processing node 69e02f181fb14b744a548cc8: baseline-arm 2026-04-16 00:40:00,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:40:00,379 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:40:00,381 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e02f181fb14b744a548cc8/log.txt.gz 2026-04-16 00:40:00,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:40:00,679 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:40:00,681 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e02f181fb14b744a548cc8/lava-logs.yaml 2026-04-16 00:40:00,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:40:00,854 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:40:00,855 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e02f181fb14b744a548cc8/lava_callback.json.gz 2026-04-16 00:40:00,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:40:00,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02f181fb14b744a548cc8 HTTP/1.1" 200 None 2026-04-16 00:40:00,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:40:00,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a2e1fb14b744a54889b HTTP/1.1" 200 None 2026-04-16 00:40:00,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:40:00,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e02f181fb14b744a548cc8 HTTP/1.1" 200 None 2026-04-16 00:40:00,969 - lava_callback - INFO - Completed processing callback for node 69e02f181fb14b744a548cc8 INFO: 172.21.0.1:52104 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:40:07,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:40:07,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40502 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:40:27,241 - lava_callback - INFO - Received callback for node 69dffeeeb70ef96924eadca6 INFO: 172.21.0.1:40508 - "POST /node/69dffeeeb70ef96924eadca6 HTTP/1.0" 202 Accepted 2026-04-16 00:40:27,251 - lava_callback - INFO - Starting async job submit for node 69dffeeeb70ef96924eadca6 2026-04-16 00:40:27,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:40:27,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dffeeeb70ef96924eadca6 HTTP/1.1" 200 None 2026-04-16 00:40:27,300 - lava_callback - DEBUG - Processing node 69dffeeeb70ef96924eadca6: baseline-x86 2026-04-16 00:40:27,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:40:27,861 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:40:27,863 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69dffeeeb70ef96924eadca6/log.txt.gz 2026-04-16 00:40:28,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:40:28,317 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:40:28,319 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69dffeeeb70ef96924eadca6/lava-logs.yaml 2026-04-16 00:40:28,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:40:28,461 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:40:28,463 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69dffeeeb70ef96924eadca6/lava_callback.json.gz 2026-04-16 00:40:28,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:40:28,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dffeeeb70ef96924eadca6 HTTP/1.1" 200 None 2026-04-16 00:40:28,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:40:28,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69df49c106e8e7b15e9624ed HTTP/1.1" 200 None 2026-04-16 00:40:28,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:40:28,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dffeeeb70ef96924eadca6 HTTP/1.1" 200 None 2026-04-16 00:40:28,544 - lava_callback - INFO - Completed processing callback for node 69dffeeeb70ef96924eadca6 INFO: 172.21.0.1:40512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49336 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:40:37,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:40:37,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35352 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47812 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:41:37,116 - lava_callback - INFO - Received callback for node 69e02f111fb14b744a548cb2 INFO: 172.21.0.1:47820 - "POST /node/69e02f111fb14b744a548cb2 HTTP/1.0" 202 Accepted 2026-04-16 00:41:37,124 - lava_callback - INFO - Starting async job submit for node 69e02f111fb14b744a548cb2 2026-04-16 00:41:37,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:41:37,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02f111fb14b744a548cb2 HTTP/1.1" 200 None 2026-04-16 00:41:37,165 - lava_callback - DEBUG - Processing node 69e02f111fb14b744a548cb2: ltp-syscalls 2026-04-16 00:41:38,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:41:38,198 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:41:38,200 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-69e02f111fb14b744a548cb2/log.txt.gz 2026-04-16 00:41:38,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:41:38,998 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:41:39,000 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-69e02f111fb14b744a548cb2/lava-logs.yaml 2026-04-16 00:41:39,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:41:39,216 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:41:39,218 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-69e02f111fb14b744a548cb2/lava_callback.json.gz 2026-04-16 00:41:39,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:41:39,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02f111fb14b744a548cb2 HTTP/1.1" 200 None 2026-04-16 00:41:39,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:41:39,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 00:41:39,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:41:39,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e02f111fb14b744a548cb2 HTTP/1.1" 200 None 2026-04-16 00:41:39,302 - lava_callback - INFO - Completed processing callback for node 69e02f111fb14b744a548cb2 INFO: 172.21.0.1:48590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36340 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:41:57,453 - lava_callback - INFO - Received callback for node 69e02eda1fb14b744a548bd4 INFO: 172.21.0.1:36348 - "POST /node/69e02eda1fb14b744a548bd4 HTTP/1.0" 202 Accepted 2026-04-16 00:41:57,460 - lava_callback - INFO - Starting async job submit for node 69e02eda1fb14b744a548bd4 2026-04-16 00:41:57,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:41:57,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02eda1fb14b744a548bd4 HTTP/1.1" 200 None 2026-04-16 00:41:57,501 - lava_callback - DEBUG - Processing node 69e02eda1fb14b744a548bd4: baseline-arm-broonie 2026-04-16 00:41:57,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:41:57,909 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:41:57,911 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e02eda1fb14b744a548bd4/log.txt.gz 2026-04-16 00:41:58,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:41:58,227 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:41:58,229 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e02eda1fb14b744a548bd4/lava-logs.yaml 2026-04-16 00:41:58,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:41:58,373 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:41:58,375 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e02eda1fb14b744a548bd4/lava_callback.json.gz 2026-04-16 00:41:58,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:41:58,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02eda1fb14b744a548bd4 HTTP/1.1" 200 None 2026-04-16 00:41:58,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:41:58,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 00:41:58,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:41:58,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e02eda1fb14b744a548bd4 HTTP/1.1" 200 None 2026-04-16 00:41:58,465 - lava_callback - INFO - Completed processing callback for node 69e02eda1fb14b744a548bd4 INFO: 172.21.0.1:35408 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:42:06,971 - lava_callback - INFO - Received callback for node 69e030401fb14b744a548eaf INFO: 172.21.0.1:35424 - "POST /node/69e030401fb14b744a548eaf HTTP/1.0" 202 Accepted 2026-04-16 00:42:06,977 - lava_callback - INFO - Starting async job submit for node 69e030401fb14b744a548eaf 2026-04-16 00:42:06,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:42:07,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e030401fb14b744a548eaf HTTP/1.1" 200 None 2026-04-16 00:42:07,011 - lava_callback - DEBUG - Processing node 69e030401fb14b744a548eaf: baseline-x86 2026-04-16 00:42:07,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:42:07,296 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:42:07,297 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69e030401fb14b744a548eaf/log.txt.gz 2026-04-16 00:42:07,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:42:07,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:42:07,598 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:42:07,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-16 00:42:07,602 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69e030401fb14b744a548eaf/lava-logs.yaml 2026-04-16 00:42:07,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:42:07,734 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:42:07,736 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69e030401fb14b744a548eaf/lava_callback.json.gz 2026-04-16 00:42:07,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:42:07,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e030401fb14b744a548eaf HTTP/1.1" 200 None 2026-04-16 00:42:07,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:42:07,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a551fb14b744a5488c2 HTTP/1.1" 200 None 2026-04-16 00:42:07,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:42:07,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e030401fb14b744a548eaf HTTP/1.1" 200 None 2026-04-16 00:42:07,812 - lava_callback - INFO - Completed processing callback for node 69e030401fb14b744a548eaf INFO: 172.21.0.1:37164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37166 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:42:24,625 - lava_callback - INFO - Received callback for node 69e0303e1fb14b744a548ea6 INFO: 172.21.0.1:44018 - "POST /node/69e0303e1fb14b744a548ea6 HTTP/1.0" 202 Accepted 2026-04-16 00:42:24,631 - lava_callback - INFO - Starting async job submit for node 69e0303e1fb14b744a548ea6 2026-04-16 00:42:24,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:42:24,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0303e1fb14b744a548ea6 HTTP/1.1" 200 None 2026-04-16 00:42:24,665 - lava_callback - DEBUG - Processing node 69e0303e1fb14b744a548ea6: baseline-x86 2026-04-16 00:42:24,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:42:24,973 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:42:24,975 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69e0303e1fb14b744a548ea6/log.txt.gz 2026-04-16 00:42:25,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:42:25,281 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:42:25,284 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69e0303e1fb14b744a548ea6/lava-logs.yaml 2026-04-16 00:42:25,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:42:25,445 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:42:25,447 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69e0303e1fb14b744a548ea6/lava_callback.json.gz 2026-04-16 00:42:25,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:42:25,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0303e1fb14b744a548ea6 HTTP/1.1" 200 None 2026-04-16 00:42:25,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:42:25,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a551fb14b744a5488c2 HTTP/1.1" 200 None 2026-04-16 00:42:25,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:42:25,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e0303e1fb14b744a548ea6 HTTP/1.1" 200 None 2026-04-16 00:42:25,536 - lava_callback - INFO - Completed processing callback for node 69e0303e1fb14b744a548ea6 INFO: 172.21.0.1:44020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34934 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:42:37,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:42:37,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41982 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:42:55,172 - lava_callback - INFO - Received callback for node 69e0303e1fb14b744a548ea9 INFO: 172.21.0.1:40070 - "POST /node/69e0303e1fb14b744a548ea9 HTTP/1.0" 202 Accepted 2026-04-16 00:42:55,178 - lava_callback - INFO - Starting async job submit for node 69e0303e1fb14b744a548ea9 2026-04-16 00:42:55,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:42:55,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0303e1fb14b744a548ea9 HTTP/1.1" 200 None 2026-04-16 00:42:55,230 - lava_callback - DEBUG - Processing node 69e0303e1fb14b744a548ea9: baseline-x86 2026-04-16 00:42:55,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:42:55,660 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:42:55,662 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69e0303e1fb14b744a548ea9/log.txt.gz 2026-04-16 00:42:55,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:42:56,085 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:42:56,087 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69e0303e1fb14b744a548ea9/lava-logs.yaml 2026-04-16 00:42:56,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:42:56,244 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:42:56,246 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69e0303e1fb14b744a548ea9/lava_callback.json.gz 2026-04-16 00:42:56,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:42:56,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0303e1fb14b744a548ea9 HTTP/1.1" 200 None 2026-04-16 00:42:56,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:42:56,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a551fb14b744a5488c2 HTTP/1.1" 200 None 2026-04-16 00:42:56,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:42:56,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e0303e1fb14b744a548ea9 HTTP/1.1" 200 None 2026-04-16 00:42:56,364 - lava_callback - INFO - Completed processing callback for node 69e0303e1fb14b744a548ea9 INFO: 172.21.0.1:38606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38614 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:43:07,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:43:07,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-16 00:43:14,361 - lava_callback - INFO - Received callback for node 69e0303f1fb14b744a548eac INFO: 172.21.0.1:53152 - "POST /node/69e0303f1fb14b744a548eac HTTP/1.0" 202 Accepted 2026-04-16 00:43:14,367 - lava_callback - INFO - Starting async job submit for node 69e0303f1fb14b744a548eac 2026-04-16 00:43:14,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:43:14,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0303f1fb14b744a548eac HTTP/1.1" 200 None 2026-04-16 00:43:14,412 - lava_callback - DEBUG - Processing node 69e0303f1fb14b744a548eac: baseline-x86 2026-04-16 00:43:14,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:43:14,799 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:43:14,800 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69e0303f1fb14b744a548eac/log.txt.gz 2026-04-16 00:43:14,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:43:15,129 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:43:15,131 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69e0303f1fb14b744a548eac/lava-logs.yaml 2026-04-16 00:43:15,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:53156 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-16 00:43:15,276 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:43:15,277 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69e0303f1fb14b744a548eac/lava_callback.json.gz 2026-04-16 00:43:15,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:43:15,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0303f1fb14b744a548eac HTTP/1.1" 200 None 2026-04-16 00:43:15,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:43:15,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a551fb14b744a5488c2 HTTP/1.1" 200 None 2026-04-16 00:43:15,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:43:15,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e0303f1fb14b744a548eac HTTP/1.1" 200 None 2026-04-16 00:43:15,356 - lava_callback - INFO - Completed processing callback for node 69e0303f1fb14b744a548eac INFO: 172.21.0.1:53160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50650 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:43:28,356 - lava_callback - INFO - Received callback for node 69dd8d9ec2164e674d71f525 INFO: 172.21.0.1:50658 - "POST /node/69dd8d9ec2164e674d71f525 HTTP/1.0" 202 Accepted 2026-04-16 00:43:28,361 - lava_callback - INFO - Starting async job submit for node 69dd8d9ec2164e674d71f525 2026-04-16 00:43:28,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:43:28,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8d9ec2164e674d71f525 HTTP/1.1" 200 None 2026-04-16 00:43:28,378 - lava_callback - DEBUG - Processing node 69dd8d9ec2164e674d71f525: baseline-arm64-clabbe 2026-04-16 00:43:28,378 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd8d9ec2164e674d71f525 2026-04-16 00:43:28,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:43:28,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8d9ec2164e674d71f525 HTTP/1.1" 200 None 2026-04-16 00:43:28,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:43:28,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd171917c944d2f17d8b46 HTTP/1.1" 200 None 2026-04-16 00:43:28,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:43:28,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8d9ec2164e674d71f525 HTTP/1.1" 200 None 2026-04-16 00:43:28,437 - lava_callback - ERROR - Error processing callback for node 69dd8d9ec2164e674d71f525: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38642 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:43:37,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:43:37,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33002 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:44:28,382 - lava_callback - INFO - Received callback for node 69dd8de9c2164e674d71f583 INFO: 172.21.0.1:33010 - "POST /node/69dd8de9c2164e674d71f583 HTTP/1.0" 202 Accepted 2026-04-16 00:44:28,397 - lava_callback - INFO - Starting async job submit for node 69dd8de9c2164e674d71f583 2026-04-16 00:44:28,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:44:28,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8de9c2164e674d71f583 HTTP/1.1" 200 None 2026-04-16 00:44:28,438 - lava_callback - DEBUG - Processing node 69dd8de9c2164e674d71f583: baseline-arm64-clabbe 2026-04-16 00:44:28,438 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd8de9c2164e674d71f583 2026-04-16 00:44:28,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:44:28,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8de9c2164e674d71f583 HTTP/1.1" 200 None 2026-04-16 00:44:28,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:44:28,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd171917c944d2f17d8b46 HTTP/1.1" 200 None 2026-04-16 00:44:28,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:44:28,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8de9c2164e674d71f583 HTTP/1.1" 200 None 2026-04-16 00:44:28,539 - lava_callback - ERROR - Error processing callback for node 69dd8de9c2164e674d71f583: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44384 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50068 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:45:48,480 - lava_callback - INFO - Received callback for node 69dd8e32c2164e674d71f5f1 INFO: 172.21.0.1:50084 - "POST /node/69dd8e32c2164e674d71f5f1 HTTP/1.0" 202 Accepted 2026-04-16 00:45:48,489 - lava_callback - INFO - Starting async job submit for node 69dd8e32c2164e674d71f5f1 2026-04-16 00:45:48,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:45:48,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8e32c2164e674d71f5f1 HTTP/1.1" 200 None 2026-04-16 00:45:48,520 - lava_callback - DEBUG - Processing node 69dd8e32c2164e674d71f5f1: baseline-arm64-clabbe 2026-04-16 00:45:48,520 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd8e32c2164e674d71f5f1 2026-04-16 00:45:48,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:45:48,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8e32c2164e674d71f5f1 HTTP/1.1" 200 None 2026-04-16 00:45:48,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:45:48,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd171917c944d2f17d8b46 HTTP/1.1" 200 None 2026-04-16 00:45:48,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:45:48,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8e32c2164e674d71f5f1 HTTP/1.1" 200 None 2026-04-16 00:45:48,628 - lava_callback - ERROR - Error processing callback for node 69dd8e32c2164e674d71f5f1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42778 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:45:58,575 - lava_callback - INFO - Received callback for node 69e02efd1fb14b744a548c7e INFO: 172.21.0.1:42786 - "POST /node/69e02efd1fb14b744a548c7e HTTP/1.0" 202 Accepted 2026-04-16 00:45:58,585 - lava_callback - INFO - Starting async job submit for node 69e02efd1fb14b744a548c7e 2026-04-16 00:45:58,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:45:58,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02efd1fb14b744a548c7e HTTP/1.1" 200 None 2026-04-16 00:45:58,663 - lava_callback - DEBUG - Processing node 69e02efd1fb14b744a548c7e: ltp-cap_bounds 2026-04-16 00:45:59,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:45:59,698 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:45:59,700 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69e02efd1fb14b744a548c7e/log.txt.gz 2026-04-16 00:46:00,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:46:00,188 - lava_callback - INFO - Received callback for node 69e02f011fb14b744a548c92 INFO: 172.21.0.1:53616 - "POST /node/69e02f011fb14b744a548c92 HTTP/1.0" 202 Accepted 2026-04-16 00:46:00,203 - lava_callback - INFO - Starting async job submit for node 69e02f011fb14b744a548c92 2026-04-16 00:46:00,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:46:00,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02f011fb14b744a548c92 HTTP/1.1" 200 None 2026-04-16 00:46:00,293 - lava_callback - DEBUG - Processing node 69e02f011fb14b744a548c92: ltp-controllers 2026-04-16 00:46:00,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:46:01,019 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:46:01,022 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69e02efd1fb14b744a548c7e/lava-logs.yaml 2026-04-16 00:46:01,023 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:46:01,026 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-controllers-69e02f011fb14b744a548c92/log.txt.gz 2026-04-16 00:46:01,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:46:01,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:46:01,584 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:46:01,586 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69e02efd1fb14b744a548c7e/lava_callback.json.gz 2026-04-16 00:46:01,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:46:01,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02efd1fb14b744a548c7e HTTP/1.1" 200 None 2026-04-16 00:46:01,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:46:01,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 00:46:01,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:46:01,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e02efd1fb14b744a548c7e HTTP/1.1" 200 None 2026-04-16 00:46:01,761 - lava_callback - INFO - Completed processing callback for node 69e02efd1fb14b744a548c7e 2026-04-16 00:46:02,175 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:46:02,178 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-controllers-69e02f011fb14b744a548c92/lava-logs.yaml 2026-04-16 00:46:02,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:46:02,752 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:46:02,754 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-controllers-69e02f011fb14b744a548c92/lava_callback.json.gz 2026-04-16 00:46:02,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:46:02,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02f011fb14b744a548c92 HTTP/1.1" 200 None 2026-04-16 00:46:02,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:46:02,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 00:46:02,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:46:02,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e02f011fb14b744a548c92 HTTP/1.1" 200 None 2026-04-16 00:46:02,881 - lava_callback - INFO - Completed processing callback for node 69e02f011fb14b744a548c92 INFO: 172.21.0.1:53628 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:46:07,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:46:07,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43202 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:46:20,145 - lava_callback - INFO - Received callback for node 69e02f061fb14b744a548c9c INFO: 172.21.0.1:34552 - "POST /node/69e02f061fb14b744a548c9c HTTP/1.0" 202 Accepted 2026-04-16 00:46:20,151 - lava_callback - INFO - Starting async job submit for node 69e02f061fb14b744a548c9c 2026-04-16 00:46:20,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:46:20,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02f061fb14b744a548c9c HTTP/1.1" 200 None 2026-04-16 00:46:20,192 - lava_callback - DEBUG - Processing node 69e02f061fb14b744a548c9c: ltp-fs_bind 2026-04-16 00:46:20,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:46:20,746 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:46:20,748 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69e02f061fb14b744a548c9c/log.txt.gz 2026-04-16 00:46:20,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:46:21,208 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:46:21,210 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69e02f061fb14b744a548c9c/lava-logs.yaml 2026-04-16 00:46:21,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:46:21,407 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:46:21,409 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69e02f061fb14b744a548c9c/lava_callback.json.gz 2026-04-16 00:46:21,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:46:21,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02f061fb14b744a548c9c HTTP/1.1" 200 None 2026-04-16 00:46:21,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:46:21,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 00:46:21,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:46:21,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e02f061fb14b744a548c9c HTTP/1.1" 200 None 2026-04-16 00:46:21,495 - lava_callback - INFO - Completed processing callback for node 69e02f061fb14b744a548c9c INFO: 172.21.0.1:34568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46078 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:46:37,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:46:37,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60700 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:47:08,483 - lava_callback - INFO - Received callback for node 69dd8e79c2164e674d71f645 INFO: 172.21.0.1:60704 - "POST /node/69dd8e79c2164e674d71f645 HTTP/1.0" 202 Accepted 2026-04-16 00:47:08,489 - lava_callback - INFO - Starting async job submit for node 69dd8e79c2164e674d71f645 2026-04-16 00:47:08,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:47:08,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8e79c2164e674d71f645 HTTP/1.1" 200 None 2026-04-16 00:47:08,505 - lava_callback - DEBUG - Processing node 69dd8e79c2164e674d71f645: baseline-arm64-clabbe 2026-04-16 00:47:08,505 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd8e79c2164e674d71f645 2026-04-16 00:47:08,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:47:08,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8e79c2164e674d71f645 HTTP/1.1" 200 None 2026-04-16 00:47:08,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:47:08,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd171917c944d2f17d8b46 HTTP/1.1" 200 None 2026-04-16 00:47:08,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:47:08,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8e79c2164e674d71f645 HTTP/1.1" 200 None 2026-04-16 00:47:08,554 - lava_callback - ERROR - Error processing callback for node 69dd8e79c2164e674d71f645: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45868 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:47:39,422 - lava_callback - INFO - Received callback for node 69e0319e1fb14b744a549071 INFO: 172.21.0.1:45884 - "POST /node/69e0319e1fb14b744a549071 HTTP/1.0" 202 Accepted 2026-04-16 00:47:39,428 - lava_callback - INFO - Starting async job submit for node 69e0319e1fb14b744a549071 2026-04-16 00:47:39,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:47:39,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0319e1fb14b744a549071 HTTP/1.1" 200 None 2026-04-16 00:47:39,447 - lava_callback - DEBUG - Processing node 69e0319e1fb14b744a549071: baseline-arm 2026-04-16 00:47:39,452 - lava_callback - WARNING - Failed to upload log 2026-04-16 00:47:39,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:47:39,633 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:47:39,635 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e0319e1fb14b744a549071/lava-logs.yaml 2026-04-16 00:47:39,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:47:39,750 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:47:39,751 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e0319e1fb14b744a549071/lava_callback.json.gz 2026-04-16 00:47:39,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:47:39,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0319e1fb14b744a549071 HTTP/1.1" 200 None 2026-04-16 00:47:39,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:47:39,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 00:47:39,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:47:39,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e0319e1fb14b744a549071 HTTP/1.1" 200 None 2026-04-16 00:47:39,825 - lava_callback - INFO - Completed processing callback for node 69e0319e1fb14b744a549071 INFO: 172.21.0.1:47428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48336 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:48:07,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:48:07,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-16 00:48:08,576 - lava_callback - INFO - Received callback for node 69dd8ec4c2164e674d71f6be INFO: 172.21.0.1:48348 - "POST /node/69dd8ec4c2164e674d71f6be HTTP/1.0" 202 Accepted 2026-04-16 00:48:08,585 - lava_callback - INFO - Starting async job submit for node 69dd8ec4c2164e674d71f6be 2026-04-16 00:48:08,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:48:08,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8ec4c2164e674d71f6be HTTP/1.1" 200 None 2026-04-16 00:48:08,619 - lava_callback - DEBUG - Processing node 69dd8ec4c2164e674d71f6be: baseline-arm64-clabbe 2026-04-16 00:48:08,619 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd8ec4c2164e674d71f6be 2026-04-16 00:48:08,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:48:08,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8ec4c2164e674d71f6be HTTP/1.1" 200 None 2026-04-16 00:48:08,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:48:08,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd171917c944d2f17d8b46 HTTP/1.1" 200 None 2026-04-16 00:48:08,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:48:08,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8ec4c2164e674d71f6be HTTP/1.1" 200 None 2026-04-16 00:48:08,709 - lava_callback - ERROR - Error processing callback for node 69dd8ec4c2164e674d71f6be: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51454 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56922 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42060 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:49:28,635 - lava_callback - INFO - Received callback for node 69dd8f0fc2164e674d71f707 INFO: 172.21.0.1:42062 - "POST /node/69dd8f0fc2164e674d71f707 HTTP/1.0" 202 Accepted 2026-04-16 00:49:28,641 - lava_callback - INFO - Starting async job submit for node 69dd8f0fc2164e674d71f707 2026-04-16 00:49:28,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:49:28,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8f0fc2164e674d71f707 HTTP/1.1" 200 None 2026-04-16 00:49:28,656 - lava_callback - DEBUG - Processing node 69dd8f0fc2164e674d71f707: baseline-arm64-clabbe 2026-04-16 00:49:28,656 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd8f0fc2164e674d71f707 2026-04-16 00:49:28,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:49:28,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8f0fc2164e674d71f707 HTTP/1.1" 200 None 2026-04-16 00:49:28,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:49:28,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd171917c944d2f17d8b46 HTTP/1.1" 200 None 2026-04-16 00:49:28,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:49:28,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8f0fc2164e674d71f707 HTTP/1.1" 200 None 2026-04-16 00:49:28,712 - lava_callback - ERROR - Error processing callback for node 69dd8f0fc2164e674d71f707: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36522 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:49:57,401 - lava_callback - INFO - Received callback for node 69e02f0b1fb14b744a548ca5 INFO: 172.21.0.1:36524 - "POST /node/69e02f0b1fb14b744a548ca5 HTTP/1.0" 202 Accepted 2026-04-16 00:49:57,408 - lava_callback - INFO - Starting async job submit for node 69e02f0b1fb14b744a548ca5 2026-04-16 00:49:57,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:49:57,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02f0b1fb14b744a548ca5 HTTP/1.1" 200 None 2026-04-16 00:49:57,459 - lava_callback - DEBUG - Processing node 69e02f0b1fb14b744a548ca5: ltp-ipc 2026-04-16 00:49:57,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:49:58,275 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:49:58,276 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-ipc-69e02f0b1fb14b744a548ca5/log.txt.gz 2026-04-16 00:49:58,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:49:58,701 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:49:58,703 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-ipc-69e02f0b1fb14b744a548ca5/lava-logs.yaml 2026-04-16 00:49:58,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:49:58,890 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:49:58,892 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-ipc-69e02f0b1fb14b744a548ca5/lava_callback.json.gz 2026-04-16 00:49:58,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:49:58,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02f0b1fb14b744a548ca5 HTTP/1.1" 200 None 2026-04-16 00:49:58,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:49:58,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 00:49:58,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:49:58,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e02f0b1fb14b744a548ca5 HTTP/1.1" 200 None 2026-04-16 00:49:58,971 - lava_callback - INFO - Completed processing callback for node 69e02f0b1fb14b744a548ca5 INFO: 172.21.0.1:48048 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:50:07,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:50:07,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-16 00:50:10,759 - lava_callback - INFO - Received callback for node 69e030411fb14b744a548eb2 INFO: 172.21.0.1:59316 - "POST /node/69e030411fb14b744a548eb2 HTTP/1.0" 202 Accepted 2026-04-16 00:50:10,765 - lava_callback - INFO - Starting async job submit for node 69e030411fb14b744a548eb2 2026-04-16 00:50:10,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:50:10,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e030411fb14b744a548eb2 HTTP/1.1" 200 None 2026-04-16 00:50:10,798 - lava_callback - DEBUG - Processing node 69e030411fb14b744a548eb2: baseline-x86 2026-04-16 00:50:11,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:50:11,241 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:50:11,243 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69e030411fb14b744a548eb2/log.txt.gz 2026-04-16 00:50:11,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:50:11,607 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:50:11,609 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69e030411fb14b744a548eb2/lava-logs.yaml 2026-04-16 00:50:11,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:50:11,743 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:50:11,745 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69e030411fb14b744a548eb2/lava_callback.json.gz 2026-04-16 00:50:11,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:50:11,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e030411fb14b744a548eb2 HTTP/1.1" 200 None 2026-04-16 00:50:11,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:50:11,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a551fb14b744a5488c2 HTTP/1.1" 200 None 2026-04-16 00:50:11,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:50:11,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e030411fb14b744a548eb2 HTTP/1.1" 200 None 2026-04-16 00:50:11,822 - lava_callback - INFO - Completed processing callback for node 69e030411fb14b744a548eb2 INFO: 172.21.0.1:59320 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59330 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:50:17,618 - lava_callback - INFO - Received callback for node 69e02f091fb14b744a548ca2 INFO: 172.21.0.1:59338 - "POST /node/69e02f091fb14b744a548ca2 HTTP/1.0" 202 Accepted 2026-04-16 00:50:17,625 - lava_callback - INFO - Starting async job submit for node 69e02f091fb14b744a548ca2 2026-04-16 00:50:17,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:50:17,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02f091fb14b744a548ca2 HTTP/1.1" 200 None 2026-04-16 00:50:17,676 - lava_callback - DEBUG - Processing node 69e02f091fb14b744a548ca2: ltp-input 2026-04-16 00:50:18,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:50:18,201 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:50:18,202 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-input-69e02f091fb14b744a548ca2/log.txt.gz 2026-04-16 00:50:18,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:50:18,628 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:50:18,630 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-input-69e02f091fb14b744a548ca2/lava-logs.yaml 2026-04-16 00:50:18,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:50:18,813 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:50:18,815 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-input-69e02f091fb14b744a548ca2/lava_callback.json.gz 2026-04-16 00:50:18,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:50:18,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02f091fb14b744a548ca2 HTTP/1.1" 200 None 2026-04-16 00:50:18,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:50:18,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 00:50:18,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:50:18,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e02f091fb14b744a548ca2 HTTP/1.1" 200 None 2026-04-16 00:50:18,897 - lava_callback - INFO - Completed processing callback for node 69e02f091fb14b744a548ca2 2026-04-16 00:50:20,070 - lava_callback - INFO - Received callback for node 69e02f0c1fb14b744a548ca8 INFO: 172.21.0.1:59198 - "POST /node/69e02f0c1fb14b744a548ca8 HTTP/1.0" 202 Accepted 2026-04-16 00:50:20,076 - lava_callback - INFO - Starting async job submit for node 69e02f0c1fb14b744a548ca8 2026-04-16 00:50:20,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:50:20,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02f0c1fb14b744a548ca8 HTTP/1.1" 200 None 2026-04-16 00:50:20,117 - lava_callback - DEBUG - Processing node 69e02f0c1fb14b744a548ca8: ltp-pty 2026-04-16 00:50:20,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:50:20,583 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:50:20,585 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-pty-69e02f0c1fb14b744a548ca8/log.txt.gz 2026-04-16 00:50:20,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:50:21,039 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:50:21,041 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-pty-69e02f0c1fb14b744a548ca8/lava-logs.yaml 2026-04-16 00:50:21,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:50:21,214 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:50:21,215 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-pty-69e02f0c1fb14b744a548ca8/lava_callback.json.gz 2026-04-16 00:50:21,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:50:21,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02f0c1fb14b744a548ca8 HTTP/1.1" 200 None 2026-04-16 00:50:21,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:50:21,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 00:50:21,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:50:21,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e02f0c1fb14b744a548ca8 HTTP/1.1" 200 None 2026-04-16 00:50:21,298 - lava_callback - INFO - Completed processing callback for node 69e02f0c1fb14b744a548ca8 INFO: 172.21.0.1:59202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43762 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:50:37,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:50:37,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55444 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:50:48,711 - lava_callback - INFO - Received callback for node 69dd8f59c2164e674d71f74b INFO: 172.21.0.1:55448 - "POST /node/69dd8f59c2164e674d71f74b HTTP/1.0" 202 Accepted 2026-04-16 00:50:48,720 - lava_callback - INFO - Starting async job submit for node 69dd8f59c2164e674d71f74b 2026-04-16 00:50:48,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:50:48,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8f59c2164e674d71f74b HTTP/1.1" 200 None 2026-04-16 00:50:48,750 - lava_callback - DEBUG - Processing node 69dd8f59c2164e674d71f74b: baseline-arm64-clabbe 2026-04-16 00:50:48,751 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd8f59c2164e674d71f74b 2026-04-16 00:50:48,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:50:48,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8f59c2164e674d71f74b HTTP/1.1" 200 None 2026-04-16 00:50:48,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:50:48,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd171917c944d2f17d8b46 HTTP/1.1" 200 None 2026-04-16 00:50:48,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:50:48,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8f59c2164e674d71f74b HTTP/1.1" 200 None 2026-04-16 00:50:48,854 - lava_callback - ERROR - Error processing callback for node 69dd8f59c2164e674d71f74b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50458 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:50:57,512 - lava_callback - INFO - Received callback for node 69e02f101fb14b744a548caf INFO: 172.21.0.1:50460 - "POST /node/69e02f101fb14b744a548caf HTTP/1.0" 202 Accepted 2026-04-16 00:50:57,522 - lava_callback - INFO - Starting async job submit for node 69e02f101fb14b744a548caf 2026-04-16 00:50:57,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:50:57,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02f101fb14b744a548caf HTTP/1.1" 200 None 2026-04-16 00:50:57,662 - lava_callback - DEBUG - Processing node 69e02f101fb14b744a548caf: ltp-smoke 2026-04-16 00:50:58,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:50:58,547 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:50:58,549 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69e02f101fb14b744a548caf/log.txt.gz 2026-04-16 00:50:58,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:50:59,250 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:50:59,253 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69e02f101fb14b744a548caf/lava-logs.yaml 2026-04-16 00:50:59,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:50:59,401 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:50:59,403 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69e02f101fb14b744a548caf/lava_callback.json.gz 2026-04-16 00:50:59,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:50:59,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02f101fb14b744a548caf HTTP/1.1" 200 None 2026-04-16 00:50:59,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:50:59,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 00:50:59,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:50:59,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e02f101fb14b744a548caf HTTP/1.1" 200 None 2026-04-16 00:50:59,526 - lava_callback - INFO - Completed processing callback for node 69e02f101fb14b744a548caf INFO: 172.21.0.1:59456 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:51:07,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:51:07,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38040 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52984 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:51:28,788 - lava_callback - INFO - Received callback for node 69dfdc248aa6875c96aff0a5 INFO: 172.21.0.1:52998 - "POST /node/69dfdc248aa6875c96aff0a5 HTTP/1.0" 202 Accepted 2026-04-16 00:51:28,799 - lava_callback - INFO - Starting async job submit for node 69dfdc248aa6875c96aff0a5 2026-04-16 00:51:28,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:51:28,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dfdc248aa6875c96aff0a5 HTTP/1.1" 200 None 2026-04-16 00:51:28,884 - lava_callback - DEBUG - Processing node 69dfdc248aa6875c96aff0a5: baseline-x86 INFO: 172.21.0.1:53012 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:51:29,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:51:30,095 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:51:30,097 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69dfdc248aa6875c96aff0a5/log.txt.gz 2026-04-16 00:51:30,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:51:30,940 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:51:30,942 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69dfdc248aa6875c96aff0a5/lava-logs.yaml 2026-04-16 00:51:30,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:51:31,411 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:51:31,413 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69dfdc248aa6875c96aff0a5/lava_callback.json.gz 2026-04-16 00:51:31,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:51:31,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dfdc248aa6875c96aff0a5 HTTP/1.1" 200 None 2026-04-16 00:51:31,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:51:31,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ded961f490930782fb6e47 HTTP/1.1" 200 None 2026-04-16 00:51:31,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:51:31,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dfdc248aa6875c96aff0a5 HTTP/1.1" 200 None 2026-04-16 00:51:31,507 - lava_callback - INFO - Completed processing callback for node 69dfdc248aa6875c96aff0a5 INFO: 172.21.0.1:59012 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:51:37,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:51:37,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54504 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:52:05,110 - lava_callback - INFO - Received callback for node 69e02ecb1fb14b744a548ba5 INFO: 172.21.0.1:43676 - "POST /node/69e02ecb1fb14b744a548ba5 HTTP/1.0" 202 Accepted 2026-04-16 00:52:05,122 - lava_callback - INFO - Starting async job submit for node 69e02ecb1fb14b744a548ba5 2026-04-16 00:52:05,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:52:05,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02ecb1fb14b744a548ba5 HTTP/1.1" 200 None 2026-04-16 00:52:05,289 - lava_callback - DEBUG - Processing node 69e02ecb1fb14b744a548ba5: baseline-arm 2026-04-16 00:52:06,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:52:06,302 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:52:06,304 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e02ecb1fb14b744a548ba5/log.txt.gz INFO: 172.21.0.1:43688 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:52:06,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:52:07,066 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:52:07,069 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e02ecb1fb14b744a548ba5/lava-logs.yaml 2026-04-16 00:52:07,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:52:07,521 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:52:07,523 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e02ecb1fb14b744a548ba5/lava_callback.json.gz DEBUG: Setup failed for 69e02ecb1fb14b744a548ba5. Transitting job node result: incomplete -> fail 2026-04-16 00:52:07,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:52:07,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02ecb1fb14b744a548ba5 HTTP/1.1" 200 None 2026-04-16 00:52:07,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:52:07,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 00:52:07,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:52:07,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e02ecb1fb14b744a548ba5 HTTP/1.1" 200 None 2026-04-16 00:52:07,807 - lava_callback - INFO - Completed processing callback for node 69e02ecb1fb14b744a548ba5 2026-04-16 00:52:07,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:52:07,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-16 00:52:13,585 - lava_callback - INFO - Received callback for node 69dd8fb0c2164e674d71f7b7 INFO: 172.21.0.1:46186 - "POST /node/69dd8fb0c2164e674d71f7b7 HTTP/1.0" 202 Accepted 2026-04-16 00:52:13,592 - lava_callback - INFO - Starting async job submit for node 69dd8fb0c2164e674d71f7b7 2026-04-16 00:52:13,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:52:13,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8fb0c2164e674d71f7b7 HTTP/1.1" 200 None 2026-04-16 00:52:13,608 - lava_callback - DEBUG - Processing node 69dd8fb0c2164e674d71f7b7: baseline-arm-baylibre 2026-04-16 00:52:13,608 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd8fb0c2164e674d71f7b7 2026-04-16 00:52:13,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:52:13,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8fb0c2164e674d71f7b7 HTTP/1.1" 200 None 2026-04-16 00:52:13,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:52:13,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 00:52:13,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:52:13,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8fb0c2164e674d71f7b7 HTTP/1.1" 200 None 2026-04-16 00:52:13,663 - lava_callback - ERROR - Error processing callback for node 69dd8fb0c2164e674d71f7b7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52680 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:52:53,580 - lava_callback - INFO - Received callback for node 69dd8fd4c2164e674d71f7fd INFO: 172.21.0.1:41000 - "POST /node/69dd8fd4c2164e674d71f7fd HTTP/1.0" 202 Accepted 2026-04-16 00:52:53,586 - lava_callback - INFO - Starting async job submit for node 69dd8fd4c2164e674d71f7fd 2026-04-16 00:52:53,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:52:53,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8fd4c2164e674d71f7fd HTTP/1.1" 200 None 2026-04-16 00:52:53,601 - lava_callback - DEBUG - Processing node 69dd8fd4c2164e674d71f7fd: baseline-arm-baylibre 2026-04-16 00:52:53,601 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd8fd4c2164e674d71f7fd 2026-04-16 00:52:53,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:52:53,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8fd4c2164e674d71f7fd HTTP/1.1" 200 None 2026-04-16 00:52:53,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:52:53,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 00:52:53,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:52:53,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8fd4c2164e674d71f7fd HTTP/1.1" 200 None 2026-04-16 00:52:53,649 - lava_callback - ERROR - Error processing callback for node 69dd8fd4c2164e674d71f7fd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55512 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:53:13,610 - lava_callback - INFO - Received callback for node 69dd8ff5c2164e674d71f842 INFO: 172.21.0.1:39640 - "POST /node/69dd8ff5c2164e674d71f842 HTTP/1.0" 202 Accepted 2026-04-16 00:53:13,618 - lava_callback - INFO - Starting async job submit for node 69dd8ff5c2164e674d71f842 2026-04-16 00:53:13,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:53:13,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8ff5c2164e674d71f842 HTTP/1.1" 200 None 2026-04-16 00:53:13,639 - lava_callback - DEBUG - Processing node 69dd8ff5c2164e674d71f842: baseline-arm-baylibre 2026-04-16 00:53:13,639 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd8ff5c2164e674d71f842 2026-04-16 00:53:13,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:53:13,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd8ff5c2164e674d71f842 HTTP/1.1" 200 None 2026-04-16 00:53:13,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:53:13,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 00:53:13,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:53:13,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd8ff5c2164e674d71f842 HTTP/1.1" 200 None 2026-04-16 00:53:13,697 - lava_callback - ERROR - Error processing callback for node 69dd8ff5c2164e674d71f842: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39646 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37368 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:53:53,601 - lava_callback - INFO - Received callback for node 69dd9019c2164e674d71f8cb INFO: 172.21.0.1:36428 - "POST /node/69dd9019c2164e674d71f8cb HTTP/1.0" 202 Accepted 2026-04-16 00:53:53,610 - lava_callback - INFO - Starting async job submit for node 69dd9019c2164e674d71f8cb 2026-04-16 00:53:53,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:53:53,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9019c2164e674d71f8cb HTTP/1.1" 200 None 2026-04-16 00:53:53,627 - lava_callback - DEBUG - Processing node 69dd9019c2164e674d71f8cb: baseline-arm-baylibre 2026-04-16 00:53:53,627 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9019c2164e674d71f8cb 2026-04-16 00:53:53,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:53:53,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9019c2164e674d71f8cb HTTP/1.1" 200 None 2026-04-16 00:53:53,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:53:53,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-16 00:53:53,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:53:53,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9019c2164e674d71f8cb HTTP/1.1" 200 None 2026-04-16 00:53:53,679 - lava_callback - ERROR - Error processing callback for node 69dd9019c2164e674d71f8cb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 00:53:54,298 - lava_callback - INFO - Received callback for node 69dd901cc2164e674d71f8cf INFO: 172.21.0.1:36438 - "POST /node/69dd901cc2164e674d71f8cf HTTP/1.0" 202 Accepted 2026-04-16 00:53:54,308 - lava_callback - INFO - Starting async job submit for node 69dd901cc2164e674d71f8cf 2026-04-16 00:53:54,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:53:54,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd901cc2164e674d71f8cf HTTP/1.1" 200 None 2026-04-16 00:53:54,332 - lava_callback - DEBUG - Processing node 69dd901cc2164e674d71f8cf: baseline-arm64-baylibre 2026-04-16 00:53:54,333 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd901cc2164e674d71f8cf 2026-04-16 00:53:54,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:53:54,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd901cc2164e674d71f8cf HTTP/1.1" 200 None 2026-04-16 00:53:54,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:53:54,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-16 00:53:54,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:53:54,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd901cc2164e674d71f8cf HTTP/1.1" 200 None 2026-04-16 00:53:54,398 - lava_callback - ERROR - Error processing callback for node 69dd901cc2164e674d71f8cf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 00:53:54,975 - lava_callback - INFO - Received callback for node 69dd901dc2164e674d71f8d2 INFO: 172.21.0.1:36446 - "POST /node/69dd901dc2164e674d71f8d2 HTTP/1.0" 202 Accepted 2026-04-16 00:53:54,982 - lava_callback - INFO - Starting async job submit for node 69dd901dc2164e674d71f8d2 2026-04-16 00:53:54,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:53:54,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd901dc2164e674d71f8d2 HTTP/1.1" 200 None 2026-04-16 00:53:54,997 - lava_callback - DEBUG - Processing node 69dd901dc2164e674d71f8d2: baseline-arm64-baylibre 2026-04-16 00:53:54,997 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd901dc2164e674d71f8d2 2026-04-16 00:53:54,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:53:55,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd901dc2164e674d71f8d2 HTTP/1.1" 200 None 2026-04-16 00:53:55,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:53:55,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-16 00:53:55,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:53:55,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd901dc2164e674d71f8d2 HTTP/1.1" 200 None 2026-04-16 00:53:55,050 - lava_callback - ERROR - Error processing callback for node 69dd901dc2164e674d71f8d2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36450 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:53:57,535 - lava_callback - INFO - Received callback for node 69e02f131fb14b744a548cb5 INFO: 172.21.0.1:36460 - "POST /node/69e02f131fb14b744a548cb5 HTTP/1.0" 202 Accepted 2026-04-16 00:53:57,545 - lava_callback - INFO - Starting async job submit for node 69e02f131fb14b744a548cb5 2026-04-16 00:53:57,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:53:57,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02f131fb14b744a548cb5 HTTP/1.1" 200 None 2026-04-16 00:53:57,590 - lava_callback - DEBUG - Processing node 69e02f131fb14b744a548cb5: ltp-syscalls-ipc 2026-04-16 00:53:58,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:53:58,187 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:53:58,189 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69e02f131fb14b744a548cb5/log.txt.gz 2026-04-16 00:53:58,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:53:58,687 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:53:58,689 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69e02f131fb14b744a548cb5/lava-logs.yaml 2026-04-16 00:53:58,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:53:58,903 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:53:58,905 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69e02f131fb14b744a548cb5/lava_callback.json.gz 2026-04-16 00:53:58,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:53:58,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02f131fb14b744a548cb5 HTTP/1.1" 200 None 2026-04-16 00:53:58,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:53:58,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 00:53:58,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:53:58,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e02f131fb14b744a548cb5 HTTP/1.1" 200 None 2026-04-16 00:53:59,001 - lava_callback - INFO - Completed processing callback for node 69e02f131fb14b744a548cb5 INFO: 172.21.0.1:43536 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:54:07,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:07,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-16 00:54:13,603 - lava_callback - INFO - Received callback for node 69dd9021c2164e674d71f8d9 INFO: 172.21.0.1:37946 - "POST /node/69dd9021c2164e674d71f8d9 HTTP/1.0" 202 Accepted 2026-04-16 00:54:13,608 - lava_callback - INFO - Starting async job submit for node 69dd9021c2164e674d71f8d9 2026-04-16 00:54:13,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:13,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9021c2164e674d71f8d9 HTTP/1.1" 200 None 2026-04-16 00:54:13,624 - lava_callback - DEBUG - Processing node 69dd9021c2164e674d71f8d9: baseline-arm64-baylibre 2026-04-16 00:54:13,625 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9021c2164e674d71f8d9 2026-04-16 00:54:13,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:13,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9021c2164e674d71f8d9 HTTP/1.1" 200 None 2026-04-16 00:54:13,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:13,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-16 00:54:13,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:13,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9021c2164e674d71f8d9 HTTP/1.1" 200 None 2026-04-16 00:54:13,681 - lava_callback - ERROR - Error processing callback for node 69dd9021c2164e674d71f8d9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37974 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:54:20,283 - lava_callback - INFO - Received callback for node 69e02f161fb14b744a548cc5 INFO: 172.21.0.1:42380 - "POST /node/69e02f161fb14b744a548cc5 HTTP/1.0" 202 Accepted 2026-04-16 00:54:20,291 - lava_callback - INFO - Starting async job submit for node 69e02f161fb14b744a548cc5 2026-04-16 00:54:20,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:20,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02f161fb14b744a548cc5 HTTP/1.1" 200 None 2026-04-16 00:54:20,338 - lava_callback - DEBUG - Processing node 69e02f161fb14b744a548cc5: ltp-watchqueue 2026-04-16 00:54:20,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:54:20,917 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:54:20,918 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69e02f161fb14b744a548cc5/log.txt.gz 2026-04-16 00:54:21,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:54:21,339 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:54:21,341 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69e02f161fb14b744a548cc5/lava-logs.yaml 2026-04-16 00:54:21,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:54:21,506 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:54:21,507 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69e02f161fb14b744a548cc5/lava_callback.json.gz 2026-04-16 00:54:21,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:21,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02f161fb14b744a548cc5 HTTP/1.1" 200 None 2026-04-16 00:54:21,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:21,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 00:54:21,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:21,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e02f161fb14b744a548cc5 HTTP/1.1" 200 None 2026-04-16 00:54:21,590 - lava_callback - INFO - Completed processing callback for node 69e02f161fb14b744a548cc5 INFO: 172.21.0.1:42394 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:54:28,891 - lava_callback - INFO - Received callback for node 69dd9032c2164e674d71f949 INFO: 172.21.0.1:42402 - "POST /node/69dd9032c2164e674d71f949 HTTP/1.0" 202 Accepted 2026-04-16 00:54:28,897 - lava_callback - INFO - Starting async job submit for node 69dd9032c2164e674d71f949 2026-04-16 00:54:28,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:28,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9032c2164e674d71f949 HTTP/1.1" 200 None 2026-04-16 00:54:28,916 - lava_callback - DEBUG - Processing node 69dd9032c2164e674d71f949: baseline-arm64-clabbe 2026-04-16 00:54:28,916 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9032c2164e674d71f949 2026-04-16 00:54:28,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:28,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9032c2164e674d71f949 HTTP/1.1" 200 None 2026-04-16 00:54:28,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:28,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-16 00:54:28,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:28,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9032c2164e674d71f949 HTTP/1.1" 200 None 2026-04-16 00:54:28,980 - lava_callback - ERROR - Error processing callback for node 69dd9032c2164e674d71f949: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42412 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:54:29,583 - lava_callback - INFO - Received callback for node 69dd9034c2164e674d71f94d INFO: 172.21.0.1:42424 - "POST /node/69dd9034c2164e674d71f94d HTTP/1.0" 202 Accepted 2026-04-16 00:54:29,589 - lava_callback - INFO - Starting async job submit for node 69dd9034c2164e674d71f94d 2026-04-16 00:54:29,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:29,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9034c2164e674d71f94d HTTP/1.1" 200 None 2026-04-16 00:54:29,604 - lava_callback - DEBUG - Processing node 69dd9034c2164e674d71f94d: baseline-arm64-clabbe 2026-04-16 00:54:29,605 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9034c2164e674d71f94d 2026-04-16 00:54:29,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:29,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9034c2164e674d71f94d HTTP/1.1" 200 None 2026-04-16 00:54:29,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:29,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-16 00:54:29,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:29,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9034c2164e674d71f94d HTTP/1.1" 200 None 2026-04-16 00:54:29,653 - lava_callback - ERROR - Error processing callback for node 69dd9034c2164e674d71f94d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 00:54:30,270 - lava_callback - INFO - Received callback for node 69dd9034c2164e674d71f950 INFO: 172.21.0.1:41990 - "POST /node/69dd9034c2164e674d71f950 HTTP/1.0" 202 Accepted 2026-04-16 00:54:30,275 - lava_callback - INFO - Starting async job submit for node 69dd9034c2164e674d71f950 2026-04-16 00:54:30,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:30,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9034c2164e674d71f950 HTTP/1.1" 200 None 2026-04-16 00:54:30,314 - lava_callback - DEBUG - Processing node 69dd9034c2164e674d71f950: baseline-arm64-clabbe 2026-04-16 00:54:30,314 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9034c2164e674d71f950 2026-04-16 00:54:30,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:30,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9034c2164e674d71f950 HTTP/1.1" 200 None 2026-04-16 00:54:30,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:30,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-16 00:54:30,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:30,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9034c2164e674d71f950 HTTP/1.1" 200 None 2026-04-16 00:54:30,363 - lava_callback - ERROR - Error processing callback for node 69dd9034c2164e674d71f950: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 00:54:30,960 - lava_callback - INFO - Received callback for node 69dd9035c2164e674d71f953 INFO: 172.21.0.1:42006 - "POST /node/69dd9035c2164e674d71f953 HTTP/1.0" 202 Accepted 2026-04-16 00:54:30,966 - lava_callback - INFO - Starting async job submit for node 69dd9035c2164e674d71f953 2026-04-16 00:54:30,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:30,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9035c2164e674d71f953 HTTP/1.1" 200 None 2026-04-16 00:54:30,982 - lava_callback - DEBUG - Processing node 69dd9035c2164e674d71f953: baseline-arm64-clabbe 2026-04-16 00:54:30,982 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9035c2164e674d71f953 2026-04-16 00:54:30,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:30,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9035c2164e674d71f953 HTTP/1.1" 200 None 2026-04-16 00:54:30,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:31,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-16 00:54:31,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:31,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9035c2164e674d71f953 HTTP/1.1" 200 None 2026-04-16 00:54:31,033 - lava_callback - ERROR - Error processing callback for node 69dd9035c2164e674d71f953: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 00:54:31,637 - lava_callback - INFO - Received callback for node 69dd9036c2164e674d71f956 INFO: 172.21.0.1:42012 - "POST /node/69dd9036c2164e674d71f956 HTTP/1.0" 202 Accepted 2026-04-16 00:54:31,643 - lava_callback - INFO - Starting async job submit for node 69dd9036c2164e674d71f956 2026-04-16 00:54:31,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:31,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9036c2164e674d71f956 HTTP/1.1" 200 None 2026-04-16 00:54:31,661 - lava_callback - DEBUG - Processing node 69dd9036c2164e674d71f956: baseline-arm64-clabbe 2026-04-16 00:54:31,661 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9036c2164e674d71f956 2026-04-16 00:54:31,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:31,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9036c2164e674d71f956 HTTP/1.1" 200 None 2026-04-16 00:54:31,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:31,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-16 00:54:31,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:31,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9036c2164e674d71f956 HTTP/1.1" 200 None 2026-04-16 00:54:31,712 - lava_callback - ERROR - Error processing callback for node 69dd9036c2164e674d71f956: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 00:54:32,306 - lava_callback - INFO - Received callback for node 69dd9038c2164e674d71f95c INFO: 172.21.0.1:42016 - "POST /node/69dd9038c2164e674d71f95c HTTP/1.0" 202 Accepted 2026-04-16 00:54:32,312 - lava_callback - INFO - Starting async job submit for node 69dd9038c2164e674d71f95c 2026-04-16 00:54:32,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:32,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9038c2164e674d71f95c HTTP/1.1" 200 None 2026-04-16 00:54:32,331 - lava_callback - DEBUG - Processing node 69dd9038c2164e674d71f95c: baseline-arm64-clabbe 2026-04-16 00:54:32,331 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9038c2164e674d71f95c 2026-04-16 00:54:32,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:32,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9038c2164e674d71f95c HTTP/1.1" 200 None 2026-04-16 00:54:32,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:32,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-16 00:54:32,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:32,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9038c2164e674d71f95c HTTP/1.1" 200 None 2026-04-16 00:54:32,400 - lava_callback - ERROR - Error processing callback for node 69dd9038c2164e674d71f95c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 00:54:32,992 - lava_callback - INFO - Received callback for node 69dd9037c2164e674d71f959 INFO: 172.21.0.1:42032 - "POST /node/69dd9037c2164e674d71f959 HTTP/1.0" 202 Accepted 2026-04-16 00:54:32,998 - lava_callback - INFO - Starting async job submit for node 69dd9037c2164e674d71f959 2026-04-16 00:54:32,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:33,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9037c2164e674d71f959 HTTP/1.1" 200 None 2026-04-16 00:54:33,021 - lava_callback - DEBUG - Processing node 69dd9037c2164e674d71f959: baseline-arm64-clabbe 2026-04-16 00:54:33,021 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9037c2164e674d71f959 2026-04-16 00:54:33,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:33,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9037c2164e674d71f959 HTTP/1.1" 200 None 2026-04-16 00:54:33,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:33,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-16 00:54:33,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:33,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9037c2164e674d71f959 HTTP/1.1" 200 None 2026-04-16 00:54:33,085 - lava_callback - ERROR - Error processing callback for node 69dd9037c2164e674d71f959: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 00:54:33,664 - lava_callback - INFO - Received callback for node 69dd903dc2164e674d71f96a INFO: 172.21.0.1:42042 - "POST /node/69dd903dc2164e674d71f96a HTTP/1.0" 202 Accepted 2026-04-16 00:54:33,673 - lava_callback - INFO - Starting async job submit for node 69dd903dc2164e674d71f96a 2026-04-16 00:54:33,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:33,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd903dc2164e674d71f96a HTTP/1.1" 200 None 2026-04-16 00:54:33,699 - lava_callback - DEBUG - Processing node 69dd903dc2164e674d71f96a: baseline-arm-baylibre 2026-04-16 00:54:33,699 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd903dc2164e674d71f96a 2026-04-16 00:54:33,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:33,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd903dc2164e674d71f96a HTTP/1.1" 200 None 2026-04-16 00:54:33,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:33,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-16 00:54:33,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:33,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd903dc2164e674d71f96a HTTP/1.1" 200 None 2026-04-16 00:54:33,749 - lava_callback - ERROR - Error processing callback for node 69dd903dc2164e674d71f96a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42050 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:54:37,533 - lava_callback - INFO - Received callback for node 69e02f151fb14b744a548cb8 INFO: 172.21.0.1:42056 - "POST /node/69e02f151fb14b744a548cb8 HTTP/1.0" 202 Accepted 2026-04-16 00:54:37,540 - lava_callback - INFO - Starting async job submit for node 69e02f151fb14b744a548cb8 2026-04-16 00:54:37,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:37,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02f151fb14b744a548cb8 HTTP/1.1" 200 None 2026-04-16 00:54:37,592 - lava_callback - DEBUG - Processing node 69e02f151fb14b744a548cb8: ltp-timers 2026-04-16 00:54:37,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:37,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:54:37,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-16 00:54:38,135 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:54:38,137 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-timers-69e02f151fb14b744a548cb8/log.txt.gz 2026-04-16 00:54:38,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:54:38,595 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:54:38,597 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-timers-69e02f151fb14b744a548cb8/lava-logs.yaml 2026-04-16 00:54:38,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:54:38,810 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:54:38,812 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-timers-69e02f151fb14b744a548cb8/lava_callback.json.gz 2026-04-16 00:54:38,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:38,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02f151fb14b744a548cb8 HTTP/1.1" 200 None 2026-04-16 00:54:38,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:38,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 00:54:38,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:54:38,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e02f151fb14b744a548cb8 HTTP/1.1" 200 None 2026-04-16 00:54:38,915 - lava_callback - INFO - Completed processing callback for node 69e02f151fb14b744a548cb8 INFO: 172.21.0.1:40588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54422 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:55:07,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:55:07,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52166 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58410 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:55:33,666 - lava_callback - INFO - Received callback for node 69dd9081c2164e674d71fa40 INFO: 172.21.0.1:39500 - "POST /node/69dd9081c2164e674d71fa40 HTTP/1.0" 202 Accepted 2026-04-16 00:55:33,671 - lava_callback - INFO - Starting async job submit for node 69dd9081c2164e674d71fa40 2026-04-16 00:55:33,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:55:33,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9081c2164e674d71fa40 HTTP/1.1" 200 None 2026-04-16 00:55:33,688 - lava_callback - DEBUG - Processing node 69dd9081c2164e674d71fa40: baseline-arm-baylibre 2026-04-16 00:55:33,688 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9081c2164e674d71fa40 2026-04-16 00:55:33,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:55:33,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9081c2164e674d71fa40 HTTP/1.1" 200 None 2026-04-16 00:55:33,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:55:33,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-16 00:55:33,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:55:33,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9081c2164e674d71fa40 HTTP/1.1" 200 None 2026-04-16 00:55:33,737 - lava_callback - ERROR - Error processing callback for node 69dd9081c2164e674d71fa40: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53472 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45098 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:56:28,950 - lava_callback - INFO - Received callback for node 69dd90acc2164e674d71fab3 INFO: 172.21.0.1:45108 - "POST /node/69dd90acc2164e674d71fab3 HTTP/1.0" 202 Accepted 2026-04-16 00:56:28,956 - lava_callback - INFO - Starting async job submit for node 69dd90acc2164e674d71fab3 2026-04-16 00:56:28,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:56:28,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd90acc2164e674d71fab3 HTTP/1.1" 200 None 2026-04-16 00:56:28,972 - lava_callback - DEBUG - Processing node 69dd90acc2164e674d71fab3: baseline-arm-clabbe 2026-04-16 00:56:28,973 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd90acc2164e674d71fab3 2026-04-16 00:56:28,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:56:28,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd90acc2164e674d71fab3 HTTP/1.1" 200 None 2026-04-16 00:56:28,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:56:29,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-16 00:56:29,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:56:29,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd90acc2164e674d71fab3 HTTP/1.1" 200 None 2026-04-16 00:56:29,037 - lava_callback - ERROR - Error processing callback for node 69dd90acc2164e674d71fab3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42460 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:57:08,945 - lava_callback - INFO - Received callback for node 69dd90d4c2164e674d71faf3 INFO: 172.21.0.1:42464 - "POST /node/69dd90d4c2164e674d71faf3 HTTP/1.0" 202 Accepted 2026-04-16 00:57:08,953 - lava_callback - INFO - Starting async job submit for node 69dd90d4c2164e674d71faf3 2026-04-16 00:57:08,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:57:08,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd90d4c2164e674d71faf3 HTTP/1.1" 200 None 2026-04-16 00:57:08,978 - lava_callback - DEBUG - Processing node 69dd90d4c2164e674d71faf3: baseline-arm-clabbe 2026-04-16 00:57:08,978 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd90d4c2164e674d71faf3 2026-04-16 00:57:08,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:57:09,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd90d4c2164e674d71faf3 HTTP/1.1" 200 None 2026-04-16 00:57:09,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:57:09,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 00:57:09,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:57:09,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd90d4c2164e674d71faf3 HTTP/1.1" 200 None 2026-04-16 00:57:09,067 - lava_callback - ERROR - Error processing callback for node 69dd90d4c2164e674d71faf3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36020 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:57:40,366 - lava_callback - INFO - Received callback for node 69e02f1a1fb14b744a548ccb INFO: 172.21.0.1:44640 - "POST /node/69e02f1a1fb14b744a548ccb HTTP/1.0" 202 Accepted 2026-04-16 00:57:40,378 - lava_callback - INFO - Starting async job submit for node 69e02f1a1fb14b744a548ccb 2026-04-16 00:57:40,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:57:40,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02f1a1fb14b744a548ccb HTTP/1.1" 200 None 2026-04-16 00:57:40,511 - lava_callback - DEBUG - Processing node 69e02f1a1fb14b744a548ccb: ltp-smoke 2026-04-16 00:57:41,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:57:41,453 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:57:41,455 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69e02f1a1fb14b744a548ccb/log.txt.gz 2026-04-16 00:57:41,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:57:42,353 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:57:42,356 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69e02f1a1fb14b744a548ccb/lava-logs.yaml 2026-04-16 00:57:42,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 00:57:42,508 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 00:57:42,510 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69e02f1a1fb14b744a548ccb/lava_callback.json.gz 2026-04-16 00:57:42,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:57:42,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02f1a1fb14b744a548ccb HTTP/1.1" 200 None 2026-04-16 00:57:42,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:57:42,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a2e1fb14b744a54889b HTTP/1.1" 200 None 2026-04-16 00:57:42,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:57:42,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e02f1a1fb14b744a548ccb HTTP/1.1" 200 None 2026-04-16 00:57:42,941 - lava_callback - INFO - Completed processing callback for node 69e02f1a1fb14b744a548ccb INFO: 172.21.0.1:44644 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:57:49,022 - lava_callback - INFO - Received callback for node 69dd90f9c2164e674d71fb14 INFO: 172.21.0.1:44652 - "POST /node/69dd90f9c2164e674d71fb14 HTTP/1.0" 202 Accepted 2026-04-16 00:57:49,028 - lava_callback - INFO - Starting async job submit for node 69dd90f9c2164e674d71fb14 2026-04-16 00:57:49,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:57:49,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd90f9c2164e674d71fb14 HTTP/1.1" 200 None 2026-04-16 00:57:49,044 - lava_callback - DEBUG - Processing node 69dd90f9c2164e674d71fb14: baseline-arm-clabbe 2026-04-16 00:57:49,044 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd90f9c2164e674d71fb14 2026-04-16 00:57:49,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:57:49,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd90f9c2164e674d71fb14 HTTP/1.1" 200 None 2026-04-16 00:57:49,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:57:49,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-16 00:57:49,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:57:49,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd90f9c2164e674d71fb14 HTTP/1.1" 200 None 2026-04-16 00:57:49,117 - lava_callback - ERROR - Error processing callback for node 69dd90f9c2164e674d71fb14: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42616 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:58:07,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:58:08,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-16 00:58:09,022 - lava_callback - INFO - Received callback for node 69dd911ec2164e674d71fb50 INFO: 172.21.0.1:42626 - "POST /node/69dd911ec2164e674d71fb50 HTTP/1.0" 202 Accepted 2026-04-16 00:58:09,031 - lava_callback - INFO - Starting async job submit for node 69dd911ec2164e674d71fb50 2026-04-16 00:58:09,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:58:09,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd911ec2164e674d71fb50 HTTP/1.1" 200 None 2026-04-16 00:58:09,049 - lava_callback - DEBUG - Processing node 69dd911ec2164e674d71fb50: baseline-arm-clabbe 2026-04-16 00:58:09,050 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd911ec2164e674d71fb50 2026-04-16 00:58:09,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:58:09,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd911ec2164e674d71fb50 HTTP/1.1" 200 None 2026-04-16 00:58:09,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:58:09,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-16 00:58:09,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:58:09,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd911ec2164e674d71fb50 HTTP/1.1" 200 None 2026-04-16 00:58:09,109 - lava_callback - ERROR - Error processing callback for node 69dd911ec2164e674d71fb50: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33226 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:58:49,022 - lava_callback - INFO - Received callback for node 69dd9142c2164e674d71fb6d INFO: 172.21.0.1:33228 - "POST /node/69dd9142c2164e674d71fb6d HTTP/1.0" 202 Accepted 2026-04-16 00:58:49,031 - lava_callback - INFO - Starting async job submit for node 69dd9142c2164e674d71fb6d 2026-04-16 00:58:49,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:58:49,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9142c2164e674d71fb6d HTTP/1.1" 200 None 2026-04-16 00:58:49,047 - lava_callback - DEBUG - Processing node 69dd9142c2164e674d71fb6d: baseline-arm-clabbe 2026-04-16 00:58:49,047 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9142c2164e674d71fb6d 2026-04-16 00:58:49,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:58:49,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9142c2164e674d71fb6d HTTP/1.1" 200 None 2026-04-16 00:58:49,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:58:49,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-16 00:58:49,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:58:49,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9142c2164e674d71fb6d HTTP/1.1" 200 None 2026-04-16 00:58:49,110 - lava_callback - ERROR - Error processing callback for node 69dd9142c2164e674d71fb6d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45990 - "GET / HTTP/1.0" 200 OK 2026-04-16 00:59:29,039 - lava_callback - INFO - Received callback for node 69dd9162c2164e674d71fb9c INFO: 172.21.0.1:46002 - "POST /node/69dd9162c2164e674d71fb9c HTTP/1.0" 202 Accepted 2026-04-16 00:59:29,045 - lava_callback - INFO - Starting async job submit for node 69dd9162c2164e674d71fb9c 2026-04-16 00:59:29,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:59:29,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9162c2164e674d71fb9c HTTP/1.1" 200 None 2026-04-16 00:59:29,062 - lava_callback - DEBUG - Processing node 69dd9162c2164e674d71fb9c: baseline-arm-clabbe 2026-04-16 00:59:29,062 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9162c2164e674d71fb9c 2026-04-16 00:59:29,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:59:29,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9162c2164e674d71fb9c HTTP/1.1" 200 None 2026-04-16 00:59:29,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:59:29,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-16 00:59:29,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 00:59:29,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9162c2164e674d71fb9c HTTP/1.1" 200 None 2026-04-16 00:59:29,124 - lava_callback - ERROR - Error processing callback for node 69dd9162c2164e674d71fb9c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43160 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:00:09,353 - lava_callback - INFO - Received callback for node 69dd9185c2164e674d71fbd7 INFO: 172.21.0.1:43162 - "POST /node/69dd9185c2164e674d71fbd7 HTTP/1.0" 202 Accepted 2026-04-16 01:00:09,358 - lava_callback - INFO - Starting async job submit for node 69dd9185c2164e674d71fbd7 2026-04-16 01:00:09,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:00:09,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9185c2164e674d71fbd7 HTTP/1.1" 200 None 2026-04-16 01:00:09,377 - lava_callback - DEBUG - Processing node 69dd9185c2164e674d71fbd7: baseline-arm-clabbe 2026-04-16 01:00:09,378 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9185c2164e674d71fbd7 2026-04-16 01:00:09,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:00:09,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9185c2164e674d71fbd7 HTTP/1.1" 200 None 2026-04-16 01:00:09,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:00:09,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-16 01:00:09,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:00:09,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9185c2164e674d71fbd7 HTTP/1.1" 200 None 2026-04-16 01:00:09,425 - lava_callback - ERROR - Error processing callback for node 69dd9185c2164e674d71fbd7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43206 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:00:29,086 - lava_callback - INFO - Received callback for node 69dd91a7c2164e674d71fc2a INFO: 172.21.0.1:43216 - "POST /node/69dd91a7c2164e674d71fc2a HTTP/1.0" 202 Accepted 2026-04-16 01:00:29,092 - lava_callback - INFO - Starting async job submit for node 69dd91a7c2164e674d71fc2a 2026-04-16 01:00:29,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:00:29,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd91a7c2164e674d71fc2a HTTP/1.1" 200 None 2026-04-16 01:00:29,126 - lava_callback - DEBUG - Processing node 69dd91a7c2164e674d71fc2a: baseline-arm-clabbe 2026-04-16 01:00:29,126 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd91a7c2164e674d71fc2a 2026-04-16 01:00:29,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:00:29,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd91a7c2164e674d71fc2a HTTP/1.1" 200 None 2026-04-16 01:00:29,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:00:29,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-16 01:00:29,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:00:29,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd91a7c2164e674d71fc2a HTTP/1.1" 200 None 2026-04-16 01:00:29,174 - lava_callback - ERROR - Error processing callback for node 69dd91a7c2164e674d71fc2a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48062 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:01:09,169 - lava_callback - INFO - Received callback for node 69dd91cbc2164e674d71fc41 INFO: 172.21.0.1:48076 - "POST /node/69dd91cbc2164e674d71fc41 HTTP/1.0" 202 Accepted 2026-04-16 01:01:09,174 - lava_callback - INFO - Starting async job submit for node 69dd91cbc2164e674d71fc41 2026-04-16 01:01:09,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:01:09,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd91cbc2164e674d71fc41 HTTP/1.1" 200 None 2026-04-16 01:01:09,190 - lava_callback - DEBUG - Processing node 69dd91cbc2164e674d71fc41: baseline-arm-clabbe 2026-04-16 01:01:09,190 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd91cbc2164e674d71fc41 2026-04-16 01:01:09,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:01:09,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd91cbc2164e674d71fc41 HTTP/1.1" 200 None 2026-04-16 01:01:09,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:01:09,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-16 01:01:09,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:01:09,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd91cbc2164e674d71fc41 HTTP/1.1" 200 None 2026-04-16 01:01:09,258 - lava_callback - ERROR - Error processing callback for node 69dd91cbc2164e674d71fc41: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42030 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:01:49,110 - lava_callback - INFO - Received callback for node 69dd91edc2164e674d71fc70 INFO: 172.21.0.1:42046 - "POST /node/69dd91edc2164e674d71fc70 HTTP/1.0" 202 Accepted 2026-04-16 01:01:49,116 - lava_callback - INFO - Starting async job submit for node 69dd91edc2164e674d71fc70 2026-04-16 01:01:49,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:01:49,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd91edc2164e674d71fc70 HTTP/1.1" 200 None 2026-04-16 01:01:49,132 - lava_callback - DEBUG - Processing node 69dd91edc2164e674d71fc70: baseline-arm-clabbe 2026-04-16 01:01:49,132 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd91edc2164e674d71fc70 2026-04-16 01:01:49,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:01:49,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd91edc2164e674d71fc70 HTTP/1.1" 200 None 2026-04-16 01:01:49,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:01:49,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-16 01:01:49,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:01:49,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd91edc2164e674d71fc70 HTTP/1.1" 200 None 2026-04-16 01:01:49,211 - lava_callback - ERROR - Error processing callback for node 69dd91edc2164e674d71fc70: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36032 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:02:09,208 - lava_callback - INFO - Received callback for node 69dd920ec2164e674d71fcc8 INFO: 172.21.0.1:36046 - "POST /node/69dd920ec2164e674d71fcc8 HTTP/1.0" 202 Accepted 2026-04-16 01:02:09,213 - lava_callback - INFO - Starting async job submit for node 69dd920ec2164e674d71fcc8 2026-04-16 01:02:09,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:02:09,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd920ec2164e674d71fcc8 HTTP/1.1" 200 None 2026-04-16 01:02:09,229 - lava_callback - DEBUG - Processing node 69dd920ec2164e674d71fcc8: baseline-arm-clabbe 2026-04-16 01:02:09,230 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd920ec2164e674d71fcc8 2026-04-16 01:02:09,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:02:09,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd920ec2164e674d71fcc8 HTTP/1.1" 200 None 2026-04-16 01:02:09,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:02:09,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 01:02:09,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:02:09,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd920ec2164e674d71fcc8 HTTP/1.1" 200 None 2026-04-16 01:02:09,276 - lava_callback - ERROR - Error processing callback for node 69dd920ec2164e674d71fcc8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48122 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:04:49,260 - lava_callback - INFO - Received callback for node 69dd929bc2164e674d71fd59 INFO: 172.21.0.1:48130 - "POST /node/69dd929bc2164e674d71fd59 HTTP/1.0" 202 Accepted 2026-04-16 01:04:49,266 - lava_callback - INFO - Starting async job submit for node 69dd929bc2164e674d71fd59 2026-04-16 01:04:49,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:04:49,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd929bc2164e674d71fd59 HTTP/1.1" 200 None 2026-04-16 01:04:49,282 - lava_callback - DEBUG - Processing node 69dd929bc2164e674d71fd59: baseline-arm-clabbe 2026-04-16 01:04:49,282 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd929bc2164e674d71fd59 2026-04-16 01:04:49,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:04:49,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd929bc2164e674d71fd59 HTTP/1.1" 200 None 2026-04-16 01:04:49,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:04:49,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 01:04:49,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:04:49,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd929bc2164e674d71fd59 HTTP/1.1" 200 None 2026-04-16 01:04:49,332 - lava_callback - ERROR - Error processing callback for node 69dd929bc2164e674d71fd59: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49396 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49398 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:06:17,732 - lava_callback - INFO - Received callback for node 69e02f071fb14b744a548c9f INFO: 172.21.0.1:49402 - "POST /node/69e02f071fb14b744a548c9f HTTP/1.0" 202 Accepted 2026-04-16 01:06:17,778 - lava_callback - INFO - Starting async job submit for node 69e02f071fb14b744a548c9f 2026-04-16 01:06:17,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:06:17,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02f071fb14b744a548c9f HTTP/1.1" 200 None 2026-04-16 01:06:17,831 - lava_callback - DEBUG - Processing node 69e02f071fb14b744a548c9f: ltp-fsx 2026-04-16 01:06:17,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:06:18,110 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:06:18,112 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fsx-69e02f071fb14b744a548c9f/log.txt.gz 2026-04-16 01:06:18,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:06:18,376 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:06:18,378 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fsx-69e02f071fb14b744a548c9f/lava-logs.yaml 2026-04-16 01:06:18,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:06:18,521 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:06:18,523 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fsx-69e02f071fb14b744a548c9f/lava_callback.json.gz 2026-04-16 01:06:18,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:06:18,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02f071fb14b744a548c9f HTTP/1.1" 200 None 2026-04-16 01:06:18,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:06:18,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 01:06:18,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:06:18,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e02f071fb14b744a548c9f HTTP/1.1" 200 None 2026-04-16 01:06:18,687 - lava_callback - INFO - Completed processing callback for node 69e02f071fb14b744a548c9f INFO: 172.21.0.1:57796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43802 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:06:38,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:06:38,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45240 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:08:09,412 - lava_callback - INFO - Received callback for node 69dd9367c2164e674d71fe47 INFO: 172.21.0.1:45252 - "POST /node/69dd9367c2164e674d71fe47 HTTP/1.0" 202 Accepted 2026-04-16 01:08:09,422 - lava_callback - INFO - Starting async job submit for node 69dd9367c2164e674d71fe47 2026-04-16 01:08:09,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:08:09,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9367c2164e674d71fe47 HTTP/1.1" 200 None 2026-04-16 01:08:09,454 - lava_callback - DEBUG - Processing node 69dd9367c2164e674d71fe47: baseline-arm-clabbe 2026-04-16 01:08:09,454 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9367c2164e674d71fe47 2026-04-16 01:08:09,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:08:09,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9367c2164e674d71fe47 HTTP/1.1" 200 None 2026-04-16 01:08:09,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:08:09,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 01:08:09,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:08:09,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9367c2164e674d71fe47 HTTP/1.1" 200 None 2026-04-16 01:08:09,525 - lava_callback - ERROR - Error processing callback for node 69dd9367c2164e674d71fe47: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57634 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:08:24,944 - lava_callback - INFO - Received callback for node 69e0365d1fb14b744a5495ac INFO: 172.21.0.1:34312 - "POST /node/69e0365d1fb14b744a5495ac HTTP/1.0" 202 Accepted 2026-04-16 01:08:24,950 - lava_callback - INFO - Starting async job submit for node 69e0365d1fb14b744a5495ac 2026-04-16 01:08:24,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:08:24,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0365d1fb14b744a5495ac HTTP/1.1" 200 None 2026-04-16 01:08:24,985 - lava_callback - DEBUG - Processing node 69e0365d1fb14b744a5495ac: baseline-arm64 2026-04-16 01:08:25,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:08:25,272 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:08:25,273 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e0365d1fb14b744a5495ac/log.txt.gz 2026-04-16 01:08:25,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:08:25,602 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:08:25,604 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e0365d1fb14b744a5495ac/lava-logs.yaml 2026-04-16 01:08:25,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:08:25,745 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:08:25,747 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e0365d1fb14b744a5495ac/lava_callback.json.gz 2026-04-16 01:08:25,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:08:25,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0365d1fb14b744a5495ac HTTP/1.1" 200 None 2026-04-16 01:08:25,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:08:25,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:08:25,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:08:25,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e0365d1fb14b744a5495ac HTTP/1.1" 200 None 2026-04-16 01:08:25,837 - lava_callback - INFO - Completed processing callback for node 69e0365d1fb14b744a5495ac INFO: 172.21.0.1:34326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34334 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:08:29,927 - lava_callback - INFO - Received callback for node 69e0366a1fb14b744a5495ee INFO: 172.21.0.1:33890 - "POST /node/69e0366a1fb14b744a5495ee HTTP/1.0" 202 Accepted 2026-04-16 01:08:29,934 - lava_callback - INFO - Starting async job submit for node 69e0366a1fb14b744a5495ee 2026-04-16 01:08:29,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:08:29,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0366a1fb14b744a5495ee HTTP/1.1" 200 None 2026-04-16 01:08:29,966 - lava_callback - DEBUG - Processing node 69e0366a1fb14b744a5495ee: baseline-arm64 2026-04-16 01:08:30,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:08:30,265 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:08:30,267 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e0366a1fb14b744a5495ee/log.txt.gz 2026-04-16 01:08:30,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:08:30,617 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:08:30,618 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e0366a1fb14b744a5495ee/lava-logs.yaml 2026-04-16 01:08:30,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:08:30,761 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:08:30,763 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e0366a1fb14b744a5495ee/lava_callback.json.gz 2026-04-16 01:08:30,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:08:30,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0366a1fb14b744a5495ee HTTP/1.1" 200 None 2026-04-16 01:08:30,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:08:30,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:08:30,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:08:30,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e0366a1fb14b744a5495ee HTTP/1.1" 200 None 2026-04-16 01:08:30,844 - lava_callback - INFO - Completed processing callback for node 69e0366a1fb14b744a5495ee 2026-04-16 01:08:34,370 - lava_callback - INFO - Received callback for node 69e036791fb14b744a549618 INFO: 172.21.0.1:33892 - "POST /node/69e036791fb14b744a549618 HTTP/1.0" 202 Accepted 2026-04-16 01:08:34,376 - lava_callback - INFO - Starting async job submit for node 69e036791fb14b744a549618 2026-04-16 01:08:34,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:08:34,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036791fb14b744a549618 HTTP/1.1" 200 None 2026-04-16 01:08:34,402 - lava_callback - DEBUG - Processing node 69e036791fb14b744a549618: baseline-nfs-arm64 2026-04-16 01:08:34,403 - lava_callback - WARNING - Failed to upload log 2026-04-16 01:08:34,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:08:34,536 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:08:34,538 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e036791fb14b744a549618/lava-logs.yaml 2026-04-16 01:08:34,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:08:34,901 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:08:34,903 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e036791fb14b744a549618/lava_callback.json.gz 2026-04-16 01:08:34,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:08:34,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036791fb14b744a549618 HTTP/1.1" 200 None 2026-04-16 01:08:34,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:08:34,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:08:34,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:08:35,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e036791fb14b744a549618 HTTP/1.1" 200 None 2026-04-16 01:08:35,004 - lava_callback - INFO - Completed processing callback for node 69e036791fb14b744a549618 INFO: 172.21.0.1:33900 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:08:38,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:08:38,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-16 01:08:45,522 - lava_callback - INFO - Received callback for node 69e0365f1fb14b744a5495b2 INFO: 172.21.0.1:52850 - "POST /node/69e0365f1fb14b744a5495b2 HTTP/1.0" 202 Accepted 2026-04-16 01:08:45,533 - lava_callback - INFO - Starting async job submit for node 69e0365f1fb14b744a5495b2 2026-04-16 01:08:45,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:08:45,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0365f1fb14b744a5495b2 HTTP/1.1" 200 None 2026-04-16 01:08:45,587 - lava_callback - DEBUG - Processing node 69e0365f1fb14b744a5495b2: baseline-arm64 2026-04-16 01:08:46,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:08:46,482 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:08:46,484 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e0365f1fb14b744a5495b2/log.txt.gz INFO: 172.21.0.1:52864 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:08:46,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:08:47,334 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:08:47,336 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e0365f1fb14b744a5495b2/lava-logs.yaml 2026-04-16 01:08:47,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:08:47,495 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:08:47,496 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e0365f1fb14b744a5495b2/lava_callback.json.gz 2026-04-16 01:08:47,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:08:47,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0365f1fb14b744a5495b2 HTTP/1.1" 200 None 2026-04-16 01:08:47,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:08:47,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:08:47,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:08:47,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e0365f1fb14b744a5495b2 HTTP/1.1" 200 None 2026-04-16 01:08:47,583 - lava_callback - INFO - Completed processing callback for node 69e0365f1fb14b744a5495b2 INFO: 172.21.0.1:46172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52294 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:09:08,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:08,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34750 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34764 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:09:23,402 - lava_callback - INFO - Received callback for node 69e0365e1fb14b744a5495af INFO: 172.21.0.1:58654 - "POST /node/69e0365e1fb14b744a5495af HTTP/1.0" 202 Accepted 2026-04-16 01:09:23,408 - lava_callback - INFO - Starting async job submit for node 69e0365e1fb14b744a5495af 2026-04-16 01:09:23,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:23,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0365e1fb14b744a5495af HTTP/1.1" 200 None 2026-04-16 01:09:23,446 - lava_callback - DEBUG - Processing node 69e0365e1fb14b744a5495af: baseline-arm64 2026-04-16 01:09:23,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:09:24,024 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:09:24,027 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e0365e1fb14b744a5495af/log.txt.gz 2026-04-16 01:09:24,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:09:24,668 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:09:24,671 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e0365e1fb14b744a5495af/lava-logs.yaml 2026-04-16 01:09:24,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:09:24,882 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:09:24,884 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e0365e1fb14b744a5495af/lava_callback.json.gz 2026-04-16 01:09:24,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:24,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0365e1fb14b744a5495af HTTP/1.1" 200 None 2026-04-16 01:09:24,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:24,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:09:24,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:24,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e0365e1fb14b744a5495af HTTP/1.1" 200 None 2026-04-16 01:09:24,986 - lava_callback - INFO - Completed processing callback for node 69e0365e1fb14b744a5495af INFO: 172.21.0.1:58660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35470 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:09:38,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:38,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-16 01:09:40,744 - lava_callback - INFO - Received callback for node 69e035e91fb14b744a549538 INFO: 172.21.0.1:39262 - "POST /node/69e035e91fb14b744a549538 HTTP/1.0" 202 Accepted 2026-04-16 01:09:40,751 - lava_callback - INFO - Starting async job submit for node 69e035e91fb14b744a549538 2026-04-16 01:09:40,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:40,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e035e91fb14b744a549538 HTTP/1.1" 200 None 2026-04-16 01:09:40,800 - lava_callback - DEBUG - Processing node 69e035e91fb14b744a549538: ltp-containers 2026-04-16 01:09:41,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:09:41,548 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:09:41,550 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-containers-69e035e91fb14b744a549538/log.txt.gz 2026-04-16 01:09:41,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:09:42,158 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:09:42,160 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-containers-69e035e91fb14b744a549538/lava-logs.yaml 2026-04-16 01:09:42,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:09:42,327 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:09:42,329 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-containers-69e035e91fb14b744a549538/lava_callback.json.gz 2026-04-16 01:09:42,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:42,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e035e91fb14b744a549538 HTTP/1.1" 200 None 2026-04-16 01:09:42,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:42,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 01:09:42,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:42,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e035e91fb14b744a549538 HTTP/1.1" 200 None 2026-04-16 01:09:42,441 - lava_callback - INFO - Completed processing callback for node 69e035e91fb14b744a549538 2026-04-16 01:09:43,073 - lava_callback - INFO - Received callback for node 69e0368c1fb14b744a549676 INFO: 172.21.0.1:39266 - "POST /node/69e0368c1fb14b744a549676 HTTP/1.0" 202 Accepted 2026-04-16 01:09:43,080 - lava_callback - INFO - Starting async job submit for node 69e0368c1fb14b744a549676 2026-04-16 01:09:43,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:43,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0368c1fb14b744a549676 HTTP/1.1" 200 None 2026-04-16 01:09:43,118 - lava_callback - DEBUG - Processing node 69e0368c1fb14b744a549676: baseline-arm64-broonie 2026-04-16 01:09:43,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:09:43,676 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:09:43,677 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e0368c1fb14b744a549676/log.txt.gz 2026-04-16 01:09:43,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:09:44,206 - lava_callback - INFO - Received callback for node 69e036a31fb14b744a5496f1 INFO: 172.21.0.1:39276 - "POST /node/69e036a31fb14b744a5496f1 HTTP/1.0" 202 Accepted 2026-04-16 01:09:44,217 - lava_callback - INFO - Starting async job submit for node 69e036a31fb14b744a5496f1 2026-04-16 01:09:44,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:44,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036a31fb14b744a5496f1 HTTP/1.1" 200 None 2026-04-16 01:09:44,299 - lava_callback - DEBUG - Processing node 69e036a31fb14b744a5496f1: baseline-arm64-kontron 2026-04-16 01:09:44,359 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:09:44,372 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e0368c1fb14b744a549676/lava-logs.yaml 2026-04-16 01:09:44,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:09:44,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:09:45,054 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:09:45,056 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69e036a31fb14b744a5496f1/log.txt.gz 2026-04-16 01:09:45,068 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:09:45,081 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e0368c1fb14b744a549676/lava_callback.json.gz 2026-04-16 01:09:45,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:45,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0368c1fb14b744a549676 HTTP/1.1" 200 None 2026-04-16 01:09:45,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:45,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:09:45,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:09:45,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:45,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e0368c1fb14b744a549676 HTTP/1.1" 200 None 2026-04-16 01:09:45,329 - lava_callback - INFO - Completed processing callback for node 69e0368c1fb14b744a549676 2026-04-16 01:09:45,511 - lava_callback - INFO - Received callback for node 69e036a51fb14b744a5496f4 INFO: 172.21.0.1:39282 - "POST /node/69e036a51fb14b744a5496f4 HTTP/1.0" 202 Accepted 2026-04-16 01:09:45,521 - lava_callback - INFO - Starting async job submit for node 69e036a51fb14b744a5496f4 2026-04-16 01:09:45,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:45,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036a51fb14b744a5496f4 HTTP/1.1" 200 None 2026-04-16 01:09:45,614 - lava_callback - DEBUG - Processing node 69e036a51fb14b744a5496f4: baseline-arm64-kontron 2026-04-16 01:09:46,139 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:09:46,142 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69e036a31fb14b744a5496f1/lava-logs.yaml 2026-04-16 01:09:46,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:09:46,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:39290 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:09:46,835 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:09:46,838 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69e036a51fb14b744a5496f4/log.txt.gz 2026-04-16 01:09:46,886 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:09:46,915 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69e036a31fb14b744a5496f1/lava_callback.json.gz 2026-04-16 01:09:47,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:47,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036a31fb14b744a5496f1 HTTP/1.1" 200 None 2026-04-16 01:09:47,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:47,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:09:47,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:09:47,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:47,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e036a31fb14b744a5496f1 HTTP/1.1" 200 None 2026-04-16 01:09:47,198 - lava_callback - INFO - Completed processing callback for node 69e036a31fb14b744a5496f1 2026-04-16 01:09:47,843 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:09:47,846 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69e036a51fb14b744a5496f4/lava-logs.yaml 2026-04-16 01:09:47,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:09:48,038 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:09:48,040 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69e036a51fb14b744a5496f4/lava_callback.json.gz 2026-04-16 01:09:48,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:48,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036a51fb14b744a5496f4 HTTP/1.1" 200 None 2026-04-16 01:09:48,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:48,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:09:48,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:48,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e036a51fb14b744a5496f4 HTTP/1.1" 200 None 2026-04-16 01:09:48,210 - lava_callback - INFO - Completed processing callback for node 69e036a51fb14b744a5496f4 2026-04-16 01:09:49,472 - lava_callback - INFO - Received callback for node 69dd93cdc2164e674d71febe INFO: 172.21.0.1:39304 - "POST /node/69dd93cdc2164e674d71febe HTTP/1.0" 202 Accepted 2026-04-16 01:09:49,481 - lava_callback - INFO - Starting async job submit for node 69dd93cdc2164e674d71febe 2026-04-16 01:09:49,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:49,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd93cdc2164e674d71febe HTTP/1.1" 200 None 2026-04-16 01:09:49,498 - lava_callback - DEBUG - Processing node 69dd93cdc2164e674d71febe: baseline-arm-clabbe 2026-04-16 01:09:49,498 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd93cdc2164e674d71febe 2026-04-16 01:09:49,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:49,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd93cdc2164e674d71febe HTTP/1.1" 200 None 2026-04-16 01:09:49,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:49,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 01:09:49,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:49,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd93cdc2164e674d71febe HTTP/1.1" 200 None 2026-04-16 01:09:49,560 - lava_callback - ERROR - Error processing callback for node 69dd93cdc2164e674d71febe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 01:09:54,109 - lava_callback - INFO - Received callback for node 69e036ab1fb14b744a549704 INFO: 172.21.0.1:38268 - "POST /node/69e036ab1fb14b744a549704 HTTP/1.0" 202 Accepted 2026-04-16 01:09:54,120 - lava_callback - INFO - Starting async job submit for node 69e036ab1fb14b744a549704 2026-04-16 01:09:54,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:54,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036ab1fb14b744a549704 HTTP/1.1" 200 None 2026-04-16 01:09:54,215 - lava_callback - DEBUG - Processing node 69e036ab1fb14b744a549704: baseline-arm64-foundriesio 2026-04-16 01:09:54,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:09:55,035 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:09:55,037 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e036ab1fb14b744a549704/log.txt.gz 2026-04-16 01:09:55,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:09:55,613 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:09:55,615 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e036ab1fb14b744a549704/lava-logs.yaml 2026-04-16 01:09:55,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:09:55,705 - lava_callback - INFO - Received callback for node 69e036661fb14b744a5495e5 INFO: 172.21.0.1:38282 - "POST /node/69e036661fb14b744a5495e5 HTTP/1.0" 202 Accepted 2026-04-16 01:09:55,713 - lava_callback - INFO - Starting async job submit for node 69e036661fb14b744a5495e5 2026-04-16 01:09:55,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:55,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036661fb14b744a5495e5 HTTP/1.1" 200 None 2026-04-16 01:09:55,784 - lava_callback - DEBUG - Processing node 69e036661fb14b744a5495e5: baseline-arm64 2026-04-16 01:09:55,956 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:09:55,995 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e036ab1fb14b744a549704/lava_callback.json.gz 2026-04-16 01:09:56,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:56,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036ab1fb14b744a549704 HTTP/1.1" 200 None 2026-04-16 01:09:56,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:56,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:09:56,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:56,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:09:56,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e036ab1fb14b744a549704 HTTP/1.1" 200 None 2026-04-16 01:09:56,393 - lava_callback - INFO - Completed processing callback for node 69e036ab1fb14b744a549704 INFO: 172.21.0.1:38288 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:09:56,837 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:09:56,839 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e036661fb14b744a5495e5/log.txt.gz 2026-04-16 01:09:57,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:09:57,428 - lava_callback - INFO - Received callback for node 69e036651fb14b744a5495e2 INFO: 172.21.0.1:38300 - "POST /node/69e036651fb14b744a5495e2 HTTP/1.0" 202 Accepted 2026-04-16 01:09:57,438 - lava_callback - INFO - Starting async job submit for node 69e036651fb14b744a5495e2 2026-04-16 01:09:57,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:57,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036651fb14b744a5495e2 HTTP/1.1" 200 None 2026-04-16 01:09:57,488 - lava_callback - DEBUG - Processing node 69e036651fb14b744a5495e2: baseline-arm64 2026-04-16 01:09:57,577 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:09:57,610 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e036661fb14b744a5495e5/lava-logs.yaml 2026-04-16 01:09:57,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:09:57,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:09:58,109 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:09:58,111 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e036661fb14b744a5495e5/lava_callback.json.gz 2026-04-16 01:09:58,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:58,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036661fb14b744a5495e5 HTTP/1.1" 200 None 2026-04-16 01:09:58,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:58,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:09:58,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:58,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e036661fb14b744a5495e5 HTTP/1.1" 200 None 2026-04-16 01:09:58,250 - lava_callback - INFO - Completed processing callback for node 69e036661fb14b744a5495e5 2026-04-16 01:09:58,372 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:09:58,375 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e036651fb14b744a5495e2/log.txt.gz 2026-04-16 01:09:58,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:09:59,003 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:09:59,006 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e036651fb14b744a5495e2/lava-logs.yaml 2026-04-16 01:09:59,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:09:59,360 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:09:59,362 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e036651fb14b744a5495e2/lava_callback.json.gz 2026-04-16 01:09:59,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:59,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036651fb14b744a5495e2 HTTP/1.1" 200 None 2026-04-16 01:09:59,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:59,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:09:59,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:09:59,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e036651fb14b744a5495e2 HTTP/1.1" 200 None 2026-04-16 01:09:59,488 - lava_callback - INFO - Completed processing callback for node 69e036651fb14b744a5495e2 2026-04-16 01:10:00,651 - lava_callback - INFO - Received callback for node 69e036941fb14b744a54968d INFO: 172.21.0.1:42052 - "POST /node/69e036941fb14b744a54968d HTTP/1.0" 202 Accepted 2026-04-16 01:10:00,661 - lava_callback - INFO - Starting async job submit for node 69e036941fb14b744a54968d 2026-04-16 01:10:00,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:00,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036941fb14b744a54968d HTTP/1.1" 200 None 2026-04-16 01:10:00,720 - lava_callback - DEBUG - Processing node 69e036941fb14b744a54968d: baseline-arm64-broonie 2026-04-16 01:10:01,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:01,333 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:01,335 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e036941fb14b744a54968d/log.txt.gz 2026-04-16 01:10:01,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:01,879 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:01,881 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e036941fb14b744a54968d/lava-logs.yaml 2026-04-16 01:10:01,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:02,230 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:02,233 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e036941fb14b744a54968d/lava_callback.json.gz 2026-04-16 01:10:02,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:02,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036941fb14b744a54968d HTTP/1.1" 200 None 2026-04-16 01:10:02,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:02,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:10:02,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:02,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e036941fb14b744a54968d HTTP/1.1" 200 None 2026-04-16 01:10:02,349 - lava_callback - INFO - Completed processing callback for node 69e036941fb14b744a54968d 2026-04-16 01:10:03,692 - lava_callback - INFO - Received callback for node 69e036a61fb14b744a5496f7 INFO: 172.21.0.1:42056 - "POST /node/69e036a61fb14b744a5496f7 HTTP/1.0" 202 Accepted 2026-04-16 01:10:03,702 - lava_callback - INFO - Starting async job submit for node 69e036a61fb14b744a5496f7 2026-04-16 01:10:03,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:03,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036a61fb14b744a5496f7 HTTP/1.1" 200 None 2026-04-16 01:10:03,762 - lava_callback - DEBUG - Processing node 69e036a61fb14b744a5496f7: baseline-arm64-pengutronix 2026-04-16 01:10:04,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:04,143 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:04,145 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e036a61fb14b744a5496f7/log.txt.gz 2026-04-16 01:10:04,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:04,410 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:04,412 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e036a61fb14b744a5496f7/lava-logs.yaml 2026-04-16 01:10:04,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:04,538 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:04,540 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e036a61fb14b744a5496f7/lava_callback.json.gz 2026-04-16 01:10:04,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:04,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036a61fb14b744a5496f7 HTTP/1.1" 200 None 2026-04-16 01:10:04,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:04,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:10:04,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:04,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e036a61fb14b744a5496f7 HTTP/1.1" 200 None 2026-04-16 01:10:04,632 - lava_callback - INFO - Completed processing callback for node 69e036a61fb14b744a5496f7 INFO: 172.21.0.1:42070 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:10:08,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:08,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-16 01:10:10,457 - lava_callback - INFO - Received callback for node 69e0366b1fb14b744a5495f1 INFO: 172.21.0.1:43562 - "POST /node/69e0366b1fb14b744a5495f1 HTTP/1.0" 202 Accepted 2026-04-16 01:10:10,463 - lava_callback - INFO - Starting async job submit for node 69e0366b1fb14b744a5495f1 2026-04-16 01:10:10,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:10,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0366b1fb14b744a5495f1 HTTP/1.1" 200 None 2026-04-16 01:10:10,500 - lava_callback - DEBUG - Processing node 69e0366b1fb14b744a5495f1: baseline-arm64 2026-04-16 01:10:10,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:10,844 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:10,845 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e0366b1fb14b744a5495f1/log.txt.gz 2026-04-16 01:10:10,919 - lava_callback - INFO - Received callback for node 69e0366f1fb14b744a5495fe INFO: 172.21.0.1:43566 - "POST /node/69e0366f1fb14b744a5495fe HTTP/1.0" 202 Accepted 2026-04-16 01:10:10,943 - lava_callback - INFO - Starting async job submit for node 69e0366f1fb14b744a5495fe 2026-04-16 01:10:10,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:11,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:11,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0366f1fb14b744a5495fe HTTP/1.1" 200 None 2026-04-16 01:10:11,026 - lava_callback - DEBUG - Processing node 69e0366f1fb14b744a5495fe: baseline-arm64 2026-04-16 01:10:11,148 - lava_callback - INFO - Received callback for node 69e036aa1fb14b744a549701 INFO: 172.21.0.1:43568 - "POST /node/69e036aa1fb14b744a549701 HTTP/1.0" 202 Accepted 2026-04-16 01:10:11,165 - lava_callback - INFO - Starting async job submit for node 69e036aa1fb14b744a549701 2026-04-16 01:10:11,215 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:11,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:11,253 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e0366b1fb14b744a5495f1/lava-logs.yaml 2026-04-16 01:10:11,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036aa1fb14b744a549701 HTTP/1.1" 200 None 2026-04-16 01:10:11,349 - lava_callback - DEBUG - Processing node 69e036aa1fb14b744a549701: baseline-arm64-foundriesio 2026-04-16 01:10:11,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:11,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:11,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:11,665 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:11,667 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e0366f1fb14b744a5495fe/log.txt.gz 2026-04-16 01:10:11,692 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:11,724 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:11,724 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e0366b1fb14b744a5495f1/lava_callback.json.gz 2026-04-16 01:10:11,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:11,799 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e036aa1fb14b744a549701/log.txt.gz 2026-04-16 01:10:11,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0366b1fb14b744a5495f1 HTTP/1.1" 200 None 2026-04-16 01:10:11,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:12,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:12,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:12,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:10:12,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:12,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e0366b1fb14b744a5495f1 HTTP/1.1" 200 None 2026-04-16 01:10:12,072 - lava_callback - INFO - Completed processing callback for node 69e0366b1fb14b744a5495f1 2026-04-16 01:10:12,268 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:12,270 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e036aa1fb14b744a549701/lava-logs.yaml 2026-04-16 01:10:12,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:12,355 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:12,357 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e0366f1fb14b744a5495fe/lava-logs.yaml 2026-04-16 01:10:12,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:12,439 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:12,442 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e036aa1fb14b744a549701/lava_callback.json.gz 2026-04-16 01:10:12,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:12,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036aa1fb14b744a549701 HTTP/1.1" 200 None 2026-04-16 01:10:12,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:12,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:10:12,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:12,557 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:12,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e036aa1fb14b744a549701 HTTP/1.1" 200 None 2026-04-16 01:10:12,566 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e0366f1fb14b744a5495fe/lava_callback.json.gz 2026-04-16 01:10:12,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:12,647 - lava_callback - INFO - Completed processing callback for node 69e036aa1fb14b744a549701 2026-04-16 01:10:12,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0366f1fb14b744a5495fe HTTP/1.1" 200 None 2026-04-16 01:10:12,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:12,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:10:12,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:12,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e0366f1fb14b744a5495fe HTTP/1.1" 200 None 2026-04-16 01:10:12,738 - lava_callback - INFO - Completed processing callback for node 69e0366f1fb14b744a5495fe 2026-04-16 01:10:14,841 - lava_callback - INFO - Received callback for node 69e036601fb14b744a5495b5 INFO: 172.21.0.1:43580 - "POST /node/69e036601fb14b744a5495b5 HTTP/1.0" 202 Accepted 2026-04-16 01:10:14,847 - lava_callback - INFO - Starting async job submit for node 69e036601fb14b744a5495b5 2026-04-16 01:10:14,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:14,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036601fb14b744a5495b5 HTTP/1.1" 200 None 2026-04-16 01:10:14,883 - lava_callback - DEBUG - Processing node 69e036601fb14b744a5495b5: baseline-arm64 2026-04-16 01:10:15,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:43588 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-16 01:10:15,263 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:15,265 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e036601fb14b744a5495b5/log.txt.gz 2026-04-16 01:10:15,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:15,445 - lava_callback - INFO - Received callback for node 69e036a81fb14b744a5496fa INFO: 172.21.0.1:43600 - "POST /node/69e036a81fb14b744a5496fa HTTP/1.0" 202 Accepted 2026-04-16 01:10:15,452 - lava_callback - INFO - Starting async job submit for node 69e036a81fb14b744a5496fa 2026-04-16 01:10:15,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:15,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036a81fb14b744a5496fa HTTP/1.1" 200 None 2026-04-16 01:10:15,495 - lava_callback - DEBUG - Processing node 69e036a81fb14b744a5496fa: baseline-arm64-pengutronix 2026-04-16 01:10:15,631 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:15,663 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e036601fb14b744a5495b5/lava-logs.yaml 2026-04-16 01:10:15,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:15,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:15,840 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:15,841 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e036a81fb14b744a5496fa/log.txt.gz 2026-04-16 01:10:15,874 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:15,907 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e036601fb14b744a5495b5/lava_callback.json.gz 2026-04-16 01:10:15,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:15,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:16,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036601fb14b744a5495b5 HTTP/1.1" 200 None 2026-04-16 01:10:16,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:16,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:10:16,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:16,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e036601fb14b744a5495b5 HTTP/1.1" 200 None 2026-04-16 01:10:16,044 - lava_callback - INFO - Completed processing callback for node 69e036601fb14b744a5495b5 2026-04-16 01:10:16,238 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:16,241 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e036a81fb14b744a5496fa/lava-logs.yaml 2026-04-16 01:10:16,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:16,402 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:16,404 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e036a81fb14b744a5496fa/lava_callback.json.gz 2026-04-16 01:10:16,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:16,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036a81fb14b744a5496fa HTTP/1.1" 200 None 2026-04-16 01:10:16,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:16,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:10:16,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:16,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e036a81fb14b744a5496fa HTTP/1.1" 200 None 2026-04-16 01:10:16,503 - lava_callback - INFO - Completed processing callback for node 69e036a81fb14b744a5496fa INFO: 172.21.0.1:43616 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:10:17,993 - lava_callback - INFO - Received callback for node 69e036991fb14b744a54969e INFO: 172.21.0.1:43630 - "POST /node/69e036991fb14b744a54969e HTTP/1.0" 202 Accepted 2026-04-16 01:10:17,999 - lava_callback - INFO - Starting async job submit for node 69e036991fb14b744a54969e 2026-04-16 01:10:18,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:18,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036991fb14b744a54969e HTTP/1.1" 200 None 2026-04-16 01:10:18,048 - lava_callback - DEBUG - Processing node 69e036991fb14b744a54969e: baseline-arm64-broonie 2026-04-16 01:10:18,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:18,442 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:18,444 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e036991fb14b744a54969e/log.txt.gz 2026-04-16 01:10:18,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:18,770 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:18,772 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e036991fb14b744a54969e/lava-logs.yaml 2026-04-16 01:10:18,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:18,913 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:18,915 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e036991fb14b744a54969e/lava_callback.json.gz 2026-04-16 01:10:18,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:18,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036991fb14b744a54969e HTTP/1.1" 200 None 2026-04-16 01:10:18,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:18,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:10:18,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:19,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e036991fb14b744a54969e HTTP/1.1" 200 None 2026-04-16 01:10:19,011 - lava_callback - INFO - Completed processing callback for node 69e036991fb14b744a54969e 2026-04-16 01:10:19,419 - lava_callback - INFO - Received callback for node 69e0366d1fb14b744a5495f7 INFO: 172.21.0.1:43644 - "POST /node/69e0366d1fb14b744a5495f7 HTTP/1.0" 202 Accepted 2026-04-16 01:10:19,429 - lava_callback - INFO - Starting async job submit for node 69e0366d1fb14b744a5495f7 2026-04-16 01:10:19,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:19,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0366d1fb14b744a5495f7 HTTP/1.1" 200 None 2026-04-16 01:10:19,474 - lava_callback - DEBUG - Processing node 69e0366d1fb14b744a5495f7: baseline-arm64 2026-04-16 01:10:19,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:19,858 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:19,859 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e0366d1fb14b744a5495f7/log.txt.gz 2026-04-16 01:10:20,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:20,206 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:20,208 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e0366d1fb14b744a5495f7/lava-logs.yaml 2026-04-16 01:10:20,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:20,341 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:20,342 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e0366d1fb14b744a5495f7/lava_callback.json.gz 2026-04-16 01:10:20,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:20,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0366d1fb14b744a5495f7 HTTP/1.1" 200 None 2026-04-16 01:10:20,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:20,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:10:20,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:20,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e0366d1fb14b744a5495f7 HTTP/1.1" 200 None 2026-04-16 01:10:20,418 - lava_callback - INFO - Completed processing callback for node 69e0366d1fb14b744a5495f7 2026-04-16 01:10:21,487 - lava_callback - INFO - Received callback for node 69e036a91fb14b744a5496fd INFO: 172.21.0.1:41760 - "POST /node/69e036a91fb14b744a5496fd HTTP/1.0" 202 Accepted 2026-04-16 01:10:21,493 - lava_callback - INFO - Starting async job submit for node 69e036a91fb14b744a5496fd 2026-04-16 01:10:21,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:21,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036a91fb14b744a5496fd HTTP/1.1" 200 None 2026-04-16 01:10:21,528 - lava_callback - DEBUG - Processing node 69e036a91fb14b744a5496fd: baseline-arm64-pengutronix 2026-04-16 01:10:21,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:21,879 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:21,880 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e036a91fb14b744a5496fd/log.txt.gz 2026-04-16 01:10:22,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:22,194 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:22,197 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e036a91fb14b744a5496fd/lava-logs.yaml 2026-04-16 01:10:22,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:22,330 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:22,332 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e036a91fb14b744a5496fd/lava_callback.json.gz 2026-04-16 01:10:22,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:22,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036a91fb14b744a5496fd HTTP/1.1" 200 None 2026-04-16 01:10:22,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:22,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:10:22,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:22,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e036a91fb14b744a5496fd HTTP/1.1" 200 None 2026-04-16 01:10:22,409 - lava_callback - INFO - Completed processing callback for node 69e036a91fb14b744a5496fd 2026-04-16 01:10:22,636 - lava_callback - INFO - Received callback for node 69e036771fb14b744a549610 INFO: 172.21.0.1:41764 - "POST /node/69e036771fb14b744a549610 HTTP/1.0" 202 Accepted 2026-04-16 01:10:22,643 - lava_callback - INFO - Starting async job submit for node 69e036771fb14b744a549610 2026-04-16 01:10:22,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:22,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036771fb14b744a549610 HTTP/1.1" 200 None 2026-04-16 01:10:22,690 - lava_callback - DEBUG - Processing node 69e036771fb14b744a549610: baseline-nfs-arm64 2026-04-16 01:10:23,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:23,237 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:23,239 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e036771fb14b744a549610/log.txt.gz 2026-04-16 01:10:23,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:23,687 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:23,689 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e036771fb14b744a549610/lava-logs.yaml 2026-04-16 01:10:23,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:23,840 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:23,841 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e036771fb14b744a549610/lava_callback.json.gz 2026-04-16 01:10:23,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:23,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036771fb14b744a549610 HTTP/1.1" 200 None 2026-04-16 01:10:23,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:23,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:10:23,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:23,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e036771fb14b744a549610 HTTP/1.1" 200 None 2026-04-16 01:10:23,941 - lava_callback - INFO - Completed processing callback for node 69e036771fb14b744a549610 2026-04-16 01:10:24,382 - lava_callback - INFO - Received callback for node 69e0367b1fb14b744a54961d INFO: 172.21.0.1:41768 - "POST /node/69e0367b1fb14b744a54961d HTTP/1.0" 202 Accepted 2026-04-16 01:10:24,389 - lava_callback - INFO - Starting async job submit for node 69e0367b1fb14b744a54961d 2026-04-16 01:10:24,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:24,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0367b1fb14b744a54961d HTTP/1.1" 200 None 2026-04-16 01:10:24,428 - lava_callback - DEBUG - Processing node 69e0367b1fb14b744a54961d: baseline-nfs-arm64 2026-04-16 01:10:24,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:24,883 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:24,884 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e0367b1fb14b744a54961d/log.txt.gz 2026-04-16 01:10:25,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:25,260 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:25,262 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e0367b1fb14b744a54961d/lava-logs.yaml 2026-04-16 01:10:25,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:25,400 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:25,402 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e0367b1fb14b744a54961d/lava_callback.json.gz 2026-04-16 01:10:25,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:25,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0367b1fb14b744a54961d HTTP/1.1" 200 None 2026-04-16 01:10:25,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:25,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:10:25,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:25,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e0367b1fb14b744a54961d HTTP/1.1" 200 None 2026-04-16 01:10:25,488 - lava_callback - INFO - Completed processing callback for node 69e0367b1fb14b744a54961d INFO: 172.21.0.1:41778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41790 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:10:29,481 - lava_callback - INFO - Received callback for node 69dd93f1c2164e674d71ff01 INFO: 172.21.0.1:41792 - "POST /node/69dd93f1c2164e674d71ff01 HTTP/1.0" 202 Accepted 2026-04-16 01:10:29,487 - lava_callback - INFO - Starting async job submit for node 69dd93f1c2164e674d71ff01 2026-04-16 01:10:29,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:29,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd93f1c2164e674d71ff01 HTTP/1.1" 200 None 2026-04-16 01:10:29,505 - lava_callback - DEBUG - Processing node 69dd93f1c2164e674d71ff01: baseline-arm-clabbe 2026-04-16 01:10:29,505 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd93f1c2164e674d71ff01 2026-04-16 01:10:29,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:29,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd93f1c2164e674d71ff01 HTTP/1.1" 200 None 2026-04-16 01:10:29,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:29,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 01:10:29,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:29,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd93f1c2164e674d71ff01 HTTP/1.1" 200 None 2026-04-16 01:10:29,554 - lava_callback - ERROR - Error processing callback for node 69dd93f1c2164e674d71ff01: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 01:10:31,559 - lava_callback - INFO - Received callback for node 69e036781fb14b744a549613 INFO: 172.21.0.1:35246 - "POST /node/69e036781fb14b744a549613 HTTP/1.0" 202 Accepted 2026-04-16 01:10:31,566 - lava_callback - INFO - Starting async job submit for node 69e036781fb14b744a549613 2026-04-16 01:10:31,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:31,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036781fb14b744a549613 HTTP/1.1" 200 None 2026-04-16 01:10:31,604 - lava_callback - DEBUG - Processing node 69e036781fb14b744a549613: baseline-nfs-arm64 2026-04-16 01:10:32,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:32,181 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:32,182 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e036781fb14b744a549613/log.txt.gz 2026-04-16 01:10:32,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:32,666 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:32,668 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e036781fb14b744a549613/lava-logs.yaml 2026-04-16 01:10:32,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:32,836 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:32,838 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e036781fb14b744a549613/lava_callback.json.gz 2026-04-16 01:10:32,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:32,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036781fb14b744a549613 HTTP/1.1" 200 None 2026-04-16 01:10:32,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:32,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:10:32,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:32,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e036781fb14b744a549613 HTTP/1.1" 200 None 2026-04-16 01:10:32,923 - lava_callback - INFO - Completed processing callback for node 69e036781fb14b744a549613 2026-04-16 01:10:34,765 - lava_callback - INFO - Received callback for node 69e0367d1fb14b744a549625 INFO: 172.21.0.1:35248 - "POST /node/69e0367d1fb14b744a549625 HTTP/1.0" 202 Accepted 2026-04-16 01:10:34,772 - lava_callback - INFO - Starting async job submit for node 69e0367d1fb14b744a549625 2026-04-16 01:10:34,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:34,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0367d1fb14b744a549625 HTTP/1.1" 200 None 2026-04-16 01:10:34,811 - lava_callback - DEBUG - Processing node 69e0367d1fb14b744a549625: baseline-nfs-arm64 2026-04-16 01:10:35,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:35,295 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:35,297 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e0367d1fb14b744a549625/log.txt.gz 2026-04-16 01:10:35,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:35,707 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:35,709 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e0367d1fb14b744a549625/lava-logs.yaml 2026-04-16 01:10:35,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:35,876 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:35,878 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e0367d1fb14b744a549625/lava_callback.json.gz 2026-04-16 01:10:35,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:35,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0367d1fb14b744a549625 HTTP/1.1" 200 None 2026-04-16 01:10:35,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:35,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:10:35,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:35,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e0367d1fb14b744a549625 HTTP/1.1" 200 None 2026-04-16 01:10:35,972 - lava_callback - INFO - Completed processing callback for node 69e0367d1fb14b744a549625 INFO: 172.21.0.1:35250 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:10:38,121 - lava_callback - INFO - Received callback for node 69e0360e1fb14b744a54955e INFO: 172.21.0.1:35266 - "POST /node/69e0360e1fb14b744a54955e HTTP/1.0" 202 Accepted 2026-04-16 01:10:38,128 - lava_callback - INFO - Starting async job submit for node 69e0360e1fb14b744a54955e 2026-04-16 01:10:38,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:38,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:38,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0360e1fb14b744a54955e HTTP/1.1" 200 None 2026-04-16 01:10:38,177 - lava_callback - DEBUG - Processing node 69e0360e1fb14b744a54955e: ltp-cve 2026-04-16 01:10:38,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-16 01:10:38,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:38,693 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:38,694 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cve-69e0360e1fb14b744a54955e/log.txt.gz 2026-04-16 01:10:38,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:39,109 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:39,112 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cve-69e0360e1fb14b744a54955e/lava-logs.yaml 2026-04-16 01:10:39,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:39,271 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:39,273 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cve-69e0360e1fb14b744a54955e/lava_callback.json.gz 2026-04-16 01:10:39,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:39,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0360e1fb14b744a54955e HTTP/1.1" 200 None 2026-04-16 01:10:39,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:39,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 01:10:39,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:39,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e0360e1fb14b744a54955e HTTP/1.1" 200 None 2026-04-16 01:10:39,358 - lava_callback - INFO - Completed processing callback for node 69e0360e1fb14b744a54955e 2026-04-16 01:10:39,576 - lava_callback - INFO - Received callback for node 69e036901fb14b744a549680 INFO: 172.21.0.1:35268 - "POST /node/69e036901fb14b744a549680 HTTP/1.0" 202 Accepted 2026-04-16 01:10:39,586 - lava_callback - INFO - Starting async job submit for node 69e036901fb14b744a549680 2026-04-16 01:10:39,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:39,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036901fb14b744a549680 HTTP/1.1" 200 None 2026-04-16 01:10:39,635 - lava_callback - DEBUG - Processing node 69e036901fb14b744a549680: baseline-arm64-broonie 2026-04-16 01:10:39,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:40,032 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:40,033 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e036901fb14b744a549680/log.txt.gz 2026-04-16 01:10:40,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:40,399 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:40,401 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e036901fb14b744a549680/lava-logs.yaml 2026-04-16 01:10:40,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:40,542 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:40,543 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e036901fb14b744a549680/lava_callback.json.gz 2026-04-16 01:10:40,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:40,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036901fb14b744a549680 HTTP/1.1" 200 None 2026-04-16 01:10:40,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:40,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:10:40,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:40,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e036901fb14b744a549680 HTTP/1.1" 200 None 2026-04-16 01:10:40,620 - lava_callback - INFO - Completed processing callback for node 69e036901fb14b744a549680 2026-04-16 01:10:40,947 - lava_callback - INFO - Received callback for node 69e0369a1fb14b744a5496a1 INFO: 172.21.0.1:59454 - "POST /node/69e0369a1fb14b744a5496a1 HTTP/1.0" 202 Accepted 2026-04-16 01:10:40,953 - lava_callback - INFO - Starting async job submit for node 69e0369a1fb14b744a5496a1 2026-04-16 01:10:40,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:41,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0369a1fb14b744a5496a1 HTTP/1.1" 200 None 2026-04-16 01:10:41,012 - lava_callback - DEBUG - Processing node 69e0369a1fb14b744a5496a1: baseline-arm64-broonie 2026-04-16 01:10:41,069 - lava_callback - INFO - Received callback for node 69e036911fb14b744a549683 INFO: 172.21.0.1:59456 - "POST /node/69e036911fb14b744a549683 HTTP/1.0" 202 Accepted 2026-04-16 01:10:41,103 - lava_callback - INFO - Starting async job submit for node 69e036911fb14b744a549683 2026-04-16 01:10:41,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:41,164 - lava_callback - INFO - Received callback for node 69e0367f1fb14b744a54962c INFO: 172.21.0.1:59464 - "POST /node/69e0367f1fb14b744a54962c HTTP/1.0" 202 Accepted 2026-04-16 01:10:41,182 - lava_callback - INFO - Starting async job submit for node 69e0367f1fb14b744a54962c 2026-04-16 01:10:41,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:41,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036911fb14b744a549683 HTTP/1.1" 200 None 2026-04-16 01:10:41,341 - lava_callback - DEBUG - Processing node 69e036911fb14b744a549683: baseline-arm64-broonie 2026-04-16 01:10:41,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0367f1fb14b744a54962c HTTP/1.1" 200 None 2026-04-16 01:10:41,528 - lava_callback - DEBUG - Processing node 69e0367f1fb14b744a54962c: baseline-nfs-arm64 2026-04-16 01:10:41,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:41,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:41,993 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:42,046 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e0369a1fb14b744a5496a1/log.txt.gz 2026-04-16 01:10:42,179 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:42,311 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e036911fb14b744a549683/log.txt.gz 2026-04-16 01:10:42,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:42,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:42,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:42,638 - lava_callback - INFO - Received callback for node 69e036961fb14b744a549698 2026-04-16 01:10:42,648 - lava_callback - INFO - Starting async job submit for node 69e036961fb14b744a549698 INFO: 172.21.0.1:59470 - "POST /node/69e036961fb14b744a549698 HTTP/1.0" 202 Accepted 2026-04-16 01:10:42,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:42,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036961fb14b744a549698 HTTP/1.1" 200 None 2026-04-16 01:10:42,698 - lava_callback - DEBUG - Processing node 69e036961fb14b744a549698: baseline-arm64-broonie 2026-04-16 01:10:42,723 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:42,771 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e0367f1fb14b744a54962c/log.txt.gz 2026-04-16 01:10:42,778 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:42,865 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:42,896 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e0369a1fb14b744a5496a1/lava-logs.yaml 2026-04-16 01:10:43,057 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e036911fb14b744a549683/lava-logs.yaml 2026-04-16 01:10:43,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:43,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:43,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:43,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:43,457 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:43,459 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e036961fb14b744a549698/log.txt.gz 2026-04-16 01:10:43,476 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:43,486 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:43,511 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e0369a1fb14b744a5496a1/lava_callback.json.gz 2026-04-16 01:10:43,512 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e036911fb14b744a549683/lava_callback.json.gz 2026-04-16 01:10:43,567 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:43,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:43,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:43,603 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e0367f1fb14b744a54962c/lava-logs.yaml 2026-04-16 01:10:43,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:43,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0369a1fb14b744a5496a1 HTTP/1.1" 200 None 2026-04-16 01:10:43,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:43,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:43,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036911fb14b744a549683 HTTP/1.1" 200 None 2026-04-16 01:10:43,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:43,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:10:43,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:10:43,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:43,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:43,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e0369a1fb14b744a5496a1 HTTP/1.1" 200 None 2026-04-16 01:10:43,755 - lava_callback - INFO - Completed processing callback for node 69e0369a1fb14b744a5496a1 2026-04-16 01:10:43,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e036911fb14b744a549683 HTTP/1.1" 200 None 2026-04-16 01:10:43,807 - lava_callback - INFO - Completed processing callback for node 69e036911fb14b744a549683 2026-04-16 01:10:43,960 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:43,962 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e0367f1fb14b744a54962c/lava_callback.json.gz 2026-04-16 01:10:44,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:44,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0367f1fb14b744a54962c HTTP/1.1" 200 None 2026-04-16 01:10:44,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:44,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:10:44,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:44,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e0367f1fb14b744a54962c HTTP/1.1" 200 None 2026-04-16 01:10:44,079 - lava_callback - INFO - Completed processing callback for node 69e0367f1fb14b744a54962c 2026-04-16 01:10:44,080 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:44,083 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e036961fb14b744a549698/lava-logs.yaml 2026-04-16 01:10:44,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:44,269 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:44,271 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e036961fb14b744a549698/lava_callback.json.gz 2026-04-16 01:10:44,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:44,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036961fb14b744a549698 HTTP/1.1" 200 None 2026-04-16 01:10:44,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:44,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:10:44,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:44,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e036961fb14b744a549698 HTTP/1.1" 200 None 2026-04-16 01:10:44,371 - lava_callback - INFO - Completed processing callback for node 69e036961fb14b744a549698 2026-04-16 01:10:46,405 - lava_callback - INFO - Received callback for node 69e036671fb14b744a5495e8 INFO: 172.21.0.1:59482 - "POST /node/69e036671fb14b744a5495e8 HTTP/1.0" 202 Accepted 2026-04-16 01:10:46,411 - lava_callback - INFO - Starting async job submit for node 69e036671fb14b744a5495e8 2026-04-16 01:10:46,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:46,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036671fb14b744a5495e8 HTTP/1.1" 200 None 2026-04-16 01:10:46,451 - lava_callback - DEBUG - Processing node 69e036671fb14b744a5495e8: baseline-arm64 INFO: 172.21.0.1:59488 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:10:46,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:46,892 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:46,894 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e036671fb14b744a5495e8/log.txt.gz 2026-04-16 01:10:47,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:47,353 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:47,356 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e036671fb14b744a5495e8/lava-logs.yaml 2026-04-16 01:10:47,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:10:47,515 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:10:47,517 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e036671fb14b744a5495e8/lava_callback.json.gz 2026-04-16 01:10:47,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:47,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036671fb14b744a5495e8 HTTP/1.1" 200 None 2026-04-16 01:10:47,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:47,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:10:47,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:10:47,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e036671fb14b744a5495e8 HTTP/1.1" 200 None 2026-04-16 01:10:47,652 - lava_callback - INFO - Completed processing callback for node 69e036671fb14b744a5495e8 INFO: 172.21.0.1:33470 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:11:00,934 - lava_callback - INFO - Received callback for node 69e0368e1fb14b744a549679 INFO: 172.21.0.1:59866 - "POST /node/69e0368e1fb14b744a549679 HTTP/1.0" 202 Accepted 2026-04-16 01:11:00,940 - lava_callback - INFO - Starting async job submit for node 69e0368e1fb14b744a549679 2026-04-16 01:11:00,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:11:01,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0368e1fb14b744a549679 HTTP/1.1" 200 None 2026-04-16 01:11:01,003 - lava_callback - DEBUG - Processing node 69e0368e1fb14b744a549679: baseline-arm64-broonie 2026-04-16 01:11:01,063 - lava_callback - INFO - Received callback for node 69e037111fb14b744a549860 INFO: 172.21.0.1:59870 - "POST /node/69e037111fb14b744a549860 HTTP/1.0" 202 Accepted 2026-04-16 01:11:01,085 - lava_callback - INFO - Starting async job submit for node 69e037111fb14b744a549860 2026-04-16 01:11:01,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:11:01,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e037111fb14b744a549860 HTTP/1.1" 200 None 2026-04-16 01:11:01,182 - lava_callback - DEBUG - Processing node 69e037111fb14b744a549860: baseline-arm 2026-04-16 01:11:01,243 - lava_callback - WARNING - Failed to upload log 2026-04-16 01:11:01,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:11:01,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:11:01,408 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:11:01,410 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e0368e1fb14b744a549679/log.txt.gz 2026-04-16 01:11:01,437 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:11:01,468 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e037111fb14b744a549860/lava-logs.yaml 2026-04-16 01:11:01,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:11:01,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:11:01,710 - lava_callback - INFO - Received callback for node 69e036721fb14b744a549604 2026-04-16 01:11:01,716 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 INFO: 172.21.0.1:59882 - "POST /node/69e036721fb14b744a549604 HTTP/1.0" 202 Accepted 2026-04-16 01:11:01,722 - lava_callback - INFO - Starting async job submit for node 69e036721fb14b744a549604 2026-04-16 01:11:01,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:11:01,750 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e037111fb14b744a549860/lava_callback.json.gz 2026-04-16 01:11:01,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:11:01,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036721fb14b744a549604 HTTP/1.1" 200 None 2026-04-16 01:11:01,771 - lava_callback - DEBUG - Processing node 69e036721fb14b744a549604: baseline-nfs-arm64 2026-04-16 01:11:01,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e037111fb14b744a549860 HTTP/1.1" 200 None 2026-04-16 01:11:01,809 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:11:01,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:11:01,852 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e0368e1fb14b744a549679/lava-logs.yaml 2026-04-16 01:11:01,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 01:11:01,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:11:01,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:11:02,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e037111fb14b744a549860 HTTP/1.1" 200 None 2026-04-16 01:11:02,133 - lava_callback - INFO - Completed processing callback for node 69e037111fb14b744a549860 2026-04-16 01:11:02,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:11:02,365 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:11:02,366 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e0368e1fb14b744a549679/lava_callback.json.gz 2026-04-16 01:11:02,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:11:02,395 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:11:02,397 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e036721fb14b744a549604/log.txt.gz 2026-04-16 01:11:02,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0368e1fb14b744a549679 HTTP/1.1" 200 None 2026-04-16 01:11:02,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:11:02,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:11:02,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:11:02,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:11:02,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e0368e1fb14b744a549679 HTTP/1.1" 200 None 2026-04-16 01:11:02,610 - lava_callback - INFO - Completed processing callback for node 69e0368e1fb14b744a549679 2026-04-16 01:11:02,851 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:11:02,853 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e036721fb14b744a549604/lava-logs.yaml 2026-04-16 01:11:02,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:11:03,019 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:11:03,021 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e036721fb14b744a549604/lava_callback.json.gz 2026-04-16 01:11:03,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:11:03,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036721fb14b744a549604 HTTP/1.1" 200 None 2026-04-16 01:11:03,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:11:03,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:11:03,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:11:03,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e036721fb14b744a549604 HTTP/1.1" 200 None 2026-04-16 01:11:03,103 - lava_callback - INFO - Completed processing callback for node 69e036721fb14b744a549604 INFO: 172.21.0.1:59888 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:11:08,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:11:08,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:58550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58562 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:11:25,682 - lava_callback - INFO - Received callback for node 69e036741fb14b744a54960a INFO: 172.21.0.1:33554 - "POST /node/69e036741fb14b744a54960a HTTP/1.0" 202 Accepted 2026-04-16 01:11:25,689 - lava_callback - INFO - Starting async job submit for node 69e036741fb14b744a54960a 2026-04-16 01:11:25,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:11:25,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036741fb14b744a54960a HTTP/1.1" 200 None 2026-04-16 01:11:25,727 - lava_callback - DEBUG - Processing node 69e036741fb14b744a54960a: baseline-nfs-arm64 2026-04-16 01:11:26,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:11:26,164 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:11:26,166 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e036741fb14b744a54960a/log.txt.gz 2026-04-16 01:11:26,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:33566 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:11:26,557 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:11:26,559 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e036741fb14b744a54960a/lava-logs.yaml 2026-04-16 01:11:26,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:11:26,696 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:11:26,698 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e036741fb14b744a54960a/lava_callback.json.gz 2026-04-16 01:11:26,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:11:26,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036741fb14b744a54960a HTTP/1.1" 200 None 2026-04-16 01:11:26,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:11:26,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:11:26,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:11:26,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e036741fb14b744a54960a HTTP/1.1" 200 None 2026-04-16 01:11:26,813 - lava_callback - INFO - Completed processing callback for node 69e036741fb14b744a54960a INFO: 172.21.0.1:33576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54474 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:11:38,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:11:38,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35688 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:12:09,580 - lava_callback - INFO - Received callback for node 69dd945fc2164e674d71ff6b INFO: 172.21.0.1:35704 - "POST /node/69dd945fc2164e674d71ff6b HTTP/1.0" 202 Accepted 2026-04-16 01:12:09,586 - lava_callback - INFO - Starting async job submit for node 69dd945fc2164e674d71ff6b 2026-04-16 01:12:09,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:12:09,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd945fc2164e674d71ff6b HTTP/1.1" 200 None 2026-04-16 01:12:09,601 - lava_callback - DEBUG - Processing node 69dd945fc2164e674d71ff6b: baseline-arm-clabbe 2026-04-16 01:12:09,602 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd945fc2164e674d71ff6b 2026-04-16 01:12:09,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:12:09,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd945fc2164e674d71ff6b HTTP/1.1" 200 None 2026-04-16 01:12:09,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:12:09,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 01:12:09,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:12:09,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd945fc2164e674d71ff6b HTTP/1.1" 200 None 2026-04-16 01:12:09,664 - lava_callback - ERROR - Error processing callback for node 69dd945fc2164e674d71ff6b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34726 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:12:20,703 - lava_callback - INFO - Received callback for node 69e036931fb14b744a549688 INFO: 172.21.0.1:45870 - "POST /node/69e036931fb14b744a549688 HTTP/1.0" 202 Accepted 2026-04-16 01:12:20,709 - lava_callback - INFO - Starting async job submit for node 69e036931fb14b744a549688 2026-04-16 01:12:20,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:12:20,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036931fb14b744a549688 HTTP/1.1" 200 None 2026-04-16 01:12:20,749 - lava_callback - DEBUG - Processing node 69e036931fb14b744a549688: baseline-arm64-broonie 2026-04-16 01:12:21,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:12:21,197 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:12:21,198 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e036931fb14b744a549688/log.txt.gz 2026-04-16 01:12:21,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:12:21,597 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:12:21,599 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e036931fb14b744a549688/lava-logs.yaml 2026-04-16 01:12:21,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:12:21,779 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:12:21,781 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e036931fb14b744a549688/lava_callback.json.gz 2026-04-16 01:12:21,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:12:21,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036931fb14b744a549688 HTTP/1.1" 200 None 2026-04-16 01:12:21,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:12:21,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:12:21,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:12:21,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e036931fb14b744a549688 HTTP/1.1" 200 None 2026-04-16 01:12:21,876 - lava_callback - INFO - Completed processing callback for node 69e036931fb14b744a549688 2026-04-16 01:12:22,433 - lava_callback - INFO - Received callback for node 69e036641fb14b744a5495df INFO: 172.21.0.1:45874 - "POST /node/69e036641fb14b744a5495df HTTP/1.0" 202 Accepted 2026-04-16 01:12:22,440 - lava_callback - INFO - Starting async job submit for node 69e036641fb14b744a5495df 2026-04-16 01:12:22,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:12:22,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036641fb14b744a5495df HTTP/1.1" 200 None 2026-04-16 01:12:22,475 - lava_callback - DEBUG - Processing node 69e036641fb14b744a5495df: baseline-arm64 2026-04-16 01:12:22,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:12:22,971 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:12:22,973 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e036641fb14b744a5495df/log.txt.gz 2026-04-16 01:12:23,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:12:23,357 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:12:23,359 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e036641fb14b744a5495df/lava-logs.yaml 2026-04-16 01:12:23,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:12:23,688 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:12:23,689 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e036641fb14b744a5495df/lava_callback.json.gz 2026-04-16 01:12:23,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:12:23,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036641fb14b744a5495df HTTP/1.1" 200 None 2026-04-16 01:12:23,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:12:23,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:12:23,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:12:23,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e036641fb14b744a5495df HTTP/1.1" 200 None 2026-04-16 01:12:23,761 - lava_callback - INFO - Completed processing callback for node 69e036641fb14b744a5495df INFO: 172.21.0.1:45886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35828 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:12:38,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:12:38,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52958 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:12:49,608 - lava_callback - INFO - Received callback for node 69dd9485c2164e674d71ff9e INFO: 172.21.0.1:52972 - "POST /node/69dd9485c2164e674d71ff9e HTTP/1.0" 202 Accepted 2026-04-16 01:12:49,614 - lava_callback - INFO - Starting async job submit for node 69dd9485c2164e674d71ff9e 2026-04-16 01:12:49,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:12:49,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9485c2164e674d71ff9e HTTP/1.1" 200 None 2026-04-16 01:12:49,629 - lava_callback - DEBUG - Processing node 69dd9485c2164e674d71ff9e: baseline-arm-clabbe 2026-04-16 01:12:49,629 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9485c2164e674d71ff9e 2026-04-16 01:12:49,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:12:49,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9485c2164e674d71ff9e HTTP/1.1" 200 None 2026-04-16 01:12:49,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:12:49,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 01:12:49,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:12:49,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9485c2164e674d71ff9e HTTP/1.1" 200 None 2026-04-16 01:12:49,686 - lava_callback - ERROR - Error processing callback for node 69dd9485c2164e674d71ff9e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45636 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:13:28,508 - lava_callback - INFO - Received callback for node 69e036731fb14b744a549607 INFO: 172.21.0.1:45652 - "POST /node/69e036731fb14b744a549607 HTTP/1.0" 202 Accepted 2026-04-16 01:13:28,518 - lava_callback - INFO - Starting async job submit for node 69e036731fb14b744a549607 2026-04-16 01:13:28,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:13:28,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036731fb14b744a549607 HTTP/1.1" 200 None 2026-04-16 01:13:28,574 - lava_callback - DEBUG - Processing node 69e036731fb14b744a549607: baseline-nfs-arm64 2026-04-16 01:13:29,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:13:29,301 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:13:29,303 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e036731fb14b744a549607/log.txt.gz INFO: 172.21.0.1:45656 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:13:29,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:13:29,662 - lava_callback - INFO - Received callback for node 69dd94a6c2164e674d71ffcb INFO: 172.21.0.1:45662 - "POST /node/69dd94a6c2164e674d71ffcb HTTP/1.0" 202 Accepted 2026-04-16 01:13:29,669 - lava_callback - INFO - Starting async job submit for node 69dd94a6c2164e674d71ffcb 2026-04-16 01:13:29,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:13:29,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd94a6c2164e674d71ffcb HTTP/1.1" 200 None 2026-04-16 01:13:29,688 - lava_callback - DEBUG - Processing node 69dd94a6c2164e674d71ffcb: baseline-arm-clabbe 2026-04-16 01:13:29,689 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd94a6c2164e674d71ffcb 2026-04-16 01:13:29,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:13:29,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd94a6c2164e674d71ffcb HTTP/1.1" 200 None 2026-04-16 01:13:29,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:13:29,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 01:13:29,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:13:29,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd94a6c2164e674d71ffcb HTTP/1.1" 200 None 2026-04-16 01:13:29,746 - lava_callback - ERROR - Error processing callback for node 69dd94a6c2164e674d71ffcb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 01:13:29,860 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:13:29,863 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e036731fb14b744a549607/lava-logs.yaml 2026-04-16 01:13:29,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:13:30,067 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:13:30,068 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e036731fb14b744a549607/lava_callback.json.gz 2026-04-16 01:13:30,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:13:30,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036731fb14b744a549607 HTTP/1.1" 200 None 2026-04-16 01:13:30,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:13:30,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:13:30,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:13:30,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e036731fb14b744a549607 HTTP/1.1" 200 None 2026-04-16 01:13:30,146 - lava_callback - INFO - Completed processing callback for node 69e036731fb14b744a549607 INFO: 172.21.0.1:51452 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:13:38,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:13:38,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-16 01:13:40,947 - lava_callback - INFO - Received callback for node 69e036971fb14b744a54969b INFO: 172.21.0.1:40224 - "POST /node/69e036971fb14b744a54969b HTTP/1.0" 202 Accepted 2026-04-16 01:13:40,954 - lava_callback - INFO - Starting async job submit for node 69e036971fb14b744a54969b 2026-04-16 01:13:41,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:13:41,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036971fb14b744a54969b HTTP/1.1" 200 None 2026-04-16 01:13:41,034 - lava_callback - DEBUG - Processing node 69e036971fb14b744a54969b: baseline-arm64-broonie 2026-04-16 01:13:41,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:13:41,838 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:13:41,839 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e036971fb14b744a54969b/log.txt.gz 2026-04-16 01:13:42,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:13:42,323 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:13:42,325 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e036971fb14b744a54969b/lava-logs.yaml 2026-04-16 01:13:42,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:13:42,664 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:13:42,666 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e036971fb14b744a54969b/lava_callback.json.gz 2026-04-16 01:13:42,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:13:42,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036971fb14b744a54969b HTTP/1.1" 200 None 2026-04-16 01:13:42,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:13:42,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:13:42,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:13:42,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e036971fb14b744a54969b HTTP/1.1" 200 None 2026-04-16 01:13:42,897 - lava_callback - INFO - Completed processing callback for node 69e036971fb14b744a54969b INFO: 172.21.0.1:40228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41628 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:14:08,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:14:08,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51198 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:14:19,284 - lava_callback - INFO - Received callback for node 69e036701fb14b744a549601 INFO: 172.21.0.1:51200 - "POST /node/69e036701fb14b744a549601 HTTP/1.0" 202 Accepted 2026-04-16 01:14:19,291 - lava_callback - INFO - Starting async job submit for node 69e036701fb14b744a549601 2026-04-16 01:14:19,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:14:19,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036701fb14b744a549601 HTTP/1.1" 200 None 2026-04-16 01:14:19,351 - lava_callback - DEBUG - Processing node 69e036701fb14b744a549601: baseline-arm64 2026-04-16 01:14:19,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:14:19,888 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:14:19,889 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e036701fb14b744a549601/log.txt.gz 2026-04-16 01:14:20,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:14:20,292 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:14:20,294 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e036701fb14b744a549601/lava-logs.yaml 2026-04-16 01:14:20,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:14:20,470 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:14:20,472 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e036701fb14b744a549601/lava_callback.json.gz DEBUG: Setup failed for 69e036701fb14b744a549601. Transitting job node result: incomplete -> fail 2026-04-16 01:14:20,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:14:20,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036701fb14b744a549601 HTTP/1.1" 200 None 2026-04-16 01:14:20,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:14:20,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:14:20,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:14:20,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e036701fb14b744a549601 HTTP/1.1" 200 None 2026-04-16 01:14:20,701 - lava_callback - INFO - Completed processing callback for node 69e036701fb14b744a549601 INFO: 172.21.0.1:47478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41916 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:14:38,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:14:38,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42254 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57616 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:18:14,124 - lava_callback - INFO - Received callback for node 69e036611fb14b744a5495b8 INFO: 172.21.0.1:41056 - "POST /node/69e036611fb14b744a5495b8 HTTP/1.0" 202 Accepted 2026-04-16 01:18:14,130 - lava_callback - INFO - Starting async job submit for node 69e036611fb14b744a5495b8 2026-04-16 01:18:14,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:18:14,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036611fb14b744a5495b8 HTTP/1.1" 200 None 2026-04-16 01:18:14,176 - lava_callback - DEBUG - Processing node 69e036611fb14b744a5495b8: baseline-arm64 2026-04-16 01:18:14,315 - lava_callback - WARNING - Failed to upload log 2026-04-16 01:18:14,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:18:14,732 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:18:14,734 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e036611fb14b744a5495b8/lava-logs.yaml 2026-04-16 01:18:14,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:18:14,867 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:18:14,868 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e036611fb14b744a5495b8/lava_callback.json.gz 2026-04-16 01:18:14,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:18:14,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036611fb14b744a5495b8 HTTP/1.1" 200 None 2026-04-16 01:18:14,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:18:14,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:18:14,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:18:14,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e036611fb14b744a5495b8 HTTP/1.1" 200 None 2026-04-16 01:18:15,025 - lava_callback - INFO - Completed processing callback for node 69e036611fb14b744a5495b8 INFO: 172.21.0.1:41058 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59834 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:18:38,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:18:38,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52776 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-16 01:19:16,345 - lava_callback - INFO - Received callback for node 69e036621fb14b744a5495bb INFO: 172.21.0.1:52790 - "POST /node/69e036621fb14b744a5495bb HTTP/1.0" 202 Accepted 2026-04-16 01:19:16,352 - lava_callback - INFO - Starting async job submit for node 69e036621fb14b744a5495bb 2026-04-16 01:19:16,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:19:16,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036621fb14b744a5495bb HTTP/1.1" 200 None 2026-04-16 01:19:16,417 - lava_callback - DEBUG - Processing node 69e036621fb14b744a5495bb: baseline-arm64 INFO: 172.21.0.1:52802 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:19:16,563 - lava_callback - WARNING - Failed to upload log 2026-04-16 01:19:16,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:19:17,038 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:19:17,040 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e036621fb14b744a5495bb/lava-logs.yaml 2026-04-16 01:19:17,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:19:17,185 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:19:17,187 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e036621fb14b744a5495bb/lava_callback.json.gz 2026-04-16 01:19:17,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:19:17,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036621fb14b744a5495bb HTTP/1.1" 200 None 2026-04-16 01:19:17,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:19:17,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:19:17,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:19:17,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e036621fb14b744a5495bb HTTP/1.1" 200 None 2026-04-16 01:19:17,341 - lava_callback - INFO - Completed processing callback for node 69e036621fb14b744a5495bb INFO: 172.21.0.1:43754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42562 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:19:38,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:19:38,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48844 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:23:11,686 - lava_callback - INFO - Received callback for node 69e036681fb14b744a5495eb INFO: 172.21.0.1:51916 - "POST /node/69e036681fb14b744a5495eb HTTP/1.0" 202 Accepted 2026-04-16 01:23:11,694 - lava_callback - INFO - Starting async job submit for node 69e036681fb14b744a5495eb 2026-04-16 01:23:11,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:23:11,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036681fb14b744a5495eb HTTP/1.1" 200 None 2026-04-16 01:23:11,770 - lava_callback - DEBUG - Processing node 69e036681fb14b744a5495eb: baseline-arm64 2026-04-16 01:23:12,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:23:13,018 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:23:13,020 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e036681fb14b744a5495eb/log.txt.gz 2026-04-16 01:23:13,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:23:13,878 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:23:13,880 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e036681fb14b744a5495eb/lava-logs.yaml 2026-04-16 01:23:13,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:23:14,093 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:23:14,095 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e036681fb14b744a5495eb/lava_callback.json.gz 2026-04-16 01:23:14,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:23:14,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036681fb14b744a5495eb HTTP/1.1" 200 None 2026-04-16 01:23:14,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:23:14,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:23:14,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:23:14,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e036681fb14b744a5495eb HTTP/1.1" 200 None 2026-04-16 01:23:14,321 - lava_callback - INFO - Completed processing callback for node 69e036681fb14b744a5495eb INFO: 172.21.0.1:51930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53410 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:23:38,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:23:38,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50438 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:24:35,336 - lava_callback - INFO - Received callback for node 69dd9741c2164e674d720306 INFO: 172.21.0.1:34172 - "POST /node/69dd9741c2164e674d720306 HTTP/1.0" 202 Accepted 2026-04-16 01:24:35,341 - lava_callback - INFO - Starting async job submit for node 69dd9741c2164e674d720306 2026-04-16 01:24:35,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:24:35,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9741c2164e674d720306 HTTP/1.1" 200 None 2026-04-16 01:24:35,359 - lava_callback - DEBUG - Processing node 69dd9741c2164e674d720306: baseline-arm64-baylibre 2026-04-16 01:24:35,359 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9741c2164e674d720306 2026-04-16 01:24:35,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:24:35,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9741c2164e674d720306 HTTP/1.1" 200 None 2026-04-16 01:24:35,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:24:35,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-16 01:24:35,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:24:35,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9741c2164e674d720306 HTTP/1.1" 200 None 2026-04-16 01:24:35,413 - lava_callback - ERROR - Error processing callback for node 69dd9741c2164e674d720306: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33024 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:25:55,310 - lava_callback - INFO - Received callback for node 69dd9791c2164e674d720364 INFO: 172.21.0.1:41978 - "POST /node/69dd9791c2164e674d720364 HTTP/1.0" 202 Accepted 2026-04-16 01:25:55,316 - lava_callback - INFO - Starting async job submit for node 69dd9791c2164e674d720364 2026-04-16 01:25:55,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:25:55,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9791c2164e674d720364 HTTP/1.1" 200 None 2026-04-16 01:25:55,332 - lava_callback - DEBUG - Processing node 69dd9791c2164e674d720364: baseline-arm64-baylibre 2026-04-16 01:25:55,332 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9791c2164e674d720364 2026-04-16 01:25:55,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:25:55,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9791c2164e674d720364 HTTP/1.1" 200 None 2026-04-16 01:25:55,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:25:55,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-16 01:25:55,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:25:55,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9791c2164e674d720364 HTTP/1.1" 200 None 2026-04-16 01:25:55,384 - lava_callback - ERROR - Error processing callback for node 69dd9791c2164e674d720364: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41776 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-16 01:27:15,388 - lava_callback - INFO - Received callback for node 69dd97e3c2164e674d720385 INFO: 172.21.0.1:41784 - "POST /node/69dd97e3c2164e674d720385 HTTP/1.0" 202 Accepted 2026-04-16 01:27:15,394 - lava_callback - INFO - Starting async job submit for node 69dd97e3c2164e674d720385 2026-04-16 01:27:15,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:27:15,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd97e3c2164e674d720385 HTTP/1.1" 200 None 2026-04-16 01:27:15,409 - lava_callback - DEBUG - Processing node 69dd97e3c2164e674d720385: baseline-arm64-baylibre 2026-04-16 01:27:15,409 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd97e3c2164e674d720385 2026-04-16 01:27:15,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:27:15,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd97e3c2164e674d720385 HTTP/1.1" 200 None 2026-04-16 01:27:15,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:27:15,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-16 01:27:15,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:27:15,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd97e3c2164e674d720385 HTTP/1.1" 200 None 2026-04-16 01:27:15,457 - lava_callback - ERROR - Error processing callback for node 69dd97e3c2164e674d720385: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45016 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:27:51,634 - lava_callback - INFO - Received callback for node 69e0366c1fb14b744a5495f4 INFO: 172.21.0.1:55726 - "POST /node/69e0366c1fb14b744a5495f4 HTTP/1.0" 202 Accepted 2026-04-16 01:27:51,640 - lava_callback - INFO - Starting async job submit for node 69e0366c1fb14b744a5495f4 2026-04-16 01:27:51,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:27:51,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0366c1fb14b744a5495f4 HTTP/1.1" 200 None 2026-04-16 01:27:51,680 - lava_callback - DEBUG - Processing node 69e0366c1fb14b744a5495f4: baseline-arm64 2026-04-16 01:27:52,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:27:52,365 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:27:52,367 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e0366c1fb14b744a5495f4/log.txt.gz 2026-04-16 01:27:52,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:27:52,846 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:27:52,848 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e0366c1fb14b744a5495f4/lava-logs.yaml 2026-04-16 01:27:52,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:27:53,065 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:27:53,067 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e0366c1fb14b744a5495f4/lava_callback.json.gz 2026-04-16 01:27:53,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:27:53,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0366c1fb14b744a5495f4 HTTP/1.1" 200 None 2026-04-16 01:27:53,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:27:53,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:27:53,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:27:53,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e0366c1fb14b744a5495f4 HTTP/1.1" 200 None 2026-04-16 01:27:53,200 - lava_callback - INFO - Completed processing callback for node 69e0366c1fb14b744a5495f4 INFO: 172.21.0.1:55738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42156 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:28:08,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:28:08,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36336 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:28:35,470 - lava_callback - INFO - Received callback for node 69dd983ac2164e674d7203c5 INFO: 172.21.0.1:57936 - "POST /node/69dd983ac2164e674d7203c5 HTTP/1.0" 202 Accepted 2026-04-16 01:28:35,475 - lava_callback - INFO - Starting async job submit for node 69dd983ac2164e674d7203c5 2026-04-16 01:28:35,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:28:35,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd983ac2164e674d7203c5 HTTP/1.1" 200 None 2026-04-16 01:28:35,503 - lava_callback - DEBUG - Processing node 69dd983ac2164e674d7203c5: baseline-arm64-baylibre 2026-04-16 01:28:35,503 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd983ac2164e674d7203c5 2026-04-16 01:28:35,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:28:35,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd983ac2164e674d7203c5 HTTP/1.1" 200 None 2026-04-16 01:28:35,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:28:35,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-16 01:28:35,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:28:35,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd983ac2164e674d7203c5 HTTP/1.1" 200 None 2026-04-16 01:28:35,551 - lava_callback - ERROR - Error processing callback for node 69dd983ac2164e674d7203c5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57950 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:28:45,944 - lava_callback - INFO - Received callback for node 69e036761fb14b744a54960d INFO: 172.21.0.1:59494 - "POST /node/69e036761fb14b744a54960d HTTP/1.0" 202 Accepted 2026-04-16 01:28:45,952 - lava_callback - INFO - Starting async job submit for node 69e036761fb14b744a54960d 2026-04-16 01:28:45,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:28:46,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036761fb14b744a54960d HTTP/1.1" 200 None 2026-04-16 01:28:46,023 - lava_callback - DEBUG - Processing node 69e036761fb14b744a54960d: baseline-nfs-arm64 INFO: 172.21.0.1:59502 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:28:47,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:28:47,215 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:28:47,216 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e036761fb14b744a54960d/log.txt.gz 2026-04-16 01:28:47,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:28:48,018 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:28:48,021 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e036761fb14b744a54960d/lava-logs.yaml 2026-04-16 01:28:48,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:28:48,254 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:28:48,256 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e036761fb14b744a54960d/lava_callback.json.gz DEBUG: Setup failed for 69e036761fb14b744a54960d. Transitting job node result: incomplete -> fail 2026-04-16 01:28:48,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:28:48,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e036761fb14b744a54960d HTTP/1.1" 200 None 2026-04-16 01:28:48,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:28:48,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:28:48,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:28:48,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e036761fb14b744a54960d HTTP/1.1" 200 None 2026-04-16 01:28:48,500 - lava_callback - INFO - Completed processing callback for node 69e036761fb14b744a54960d INFO: 172.21.0.1:39640 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:28:59,093 - lava_callback - INFO - Received callback for node 69e0367c1fb14b744a549622 INFO: 172.21.0.1:39648 - "POST /node/69e0367c1fb14b744a549622 HTTP/1.0" 202 Accepted 2026-04-16 01:28:59,101 - lava_callback - INFO - Starting async job submit for node 69e0367c1fb14b744a549622 2026-04-16 01:28:59,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:28:59,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0367c1fb14b744a549622 HTTP/1.1" 200 None 2026-04-16 01:28:59,150 - lava_callback - DEBUG - Processing node 69e0367c1fb14b744a549622: baseline-nfs-arm64 2026-04-16 01:28:59,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:28:59,932 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:28:59,934 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e0367c1fb14b744a549622/log.txt.gz 2026-04-16 01:29:00,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:29:00,513 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:29:00,515 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e0367c1fb14b744a549622/lava-logs.yaml 2026-04-16 01:29:00,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:29:00,704 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:29:00,706 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e0367c1fb14b744a549622/lava_callback.json.gz 2026-04-16 01:29:00,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:29:00,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0367c1fb14b744a549622 HTTP/1.1" 200 None 2026-04-16 01:29:00,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:29:00,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:29:00,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:29:00,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e0367c1fb14b744a549622 HTTP/1.1" 200 None 2026-04-16 01:29:00,848 - lava_callback - INFO - Completed processing callback for node 69e0367c1fb14b744a549622 INFO: 172.21.0.1:54888 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:29:08,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:29:08,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51498 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:29:55,585 - lava_callback - INFO - Received callback for node 69dd9881c2164e674d72043f INFO: 172.21.0.1:49334 - "POST /node/69dd9881c2164e674d72043f HTTP/1.0" 202 Accepted 2026-04-16 01:29:55,591 - lava_callback - INFO - Starting async job submit for node 69dd9881c2164e674d72043f 2026-04-16 01:29:55,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:29:55,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9881c2164e674d72043f HTTP/1.1" 200 None 2026-04-16 01:29:55,608 - lava_callback - DEBUG - Processing node 69dd9881c2164e674d72043f: baseline-arm64-baylibre 2026-04-16 01:29:55,608 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9881c2164e674d72043f 2026-04-16 01:29:55,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:29:55,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9881c2164e674d72043f HTTP/1.1" 200 None 2026-04-16 01:29:55,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:29:55,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-16 01:29:55,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:29:55,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9881c2164e674d72043f HTTP/1.1" 200 None 2026-04-16 01:29:55,655 - lava_callback - ERROR - Error processing callback for node 69dd9881c2164e674d72043f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40346 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-16 01:31:15,600 - lava_callback - INFO - Received callback for node 69dd98d2c2164e674d720482 INFO: 172.21.0.1:40352 - "POST /node/69dd98d2c2164e674d720482 HTTP/1.0" 202 Accepted 2026-04-16 01:31:15,606 - lava_callback - INFO - Starting async job submit for node 69dd98d2c2164e674d720482 2026-04-16 01:31:15,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:31:15,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd98d2c2164e674d720482 HTTP/1.1" 200 None 2026-04-16 01:31:15,623 - lava_callback - DEBUG - Processing node 69dd98d2c2164e674d720482: baseline-arm64-baylibre 2026-04-16 01:31:15,623 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd98d2c2164e674d720482 2026-04-16 01:31:15,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:31:15,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd98d2c2164e674d720482 HTTP/1.1" 200 None 2026-04-16 01:31:15,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:31:15,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-16 01:31:15,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:31:15,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd98d2c2164e674d720482 HTTP/1.1" 200 None 2026-04-16 01:31:15,681 - lava_callback - ERROR - Error processing callback for node 69dd98d2c2164e674d720482: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33390 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:32:30,477 - lava_callback - INFO - Received callback for node 69dd9928c2164e674d7204d0 INFO: 172.21.0.1:33396 - "POST /node/69dd9928c2164e674d7204d0 HTTP/1.0" 202 Accepted 2026-04-16 01:32:30,482 - lava_callback - INFO - Starting async job submit for node 69dd9928c2164e674d7204d0 2026-04-16 01:32:30,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:32:30,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9928c2164e674d7204d0 HTTP/1.1" 200 None 2026-04-16 01:32:30,499 - lava_callback - DEBUG - Processing node 69dd9928c2164e674d7204d0: baseline-arm64-clabbe 2026-04-16 01:32:30,499 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9928c2164e674d7204d0 2026-04-16 01:32:30,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:32:30,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9928c2164e674d7204d0 HTTP/1.1" 200 None 2026-04-16 01:32:30,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:32:30,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-16 01:32:30,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:32:30,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9928c2164e674d7204d0 HTTP/1.1" 200 None 2026-04-16 01:32:30,556 - lava_callback - ERROR - Error processing callback for node 69dd9928c2164e674d7204d0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41550 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:32:46,531 - lava_callback - INFO - Received callback for node 69e038251fb14b744a549f68 INFO: 172.21.0.1:41556 - "POST /node/69e038251fb14b744a549f68 HTTP/1.0" 202 Accepted 2026-04-16 01:32:46,538 - lava_callback - INFO - Starting async job submit for node 69e038251fb14b744a549f68 2026-04-16 01:32:46,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:32:46,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e038251fb14b744a549f68 HTTP/1.1" 200 None 2026-04-16 01:32:46,609 - lava_callback - DEBUG - Processing node 69e038251fb14b744a549f68: baseline-arm 2026-04-16 01:32:47,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:32:47,395 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:32:47,397 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e038251fb14b744a549f68/log.txt.gz 2026-04-16 01:32:47,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:32:48,180 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:32:48,182 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e038251fb14b744a549f68/lava-logs.yaml 2026-04-16 01:32:48,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:32:48,381 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:32:48,383 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e038251fb14b744a549f68/lava_callback.json.gz DEBUG: Setup failed for 69e038251fb14b744a549f68. Transitting job node result: incomplete -> fail 2026-04-16 01:32:48,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:32:48,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e038251fb14b744a549f68 HTTP/1.1" 200 None 2026-04-16 01:32:48,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:32:48,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 01:32:48,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:32:48,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e038251fb14b744a549f68 HTTP/1.1" 200 None 2026-04-16 01:32:48,660 - lava_callback - INFO - Completed processing callback for node 69e038251fb14b744a549f68 INFO: 172.21.0.1:41092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38678 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:33:08,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:33:08,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49834 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:33:50,537 - lava_callback - INFO - Received callback for node 69dd997bc2164e674d720509 INFO: 172.21.0.1:40936 - "POST /node/69dd997bc2164e674d720509 HTTP/1.0" 202 Accepted 2026-04-16 01:33:50,543 - lava_callback - INFO - Starting async job submit for node 69dd997bc2164e674d720509 2026-04-16 01:33:50,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:33:50,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd997bc2164e674d720509 HTTP/1.1" 200 None 2026-04-16 01:33:50,560 - lava_callback - DEBUG - Processing node 69dd997bc2164e674d720509: baseline-arm64-clabbe 2026-04-16 01:33:50,560 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd997bc2164e674d720509 2026-04-16 01:33:50,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:33:50,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd997bc2164e674d720509 HTTP/1.1" 200 None 2026-04-16 01:33:50,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:33:50,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-16 01:33:50,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:33:50,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd997bc2164e674d720509 HTTP/1.1" 200 None 2026-04-16 01:33:50,631 - lava_callback - ERROR - Error processing callback for node 69dd997bc2164e674d720509: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42418 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46124 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:35:10,644 - lava_callback - INFO - Received callback for node 69dd99c0c2164e674d720579 INFO: 172.21.0.1:58278 - "POST /node/69dd99c0c2164e674d720579 HTTP/1.0" 202 Accepted 2026-04-16 01:35:10,649 - lava_callback - INFO - Starting async job submit for node 69dd99c0c2164e674d720579 2026-04-16 01:35:10,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:35:10,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd99c0c2164e674d720579 HTTP/1.1" 200 None 2026-04-16 01:35:10,667 - lava_callback - DEBUG - Processing node 69dd99c0c2164e674d720579: baseline-arm64-clabbe 2026-04-16 01:35:10,667 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd99c0c2164e674d720579 2026-04-16 01:35:10,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:35:10,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd99c0c2164e674d720579 HTTP/1.1" 200 None 2026-04-16 01:35:10,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:35:10,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-16 01:35:10,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:35:10,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd99c0c2164e674d720579 HTTP/1.1" 200 None 2026-04-16 01:35:10,723 - lava_callback - ERROR - Error processing callback for node 69dd99c0c2164e674d720579: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47980 - "GET /node/6992688998a8bdb31c392217%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:47986 - "GET /node/69884c48e408e9ea60fad232%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:48000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54286 - "GET /node/69863491177ca0f097bd2a30%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:54300 - "GET /node/694bd895c19e09af58d497e9%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:54314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38722 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54978 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:36:30,659 - lava_callback - INFO - Received callback for node 69dd9a11c2164e674d7205b8 INFO: 172.21.0.1:54986 - "POST /node/69dd9a11c2164e674d7205b8 HTTP/1.0" 202 Accepted 2026-04-16 01:36:30,664 - lava_callback - INFO - Starting async job submit for node 69dd9a11c2164e674d7205b8 2026-04-16 01:36:30,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:36:30,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9a11c2164e674d7205b8 HTTP/1.1" 200 None 2026-04-16 01:36:30,680 - lava_callback - DEBUG - Processing node 69dd9a11c2164e674d7205b8: baseline-arm64-clabbe 2026-04-16 01:36:30,680 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9a11c2164e674d7205b8 2026-04-16 01:36:30,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:36:30,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9a11c2164e674d7205b8 HTTP/1.1" 200 None 2026-04-16 01:36:30,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:36:30,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-16 01:36:30,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:36:30,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9a11c2164e674d7205b8 HTTP/1.1" 200 None 2026-04-16 01:36:30,737 - lava_callback - ERROR - Error processing callback for node 69dd9a11c2164e674d7205b8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38418 - "GET /node/695301fa9912bd6bbcea6ba0%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:38432 - "GET /node/69103887f4a91d81a0ec4774%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:38440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38718 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:37:50,754 - lava_callback - INFO - Received callback for node 69dd9a5fc2164e674d7205f6 INFO: 172.21.0.1:59066 - "POST /node/69dd9a5fc2164e674d7205f6 HTTP/1.0" 202 Accepted 2026-04-16 01:37:50,760 - lava_callback - INFO - Starting async job submit for node 69dd9a5fc2164e674d7205f6 2026-04-16 01:37:50,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:37:50,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9a5fc2164e674d7205f6 HTTP/1.1" 200 None 2026-04-16 01:37:50,790 - lava_callback - DEBUG - Processing node 69dd9a5fc2164e674d7205f6: baseline-arm64-clabbe 2026-04-16 01:37:50,791 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9a5fc2164e674d7205f6 2026-04-16 01:37:50,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:37:50,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9a5fc2164e674d7205f6 HTTP/1.1" 200 None 2026-04-16 01:37:50,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:37:50,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-16 01:37:50,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:37:50,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9a5fc2164e674d7205f6 HTTP/1.1" 200 None 2026-04-16 01:37:50,840 - lava_callback - ERROR - Error processing callback for node 69dd9a5fc2164e674d7205f6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60124 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:39:10,780 - lava_callback - INFO - Received callback for node 69dd9aaac2164e674d72065c INFO: 172.21.0.1:55718 - "POST /node/69dd9aaac2164e674d72065c HTTP/1.0" 202 Accepted 2026-04-16 01:39:10,786 - lava_callback - INFO - Starting async job submit for node 69dd9aaac2164e674d72065c 2026-04-16 01:39:10,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:39:10,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9aaac2164e674d72065c HTTP/1.1" 200 None 2026-04-16 01:39:10,806 - lava_callback - DEBUG - Processing node 69dd9aaac2164e674d72065c: baseline-arm64-clabbe 2026-04-16 01:39:10,806 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9aaac2164e674d72065c 2026-04-16 01:39:10,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:39:10,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9aaac2164e674d72065c HTTP/1.1" 200 None 2026-04-16 01:39:10,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:39:10,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-16 01:39:10,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:39:10,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9aaac2164e674d72065c HTTP/1.1" 200 None 2026-04-16 01:39:10,858 - lava_callback - ERROR - Error processing callback for node 69dd9aaac2164e674d72065c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45660 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:40:10,901 - lava_callback - INFO - Received callback for node 69dd9af5c2164e674d7206ae INFO: 172.21.0.1:40136 - "POST /node/69dd9af5c2164e674d7206ae HTTP/1.0" 202 Accepted 2026-04-16 01:40:10,909 - lava_callback - INFO - Starting async job submit for node 69dd9af5c2164e674d7206ae 2026-04-16 01:40:10,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:40:10,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9af5c2164e674d7206ae HTTP/1.1" 200 None 2026-04-16 01:40:10,936 - lava_callback - DEBUG - Processing node 69dd9af5c2164e674d7206ae: baseline-arm64-clabbe 2026-04-16 01:40:10,936 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9af5c2164e674d7206ae 2026-04-16 01:40:10,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:40:10,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9af5c2164e674d7206ae HTTP/1.1" 200 None 2026-04-16 01:40:10,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:40:10,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-16 01:40:10,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:40:11,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9af5c2164e674d7206ae HTTP/1.1" 200 None 2026-04-16 01:40:11,001 - lava_callback - ERROR - Error processing callback for node 69dd9af5c2164e674d7206ae: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43722 - "GET /node/69903bf8985e4efca431df0b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:43734 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-16 01:41:16,166 - lava_callback - INFO - Received callback for node 69dd9b39c2164e674d720711 INFO: 172.21.0.1:43736 - "POST /node/69dd9b39c2164e674d720711 HTTP/1.0" 202 Accepted 2026-04-16 01:41:16,172 - lava_callback - INFO - Starting async job submit for node 69dd9b39c2164e674d720711 2026-04-16 01:41:16,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:41:16,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9b39c2164e674d720711 HTTP/1.1" 200 None 2026-04-16 01:41:16,187 - lava_callback - DEBUG - Processing node 69dd9b39c2164e674d720711: baseline-arm64-baylibre 2026-04-16 01:41:16,187 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9b39c2164e674d720711 2026-04-16 01:41:16,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:41:16,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9b39c2164e674d720711 HTTP/1.1" 200 None 2026-04-16 01:41:16,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:41:16,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d841b2b28893fa2e230976 HTTP/1.1" 200 None 2026-04-16 01:41:16,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:41:16,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9b39c2164e674d720711 HTTP/1.1" 200 None 2026-04-16 01:41:16,264 - lava_callback - ERROR - Error processing callback for node 69dd9b39c2164e674d720711: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32768 - "GET /node/6952406f5318368af0c49ddb%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:32784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47814 - "GET /node/695fe01bf1cdc0dc69d51f02%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:47828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59842 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54024 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:42:36,240 - lava_callback - INFO - Received callback for node 69dd9b8ac2164e674d720740 INFO: 172.21.0.1:54038 - "POST /node/69dd9b8ac2164e674d720740 HTTP/1.0" 202 Accepted 2026-04-16 01:42:36,246 - lava_callback - INFO - Starting async job submit for node 69dd9b8ac2164e674d720740 2026-04-16 01:42:36,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:42:36,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9b8ac2164e674d720740 HTTP/1.1" 200 None 2026-04-16 01:42:36,263 - lava_callback - DEBUG - Processing node 69dd9b8ac2164e674d720740: baseline-arm64-baylibre 2026-04-16 01:42:36,263 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9b8ac2164e674d720740 2026-04-16 01:42:36,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:42:36,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9b8ac2164e674d720740 HTTP/1.1" 200 None 2026-04-16 01:42:36,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:42:36,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d841b2b28893fa2e230976 HTTP/1.1" 200 None 2026-04-16 01:42:36,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:42:36,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9b8ac2164e674d720740 HTTP/1.1" 200 None 2026-04-16 01:42:36,327 - lava_callback - ERROR - Error processing callback for node 69dd9b8ac2164e674d720740: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50482 - "GET /node/69903e93985e4efca431e70b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:50492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45154 - "GET /node/69afe50aae557f2600f0fec5%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:40948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50244 - "GET /node/698bd8071e517752bab8b554%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:50246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50494 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-16 01:45:16,428 - lava_callback - INFO - Received callback for node 69dd9c1cc2164e674d7207eb INFO: 172.21.0.1:50508 - "POST /node/69dd9c1cc2164e674d7207eb HTTP/1.0" 202 Accepted 2026-04-16 01:45:16,434 - lava_callback - INFO - Starting async job submit for node 69dd9c1cc2164e674d7207eb 2026-04-16 01:45:16,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:45:16,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9c1cc2164e674d7207eb HTTP/1.1" 200 None 2026-04-16 01:45:16,452 - lava_callback - DEBUG - Processing node 69dd9c1cc2164e674d7207eb: baseline-arm64-baylibre 2026-04-16 01:45:16,452 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9c1cc2164e674d7207eb 2026-04-16 01:45:16,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:45:16,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9c1cc2164e674d7207eb HTTP/1.1" 200 None 2026-04-16 01:45:16,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:45:16,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d841b2b28893fa2e230976 HTTP/1.1" 200 None 2026-04-16 01:45:16,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:45:16,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9c1cc2164e674d7207eb HTTP/1.1" 200 None 2026-04-16 01:45:16,508 - lava_callback - ERROR - Error processing callback for node 69dd9c1cc2164e674d7207eb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51000 - "GET /node/693b7d4341fb4c9509763894%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-16 01:46:42,344 - lava_callback - INFO - Received callback for node 69e03e891fb14b744a54a54d INFO: 172.21.0.1:51012 - "POST /node/69e03e891fb14b744a54a54d HTTP/1.0" 202 Accepted 2026-04-16 01:46:42,354 - lava_callback - INFO - Starting async job submit for node 69e03e891fb14b744a54a54d 2026-04-16 01:46:42,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:46:42,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e03e891fb14b744a54a54d HTTP/1.1" 200 None 2026-04-16 01:46:42,396 - lava_callback - DEBUG - Processing node 69e03e891fb14b744a54a54d: ltp-fsx 2026-04-16 01:46:42,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:46:42,914 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:46:42,916 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fsx-69e03e891fb14b744a54a54d/log.txt.gz 2026-04-16 01:46:43,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:46:43,400 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:46:43,402 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fsx-69e03e891fb14b744a54a54d/lava-logs.yaml 2026-04-16 01:46:43,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:46:43,564 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:46:43,566 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fsx-69e03e891fb14b744a54a54d/lava_callback.json.gz 2026-04-16 01:46:43,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:46:43,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e03e891fb14b744a54a54d HTTP/1.1" 200 None 2026-04-16 01:46:43,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:46:43,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 01:46:43,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:46:43,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e03e891fb14b744a54a54d HTTP/1.1" 200 None 2026-04-16 01:46:43,657 - lava_callback - INFO - Completed processing callback for node 69e03e891fb14b744a54a54d INFO: 172.21.0.1:51026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58438 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:47:08,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:47:08,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40454 - "GET /node/698e31b9952a14bf500e444a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:40464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34954 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:47:30,864 - lava_callback - INFO - Received callback for node 69e03fa91fb14b744a54a695 INFO: 172.21.0.1:34962 - "POST /node/69e03fa91fb14b744a54a695 HTTP/1.0" 202 Accepted 2026-04-16 01:47:30,870 - lava_callback - INFO - Starting async job submit for node 69e03fa91fb14b744a54a695 2026-04-16 01:47:30,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:47:30,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e03fa91fb14b744a54a695 HTTP/1.1" 200 None 2026-04-16 01:47:30,894 - lava_callback - DEBUG - Processing node 69e03fa91fb14b744a54a695: baseline-nfs-arm64 2026-04-16 01:47:30,896 - lava_callback - WARNING - Failed to upload log 2026-04-16 01:47:30,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:47:31,032 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:47:31,034 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e03fa91fb14b744a54a695/lava-logs.yaml 2026-04-16 01:47:31,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:47:31,152 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:47:31,154 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e03fa91fb14b744a54a695/lava_callback.json.gz 2026-04-16 01:47:31,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:47:31,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e03fa91fb14b744a54a695 HTTP/1.1" 200 None 2026-04-16 01:47:31,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:47:31,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:47:31,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:47:31,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e03fa91fb14b744a54a695 HTTP/1.1" 200 None 2026-04-16 01:47:31,209 - lava_callback - INFO - Completed processing callback for node 69e03fa91fb14b744a54a695 INFO: 172.21.0.1:34966 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:47:36,572 - lava_callback - INFO - Received callback for node 69dd9cabc2164e674d720882 INFO: 172.21.0.1:34968 - "POST /node/69dd9cabc2164e674d720882 HTTP/1.0" 202 Accepted 2026-04-16 01:47:36,579 - lava_callback - INFO - Starting async job submit for node 69dd9cabc2164e674d720882 2026-04-16 01:47:36,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:47:36,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9cabc2164e674d720882 HTTP/1.1" 200 None 2026-04-16 01:47:36,595 - lava_callback - DEBUG - Processing node 69dd9cabc2164e674d720882: baseline-arm64-baylibre 2026-04-16 01:47:36,596 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9cabc2164e674d720882 2026-04-16 01:47:36,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:47:36,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9cabc2164e674d720882 HTTP/1.1" 200 None 2026-04-16 01:47:36,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:47:36,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d841b2b28893fa2e230976 HTTP/1.1" 200 None 2026-04-16 01:47:36,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:47:36,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9cabc2164e674d720882 HTTP/1.1" 200 None 2026-04-16 01:47:36,683 - lava_callback - ERROR - Error processing callback for node 69dd9cabc2164e674d720882: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 01:47:38,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:47:38,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54536 - "GET /node/699433c05ae459b9df3d338e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:54544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34448 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58890 - "GET /node/689ed4e7df4198951e9e3332%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:60542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60558 - "GET /node/695d2240f1251675e15aee61%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:60560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40268 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:50:03,805 - lava_callback - INFO - Received callback for node 69e0401d1fb14b744a54a703 INFO: 172.21.0.1:53990 - "POST /node/69e0401d1fb14b744a54a703 HTTP/1.0" 202 Accepted 2026-04-16 01:50:03,811 - lava_callback - INFO - Starting async job submit for node 69e0401d1fb14b744a54a703 2026-04-16 01:50:03,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:50:03,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0401d1fb14b744a54a703 HTTP/1.1" 200 None 2026-04-16 01:50:03,849 - lava_callback - DEBUG - Processing node 69e0401d1fb14b744a54a703: baseline-arm64-foundriesio 2026-04-16 01:50:04,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:50:04,213 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:50:04,215 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e0401d1fb14b744a54a703/log.txt.gz 2026-04-16 01:50:04,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:50:04,513 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:50:04,515 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e0401d1fb14b744a54a703/lava-logs.yaml 2026-04-16 01:50:04,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:50:04,647 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:50:04,649 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e0401d1fb14b744a54a703/lava_callback.json.gz 2026-04-16 01:50:04,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:50:04,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0401d1fb14b744a54a703 HTTP/1.1" 200 None 2026-04-16 01:50:04,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:50:04,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:50:04,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:50:04,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e0401d1fb14b744a54a703 HTTP/1.1" 200 None 2026-04-16 01:50:04,745 - lava_callback - INFO - Completed processing callback for node 69e0401d1fb14b744a54a703 INFO: 172.21.0.1:54000 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:50:08,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:50:08,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54120 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:50:16,720 - lava_callback - INFO - Received callback for node 69dd9d56c2164e674d72099a INFO: 172.21.0.1:54126 - "POST /node/69dd9d56c2164e674d72099a HTTP/1.0" 202 Accepted 2026-04-16 01:50:16,726 - lava_callback - INFO - Starting async job submit for node 69dd9d56c2164e674d72099a 2026-04-16 01:50:16,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:50:16,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9d56c2164e674d72099a HTTP/1.1" 200 None 2026-04-16 01:50:16,747 - lava_callback - DEBUG - Processing node 69dd9d56c2164e674d72099a: baseline-arm64-baylibre 2026-04-16 01:50:16,748 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9d56c2164e674d72099a 2026-04-16 01:50:16,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:50:16,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9d56c2164e674d72099a HTTP/1.1" 200 None 2026-04-16 01:50:16,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:50:16,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d841b2b28893fa2e230976 HTTP/1.1" 200 None 2026-04-16 01:50:16,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:50:16,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9d56c2164e674d72099a HTTP/1.1" 200 None 2026-04-16 01:50:16,808 - lava_callback - ERROR - Error processing callback for node 69dd9d56c2164e674d72099a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59430 - "GET /node/698a40ca22b4cc0f227b05cc%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:59436 - "GET /node/698af6983b3beb19e76171d0%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-16 01:50:42,677 - lava_callback - INFO - Received callback for node 69e03c4c1fb14b744a54a374 INFO: 172.21.0.1:49016 - "POST /node/69e03c4c1fb14b744a54a374 HTTP/1.0" 202 Accepted 2026-04-16 01:50:42,684 - lava_callback - INFO - Starting async job submit for node 69e03c4c1fb14b744a54a374 2026-04-16 01:50:42,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:50:42,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e03c4c1fb14b744a54a374 HTTP/1.1" 200 None 2026-04-16 01:50:42,761 - lava_callback - DEBUG - Processing node 69e03c4c1fb14b744a54a374: ltp-smoke 2026-04-16 01:50:43,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:50:43,534 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:50:43,536 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69e03c4c1fb14b744a54a374/log.txt.gz 2026-04-16 01:50:43,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:50:44,135 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:50:44,137 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69e03c4c1fb14b744a54a374/lava-logs.yaml 2026-04-16 01:50:44,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:50:44,316 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:50:44,318 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69e03c4c1fb14b744a54a374/lava_callback.json.gz 2026-04-16 01:50:44,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:50:44,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e03c4c1fb14b744a54a374 HTTP/1.1" 200 None 2026-04-16 01:50:44,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:50:44,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a2e1fb14b744a54889b HTTP/1.1" 200 None 2026-04-16 01:50:44,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:50:44,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e03c4c1fb14b744a54a374 HTTP/1.1" 200 None 2026-04-16 01:50:44,590 - lava_callback - INFO - Completed processing callback for node 69e03c4c1fb14b744a54a374 INFO: 172.21.0.1:49024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53370 - "GET /node/69107fba8b15debe9dd4ef1b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:35300 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:51:08,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:51:08,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55140 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:51:38,959 - lava_callback - INFO - Received callback for node 69e040701fb14b744a54a758 INFO: 172.21.0.1:55142 - "POST /node/69e040701fb14b744a54a758 HTTP/1.0" 202 Accepted 2026-04-16 01:51:38,969 - lava_callback - INFO - Starting async job submit for node 69e040701fb14b744a54a758 2026-04-16 01:51:38,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:51:39,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e040701fb14b744a54a758 HTTP/1.1" 200 None 2026-04-16 01:51:39,017 - lava_callback - DEBUG - Processing node 69e040701fb14b744a54a758: baseline-arm64 2026-04-16 01:51:39,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:51:39,544 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:51:39,546 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e040701fb14b744a54a758/log.txt.gz 2026-04-16 01:51:39,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:51:39,968 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:51:39,970 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e040701fb14b744a54a758/lava-logs.yaml 2026-04-16 01:51:39,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:51:40,119 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:51:40,121 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e040701fb14b744a54a758/lava_callback.json.gz 2026-04-16 01:51:40,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:51:40,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e040701fb14b744a54a758 HTTP/1.1" 200 None 2026-04-16 01:51:40,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:51:40,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:51:40,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:51:40,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e040701fb14b744a54a758 HTTP/1.1" 200 None 2026-04-16 01:51:40,209 - lava_callback - INFO - Completed processing callback for node 69e040701fb14b744a54a758 INFO: 172.21.0.1:41288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35562 - "GET /node/698fcc2a76d4b6342e9d75df%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:35568 - "GET /node/6990a484c45febfe4451ffa8%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:35578 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:52:08,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:52:08,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37196 - "GET /node/695142bc55ab4e5dcfcc07c2%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:37210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49456 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:52:51,279 - lava_callback - INFO - Received callback for node 69dd9de9c2164e674d720a2d INFO: 172.21.0.1:53846 - "POST /node/69dd9de9c2164e674d720a2d HTTP/1.0" 202 Accepted 2026-04-16 01:52:51,286 - lava_callback - INFO - Starting async job submit for node 69dd9de9c2164e674d720a2d 2026-04-16 01:52:51,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:52:51,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9de9c2164e674d720a2d HTTP/1.1" 200 None 2026-04-16 01:52:51,301 - lava_callback - DEBUG - Processing node 69dd9de9c2164e674d720a2d: baseline-arm64-clabbe 2026-04-16 01:52:51,301 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9de9c2164e674d720a2d 2026-04-16 01:52:51,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:52:51,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9de9c2164e674d720a2d HTTP/1.1" 200 None 2026-04-16 01:52:51,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:52:51,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d841b2b28893fa2e230976 HTTP/1.1" 200 None 2026-04-16 01:52:51,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:52:51,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9de9c2164e674d720a2d HTTP/1.1" 200 None 2026-04-16 01:52:51,370 - lava_callback - ERROR - Error processing callback for node 69dd9de9c2164e674d720a2d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33658 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:55:11,376 - lava_callback - INFO - Received callback for node 69dd9e73c2164e674d720ac7 INFO: 172.21.0.1:43836 - "POST /node/69dd9e73c2164e674d720ac7 HTTP/1.0" 202 Accepted 2026-04-16 01:55:11,384 - lava_callback - INFO - Starting async job submit for node 69dd9e73c2164e674d720ac7 2026-04-16 01:55:11,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:55:11,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9e73c2164e674d720ac7 HTTP/1.1" 200 None 2026-04-16 01:55:11,400 - lava_callback - DEBUG - Processing node 69dd9e73c2164e674d720ac7: baseline-arm64-clabbe 2026-04-16 01:55:11,401 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9e73c2164e674d720ac7 2026-04-16 01:55:11,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:55:11,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9e73c2164e674d720ac7 HTTP/1.1" 200 None 2026-04-16 01:55:11,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:55:11,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d841b2b28893fa2e230976 HTTP/1.1" 200 None 2026-04-16 01:55:11,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:55:11,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9e73c2164e674d720ac7 HTTP/1.1" 200 None 2026-04-16 01:55:11,472 - lava_callback - ERROR - Error processing callback for node 69dd9e73c2164e674d720ac7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36884 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:56:31,494 - lava_callback - INFO - Received callback for node 69dd9ebec2164e674d720b2a INFO: 172.21.0.1:36894 - "POST /node/69dd9ebec2164e674d720b2a HTTP/1.0" 202 Accepted 2026-04-16 01:56:31,500 - lava_callback - INFO - Starting async job submit for node 69dd9ebec2164e674d720b2a 2026-04-16 01:56:31,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:56:31,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9ebec2164e674d720b2a HTTP/1.1" 200 None 2026-04-16 01:56:31,515 - lava_callback - DEBUG - Processing node 69dd9ebec2164e674d720b2a: baseline-arm64-clabbe 2026-04-16 01:56:31,515 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9ebec2164e674d720b2a 2026-04-16 01:56:31,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:56:31,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9ebec2164e674d720b2a HTTP/1.1" 200 None 2026-04-16 01:56:31,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:56:31,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d841b2b28893fa2e230976 HTTP/1.1" 200 None 2026-04-16 01:56:31,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:56:31,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9ebec2164e674d720b2a HTTP/1.1" 200 None 2026-04-16 01:56:31,564 - lava_callback - ERROR - Error processing callback for node 69dd9ebec2164e674d720b2a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36902 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:56:40,097 - lava_callback - INFO - Received callback for node 69e041a11fb14b744a54a889 INFO: 172.21.0.1:43138 - "POST /node/69e041a11fb14b744a54a889 HTTP/1.0" 202 Accepted 2026-04-16 01:56:40,107 - lava_callback - INFO - Starting async job submit for node 69e041a11fb14b744a54a889 2026-04-16 01:56:40,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:56:40,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e041a11fb14b744a54a889 HTTP/1.1" 200 None 2026-04-16 01:56:40,155 - lava_callback - DEBUG - Processing node 69e041a11fb14b744a54a889: baseline-arm64 2026-04-16 01:56:40,303 - lava_callback - WARNING - Failed to upload log 2026-04-16 01:56:40,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:56:40,582 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:56:40,584 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e041a11fb14b744a54a889/lava-logs.yaml 2026-04-16 01:56:40,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:56:40,714 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:56:40,716 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e041a11fb14b744a54a889/lava_callback.json.gz 2026-04-16 01:56:40,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:56:40,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e041a11fb14b744a54a889 HTTP/1.1" 200 None 2026-04-16 01:56:40,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:56:40,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:56:40,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:56:40,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e041a11fb14b744a54a889 HTTP/1.1" 200 None 2026-04-16 01:56:40,874 - lava_callback - INFO - Completed processing callback for node 69e041a11fb14b744a54a889 INFO: 172.21.0.1:43154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46942 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:57:08,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:57:08,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54400 - "GET /node/6992f8b031166481c8ddd71f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:54410 - "GET /node/698fd72876d4b6342e9d8f49%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:54416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58626 - "GET /node/698af0243b3beb19e76161d6%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:58634 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:57:51,512 - lava_callback - INFO - Received callback for node 69dd9f11c2164e674d720b73 INFO: 172.21.0.1:48734 - "POST /node/69dd9f11c2164e674d720b73 HTTP/1.0" 202 Accepted 2026-04-16 01:57:51,518 - lava_callback - INFO - Starting async job submit for node 69dd9f11c2164e674d720b73 2026-04-16 01:57:51,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:57:51,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9f11c2164e674d720b73 HTTP/1.1" 200 None 2026-04-16 01:57:51,534 - lava_callback - DEBUG - Processing node 69dd9f11c2164e674d720b73: baseline-arm64-clabbe 2026-04-16 01:57:51,534 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9f11c2164e674d720b73 2026-04-16 01:57:51,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:57:51,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9f11c2164e674d720b73 HTTP/1.1" 200 None 2026-04-16 01:57:51,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:57:51,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d841b2b28893fa2e230976 HTTP/1.1" 200 None 2026-04-16 01:57:51,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:57:51,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9f11c2164e674d720b73 HTTP/1.1" 200 None 2026-04-16 01:57:51,594 - lava_callback - ERROR - Error processing callback for node 69dd9f11c2164e674d720b73: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 01:57:54,105 - lava_callback - INFO - Received callback for node 69e041e81fb14b744a54a8dc INFO: 172.21.0.1:48742 - "POST /node/69e041e81fb14b744a54a8dc HTTP/1.0" 202 Accepted 2026-04-16 01:57:54,112 - lava_callback - INFO - Starting async job submit for node 69e041e81fb14b744a54a8dc 2026-04-16 01:57:54,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:57:54,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e041e81fb14b744a54a8dc HTTP/1.1" 200 None 2026-04-16 01:57:54,157 - lava_callback - DEBUG - Processing node 69e041e81fb14b744a54a8dc: baseline-arm64 2026-04-16 01:57:54,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:57:54,430 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:57:54,431 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e041e81fb14b744a54a8dc/log.txt.gz 2026-04-16 01:57:54,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:57:54,697 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:57:54,699 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e041e81fb14b744a54a8dc/lava-logs.yaml 2026-04-16 01:57:54,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:57:54,851 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:57:54,853 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e041e81fb14b744a54a8dc/lava_callback.json.gz 2026-04-16 01:57:54,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:57:54,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e041e81fb14b744a54a8dc HTTP/1.1" 200 None 2026-04-16 01:57:54,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:57:54,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:57:54,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:57:54,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e041e81fb14b744a54a8dc HTTP/1.1" 200 None 2026-04-16 01:57:55,034 - lava_callback - INFO - Completed processing callback for node 69e041e81fb14b744a54a8dc INFO: 172.21.0.1:48748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58332 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:58:08,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:58:08,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40040 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54694 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:59:21,233 - lava_callback - INFO - Received callback for node 69e0422f1fb14b744a54a90e INFO: 172.21.0.1:33200 - "POST /node/69e0422f1fb14b744a54a90e HTTP/1.0" 202 Accepted 2026-04-16 01:59:21,241 - lava_callback - INFO - Starting async job submit for node 69e0422f1fb14b744a54a90e 2026-04-16 01:59:21,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:59:21,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0422f1fb14b744a54a90e HTTP/1.1" 200 None 2026-04-16 01:59:21,315 - lava_callback - DEBUG - Processing node 69e0422f1fb14b744a54a90e: baseline-arm64 2026-04-16 01:59:21,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:59:21,938 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:59:21,940 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e0422f1fb14b744a54a90e/log.txt.gz 2026-04-16 01:59:22,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:59:22,405 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:59:22,408 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e0422f1fb14b744a54a90e/lava-logs.yaml 2026-04-16 01:59:22,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:59:22,536 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:59:22,538 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e0422f1fb14b744a54a90e/lava_callback.json.gz 2026-04-16 01:59:22,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:59:22,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0422f1fb14b744a54a90e HTTP/1.1" 200 None 2026-04-16 01:59:22,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:59:22,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 01:59:22,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:59:22,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e0422f1fb14b744a54a90e HTTP/1.1" 200 None 2026-04-16 01:59:22,689 - lava_callback - INFO - Completed processing callback for node 69e0422f1fb14b744a54a90e INFO: 172.21.0.1:33210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60274 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:59:38,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:59:38,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50466 - "GET /node/6985b73271989fb141496aea%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:50474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36424 - "GET / HTTP/1.0" 200 OK 2026-04-16 01:59:58,738 - lava_callback - INFO - Received callback for node 69e0415f1fb14b744a54a853 INFO: 172.21.0.1:36430 - "POST /node/69e0415f1fb14b744a54a853 HTTP/1.0" 202 Accepted 2026-04-16 01:59:58,745 - lava_callback - INFO - Starting async job submit for node 69e0415f1fb14b744a54a853 2026-04-16 01:59:58,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:59:58,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0415f1fb14b744a54a853 HTTP/1.1" 200 None 2026-04-16 01:59:58,798 - lava_callback - DEBUG - Processing node 69e0415f1fb14b744a54a853: baseline-arm64 2026-04-16 01:59:59,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:59:59,321 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:59:59,323 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e0415f1fb14b744a54a853/log.txt.gz 2026-04-16 01:59:59,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:59:59,743 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:59:59,746 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e0415f1fb14b744a54a853/lava-logs.yaml 2026-04-16 01:59:59,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 01:59:59,908 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 01:59:59,910 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e0415f1fb14b744a54a853/lava_callback.json.gz DEBUG: Setup failed for 69e0415f1fb14b744a54a853. Transitting job node result: incomplete -> fail 2026-04-16 01:59:59,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 01:59:59,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0415f1fb14b744a54a853 HTTP/1.1" 200 None 2026-04-16 02:00:00,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:00:00,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 02:00:00,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:00:00,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e0415f1fb14b744a54a853 HTTP/1.1" 200 None 2026-04-16 02:00:00,133 - lava_callback - INFO - Completed processing callback for node 69e0415f1fb14b744a54a853 INFO: 172.21.0.1:42816 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:00:08,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:00:08,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60312 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:00:51,634 - lava_callback - INFO - Received callback for node 69dd9fc1c2164e674d720bc9 INFO: 172.21.0.1:51646 - "POST /node/69dd9fc1c2164e674d720bc9 HTTP/1.0" 202 Accepted 2026-04-16 02:00:51,640 - lava_callback - INFO - Starting async job submit for node 69dd9fc1c2164e674d720bc9 2026-04-16 02:00:51,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:00:51,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9fc1c2164e674d720bc9 HTTP/1.1" 200 None 2026-04-16 02:00:51,656 - lava_callback - DEBUG - Processing node 69dd9fc1c2164e674d720bc9: baseline-arm64-clabbe 2026-04-16 02:00:51,656 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dd9fc1c2164e674d720bc9 2026-04-16 02:00:51,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:00:51,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd9fc1c2164e674d720bc9 HTTP/1.1" 200 None 2026-04-16 02:00:51,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:00:51,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d841b2b28893fa2e230976 HTTP/1.1" 200 None 2026-04-16 02:00:51,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:00:51,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dd9fc1c2164e674d720bc9 HTTP/1.1" 200 None 2026-04-16 02:00:51,707 - lava_callback - ERROR - Error processing callback for node 69dd9fc1c2164e674d720bc9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47668 - "GET /node/6986fafa6e077e4126a7d39e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:47684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57342 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:01:51,657 - lava_callback - INFO - Received callback for node 69dda008c2164e674d720c4e INFO: 172.21.0.1:43516 - "POST /node/69dda008c2164e674d720c4e HTTP/1.0" 202 Accepted 2026-04-16 02:01:51,662 - lava_callback - INFO - Starting async job submit for node 69dda008c2164e674d720c4e 2026-04-16 02:01:51,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:01:51,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda008c2164e674d720c4e HTTP/1.1" 200 None 2026-04-16 02:01:51,678 - lava_callback - DEBUG - Processing node 69dda008c2164e674d720c4e: baseline-arm64-clabbe 2026-04-16 02:01:51,678 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dda008c2164e674d720c4e 2026-04-16 02:01:51,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:01:51,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda008c2164e674d720c4e HTTP/1.1" 200 None 2026-04-16 02:01:51,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:01:51,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d841b2b28893fa2e230976 HTTP/1.1" 200 None 2026-04-16 02:01:51,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:01:51,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dda008c2164e674d720c4e HTTP/1.1" 200 None 2026-04-16 02:01:51,735 - lava_callback - ERROR - Error processing callback for node 69dda008c2164e674d720c4e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53896 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:03:11,696 - lava_callback - INFO - Received callback for node 69dda05ac2164e674d720c80 INFO: 172.21.0.1:45250 - "POST /node/69dda05ac2164e674d720c80 HTTP/1.0" 202 Accepted 2026-04-16 02:03:11,702 - lava_callback - INFO - Starting async job submit for node 69dda05ac2164e674d720c80 2026-04-16 02:03:11,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:03:11,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda05ac2164e674d720c80 HTTP/1.1" 200 None 2026-04-16 02:03:11,724 - lava_callback - DEBUG - Processing node 69dda05ac2164e674d720c80: baseline-arm64-clabbe 2026-04-16 02:03:11,724 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dda05ac2164e674d720c80 2026-04-16 02:03:11,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:03:11,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda05ac2164e674d720c80 HTTP/1.1" 200 None 2026-04-16 02:03:11,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:03:11,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d841b2b28893fa2e230976 HTTP/1.1" 200 None 2026-04-16 02:03:11,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:03:11,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dda05ac2164e674d720c80 HTTP/1.1" 200 None 2026-04-16 02:03:11,784 - lava_callback - ERROR - Error processing callback for node 69dda05ac2164e674d720c80: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36460 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:09:17,764 - lava_callback - INFO - Received callback for node 69dda1c9c2164e674d720e27 INFO: 172.21.0.1:36468 - "POST /node/69dda1c9c2164e674d720e27 HTTP/1.0" 202 Accepted 2026-04-16 02:09:17,769 - lava_callback - INFO - Starting async job submit for node 69dda1c9c2164e674d720e27 2026-04-16 02:09:17,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:09:17,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda1c9c2164e674d720e27 HTTP/1.1" 200 None 2026-04-16 02:09:17,808 - lava_callback - DEBUG - Processing node 69dda1c9c2164e674d720e27: baseline-arm-baylibre 2026-04-16 02:09:17,809 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dda1c9c2164e674d720e27 2026-04-16 02:09:17,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:09:17,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda1c9c2164e674d720e27 HTTP/1.1" 200 None 2026-04-16 02:09:17,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:09:17,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-16 02:09:17,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:09:17,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dda1c9c2164e674d720e27 HTTP/1.1" 200 None 2026-04-16 02:09:17,862 - lava_callback - ERROR - Error processing callback for node 69dda1c9c2164e674d720e27: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44230 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:11:17,881 - lava_callback - INFO - Received callback for node 69dda239c2164e674d720e6e INFO: 172.21.0.1:44240 - "POST /node/69dda239c2164e674d720e6e HTTP/1.0" 202 Accepted 2026-04-16 02:11:17,887 - lava_callback - INFO - Starting async job submit for node 69dda239c2164e674d720e6e 2026-04-16 02:11:17,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:11:17,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda239c2164e674d720e6e HTTP/1.1" 200 None 2026-04-16 02:11:17,904 - lava_callback - DEBUG - Processing node 69dda239c2164e674d720e6e: baseline-arm-baylibre 2026-04-16 02:11:17,904 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dda239c2164e674d720e6e 2026-04-16 02:11:17,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:11:17,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda239c2164e674d720e6e HTTP/1.1" 200 None 2026-04-16 02:11:17,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:11:17,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-16 02:11:17,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:11:17,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dda239c2164e674d720e6e HTTP/1.1" 200 None 2026-04-16 02:11:17,953 - lava_callback - ERROR - Error processing callback for node 69dda239c2164e674d720e6e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43580 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:12:57,899 - lava_callback - INFO - Received callback for node 69dda29dc2164e674d720f27 INFO: 172.21.0.1:43590 - "POST /node/69dda29dc2164e674d720f27 HTTP/1.0" 202 Accepted 2026-04-16 02:12:57,904 - lava_callback - INFO - Starting async job submit for node 69dda29dc2164e674d720f27 2026-04-16 02:12:57,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:12:57,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda29dc2164e674d720f27 HTTP/1.1" 200 None 2026-04-16 02:12:57,920 - lava_callback - DEBUG - Processing node 69dda29dc2164e674d720f27: baseline-arm-baylibre 2026-04-16 02:12:57,921 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dda29dc2164e674d720f27 2026-04-16 02:12:57,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:12:57,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda29dc2164e674d720f27 HTTP/1.1" 200 None 2026-04-16 02:12:57,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:12:57,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-16 02:12:57,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:12:57,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dda29dc2164e674d720f27 HTTP/1.1" 200 None 2026-04-16 02:12:57,981 - lava_callback - ERROR - Error processing callback for node 69dda29dc2164e674d720f27: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56830 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:13:37,949 - lava_callback - INFO - Received callback for node 69dda2bfc2164e674d720f42 INFO: 172.21.0.1:56846 - "POST /node/69dda2bfc2164e674d720f42 HTTP/1.0" 202 Accepted 2026-04-16 02:13:37,955 - lava_callback - INFO - Starting async job submit for node 69dda2bfc2164e674d720f42 2026-04-16 02:13:37,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:13:37,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda2bfc2164e674d720f42 HTTP/1.1" 200 None 2026-04-16 02:13:37,987 - lava_callback - DEBUG - Processing node 69dda2bfc2164e674d720f42: baseline-arm-baylibre 2026-04-16 02:13:37,987 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dda2bfc2164e674d720f42 2026-04-16 02:13:37,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:13:38,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda2bfc2164e674d720f42 HTTP/1.1" 200 None 2026-04-16 02:13:38,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:13:38,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-16 02:13:38,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:13:38,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dda2bfc2164e674d720f42 HTTP/1.1" 200 None 2026-04-16 02:13:38,048 - lava_callback - ERROR - Error processing callback for node 69dda2bfc2164e674d720f42: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52404 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:13:47,202 - lava_callback - INFO - Received callback for node 69e043491fb14b744a54aa24 INFO: 172.21.0.1:52420 - "POST /node/69e043491fb14b744a54aa24 HTTP/1.0" 202 Accepted 2026-04-16 02:13:47,209 - lava_callback - INFO - Starting async job submit for node 69e043491fb14b744a54aa24 2026-04-16 02:13:47,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:13:47,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e043491fb14b744a54aa24 HTTP/1.1" 200 None 2026-04-16 02:13:47,251 - lava_callback - DEBUG - Processing node 69e043491fb14b744a54aa24: baseline-arm64 2026-04-16 02:13:47,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:13:47,947 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:13:47,949 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e043491fb14b744a54aa24/log.txt.gz 2026-04-16 02:13:48,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:13:48,413 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:13:48,415 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e043491fb14b744a54aa24/lava-logs.yaml 2026-04-16 02:13:48,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:13:48,584 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:13:48,586 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e043491fb14b744a54aa24/lava_callback.json.gz 2026-04-16 02:13:48,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:13:48,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e043491fb14b744a54aa24 HTTP/1.1" 200 None 2026-04-16 02:13:48,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:13:48,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 02:13:48,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:13:48,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e043491fb14b744a54aa24 HTTP/1.1" 200 None 2026-04-16 02:13:48,714 - lava_callback - INFO - Completed processing callback for node 69e043491fb14b744a54aa24 INFO: 172.21.0.1:52638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40676 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:14:08,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:14:08,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46254 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46270 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:15:18,015 - lava_callback - INFO - Received callback for node 69dda32cc2164e674d720fc3 INFO: 172.21.0.1:46278 - "POST /node/69dda32cc2164e674d720fc3 HTTP/1.0" 202 Accepted 2026-04-16 02:15:18,021 - lava_callback - INFO - Starting async job submit for node 69dda32cc2164e674d720fc3 2026-04-16 02:15:18,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:15:18,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda32cc2164e674d720fc3 HTTP/1.1" 200 None 2026-04-16 02:15:18,045 - lava_callback - DEBUG - Processing node 69dda32cc2164e674d720fc3: baseline-arm-baylibre 2026-04-16 02:15:18,045 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dda32cc2164e674d720fc3 2026-04-16 02:15:18,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:15:18,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda32cc2164e674d720fc3 HTTP/1.1" 200 None 2026-04-16 02:15:18,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:15:18,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-16 02:15:18,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:15:18,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dda32cc2164e674d720fc3 HTTP/1.1" 200 None 2026-04-16 02:15:18,106 - lava_callback - ERROR - Error processing callback for node 69dda32cc2164e674d720fc3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48050 - "GET /node/69935627523507f3806a8be9%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:48056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50702 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:15:52,272 - lava_callback - INFO - Received callback for node 69dda351c2164e674d720fde INFO: 172.21.0.1:41670 - "POST /node/69dda351c2164e674d720fde HTTP/1.0" 202 Accepted 2026-04-16 02:15:52,278 - lava_callback - INFO - Starting async job submit for node 69dda351c2164e674d720fde 2026-04-16 02:15:52,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:15:52,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda351c2164e674d720fde HTTP/1.1" 200 None 2026-04-16 02:15:52,322 - lava_callback - DEBUG - Processing node 69dda351c2164e674d720fde: baseline-arm-clabbe 2026-04-16 02:15:52,322 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dda351c2164e674d720fde 2026-04-16 02:15:52,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:15:52,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda351c2164e674d720fde HTTP/1.1" 200 None 2026-04-16 02:15:52,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:15:52,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-16 02:15:52,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:15:52,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dda351c2164e674d720fde HTTP/1.1" 200 None 2026-04-16 02:15:52,373 - lava_callback - ERROR - Error processing callback for node 69dda351c2164e674d720fde: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33770 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:16:32,183 - lava_callback - INFO - Received callback for node 69dda371c2164e674d721004 INFO: 172.21.0.1:33778 - "POST /node/69dda371c2164e674d721004 HTTP/1.0" 202 Accepted 2026-04-16 02:16:32,189 - lava_callback - INFO - Starting async job submit for node 69dda371c2164e674d721004 2026-04-16 02:16:32,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:16:32,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda371c2164e674d721004 HTTP/1.1" 200 None 2026-04-16 02:16:32,205 - lava_callback - DEBUG - Processing node 69dda371c2164e674d721004: baseline-arm-clabbe 2026-04-16 02:16:32,205 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dda371c2164e674d721004 2026-04-16 02:16:32,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:16:32,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda371c2164e674d721004 HTTP/1.1" 200 None 2026-04-16 02:16:32,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:16:32,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-16 02:16:32,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:16:32,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dda371c2164e674d721004 HTTP/1.1" 200 None 2026-04-16 02:16:32,253 - lava_callback - ERROR - Error processing callback for node 69dda371c2164e674d721004: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48496 - "GET /node/6991865410b45da7d7d0fd4c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:48510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50512 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40820 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:17:32,989 - lava_callback - INFO - Received callback for node 69e0442b1fb14b744a54aabe INFO: 172.21.0.1:40828 - "POST /node/69e0442b1fb14b744a54aabe HTTP/1.0" 202 Accepted 2026-04-16 02:17:33,000 - lava_callback - INFO - Starting async job submit for node 69e0442b1fb14b744a54aabe 2026-04-16 02:17:33,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:17:33,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0442b1fb14b744a54aabe HTTP/1.1" 200 None 2026-04-16 02:17:33,062 - lava_callback - DEBUG - Processing node 69e0442b1fb14b744a54aabe: baseline-nfs-arm64 2026-04-16 02:17:33,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:17:33,743 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:17:33,745 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e0442b1fb14b744a54aabe/log.txt.gz 2026-04-16 02:17:33,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:17:34,253 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:17:34,255 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e0442b1fb14b744a54aabe/lava-logs.yaml 2026-04-16 02:17:34,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:17:34,457 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:17:34,458 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e0442b1fb14b744a54aabe/lava_callback.json.gz 2026-04-16 02:17:34,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:17:34,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e0442b1fb14b744a54aabe HTTP/1.1" 200 None 2026-04-16 02:17:34,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:17:34,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 02:17:34,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:17:34,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e0442b1fb14b744a54aabe HTTP/1.1" 200 None 2026-04-16 02:17:34,623 - lava_callback - INFO - Completed processing callback for node 69e0442b1fb14b744a54aabe INFO: 172.21.0.1:40842 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:17:38,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:17:38,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60658 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:19:32,296 - lava_callback - INFO - Received callback for node 69dda421c2164e674d7210ea INFO: 172.21.0.1:60660 - "POST /node/69dda421c2164e674d7210ea HTTP/1.0" 202 Accepted 2026-04-16 02:19:32,302 - lava_callback - INFO - Starting async job submit for node 69dda421c2164e674d7210ea 2026-04-16 02:19:32,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:19:32,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda421c2164e674d7210ea HTTP/1.1" 200 None 2026-04-16 02:19:32,318 - lava_callback - DEBUG - Processing node 69dda421c2164e674d7210ea: baseline-arm-clabbe 2026-04-16 02:19:32,319 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dda421c2164e674d7210ea 2026-04-16 02:19:32,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:19:32,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda421c2164e674d7210ea HTTP/1.1" 200 None 2026-04-16 02:19:32,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:19:32,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-16 02:19:32,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:19:32,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dda421c2164e674d7210ea HTTP/1.1" 200 None 2026-04-16 02:19:32,368 - lava_callback - ERROR - Error processing callback for node 69dda421c2164e674d7210ea: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36120 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:19:52,313 - lava_callback - INFO - Received callback for node 69dda444c2164e674d721100 INFO: 172.21.0.1:57740 - "POST /node/69dda444c2164e674d721100 HTTP/1.0" 202 Accepted 2026-04-16 02:19:52,319 - lava_callback - INFO - Starting async job submit for node 69dda444c2164e674d721100 2026-04-16 02:19:52,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:19:52,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda444c2164e674d721100 HTTP/1.1" 200 None 2026-04-16 02:19:52,337 - lava_callback - DEBUG - Processing node 69dda444c2164e674d721100: baseline-arm-clabbe 2026-04-16 02:19:52,337 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dda444c2164e674d721100 2026-04-16 02:19:52,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:19:52,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda444c2164e674d721100 HTTP/1.1" 200 None 2026-04-16 02:19:52,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:19:52,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-16 02:19:52,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:19:52,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dda444c2164e674d721100 HTTP/1.1" 200 None 2026-04-16 02:19:52,389 - lava_callback - ERROR - Error processing callback for node 69dda444c2164e674d721100: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52158 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:20:32,363 - lava_callback - INFO - Received callback for node 69dda464c2164e674d721129 INFO: 172.21.0.1:52164 - "POST /node/69dda464c2164e674d721129 HTTP/1.0" 202 Accepted 2026-04-16 02:20:32,369 - lava_callback - INFO - Starting async job submit for node 69dda464c2164e674d721129 2026-04-16 02:20:32,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:20:32,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda464c2164e674d721129 HTTP/1.1" 200 None 2026-04-16 02:20:32,385 - lava_callback - DEBUG - Processing node 69dda464c2164e674d721129: baseline-arm-clabbe 2026-04-16 02:20:32,385 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dda464c2164e674d721129 2026-04-16 02:20:32,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:20:32,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda464c2164e674d721129 HTTP/1.1" 200 None 2026-04-16 02:20:32,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:20:32,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-16 02:20:32,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:20:32,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dda464c2164e674d721129 HTTP/1.1" 200 None 2026-04-16 02:20:32,443 - lava_callback - ERROR - Error processing callback for node 69dda464c2164e674d721129: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60642 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:60646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56998 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:21:12,341 - lava_callback - INFO - Received callback for node 69dda486c2164e674d721154 INFO: 172.21.0.1:52730 - "POST /node/69dda486c2164e674d721154 HTTP/1.0" 202 Accepted 2026-04-16 02:21:12,350 - lava_callback - INFO - Starting async job submit for node 69dda486c2164e674d721154 2026-04-16 02:21:12,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:21:12,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda486c2164e674d721154 HTTP/1.1" 200 None 2026-04-16 02:21:12,375 - lava_callback - DEBUG - Processing node 69dda486c2164e674d721154: baseline-arm-clabbe 2026-04-16 02:21:12,375 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dda486c2164e674d721154 2026-04-16 02:21:12,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:21:12,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda486c2164e674d721154 HTTP/1.1" 200 None 2026-04-16 02:21:12,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:21:12,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-16 02:21:12,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:21:12,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dda486c2164e674d721154 HTTP/1.1" 200 None 2026-04-16 02:21:12,433 - lava_callback - ERROR - Error processing callback for node 69dda486c2164e674d721154: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55800 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:21:32,360 - lava_callback - INFO - Received callback for node 69dda4a3c2164e674d721179 INFO: 172.21.0.1:55814 - "POST /node/69dda4a3c2164e674d721179 HTTP/1.0" 202 Accepted 2026-04-16 02:21:32,366 - lava_callback - INFO - Starting async job submit for node 69dda4a3c2164e674d721179 2026-04-16 02:21:32,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:21:32,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda4a3c2164e674d721179 HTTP/1.1" 200 None 2026-04-16 02:21:32,382 - lava_callback - DEBUG - Processing node 69dda4a3c2164e674d721179: baseline-arm-clabbe 2026-04-16 02:21:32,382 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dda4a3c2164e674d721179 2026-04-16 02:21:32,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:21:32,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda4a3c2164e674d721179 HTTP/1.1" 200 None 2026-04-16 02:21:32,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:21:32,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-16 02:21:32,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:21:32,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dda4a3c2164e674d721179 HTTP/1.1" 200 None 2026-04-16 02:21:32,438 - lava_callback - ERROR - Error processing callback for node 69dda4a3c2164e674d721179: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60532 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:22:12,387 - lava_callback - INFO - Received callback for node 69dda4c8c2164e674d721196 INFO: 172.21.0.1:51316 - "POST /node/69dda4c8c2164e674d721196 HTTP/1.0" 202 Accepted 2026-04-16 02:22:12,392 - lava_callback - INFO - Starting async job submit for node 69dda4c8c2164e674d721196 2026-04-16 02:22:12,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:22:12,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda4c8c2164e674d721196 HTTP/1.1" 200 None 2026-04-16 02:22:12,417 - lava_callback - DEBUG - Processing node 69dda4c8c2164e674d721196: baseline-arm-clabbe 2026-04-16 02:22:12,417 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dda4c8c2164e674d721196 2026-04-16 02:22:12,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:22:12,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda4c8c2164e674d721196 HTTP/1.1" 200 None 2026-04-16 02:22:12,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:22:12,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-16 02:22:12,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:22:12,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dda4c8c2164e674d721196 HTTP/1.1" 200 None 2026-04-16 02:22:12,473 - lava_callback - ERROR - Error processing callback for node 69dda4c8c2164e674d721196: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50362 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:22:52,411 - lava_callback - INFO - Received callback for node 69dda4e9c2164e674d7211b2 INFO: 172.21.0.1:53256 - "POST /node/69dda4e9c2164e674d7211b2 HTTP/1.0" 202 Accepted 2026-04-16 02:22:52,417 - lava_callback - INFO - Starting async job submit for node 69dda4e9c2164e674d7211b2 2026-04-16 02:22:52,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:22:52,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda4e9c2164e674d7211b2 HTTP/1.1" 200 None 2026-04-16 02:22:52,433 - lava_callback - DEBUG - Processing node 69dda4e9c2164e674d7211b2: baseline-arm-clabbe 2026-04-16 02:22:52,434 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dda4e9c2164e674d7211b2 2026-04-16 02:22:52,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:22:52,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda4e9c2164e674d7211b2 HTTP/1.1" 200 None 2026-04-16 02:22:52,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:22:52,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59e9934043de23ba13b49 HTTP/1.1" 200 None 2026-04-16 02:22:52,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:22:52,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dda4e9c2164e674d7211b2 HTTP/1.1" 200 None 2026-04-16 02:22:52,482 - lava_callback - ERROR - Error processing callback for node 69dda4e9c2164e674d7211b2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55770 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:25:08,418 - lava_callback - INFO - Received callback for node 69e043e21fb14b744a54aa89 INFO: 172.21.0.1:55784 - "POST /node/69e043e21fb14b744a54aa89 HTTP/1.0" 202 Accepted 2026-04-16 02:25:08,426 - lava_callback - INFO - Starting async job submit for node 69e043e21fb14b744a54aa89 2026-04-16 02:25:08,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:25:08,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e043e21fb14b744a54aa89 HTTP/1.1" 200 None 2026-04-16 02:25:08,486 - lava_callback - DEBUG - Processing node 69e043e21fb14b744a54aa89: baseline-nfs-arm64 2026-04-16 02:25:09,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:25:09,732 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:25:09,733 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e043e21fb14b744a54aa89/log.txt.gz 2026-04-16 02:25:10,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:25:10,562 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:25:10,565 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e043e21fb14b744a54aa89/lava-logs.yaml 2026-04-16 02:25:10,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:25:10,786 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:25:10,788 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e043e21fb14b744a54aa89/lava_callback.json.gz DEBUG: Setup failed for 69e043e21fb14b744a54aa89. Transitting job node result: incomplete -> fail 2026-04-16 02:25:10,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:25:10,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e043e21fb14b744a54aa89 HTTP/1.1" 200 None 2026-04-16 02:25:10,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:25:10,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 02:25:10,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:25:10,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e043e21fb14b744a54aa89 HTTP/1.1" 200 None 2026-04-16 02:25:11,030 - lava_callback - INFO - Completed processing callback for node 69e043e21fb14b744a54aa89 INFO: 172.21.0.1:42816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46562 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:25:38,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:25:38,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43046 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:27:17,513 - lava_callback - INFO - Received callback for node 69e048ee1fb14b744a54af68 INFO: 172.21.0.1:43056 - "POST /node/69e048ee1fb14b744a54af68 HTTP/1.0" 202 Accepted 2026-04-16 02:27:17,519 - lava_callback - INFO - Starting async job submit for node 69e048ee1fb14b744a54af68 2026-04-16 02:27:17,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:27:17,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e048ee1fb14b744a54af68 HTTP/1.1" 200 None 2026-04-16 02:27:17,536 - lava_callback - DEBUG - Processing node 69e048ee1fb14b744a54af68: baseline-nfs-arm64 2026-04-16 02:27:17,538 - lava_callback - WARNING - Failed to upload log 2026-04-16 02:27:17,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:27:17,705 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:27:17,706 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e048ee1fb14b744a54af68/lava-logs.yaml 2026-04-16 02:27:17,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:27:17,837 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:27:17,838 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e048ee1fb14b744a54af68/lava_callback.json.gz 2026-04-16 02:27:17,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:27:17,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e048ee1fb14b744a54af68 HTTP/1.1" 200 None 2026-04-16 02:27:17,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:27:17,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 02:27:17,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:27:17,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e048ee1fb14b744a54af68 HTTP/1.1" 200 None 2026-04-16 02:27:17,901 - lava_callback - INFO - Completed processing callback for node 69e048ee1fb14b744a54af68 2026-04-16 02:27:24,214 - lava_callback - INFO - Received callback for node 69e045421fb14b744a54aba2 INFO: 172.21.0.1:47378 - "POST /node/69e045421fb14b744a54aba2 HTTP/1.0" 202 Accepted 2026-04-16 02:27:24,221 - lava_callback - INFO - Starting async job submit for node 69e045421fb14b744a54aba2 2026-04-16 02:27:24,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:27:24,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e045421fb14b744a54aba2 HTTP/1.1" 200 None 2026-04-16 02:27:24,293 - lava_callback - DEBUG - Processing node 69e045421fb14b744a54aba2: baseline-arm 2026-04-16 02:27:24,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:27:25,094 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:27:25,096 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e045421fb14b744a54aba2/log.txt.gz 2026-04-16 02:27:25,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:27:25,714 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:27:25,717 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e045421fb14b744a54aba2/lava-logs.yaml 2026-04-16 02:27:25,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:27:25,883 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:27:25,885 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e045421fb14b744a54aba2/lava_callback.json.gz DEBUG: Setup failed for 69e045421fb14b744a54aba2. Transitting job node result: incomplete -> fail 2026-04-16 02:27:25,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:27:26,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e045421fb14b744a54aba2 HTTP/1.1" 200 None 2026-04-16 02:27:26,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:27:26,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 02:27:26,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:27:26,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e045421fb14b744a54aba2 HTTP/1.1" 200 None 2026-04-16 02:27:26,159 - lava_callback - INFO - Completed processing callback for node 69e045421fb14b744a54aba2 INFO: 172.21.0.1:47382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34594 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:27:38,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:27:38,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44394 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:31:38,924 - lava_callback - INFO - Received callback for node 69dda6fac2164e674d7213d3 INFO: 172.21.0.1:44400 - "POST /node/69dda6fac2164e674d7213d3 HTTP/1.0" 202 Accepted 2026-04-16 02:31:38,930 - lava_callback - INFO - Starting async job submit for node 69dda6fac2164e674d7213d3 2026-04-16 02:31:38,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:31:38,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda6fac2164e674d7213d3 HTTP/1.1" 200 None 2026-04-16 02:31:38,947 - lava_callback - DEBUG - Processing node 69dda6fac2164e674d7213d3: baseline-arm64-baylibre 2026-04-16 02:31:38,947 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dda6fac2164e674d7213d3 2026-04-16 02:31:38,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:31:38,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda6fac2164e674d7213d3 HTTP/1.1" 200 None 2026-04-16 02:31:38,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:31:38,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-16 02:31:38,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:31:39,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dda6fac2164e674d7213d3 HTTP/1.1" 200 None 2026-04-16 02:31:39,023 - lava_callback - ERROR - Error processing callback for node 69dda6fac2164e674d7213d3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44952 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:34:19,046 - lava_callback - INFO - Received callback for node 69dda796c2164e674d721452 INFO: 172.21.0.1:44960 - "POST /node/69dda796c2164e674d721452 HTTP/1.0" 202 Accepted 2026-04-16 02:34:19,051 - lava_callback - INFO - Starting async job submit for node 69dda796c2164e674d721452 2026-04-16 02:34:19,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:34:19,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda796c2164e674d721452 HTTP/1.1" 200 None 2026-04-16 02:34:19,074 - lava_callback - DEBUG - Processing node 69dda796c2164e674d721452: baseline-arm64-baylibre 2026-04-16 02:34:19,074 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dda796c2164e674d721452 2026-04-16 02:34:19,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:34:19,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda796c2164e674d721452 HTTP/1.1" 200 None 2026-04-16 02:34:19,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:34:19,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-16 02:34:19,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:34:19,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dda796c2164e674d721452 HTTP/1.1" 200 None 2026-04-16 02:34:19,124 - lava_callback - ERROR - Error processing callback for node 69dda796c2164e674d721452: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56086 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:34:47,769 - lava_callback - INFO - Received callback for node 69e04a911fb14b744a54b106 INFO: 172.21.0.1:56092 - "POST /node/69e04a911fb14b744a54b106 HTTP/1.0" 202 Accepted 2026-04-16 02:34:47,780 - lava_callback - INFO - Starting async job submit for node 69e04a911fb14b744a54b106 2026-04-16 02:34:47,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:34:47,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e04a911fb14b744a54b106 HTTP/1.1" 200 None 2026-04-16 02:34:47,835 - lava_callback - DEBUG - Processing node 69e04a911fb14b744a54b106: baseline-arm64 2026-04-16 02:34:47,970 - lava_callback - WARNING - Failed to upload log 2026-04-16 02:34:48,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:34:48,220 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:34:48,222 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e04a911fb14b744a54b106/lava-logs.yaml 2026-04-16 02:34:48,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:34:48,335 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:34:48,336 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e04a911fb14b744a54b106/lava_callback.json.gz 2026-04-16 02:34:48,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:34:48,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e04a911fb14b744a54b106 HTTP/1.1" 200 None 2026-04-16 02:34:48,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:34:48,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 02:34:48,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:34:48,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e04a911fb14b744a54b106 HTTP/1.1" 200 None 2026-04-16 02:34:48,500 - lava_callback - INFO - Completed processing callback for node 69e04a911fb14b744a54b106 INFO: 172.21.0.1:39370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43954 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:35:08,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:35:08,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34828 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34830 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:35:19,106 - lava_callback - INFO - Received callback for node 69dda7e0c2164e674d7214ab INFO: 172.21.0.1:34842 - "POST /node/69dda7e0c2164e674d7214ab HTTP/1.0" 202 Accepted 2026-04-16 02:35:19,111 - lava_callback - INFO - Starting async job submit for node 69dda7e0c2164e674d7214ab 2026-04-16 02:35:19,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:35:19,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda7e0c2164e674d7214ab HTTP/1.1" 200 None 2026-04-16 02:35:19,127 - lava_callback - DEBUG - Processing node 69dda7e0c2164e674d7214ab: baseline-arm64-baylibre 2026-04-16 02:35:19,128 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dda7e0c2164e674d7214ab 2026-04-16 02:35:19,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:35:19,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda7e0c2164e674d7214ab HTTP/1.1" 200 None 2026-04-16 02:35:19,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:35:19,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-16 02:35:19,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:35:19,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dda7e0c2164e674d7214ab HTTP/1.1" 200 None 2026-04-16 02:35:19,182 - lava_callback - ERROR - Error processing callback for node 69dda7e0c2164e674d7214ab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34752 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:37:34,254 - lava_callback - INFO - Received callback for node 69e04b1f1fb14b744a54b18e INFO: 172.21.0.1:34760 - "POST /node/69e04b1f1fb14b744a54b18e HTTP/1.0" 202 Accepted 2026-04-16 02:37:34,261 - lava_callback - INFO - Starting async job submit for node 69e04b1f1fb14b744a54b18e 2026-04-16 02:37:34,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:37:34,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e04b1f1fb14b744a54b18e HTTP/1.1" 200 None 2026-04-16 02:37:34,306 - lava_callback - DEBUG - Processing node 69e04b1f1fb14b744a54b18e: baseline-arm64 2026-04-16 02:37:34,552 - lava_callback - WARNING - Failed to upload log 2026-04-16 02:37:34,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:37:34,900 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:37:34,902 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e04b1f1fb14b744a54b18e/lava-logs.yaml 2026-04-16 02:37:34,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:37:35,050 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:37:35,052 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e04b1f1fb14b744a54b18e/lava_callback.json.gz 2026-04-16 02:37:35,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:37:35,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e04b1f1fb14b744a54b18e HTTP/1.1" 200 None 2026-04-16 02:37:35,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:37:35,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 02:37:35,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:37:35,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e04b1f1fb14b744a54b18e HTTP/1.1" 200 None 2026-04-16 02:37:35,239 - lava_callback - INFO - Completed processing callback for node 69e04b1f1fb14b744a54b18e INFO: 172.21.0.1:34762 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:37:38,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:37:38,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43360 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:37:59,266 - lava_callback - INFO - Received callback for node 69dda877c2164e674d72154d INFO: 172.21.0.1:43368 - "POST /node/69dda877c2164e674d72154d HTTP/1.0" 202 Accepted 2026-04-16 02:37:59,271 - lava_callback - INFO - Starting async job submit for node 69dda877c2164e674d72154d 2026-04-16 02:37:59,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:37:59,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda877c2164e674d72154d HTTP/1.1" 200 None 2026-04-16 02:37:59,287 - lava_callback - DEBUG - Processing node 69dda877c2164e674d72154d: baseline-arm64-baylibre 2026-04-16 02:37:59,288 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dda877c2164e674d72154d 2026-04-16 02:37:59,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:37:59,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda877c2164e674d72154d HTTP/1.1" 200 None 2026-04-16 02:37:59,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:37:59,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-16 02:37:59,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:37:59,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dda877c2164e674d72154d HTTP/1.1" 200 None 2026-04-16 02:37:59,365 - lava_callback - ERROR - Error processing callback for node 69dda877c2164e674d72154d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58014 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:38:42,935 - lava_callback - INFO - Received callback for node 69e04b651fb14b744a54b1f1 INFO: 172.21.0.1:52870 - "POST /node/69e04b651fb14b744a54b1f1 HTTP/1.0" 202 Accepted 2026-04-16 02:38:42,941 - lava_callback - INFO - Starting async job submit for node 69e04b651fb14b744a54b1f1 2026-04-16 02:38:42,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:38:42,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e04b651fb14b744a54b1f1 HTTP/1.1" 200 None 2026-04-16 02:38:42,981 - lava_callback - DEBUG - Processing node 69e04b651fb14b744a54b1f1: baseline-arm64 2026-04-16 02:38:43,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:38:43,536 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:38:43,537 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e04b651fb14b744a54b1f1/log.txt.gz 2026-04-16 02:38:43,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:38:43,985 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:38:43,987 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e04b651fb14b744a54b1f1/lava-logs.yaml 2026-04-16 02:38:43,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:38:44,165 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:38:44,166 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e04b651fb14b744a54b1f1/lava_callback.json.gz 2026-04-16 02:38:44,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:38:44,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e04b651fb14b744a54b1f1 HTTP/1.1" 200 None 2026-04-16 02:38:44,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:38:44,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 02:38:44,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:38:44,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e04b651fb14b744a54b1f1 HTTP/1.1" 200 None 2026-04-16 02:38:44,309 - lava_callback - INFO - Completed processing callback for node 69e04b651fb14b744a54b1f1 INFO: 172.21.0.1:52878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48472 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:39:08,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:39:08,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55606 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38134 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54448 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:40:39,405 - lava_callback - INFO - Received callback for node 69dda91ac2164e674d7215b6 INFO: 172.21.0.1:54450 - "POST /node/69dda91ac2164e674d7215b6 HTTP/1.0" 202 Accepted 2026-04-16 02:40:39,410 - lava_callback - INFO - Starting async job submit for node 69dda91ac2164e674d7215b6 2026-04-16 02:40:39,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:40:39,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda91ac2164e674d7215b6 HTTP/1.1" 200 None 2026-04-16 02:40:39,426 - lava_callback - DEBUG - Processing node 69dda91ac2164e674d7215b6: baseline-arm64-baylibre 2026-04-16 02:40:39,426 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dda91ac2164e674d7215b6 2026-04-16 02:40:39,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:40:39,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda91ac2164e674d7215b6 HTTP/1.1" 200 None 2026-04-16 02:40:39,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:40:39,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-16 02:40:39,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:40:39,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dda91ac2164e674d7215b6 HTTP/1.1" 200 None 2026-04-16 02:40:39,477 - lava_callback - ERROR - Error processing callback for node 69dda91ac2164e674d7215b6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39320 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:42:00,207 - lava_callback - INFO - Received callback for node 69dda963c2164e674d721622 INFO: 172.21.0.1:35808 - "POST /node/69dda963c2164e674d721622 HTTP/1.0" 202 Accepted 2026-04-16 02:42:00,217 - lava_callback - INFO - Starting async job submit for node 69dda963c2164e674d721622 2026-04-16 02:42:00,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:42:00,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda963c2164e674d721622 HTTP/1.1" 200 None 2026-04-16 02:42:00,246 - lava_callback - DEBUG - Processing node 69dda963c2164e674d721622: baseline-arm64-baylibre 2026-04-16 02:42:00,246 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dda963c2164e674d721622 2026-04-16 02:42:00,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:42:00,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dda963c2164e674d721622 HTTP/1.1" 200 None 2026-04-16 02:42:00,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:42:00,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-16 02:42:00,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:42:00,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dda963c2164e674d721622 HTTP/1.1" 200 None 2026-04-16 02:42:00,304 - lava_callback - ERROR - Error processing callback for node 69dda963c2164e674d721622: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57850 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:45:53,444 - lava_callback - INFO - Received callback for node 69ddaa4dc2164e674d72171a INFO: 172.21.0.1:49594 - "POST /node/69ddaa4dc2164e674d72171a HTTP/1.0" 202 Accepted 2026-04-16 02:45:53,450 - lava_callback - INFO - Starting async job submit for node 69ddaa4dc2164e674d72171a 2026-04-16 02:45:53,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:45:53,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddaa4dc2164e674d72171a HTTP/1.1" 200 None 2026-04-16 02:45:53,476 - lava_callback - DEBUG - Processing node 69ddaa4dc2164e674d72171a: baseline-arm64-clabbe 2026-04-16 02:45:53,477 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddaa4dc2164e674d72171a 2026-04-16 02:45:53,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:45:53,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddaa4dc2164e674d72171a HTTP/1.1" 200 None 2026-04-16 02:45:53,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:45:53,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-16 02:45:53,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:45:53,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddaa4dc2164e674d72171a HTTP/1.1" 200 None 2026-04-16 02:45:53,526 - lava_callback - ERROR - Error processing callback for node 69ddaa4dc2164e674d72171a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49598 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:46:00,199 - lava_callback - INFO - Received callback for node 69e04ba91fb14b744a54b24a INFO: 172.21.0.1:37362 - "POST /node/69e04ba91fb14b744a54b24a HTTP/1.0" 202 Accepted 2026-04-16 02:46:00,206 - lava_callback - INFO - Starting async job submit for node 69e04ba91fb14b744a54b24a 2026-04-16 02:46:00,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:46:00,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e04ba91fb14b744a54b24a HTTP/1.1" 200 None 2026-04-16 02:46:00,267 - lava_callback - DEBUG - Processing node 69e04ba91fb14b744a54b24a: baseline-arm64 2026-04-16 02:46:00,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:46:00,830 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:46:00,832 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e04ba91fb14b744a54b24a/log.txt.gz 2026-04-16 02:46:01,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:46:01,331 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:46:01,333 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e04ba91fb14b744a54b24a/lava-logs.yaml 2026-04-16 02:46:01,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:46:01,523 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:46:01,525 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e04ba91fb14b744a54b24a/lava_callback.json.gz DEBUG: Setup failed for 69e04ba91fb14b744a54b24a. Transitting job node result: incomplete -> fail 2026-04-16 02:46:01,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:46:01,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e04ba91fb14b744a54b24a HTTP/1.1" 200 None 2026-04-16 02:46:01,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:46:01,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 02:46:01,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:46:01,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e04ba91fb14b744a54b24a HTTP/1.1" 200 None 2026-04-16 02:46:01,726 - lava_callback - INFO - Completed processing callback for node 69e04ba91fb14b744a54b24a INFO: 172.21.0.1:37366 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:46:08,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:46:08,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42034 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:46:53,464 - lava_callback - INFO - Received callback for node 69ddaa98c2164e674d721788 INFO: 172.21.0.1:58924 - "POST /node/69ddaa98c2164e674d721788 HTTP/1.0" 202 Accepted 2026-04-16 02:46:53,470 - lava_callback - INFO - Starting async job submit for node 69ddaa98c2164e674d721788 2026-04-16 02:46:53,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:46:53,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddaa98c2164e674d721788 HTTP/1.1" 200 None 2026-04-16 02:46:53,486 - lava_callback - DEBUG - Processing node 69ddaa98c2164e674d721788: baseline-arm64-clabbe 2026-04-16 02:46:53,486 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddaa98c2164e674d721788 2026-04-16 02:46:53,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:46:53,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddaa98c2164e674d721788 HTTP/1.1" 200 None 2026-04-16 02:46:53,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:46:53,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-16 02:46:53,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:46:53,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddaa98c2164e674d721788 HTTP/1.1" 200 None 2026-04-16 02:46:53,571 - lava_callback - ERROR - Error processing callback for node 69ddaa98c2164e674d721788: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60230 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:48:04,821 - lava_callback - INFO - Received callback for node 69e049ba1fb14b744a54b01d INFO: 172.21.0.1:49256 - "POST /node/69e049ba1fb14b744a54b01d HTTP/1.0" 202 Accepted 2026-04-16 02:48:04,828 - lava_callback - INFO - Starting async job submit for node 69e049ba1fb14b744a54b01d 2026-04-16 02:48:04,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:48:04,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e049ba1fb14b744a54b01d HTTP/1.1" 200 None 2026-04-16 02:48:04,902 - lava_callback - DEBUG - Processing node 69e049ba1fb14b744a54b01d: ltp-smoke 2026-04-16 02:48:05,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:48:05,799 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:48:05,801 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69e049ba1fb14b744a54b01d/log.txt.gz 2026-04-16 02:48:06,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:48:06,288 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:48:06,290 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69e049ba1fb14b744a54b01d/lava-logs.yaml 2026-04-16 02:48:06,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:48:06,476 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:48:06,478 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69e049ba1fb14b744a54b01d/lava_callback.json.gz INFO: 172.21.0.1:49272 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:48:06,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:48:06,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e049ba1fb14b744a54b01d HTTP/1.1" 200 None 2026-04-16 02:48:06,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:48:06,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a2e1fb14b744a54889b HTTP/1.1" 200 None 2026-04-16 02:48:06,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:48:06,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e049ba1fb14b744a54b01d HTTP/1.1" 200 None 2026-04-16 02:48:06,782 - lava_callback - INFO - Completed processing callback for node 69e049ba1fb14b744a54b01d 2026-04-16 02:48:08,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:48:08,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43354 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:48:33,562 - lava_callback - INFO - Received callback for node 69ddaaedc2164e674d7217dd INFO: 172.21.0.1:43360 - "POST /node/69ddaaedc2164e674d7217dd HTTP/1.0" 202 Accepted 2026-04-16 02:48:33,567 - lava_callback - INFO - Starting async job submit for node 69ddaaedc2164e674d7217dd 2026-04-16 02:48:33,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:48:33,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddaaedc2164e674d7217dd HTTP/1.1" 200 None 2026-04-16 02:48:33,584 - lava_callback - DEBUG - Processing node 69ddaaedc2164e674d7217dd: baseline-arm64-clabbe 2026-04-16 02:48:33,584 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddaaedc2164e674d7217dd 2026-04-16 02:48:33,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:48:33,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddaaedc2164e674d7217dd HTTP/1.1" 200 None 2026-04-16 02:48:33,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:48:33,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-16 02:48:33,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:48:33,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddaaedc2164e674d7217dd HTTP/1.1" 200 None 2026-04-16 02:48:33,641 - lava_callback - ERROR - Error processing callback for node 69ddaaedc2164e674d7217dd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32908 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:49:33,601 - lava_callback - INFO - Received callback for node 69ddab39c2164e674d721831 INFO: 172.21.0.1:32910 - "POST /node/69ddab39c2164e674d721831 HTTP/1.0" 202 Accepted 2026-04-16 02:49:33,607 - lava_callback - INFO - Starting async job submit for node 69ddab39c2164e674d721831 2026-04-16 02:49:33,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:49:33,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddab39c2164e674d721831 HTTP/1.1" 200 None 2026-04-16 02:49:33,627 - lava_callback - DEBUG - Processing node 69ddab39c2164e674d721831: baseline-arm64-clabbe 2026-04-16 02:49:33,627 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddab39c2164e674d721831 2026-04-16 02:49:33,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:49:33,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddab39c2164e674d721831 HTTP/1.1" 200 None 2026-04-16 02:49:33,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:49:33,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-16 02:49:33,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:49:33,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddab39c2164e674d721831 HTTP/1.1" 200 None 2026-04-16 02:49:33,677 - lava_callback - ERROR - Error processing callback for node 69ddab39c2164e674d721831: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44032 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:50:53,697 - lava_callback - INFO - Received callback for node 69ddab8bc2164e674d721872 INFO: 172.21.0.1:48110 - "POST /node/69ddab8bc2164e674d721872 HTTP/1.0" 202 Accepted 2026-04-16 02:50:53,703 - lava_callback - INFO - Starting async job submit for node 69ddab8bc2164e674d721872 2026-04-16 02:50:53,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:50:53,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddab8bc2164e674d721872 HTTP/1.1" 200 None 2026-04-16 02:50:53,719 - lava_callback - DEBUG - Processing node 69ddab8bc2164e674d721872: baseline-arm64-clabbe 2026-04-16 02:50:53,719 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddab8bc2164e674d721872 2026-04-16 02:50:53,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:50:53,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddab8bc2164e674d721872 HTTP/1.1" 200 None 2026-04-16 02:50:53,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:50:53,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-16 02:50:53,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:50:53,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddab8bc2164e674d721872 HTTP/1.1" 200 None 2026-04-16 02:50:53,769 - lava_callback - ERROR - Error processing callback for node 69ddab8bc2164e674d721872: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-16 02:50:53,960 - lava_callback - INFO - Received callback for node 69e04e751fb14b744a54b4cc INFO: 172.21.0.1:48120 - "POST /node/69e04e751fb14b744a54b4cc HTTP/1.0" 202 Accepted 2026-04-16 02:50:53,966 - lava_callback - INFO - Starting async job submit for node 69e04e751fb14b744a54b4cc 2026-04-16 02:50:53,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:50:53,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e04e751fb14b744a54b4cc HTTP/1.1" 200 None 2026-04-16 02:50:53,984 - lava_callback - DEBUG - Processing node 69e04e751fb14b744a54b4cc: baseline-nfs-arm64 2026-04-16 02:50:53,986 - lava_callback - WARNING - Failed to upload log 2026-04-16 02:50:53,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:50:54,132 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:50:54,134 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e04e751fb14b744a54b4cc/lava-logs.yaml 2026-04-16 02:50:54,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:50:54,249 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:50:54,250 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e04e751fb14b744a54b4cc/lava_callback.json.gz 2026-04-16 02:50:54,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:50:54,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e04e751fb14b744a54b4cc HTTP/1.1" 200 None 2026-04-16 02:50:54,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:50:54,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 02:50:54,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:50:54,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e04e751fb14b744a54b4cc HTTP/1.1" 200 None 2026-04-16 02:50:54,329 - lava_callback - INFO - Completed processing callback for node 69e04e751fb14b744a54b4cc INFO: 172.21.0.1:48134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50322 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:51:08,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:51:08,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44692 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:52:33,746 - lava_callback - INFO - Received callback for node 69ddabdec2164e674d7218c4 INFO: 172.21.0.1:44694 - "POST /node/69ddabdec2164e674d7218c4 HTTP/1.0" 202 Accepted 2026-04-16 02:52:33,752 - lava_callback - INFO - Starting async job submit for node 69ddabdec2164e674d7218c4 2026-04-16 02:52:33,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:52:33,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddabdec2164e674d7218c4 HTTP/1.1" 200 None 2026-04-16 02:52:33,780 - lava_callback - DEBUG - Processing node 69ddabdec2164e674d7218c4: baseline-arm64-clabbe 2026-04-16 02:52:33,780 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddabdec2164e674d7218c4 2026-04-16 02:52:33,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:52:33,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddabdec2164e674d7218c4 HTTP/1.1" 200 None 2026-04-16 02:52:33,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:52:33,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-16 02:52:33,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:52:33,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddabdec2164e674d7218c4 HTTP/1.1" 200 None 2026-04-16 02:52:33,829 - lava_callback - ERROR - Error processing callback for node 69ddabdec2164e674d7218c4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51814 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:53:33,837 - lava_callback - INFO - Received callback for node 69ddac27c2164e674d721919 INFO: 172.21.0.1:51818 - "POST /node/69ddac27c2164e674d721919 HTTP/1.0" 202 Accepted 2026-04-16 02:53:33,843 - lava_callback - INFO - Starting async job submit for node 69ddac27c2164e674d721919 2026-04-16 02:53:33,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:53:33,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddac27c2164e674d721919 HTTP/1.1" 200 None 2026-04-16 02:53:33,864 - lava_callback - DEBUG - Processing node 69ddac27c2164e674d721919: baseline-arm64-clabbe 2026-04-16 02:53:33,864 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddac27c2164e674d721919 2026-04-16 02:53:33,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:53:33,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddac27c2164e674d721919 HTTP/1.1" 200 None 2026-04-16 02:53:33,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:53:33,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d59ea834043de23ba13b5f HTTP/1.1" 200 None 2026-04-16 02:53:33,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:53:33,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddac27c2164e674d721919 HTTP/1.1" 200 None 2026-04-16 02:53:33,924 - lava_callback - ERROR - Error processing callback for node 69ddac27c2164e674d721919: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46888 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:53:55,351 - lava_callback - INFO - Received callback for node 69e04f111fb14b744a54b558 INFO: 172.21.0.1:46184 - "POST /node/69e04f111fb14b744a54b558 HTTP/1.0" 202 Accepted 2026-04-16 02:53:55,358 - lava_callback - INFO - Starting async job submit for node 69e04f111fb14b744a54b558 2026-04-16 02:53:55,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:53:55,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e04f111fb14b744a54b558 HTTP/1.1" 200 None 2026-04-16 02:53:55,404 - lava_callback - DEBUG - Processing node 69e04f111fb14b744a54b558: baseline-arm64 2026-04-16 02:53:55,538 - lava_callback - WARNING - Failed to upload log 2026-04-16 02:53:55,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:53:55,787 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:53:55,788 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e04f111fb14b744a54b558/lava-logs.yaml 2026-04-16 02:53:55,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:53:55,915 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:53:55,916 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e04f111fb14b744a54b558/lava_callback.json.gz 2026-04-16 02:53:55,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:53:55,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e04f111fb14b744a54b558 HTTP/1.1" 200 None 2026-04-16 02:53:55,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:53:55,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 02:53:55,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:53:55,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e04f111fb14b744a54b558 HTTP/1.1" 200 None 2026-04-16 02:53:56,063 - lava_callback - INFO - Completed processing callback for node 69e04f111fb14b744a54b558 INFO: 172.21.0.1:46192 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:54:01,712 - lava_callback - INFO - Received callback for node 69e04ccc1fb14b744a54b33d INFO: 172.21.0.1:37034 - "POST /node/69e04ccc1fb14b744a54b33d HTTP/1.0" 202 Accepted 2026-04-16 02:54:01,718 - lava_callback - INFO - Starting async job submit for node 69e04ccc1fb14b744a54b33d 2026-04-16 02:54:01,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:54:01,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e04ccc1fb14b744a54b33d HTTP/1.1" 200 None 2026-04-16 02:54:01,762 - lava_callback - DEBUG - Processing node 69e04ccc1fb14b744a54b33d: baseline-arm64 2026-04-16 02:54:02,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:54:02,453 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:54:02,454 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e04ccc1fb14b744a54b33d/log.txt.gz 2026-04-16 02:54:02,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:54:02,930 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:54:02,932 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e04ccc1fb14b744a54b33d/lava-logs.yaml 2026-04-16 02:54:02,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:54:03,111 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:54:03,113 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e04ccc1fb14b744a54b33d/lava_callback.json.gz 2026-04-16 02:54:03,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:54:03,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e04ccc1fb14b744a54b33d HTTP/1.1" 200 None 2026-04-16 02:54:03,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:54:03,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 02:54:03,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:54:03,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e04ccc1fb14b744a54b33d HTTP/1.1" 200 None 2026-04-16 02:54:03,237 - lava_callback - INFO - Completed processing callback for node 69e04ccc1fb14b744a54b33d INFO: 172.21.0.1:37038 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:54:08,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:54:08,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48508 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:55:35,841 - lava_callback - INFO - Received callback for node 69e04f761fb14b744a54b5e0 INFO: 172.21.0.1:48524 - "POST /node/69e04f761fb14b744a54b5e0 HTTP/1.0" 202 Accepted 2026-04-16 02:55:35,848 - lava_callback - INFO - Starting async job submit for node 69e04f761fb14b744a54b5e0 2026-04-16 02:55:35,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:55:35,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e04f761fb14b744a54b5e0 HTTP/1.1" 200 None 2026-04-16 02:55:35,892 - lava_callback - DEBUG - Processing node 69e04f761fb14b744a54b5e0: baseline-arm64 2026-04-16 02:55:36,060 - lava_callback - WARNING - Failed to upload log 2026-04-16 02:55:36,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:55:36,334 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:55:36,336 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e04f761fb14b744a54b5e0/lava-logs.yaml 2026-04-16 02:55:36,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:55:36,481 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:55:36,483 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e04f761fb14b744a54b5e0/lava_callback.json.gz 2026-04-16 02:55:36,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:48540 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:55:36,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e04f761fb14b744a54b5e0 HTTP/1.1" 200 None 2026-04-16 02:55:36,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:55:36,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 02:55:36,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:55:36,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e04f761fb14b744a54b5e0 HTTP/1.1" 200 None 2026-04-16 02:55:36,659 - lava_callback - INFO - Completed processing callback for node 69e04f761fb14b744a54b5e0 2026-04-16 02:55:38,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:55:38,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58076 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:56:52,343 - lava_callback - INFO - Received callback for node 69e04d1c1fb14b744a54b366 INFO: 172.21.0.1:34812 - "POST /node/69e04d1c1fb14b744a54b366 HTTP/1.0" 202 Accepted 2026-04-16 02:56:52,351 - lava_callback - INFO - Starting async job submit for node 69e04d1c1fb14b744a54b366 2026-04-16 02:56:52,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:56:52,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e04d1c1fb14b744a54b366 HTTP/1.1" 200 None 2026-04-16 02:56:52,398 - lava_callback - DEBUG - Processing node 69e04d1c1fb14b744a54b366: baseline-nfs-arm64 2026-04-16 02:56:52,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:56:53,072 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:56:53,074 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e04d1c1fb14b744a54b366/log.txt.gz 2026-04-16 02:56:53,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:56:53,576 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:56:53,578 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e04d1c1fb14b744a54b366/lava-logs.yaml 2026-04-16 02:56:53,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 02:56:53,771 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 02:56:53,773 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e04d1c1fb14b744a54b366/lava_callback.json.gz 2026-04-16 02:56:53,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:56:53,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e04d1c1fb14b744a54b366 HTTP/1.1" 200 None 2026-04-16 02:56:53,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:56:53,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 02:56:53,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:56:53,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e04d1c1fb14b744a54b366 HTTP/1.1" 200 None 2026-04-16 02:56:53,969 - lava_callback - INFO - Completed processing callback for node 69e04d1c1fb14b744a54b366 INFO: 172.21.0.1:34816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39332 - "GET / HTTP/1.0" 200 OK 2026-04-16 02:57:08,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 02:57:08,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51882 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33214 - "GET / HTTP/1.0" 200 OK 2026-04-16 03:03:28,715 - lava_callback - INFO - Received callback for node 69e04fbf1fb14b744a54b625 INFO: 172.21.0.1:33226 - "POST /node/69e04fbf1fb14b744a54b625 HTTP/1.0" 202 Accepted 2026-04-16 03:03:28,723 - lava_callback - INFO - Starting async job submit for node 69e04fbf1fb14b744a54b625 2026-04-16 03:03:28,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:03:28,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e04fbf1fb14b744a54b625 HTTP/1.1" 200 None 2026-04-16 03:03:28,770 - lava_callback - DEBUG - Processing node 69e04fbf1fb14b744a54b625: baseline-arm64 2026-04-16 03:03:29,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 03:03:29,570 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 03:03:29,572 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e04fbf1fb14b744a54b625/log.txt.gz 2026-04-16 03:03:30,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 03:03:30,271 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 03:03:30,273 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e04fbf1fb14b744a54b625/lava-logs.yaml 2026-04-16 03:03:30,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 03:03:30,443 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 03:03:30,445 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e04fbf1fb14b744a54b625/lava_callback.json.gz 2026-04-16 03:03:30,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:03:30,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e04fbf1fb14b744a54b625 HTTP/1.1" 200 None 2026-04-16 03:03:30,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:03:30,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 03:03:30,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:03:30,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e04fbf1fb14b744a54b625 HTTP/1.1" 200 None 2026-04-16 03:03:30,529 - lava_callback - INFO - Completed processing callback for node 69e04fbf1fb14b744a54b625 INFO: 172.21.0.1:36138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36148 - "GET / HTTP/1.0" 200 OK 2026-04-16 03:03:38,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:03:38,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57192 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42026 - "GET / HTTP/1.0" 200 OK 2026-04-16 03:07:59,875 - lava_callback - INFO - Received callback for node 69e04de71fb14b744a54b447 INFO: 172.21.0.1:36716 - "POST /node/69e04de71fb14b744a54b447 HTTP/1.0" 202 Accepted 2026-04-16 03:07:59,882 - lava_callback - INFO - Starting async job submit for node 69e04de71fb14b744a54b447 2026-04-16 03:07:59,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:07:59,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e04de71fb14b744a54b447 HTTP/1.1" 200 None 2026-04-16 03:07:59,942 - lava_callback - DEBUG - Processing node 69e04de71fb14b744a54b447: baseline-nfs-arm64 2026-04-16 03:08:01,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 03:08:01,219 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 03:08:01,221 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e04de71fb14b744a54b447/log.txt.gz 2026-04-16 03:08:01,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 03:08:02,031 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 03:08:02,033 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e04de71fb14b744a54b447/lava-logs.yaml 2026-04-16 03:08:02,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 03:08:02,281 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 03:08:02,283 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e04de71fb14b744a54b447/lava_callback.json.gz DEBUG: Setup failed for 69e04de71fb14b744a54b447. Transitting job node result: incomplete -> fail 2026-04-16 03:08:02,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:08:02,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e04de71fb14b744a54b447 HTTP/1.1" 200 None 2026-04-16 03:08:02,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:08:02,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 03:08:02,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:08:02,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e04de71fb14b744a54b447 HTTP/1.1" 200 None 2026-04-16 03:08:02,583 - lava_callback - INFO - Completed processing callback for node 69e04de71fb14b744a54b447 INFO: 172.21.0.1:36722 - "GET / HTTP/1.0" 200 OK 2026-04-16 03:08:08,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:08:08,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-16 03:08:12,634 - lava_callback - INFO - Received callback for node 69e04eb01fb14b744a54b516 INFO: 172.21.0.1:52274 - "POST /node/69e04eb01fb14b744a54b516 HTTP/1.0" 202 Accepted 2026-04-16 03:08:12,641 - lava_callback - INFO - Starting async job submit for node 69e04eb01fb14b744a54b516 2026-04-16 03:08:12,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:08:12,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e04eb01fb14b744a54b516 HTTP/1.1" 200 None 2026-04-16 03:08:12,728 - lava_callback - DEBUG - Processing node 69e04eb01fb14b744a54b516: baseline-arm 2026-04-16 03:08:13,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 03:08:13,540 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 03:08:13,542 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e04eb01fb14b744a54b516/log.txt.gz 2026-04-16 03:08:13,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 03:08:14,195 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 03:08:14,197 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e04eb01fb14b744a54b516/lava-logs.yaml 2026-04-16 03:08:14,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 03:08:14,364 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 03:08:14,366 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e04eb01fb14b744a54b516/lava_callback.json.gz DEBUG: Setup failed for 69e04eb01fb14b744a54b516. Transitting job node result: incomplete -> fail 2026-04-16 03:08:14,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:08:14,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e04eb01fb14b744a54b516 HTTP/1.1" 200 None 2026-04-16 03:08:14,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:08:14,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-16 03:08:14,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:08:14,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e04eb01fb14b744a54b516 HTTP/1.1" 200 None 2026-04-16 03:08:14,681 - lava_callback - INFO - Completed processing callback for node 69e04eb01fb14b744a54b516 INFO: 172.21.0.1:52290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47028 - "GET / HTTP/1.0" 200 OK 2026-04-16 03:08:38,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:08:38,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53970 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49690 - "GET / HTTP/1.0" 200 OK 2026-04-16 03:12:19,181 - lava_callback - INFO - Received callback for node 69e051dc1fb14b744a54b84e INFO: 172.21.0.1:49704 - "POST /node/69e051dc1fb14b744a54b84e HTTP/1.0" 202 Accepted 2026-04-16 03:12:19,189 - lava_callback - INFO - Starting async job submit for node 69e051dc1fb14b744a54b84e 2026-04-16 03:12:19,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:12:19,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e051dc1fb14b744a54b84e HTTP/1.1" 200 None 2026-04-16 03:12:19,250 - lava_callback - DEBUG - Processing node 69e051dc1fb14b744a54b84e: baseline-arm64 2026-04-16 03:12:19,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 03:12:19,761 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 03:12:19,763 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e051dc1fb14b744a54b84e/log.txt.gz 2026-04-16 03:12:19,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 03:12:20,176 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 03:12:20,178 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e051dc1fb14b744a54b84e/lava-logs.yaml 2026-04-16 03:12:20,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 03:12:20,363 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 03:12:20,365 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e051dc1fb14b744a54b84e/lava_callback.json.gz DEBUG: Setup failed for 69e051dc1fb14b744a54b84e. Transitting job node result: incomplete -> fail 2026-04-16 03:12:20,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:12:20,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e051dc1fb14b744a54b84e HTTP/1.1" 200 None 2026-04-16 03:12:20,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:12:20,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 03:12:20,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:12:20,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e051dc1fb14b744a54b84e HTTP/1.1" 200 None 2026-04-16 03:12:20,653 - lava_callback - INFO - Completed processing callback for node 69e051dc1fb14b744a54b84e INFO: 172.21.0.1:45214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59646 - "GET / HTTP/1.0" 200 OK 2026-04-16 03:12:38,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:12:38,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59308 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43212 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49046 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50728 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58856 - "GET / HTTP/1.0" 200 OK 2026-04-16 03:22:22,646 - lava_callback - INFO - Received callback for node 69e053711fb14b744a54ba13 INFO: 172.21.0.1:46822 - "POST /node/69e053711fb14b744a54ba13 HTTP/1.0" 202 Accepted 2026-04-16 03:22:22,652 - lava_callback - INFO - Starting async job submit for node 69e053711fb14b744a54ba13 2026-04-16 03:22:22,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:22:22,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e053711fb14b744a54ba13 HTTP/1.1" 200 None 2026-04-16 03:22:22,693 - lava_callback - DEBUG - Processing node 69e053711fb14b744a54ba13: baseline-arm64 2026-04-16 03:22:23,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 03:22:23,362 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 03:22:23,363 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e053711fb14b744a54ba13/log.txt.gz 2026-04-16 03:22:23,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 03:22:23,819 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 03:22:23,821 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e053711fb14b744a54ba13/lava-logs.yaml 2026-04-16 03:22:23,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 03:22:23,998 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 03:22:24,000 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e053711fb14b744a54ba13/lava_callback.json.gz 2026-04-16 03:22:24,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:22:24,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e053711fb14b744a54ba13 HTTP/1.1" 200 None 2026-04-16 03:22:24,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:22:24,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 03:22:24,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:22:24,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e053711fb14b744a54ba13 HTTP/1.1" 200 None 2026-04-16 03:22:24,160 - lava_callback - INFO - Completed processing callback for node 69e053711fb14b744a54ba13 INFO: 172.21.0.1:46828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57234 - "GET / HTTP/1.0" 200 OK 2026-04-16 03:22:38,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:22:38,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40076 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42090 - "GET / HTTP/1.0" 200 OK 2026-04-16 03:24:53,340 - lava_callback - INFO - Received callback for node 69e054011fb14b744a54bab2 INFO: 172.21.0.1:58346 - "POST /node/69e054011fb14b744a54bab2 HTTP/1.0" 202 Accepted 2026-04-16 03:24:53,347 - lava_callback - INFO - Starting async job submit for node 69e054011fb14b744a54bab2 2026-04-16 03:24:53,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:24:53,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e054011fb14b744a54bab2 HTTP/1.1" 200 None 2026-04-16 03:24:53,395 - lava_callback - DEBUG - Processing node 69e054011fb14b744a54bab2: baseline-nfs-arm64 2026-04-16 03:24:53,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 03:24:54,060 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 03:24:54,062 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e054011fb14b744a54bab2/log.txt.gz 2026-04-16 03:24:54,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 03:24:54,562 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 03:24:54,565 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e054011fb14b744a54bab2/lava-logs.yaml 2026-04-16 03:24:54,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 03:24:54,769 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 03:24:54,770 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e054011fb14b744a54bab2/lava_callback.json.gz 2026-04-16 03:24:54,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:24:54,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e054011fb14b744a54bab2 HTTP/1.1" 200 None 2026-04-16 03:24:54,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:24:54,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 03:24:54,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:24:54,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e054011fb14b744a54bab2 HTTP/1.1" 200 None 2026-04-16 03:24:54,910 - lava_callback - INFO - Completed processing callback for node 69e054011fb14b744a54bab2 INFO: 172.21.0.1:58362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52814 - "GET / HTTP/1.0" 200 OK 2026-04-16 03:25:08,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:25:09,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44084 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52922 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34090 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59938 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58828 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33296 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36132 - "GET /node/69562ef816d33f8361befc51%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:36138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39072 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42036 - "GET / HTTP/1.0" 200 OK 2026-04-16 03:45:50,842 - lava_callback - INFO - Received callback for node 69e056d31fb14b744a54bd2d INFO: 172.21.0.1:51882 - "POST /node/69e056d31fb14b744a54bd2d HTTP/1.0" 202 Accepted 2026-04-16 03:45:50,850 - lava_callback - INFO - Starting async job submit for node 69e056d31fb14b744a54bd2d 2026-04-16 03:45:50,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:45:50,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e056d31fb14b744a54bd2d HTTP/1.1" 200 None 2026-04-16 03:45:50,929 - lava_callback - DEBUG - Processing node 69e056d31fb14b744a54bd2d: baseline-nfs-arm64 2026-04-16 03:45:51,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 03:45:52,145 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 03:45:52,147 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e056d31fb14b744a54bd2d/log.txt.gz 2026-04-16 03:45:52,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 03:45:52,965 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 03:45:52,967 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e056d31fb14b744a54bd2d/lava-logs.yaml 2026-04-16 03:45:52,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-16 03:45:53,358 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-16 03:45:53,360 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e056d31fb14b744a54bd2d/lava_callback.json.gz DEBUG: Setup failed for 69e056d31fb14b744a54bd2d. Transitting job node result: incomplete -> fail 2026-04-16 03:45:53,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:45:53,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e056d31fb14b744a54bd2d HTTP/1.1" 200 None 2026-04-16 03:45:53,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:45:53,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-16 03:45:53,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:45:53,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e056d31fb14b744a54bd2d HTTP/1.1" 200 None 2026-04-16 03:45:53,597 - lava_callback - INFO - Completed processing callback for node 69e056d31fb14b744a54bd2d INFO: 172.21.0.1:51892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46864 - "GET / HTTP/1.0" 200 OK 2026-04-16 03:46:09,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 03:46:09,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53590 - "GET /node/698bd0561e517752bab8adb7%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:53600 - "GET /node/6993281b31166481c8de8efa%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:53616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34022 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59812 - "GET /node/698a8f14d9a1cfa777a242d6%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:59816 - "GET /node/695be6f45dac150a0e83773b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:59820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55898 - "GET /node/6985d54971989fb14149a0c0%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:37670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59410 - "GET /node/69b90f330ec88e58bad0d13c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:59426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32924 - "GET /node/69865c6c177ca0f097bd453c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:39200 - "GET /node/693b7c5f41fb4c9509763474%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:39212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39510 - "GET /node/695323b631522df6df79b354%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:50902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41520 - "GET /node/6952c33f9912bd6bbcea3b3a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:59468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37996 - "GET /node/698ef632f0e3ffbba67d2f35%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:38010 - "GET /node/691b512dac5847a394495fac%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:38016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42168 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35832 - "GET /node/69afdb6fae557f2600f0f770%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:35836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33338 - "GET /node/69a0e73e9f52b1b460a4693d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:33352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37528 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43486 - "GET /node/693ae380fee8383e92b64166%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:43496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38810 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54014 - "GET /node/698491f73a8748f282087b1d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:54024 - "GET /node/6993221531166481c8de76a1%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:39106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37266 - "GET /node/693f97910d8ce4018da9859c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:47986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58626 - "GET /node/693f5b610d8ce4018da8c7c4%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:58634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37062 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:40:06,057 - lava_callback - INFO - Received callback for node 69ddc51cc2164e674d7220c3 INFO: 172.21.0.1:47216 - "POST /node/69ddc51cc2164e674d7220c3 HTTP/1.0" 202 Accepted 2026-04-16 04:40:06,063 - lava_callback - INFO - Starting async job submit for node 69ddc51cc2164e674d7220c3 2026-04-16 04:40:06,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:40:06,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc51cc2164e674d7220c3 HTTP/1.1" 200 None 2026-04-16 04:40:06,088 - lava_callback - DEBUG - Processing node 69ddc51cc2164e674d7220c3: baseline-arm-baylibre 2026-04-16 04:40:06,088 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc51cc2164e674d7220c3 2026-04-16 04:40:06,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:40:06,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc51cc2164e674d7220c3 HTTP/1.1" 200 None 2026-04-16 04:40:06,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:40:06,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd170117c944d2f17d8b31 HTTP/1.1" 200 None 2026-04-16 04:40:06,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:40:06,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc51cc2164e674d7220c3 HTTP/1.1" 200 None 2026-04-16 04:40:06,144 - lava_callback - ERROR - Error processing callback for node 69ddc51cc2164e674d7220c3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36640 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:40:25,998 - lava_callback - INFO - Received callback for node 69ddc537c2164e674d722102 INFO: 172.21.0.1:41408 - "POST /node/69ddc537c2164e674d722102 HTTP/1.0" 202 Accepted 2026-04-16 04:40:26,004 - lava_callback - INFO - Starting async job submit for node 69ddc537c2164e674d722102 2026-04-16 04:40:26,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:40:26,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc537c2164e674d722102 HTTP/1.1" 200 None 2026-04-16 04:40:26,021 - lava_callback - DEBUG - Processing node 69ddc537c2164e674d722102: baseline-arm-baylibre 2026-04-16 04:40:26,021 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc537c2164e674d722102 2026-04-16 04:40:26,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:40:26,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc537c2164e674d722102 HTTP/1.1" 200 None 2026-04-16 04:40:26,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:40:26,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd170117c944d2f17d8b31 HTTP/1.1" 200 None 2026-04-16 04:40:26,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:40:26,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc537c2164e674d722102 HTTP/1.1" 200 None 2026-04-16 04:40:26,077 - lava_callback - ERROR - Error processing callback for node 69ddc537c2164e674d722102: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53676 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:41:06,014 - lava_callback - INFO - Received callback for node 69ddc559c2164e674d722132 INFO: 172.21.0.1:43742 - "POST /node/69ddc559c2164e674d722132 HTTP/1.0" 202 Accepted 2026-04-16 04:41:06,019 - lava_callback - INFO - Starting async job submit for node 69ddc559c2164e674d722132 2026-04-16 04:41:06,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:41:06,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc559c2164e674d722132 HTTP/1.1" 200 None 2026-04-16 04:41:06,036 - lava_callback - DEBUG - Processing node 69ddc559c2164e674d722132: baseline-arm-baylibre 2026-04-16 04:41:06,036 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc559c2164e674d722132 2026-04-16 04:41:06,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:41:06,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc559c2164e674d722132 HTTP/1.1" 200 None 2026-04-16 04:41:06,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:41:06,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd170117c944d2f17d8b31 HTTP/1.1" 200 None 2026-04-16 04:41:06,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:41:06,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc559c2164e674d722132 HTTP/1.1" 200 None 2026-04-16 04:41:06,099 - lava_callback - ERROR - Error processing callback for node 69ddc559c2164e674d722132: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58140 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:42:06,097 - lava_callback - INFO - Received callback for node 69ddc594c2164e674d722173 INFO: 172.21.0.1:43460 - "POST /node/69ddc594c2164e674d722173 HTTP/1.0" 202 Accepted 2026-04-16 04:42:06,102 - lava_callback - INFO - Starting async job submit for node 69ddc594c2164e674d722173 2026-04-16 04:42:06,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:42:06,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc594c2164e674d722173 HTTP/1.1" 200 None 2026-04-16 04:42:06,118 - lava_callback - DEBUG - Processing node 69ddc594c2164e674d722173: baseline-arm-baylibre 2026-04-16 04:42:06,118 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc594c2164e674d722173 2026-04-16 04:42:06,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:42:06,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc594c2164e674d722173 HTTP/1.1" 200 None 2026-04-16 04:42:06,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:42:06,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd170117c944d2f17d8b31 HTTP/1.1" 200 None 2026-04-16 04:42:06,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:42:06,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc594c2164e674d722173 HTTP/1.1" 200 None 2026-04-16 04:42:06,168 - lava_callback - ERROR - Error processing callback for node 69ddc594c2164e674d722173: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47060 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:42:46,106 - lava_callback - INFO - Received callback for node 69ddc5b3c2164e674d72218d INFO: 172.21.0.1:59358 - "POST /node/69ddc5b3c2164e674d72218d HTTP/1.0" 202 Accepted 2026-04-16 04:42:46,112 - lava_callback - INFO - Starting async job submit for node 69ddc5b3c2164e674d72218d 2026-04-16 04:42:46,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:42:46,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc5b3c2164e674d72218d HTTP/1.1" 200 None 2026-04-16 04:42:46,128 - lava_callback - DEBUG - Processing node 69ddc5b3c2164e674d72218d: baseline-arm-baylibre 2026-04-16 04:42:46,129 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc5b3c2164e674d72218d 2026-04-16 04:42:46,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:42:46,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc5b3c2164e674d72218d HTTP/1.1" 200 None 2026-04-16 04:42:46,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:42:46,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd170117c944d2f17d8b31 HTTP/1.1" 200 None 2026-04-16 04:42:46,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:42:46,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc5b3c2164e674d72218d HTTP/1.1" 200 None 2026-04-16 04:42:46,201 - lava_callback - ERROR - Error processing callback for node 69ddc5b3c2164e674d72218d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41752 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:43:06,123 - lava_callback - INFO - Received callback for node 69ddc5d2c2164e674d7221d2 INFO: 172.21.0.1:36742 - "POST /node/69ddc5d2c2164e674d7221d2 HTTP/1.0" 202 Accepted 2026-04-16 04:43:06,129 - lava_callback - INFO - Starting async job submit for node 69ddc5d2c2164e674d7221d2 2026-04-16 04:43:06,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:43:06,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc5d2c2164e674d7221d2 HTTP/1.1" 200 None 2026-04-16 04:43:06,149 - lava_callback - DEBUG - Processing node 69ddc5d2c2164e674d7221d2: baseline-arm-baylibre 2026-04-16 04:43:06,149 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc5d2c2164e674d7221d2 2026-04-16 04:43:06,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:43:06,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc5d2c2164e674d7221d2 HTTP/1.1" 200 None 2026-04-16 04:43:06,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:43:06,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd170117c944d2f17d8b31 HTTP/1.1" 200 None 2026-04-16 04:43:06,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:43:06,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc5d2c2164e674d7221d2 HTTP/1.1" 200 None 2026-04-16 04:43:06,217 - lava_callback - ERROR - Error processing callback for node 69ddc5d2c2164e674d7221d2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34918 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58800 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:44:06,195 - lava_callback - INFO - Received callback for node 69ddc611c2164e674d722228 INFO: 172.21.0.1:39634 - "POST /node/69ddc611c2164e674d722228 HTTP/1.0" 202 Accepted 2026-04-16 04:44:06,201 - lava_callback - INFO - Starting async job submit for node 69ddc611c2164e674d722228 2026-04-16 04:44:06,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:44:06,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc611c2164e674d722228 HTTP/1.1" 200 None 2026-04-16 04:44:06,216 - lava_callback - DEBUG - Processing node 69ddc611c2164e674d722228: baseline-arm-baylibre 2026-04-16 04:44:06,216 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc611c2164e674d722228 2026-04-16 04:44:06,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:44:06,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc611c2164e674d722228 HTTP/1.1" 200 None 2026-04-16 04:44:06,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:44:06,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 04:44:06,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:44:06,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc611c2164e674d722228 HTTP/1.1" 200 None 2026-04-16 04:44:06,289 - lava_callback - ERROR - Error processing callback for node 69ddc611c2164e674d722228: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33614 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:44:46,181 - lava_callback - INFO - Received callback for node 69ddc632c2164e674d722246 INFO: 172.21.0.1:43124 - "POST /node/69ddc632c2164e674d722246 HTTP/1.0" 202 Accepted 2026-04-16 04:44:46,187 - lava_callback - INFO - Starting async job submit for node 69ddc632c2164e674d722246 2026-04-16 04:44:46,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:44:46,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc632c2164e674d722246 HTTP/1.1" 200 None 2026-04-16 04:44:46,202 - lava_callback - DEBUG - Processing node 69ddc632c2164e674d722246: baseline-arm-baylibre 2026-04-16 04:44:46,202 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc632c2164e674d722246 2026-04-16 04:44:46,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:44:46,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc632c2164e674d722246 HTTP/1.1" 200 None 2026-04-16 04:44:46,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:44:46,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 04:44:46,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:44:46,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc632c2164e674d722246 HTTP/1.1" 200 None 2026-04-16 04:44:46,259 - lava_callback - ERROR - Error processing callback for node 69ddc632c2164e674d722246: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50622 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:45:58,577 - lava_callback - INFO - Received callback for node 69ddc676c2164e674d7222cb INFO: 172.21.0.1:50632 - "POST /node/69ddc676c2164e674d7222cb HTTP/1.0" 202 Accepted 2026-04-16 04:45:58,583 - lava_callback - INFO - Starting async job submit for node 69ddc676c2164e674d7222cb 2026-04-16 04:45:58,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:45:58,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc676c2164e674d7222cb HTTP/1.1" 200 None 2026-04-16 04:45:58,599 - lava_callback - DEBUG - Processing node 69ddc676c2164e674d7222cb: baseline-arm-clabbe 2026-04-16 04:45:58,600 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc676c2164e674d7222cb 2026-04-16 04:45:58,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:45:58,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc676c2164e674d7222cb HTTP/1.1" 200 None 2026-04-16 04:45:58,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:45:58,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd170117c944d2f17d8b31 HTTP/1.1" 200 None 2026-04-16 04:45:58,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:45:58,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc676c2164e674d7222cb HTTP/1.1" 200 None 2026-04-16 04:45:58,652 - lava_callback - ERROR - Error processing callback for node 69ddc676c2164e674d7222cb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55606 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55608 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:46:26,368 - lava_callback - INFO - Received callback for node 69ddc691c2164e674d7222d4 INFO: 172.21.0.1:49216 - "POST /node/69ddc691c2164e674d7222d4 HTTP/1.0" 202 Accepted 2026-04-16 04:46:26,373 - lava_callback - INFO - Starting async job submit for node 69ddc691c2164e674d7222d4 2026-04-16 04:46:26,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:46:26,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc691c2164e674d7222d4 HTTP/1.1" 200 None 2026-04-16 04:46:26,390 - lava_callback - DEBUG - Processing node 69ddc691c2164e674d7222d4: baseline-arm-baylibre 2026-04-16 04:46:26,390 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc691c2164e674d7222d4 2026-04-16 04:46:26,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:46:26,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc691c2164e674d7222d4 HTTP/1.1" 200 None 2026-04-16 04:46:26,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:46:26,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 04:46:26,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:46:26,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc691c2164e674d7222d4 HTTP/1.1" 200 None 2026-04-16 04:46:26,466 - lava_callback - ERROR - Error processing callback for node 69ddc691c2164e674d7222d4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47212 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:46:58,595 - lava_callback - INFO - Received callback for node 69ddc6b5c2164e674d72232e INFO: 172.21.0.1:47214 - "POST /node/69ddc6b5c2164e674d72232e HTTP/1.0" 202 Accepted 2026-04-16 04:46:58,600 - lava_callback - INFO - Starting async job submit for node 69ddc6b5c2164e674d72232e 2026-04-16 04:46:58,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:46:58,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc6b5c2164e674d72232e HTTP/1.1" 200 None 2026-04-16 04:46:58,616 - lava_callback - DEBUG - Processing node 69ddc6b5c2164e674d72232e: baseline-arm-clabbe 2026-04-16 04:46:58,616 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc6b5c2164e674d72232e 2026-04-16 04:46:58,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:46:58,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc6b5c2164e674d72232e HTTP/1.1" 200 None 2026-04-16 04:46:58,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:46:58,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd170117c944d2f17d8b31 HTTP/1.1" 200 None 2026-04-16 04:46:58,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:46:58,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc6b5c2164e674d72232e HTTP/1.1" 200 None 2026-04-16 04:46:58,663 - lava_callback - ERROR - Error processing callback for node 69ddc6b5c2164e674d72232e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35134 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51820 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:47:38,568 - lava_callback - INFO - Received callback for node 69ddc6dac2164e674d722345 INFO: 172.21.0.1:51836 - "POST /node/69ddc6dac2164e674d722345 HTTP/1.0" 202 Accepted 2026-04-16 04:47:38,574 - lava_callback - INFO - Starting async job submit for node 69ddc6dac2164e674d722345 2026-04-16 04:47:38,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:47:38,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc6dac2164e674d722345 HTTP/1.1" 200 None 2026-04-16 04:47:38,590 - lava_callback - DEBUG - Processing node 69ddc6dac2164e674d722345: baseline-arm-clabbe 2026-04-16 04:47:38,590 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc6dac2164e674d722345 2026-04-16 04:47:38,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:47:38,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc6dac2164e674d722345 HTTP/1.1" 200 None 2026-04-16 04:47:38,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:47:38,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd170117c944d2f17d8b31 HTTP/1.1" 200 None 2026-04-16 04:47:38,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:47:38,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc6dac2164e674d722345 HTTP/1.1" 200 None 2026-04-16 04:47:38,648 - lava_callback - ERROR - Error processing callback for node 69ddc6dac2164e674d722345: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39102 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:48:06,502 - lava_callback - INFO - Received callback for node 69ddc6fac2164e674d722359 INFO: 172.21.0.1:56670 - "POST /node/69ddc6fac2164e674d722359 HTTP/1.0" 202 Accepted 2026-04-16 04:48:06,508 - lava_callback - INFO - Starting async job submit for node 69ddc6fac2164e674d722359 2026-04-16 04:48:06,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:48:06,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc6fac2164e674d722359 HTTP/1.1" 200 None 2026-04-16 04:48:06,523 - lava_callback - DEBUG - Processing node 69ddc6fac2164e674d722359: baseline-arm-baylibre 2026-04-16 04:48:06,523 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc6fac2164e674d722359 2026-04-16 04:48:06,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:48:06,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc6fac2164e674d722359 HTTP/1.1" 200 None 2026-04-16 04:48:06,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:56680 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:48:06,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 04:48:06,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:48:06,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc6fac2164e674d722359 HTTP/1.1" 200 None 2026-04-16 04:48:06,572 - lava_callback - ERROR - Error processing callback for node 69ddc6fac2164e674d722359: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41338 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:48:46,433 - lava_callback - INFO - Received callback for node 69ddc71dc2164e674d722377 INFO: 172.21.0.1:60660 - "POST /node/69ddc71dc2164e674d722377 HTTP/1.0" 202 Accepted 2026-04-16 04:48:46,439 - lava_callback - INFO - Starting async job submit for node 69ddc71dc2164e674d722377 2026-04-16 04:48:46,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:48:46,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc71dc2164e674d722377 HTTP/1.1" 200 None 2026-04-16 04:48:46,481 - lava_callback - DEBUG - Processing node 69ddc71dc2164e674d722377: baseline-arm-baylibre 2026-04-16 04:48:46,481 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc71dc2164e674d722377 2026-04-16 04:48:46,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:48:46,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc71dc2164e674d722377 HTTP/1.1" 200 None 2026-04-16 04:48:46,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:48:46,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None INFO: 172.21.0.1:60662 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:48:46,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:48:46,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc71dc2164e674d722377 HTTP/1.1" 200 None 2026-04-16 04:48:46,535 - lava_callback - ERROR - Error processing callback for node 69ddc71dc2164e674d722377: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53734 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:49:18,684 - lava_callback - INFO - Received callback for node 69ddc742c2164e674d7223a3 INFO: 172.21.0.1:53740 - "POST /node/69ddc742c2164e674d7223a3 HTTP/1.0" 202 Accepted 2026-04-16 04:49:18,690 - lava_callback - INFO - Starting async job submit for node 69ddc742c2164e674d7223a3 2026-04-16 04:49:18,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:49:18,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc742c2164e674d7223a3 HTTP/1.1" 200 None 2026-04-16 04:49:18,705 - lava_callback - DEBUG - Processing node 69ddc742c2164e674d7223a3: baseline-arm-clabbe 2026-04-16 04:49:18,706 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc742c2164e674d7223a3 2026-04-16 04:49:18,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:49:18,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc742c2164e674d7223a3 HTTP/1.1" 200 None 2026-04-16 04:49:18,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:49:18,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd170117c944d2f17d8b31 HTTP/1.1" 200 None 2026-04-16 04:49:18,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:49:18,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc742c2164e674d7223a3 HTTP/1.1" 200 None 2026-04-16 04:49:18,783 - lava_callback - ERROR - Error processing callback for node 69ddc742c2164e674d7223a3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39752 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:49:58,637 - lava_callback - INFO - Received callback for node 69ddc766c2164e674d7223bb INFO: 172.21.0.1:39762 - "POST /node/69ddc766c2164e674d7223bb HTTP/1.0" 202 Accepted 2026-04-16 04:49:58,643 - lava_callback - INFO - Starting async job submit for node 69ddc766c2164e674d7223bb 2026-04-16 04:49:58,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:49:58,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc766c2164e674d7223bb HTTP/1.1" 200 None 2026-04-16 04:49:58,659 - lava_callback - DEBUG - Processing node 69ddc766c2164e674d7223bb: baseline-arm-clabbe 2026-04-16 04:49:58,659 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc766c2164e674d7223bb 2026-04-16 04:49:58,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:49:58,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc766c2164e674d7223bb HTTP/1.1" 200 None 2026-04-16 04:49:58,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:49:58,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd170117c944d2f17d8b31 HTTP/1.1" 200 None 2026-04-16 04:49:58,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:49:58,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc766c2164e674d7223bb HTTP/1.1" 200 None 2026-04-16 04:49:58,710 - lava_callback - ERROR - Error processing callback for node 69ddc766c2164e674d7223bb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40540 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40336 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:50:38,943 - lava_callback - INFO - Received callback for node 69ddc78bc2164e674d7223d6 INFO: 172.21.0.1:40346 - "POST /node/69ddc78bc2164e674d7223d6 HTTP/1.0" 202 Accepted 2026-04-16 04:50:38,949 - lava_callback - INFO - Starting async job submit for node 69ddc78bc2164e674d7223d6 2026-04-16 04:50:38,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:50:38,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc78bc2164e674d7223d6 HTTP/1.1" 200 None 2026-04-16 04:50:38,965 - lava_callback - DEBUG - Processing node 69ddc78bc2164e674d7223d6: baseline-arm-clabbe 2026-04-16 04:50:38,965 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc78bc2164e674d7223d6 2026-04-16 04:50:38,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:50:38,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc78bc2164e674d7223d6 HTTP/1.1" 200 None 2026-04-16 04:50:38,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:50:38,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd170117c944d2f17d8b31 HTTP/1.1" 200 None 2026-04-16 04:50:38,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:50:39,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc78bc2164e674d7223d6 HTTP/1.1" 200 None 2026-04-16 04:50:39,022 - lava_callback - ERROR - Error processing callback for node 69ddc78bc2164e674d7223d6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36980 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:50:58,692 - lava_callback - INFO - Received callback for node 69ddc7aac2164e674d722407 INFO: 172.21.0.1:36984 - "POST /node/69ddc7aac2164e674d722407 HTTP/1.0" 202 Accepted 2026-04-16 04:50:58,698 - lava_callback - INFO - Starting async job submit for node 69ddc7aac2164e674d722407 2026-04-16 04:50:58,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:50:58,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc7aac2164e674d722407 HTTP/1.1" 200 None 2026-04-16 04:50:58,714 - lava_callback - DEBUG - Processing node 69ddc7aac2164e674d722407: baseline-arm-clabbe 2026-04-16 04:50:58,714 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc7aac2164e674d722407 2026-04-16 04:50:58,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:50:58,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc7aac2164e674d722407 HTTP/1.1" 200 None 2026-04-16 04:50:58,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:50:58,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 04:50:58,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:50:58,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc7aac2164e674d722407 HTTP/1.1" 200 None 2026-04-16 04:50:58,760 - lava_callback - ERROR - Error processing callback for node 69ddc7aac2164e674d722407: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41506 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:51:38,761 - lava_callback - INFO - Received callback for node 69ddc7cdc2164e674d722430 INFO: 172.21.0.1:41512 - "POST /node/69ddc7cdc2164e674d722430 HTTP/1.0" 202 Accepted 2026-04-16 04:51:38,767 - lava_callback - INFO - Starting async job submit for node 69ddc7cdc2164e674d722430 2026-04-16 04:51:38,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:51:38,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc7cdc2164e674d722430 HTTP/1.1" 200 None 2026-04-16 04:51:38,791 - lava_callback - DEBUG - Processing node 69ddc7cdc2164e674d722430: baseline-arm-clabbe 2026-04-16 04:51:38,791 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc7cdc2164e674d722430 2026-04-16 04:51:38,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:51:38,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc7cdc2164e674d722430 HTTP/1.1" 200 None 2026-04-16 04:51:38,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:51:38,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd170117c944d2f17d8b31 HTTP/1.1" 200 None 2026-04-16 04:51:38,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:51:38,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc7cdc2164e674d722430 HTTP/1.1" 200 None 2026-04-16 04:51:38,839 - lava_callback - ERROR - Error processing callback for node 69ddc7cdc2164e674d722430: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51274 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:52:18,726 - lava_callback - INFO - Received callback for node 69ddc7f1c2164e674d722447 INFO: 172.21.0.1:51286 - "POST /node/69ddc7f1c2164e674d722447 HTTP/1.0" 202 Accepted 2026-04-16 04:52:18,731 - lava_callback - INFO - Starting async job submit for node 69ddc7f1c2164e674d722447 2026-04-16 04:52:18,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:52:18,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc7f1c2164e674d722447 HTTP/1.1" 200 None 2026-04-16 04:52:18,748 - lava_callback - DEBUG - Processing node 69ddc7f1c2164e674d722447: baseline-arm-clabbe 2026-04-16 04:52:18,748 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc7f1c2164e674d722447 2026-04-16 04:52:18,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:52:18,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc7f1c2164e674d722447 HTTP/1.1" 200 None 2026-04-16 04:52:18,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:52:18,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd170117c944d2f17d8b31 HTTP/1.1" 200 None 2026-04-16 04:52:18,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:52:18,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc7f1c2164e674d722447 HTTP/1.1" 200 None 2026-04-16 04:52:18,828 - lava_callback - ERROR - Error processing callback for node 69ddc7f1c2164e674d722447: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37394 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:52:58,809 - lava_callback - INFO - Received callback for node 69ddc815c2164e674d72245c INFO: 172.21.0.1:37406 - "POST /node/69ddc815c2164e674d72245c HTTP/1.0" 202 Accepted 2026-04-16 04:52:58,814 - lava_callback - INFO - Starting async job submit for node 69ddc815c2164e674d72245c 2026-04-16 04:52:58,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:52:58,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc815c2164e674d72245c HTTP/1.1" 200 None 2026-04-16 04:52:58,830 - lava_callback - DEBUG - Processing node 69ddc815c2164e674d72245c: baseline-arm-clabbe 2026-04-16 04:52:58,831 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc815c2164e674d72245c 2026-04-16 04:52:58,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:52:58,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc815c2164e674d72245c HTTP/1.1" 200 None 2026-04-16 04:52:58,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:52:58,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 04:52:58,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:52:58,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc815c2164e674d72245c HTTP/1.1" 200 None 2026-04-16 04:52:58,881 - lava_callback - ERROR - Error processing callback for node 69ddc815c2164e674d72245c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60698 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:53:18,822 - lava_callback - INFO - Received callback for node 69ddc837c2164e674d722494 INFO: 172.21.0.1:60712 - "POST /node/69ddc837c2164e674d722494 HTTP/1.0" 202 Accepted 2026-04-16 04:53:18,828 - lava_callback - INFO - Starting async job submit for node 69ddc837c2164e674d722494 2026-04-16 04:53:18,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:53:18,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc837c2164e674d722494 HTTP/1.1" 200 None 2026-04-16 04:53:18,844 - lava_callback - DEBUG - Processing node 69ddc837c2164e674d722494: baseline-arm-clabbe 2026-04-16 04:53:18,845 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc837c2164e674d722494 2026-04-16 04:53:18,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:53:18,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc837c2164e674d722494 HTTP/1.1" 200 None 2026-04-16 04:53:18,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:53:18,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 04:53:18,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:53:18,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc837c2164e674d722494 HTTP/1.1" 200 None 2026-04-16 04:53:18,895 - lava_callback - ERROR - Error processing callback for node 69ddc837c2164e674d722494: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36088 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:53:58,843 - lava_callback - INFO - Received callback for node 69ddc85ac2164e674d7224ad INFO: 172.21.0.1:36104 - "POST /node/69ddc85ac2164e674d7224ad HTTP/1.0" 202 Accepted 2026-04-16 04:53:58,849 - lava_callback - INFO - Starting async job submit for node 69ddc85ac2164e674d7224ad 2026-04-16 04:53:58,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:53:58,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc85ac2164e674d7224ad HTTP/1.1" 200 None 2026-04-16 04:53:58,865 - lava_callback - DEBUG - Processing node 69ddc85ac2164e674d7224ad: baseline-arm-clabbe 2026-04-16 04:53:58,865 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc85ac2164e674d7224ad 2026-04-16 04:53:58,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:53:58,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc85ac2164e674d7224ad HTTP/1.1" 200 None 2026-04-16 04:53:58,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:53:58,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd170117c944d2f17d8b31 HTTP/1.1" 200 None 2026-04-16 04:53:58,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:53:58,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc85ac2164e674d7224ad HTTP/1.1" 200 None 2026-04-16 04:53:58,918 - lava_callback - ERROR - Error processing callback for node 69ddc85ac2164e674d7224ad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48248 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:54:26,786 - lava_callback - INFO - Received callback for node 69ddc873c2164e674d7224e9 INFO: 172.21.0.1:48260 - "POST /node/69ddc873c2164e674d7224e9 HTTP/1.0" 202 Accepted 2026-04-16 04:54:26,791 - lava_callback - INFO - Starting async job submit for node 69ddc873c2164e674d7224e9 2026-04-16 04:54:26,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:54:26,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc873c2164e674d7224e9 HTTP/1.1" 200 None 2026-04-16 04:54:26,818 - lava_callback - DEBUG - Processing node 69ddc873c2164e674d7224e9: baseline-arm-baylibre 2026-04-16 04:54:26,818 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc873c2164e674d7224e9 2026-04-16 04:54:26,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:54:26,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc873c2164e674d7224e9 HTTP/1.1" 200 None 2026-04-16 04:54:26,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:54:26,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 04:54:26,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:54:26,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc873c2164e674d7224e9 HTTP/1.1" 200 None 2026-04-16 04:54:26,866 - lava_callback - ERROR - Error processing callback for node 69ddc873c2164e674d7224e9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46422 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:54:58,911 - lava_callback - INFO - Received callback for node 69ddc895c2164e674d72251b INFO: 172.21.0.1:46426 - "POST /node/69ddc895c2164e674d72251b HTTP/1.0" 202 Accepted 2026-04-16 04:54:58,917 - lava_callback - INFO - Starting async job submit for node 69ddc895c2164e674d72251b 2026-04-16 04:54:58,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:54:58,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc895c2164e674d72251b HTTP/1.1" 200 None 2026-04-16 04:54:58,934 - lava_callback - DEBUG - Processing node 69ddc895c2164e674d72251b: baseline-arm-clabbe 2026-04-16 04:54:58,935 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc895c2164e674d72251b 2026-04-16 04:54:58,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:54:58,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc895c2164e674d72251b HTTP/1.1" 200 None 2026-04-16 04:54:58,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:54:58,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 04:54:58,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:54:58,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc895c2164e674d72251b HTTP/1.1" 200 None 2026-04-16 04:54:58,986 - lava_callback - ERROR - Error processing callback for node 69ddc895c2164e674d72251b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59598 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59608 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:55:18,892 - lava_callback - INFO - Received callback for node 69ddc8b4c2164e674d72254b INFO: 172.21.0.1:59624 - "POST /node/69ddc8b4c2164e674d72254b HTTP/1.0" 202 Accepted 2026-04-16 04:55:18,897 - lava_callback - INFO - Starting async job submit for node 69ddc8b4c2164e674d72254b 2026-04-16 04:55:18,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:55:18,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc8b4c2164e674d72254b HTTP/1.1" 200 None 2026-04-16 04:55:18,913 - lava_callback - DEBUG - Processing node 69ddc8b4c2164e674d72254b: baseline-arm-clabbe 2026-04-16 04:55:18,914 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc8b4c2164e674d72254b 2026-04-16 04:55:18,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:55:18,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc8b4c2164e674d72254b HTTP/1.1" 200 None 2026-04-16 04:55:18,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:55:18,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 04:55:18,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:55:18,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc8b4c2164e674d72254b HTTP/1.1" 200 None 2026-04-16 04:55:18,965 - lava_callback - ERROR - Error processing callback for node 69ddc8b4c2164e674d72254b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35564 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:56:06,889 - lava_callback - INFO - Received callback for node 69ddc8d1c2164e674d722562 INFO: 172.21.0.1:35566 - "POST /node/69ddc8d1c2164e674d722562 HTTP/1.0" 202 Accepted 2026-04-16 04:56:06,895 - lava_callback - INFO - Starting async job submit for node 69ddc8d1c2164e674d722562 2026-04-16 04:56:06,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:56:06,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc8d1c2164e674d722562 HTTP/1.1" 200 None 2026-04-16 04:56:06,911 - lava_callback - DEBUG - Processing node 69ddc8d1c2164e674d722562: baseline-arm-baylibre 2026-04-16 04:56:06,911 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc8d1c2164e674d722562 2026-04-16 04:56:06,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:56:06,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc8d1c2164e674d722562 HTTP/1.1" 200 None 2026-04-16 04:56:06,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:56:06,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 04:56:06,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:56:06,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc8d1c2164e674d722562 HTTP/1.1" 200 None 2026-04-16 04:56:06,959 - lava_callback - ERROR - Error processing callback for node 69ddc8d1c2164e674d722562: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50206 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:56:26,829 - lava_callback - INFO - Received callback for node 69ddc8eec2164e674d7225a3 INFO: 172.21.0.1:50220 - "POST /node/69ddc8eec2164e674d7225a3 HTTP/1.0" 202 Accepted 2026-04-16 04:56:26,835 - lava_callback - INFO - Starting async job submit for node 69ddc8eec2164e674d7225a3 2026-04-16 04:56:26,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:56:26,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc8eec2164e674d7225a3 HTTP/1.1" 200 None 2026-04-16 04:56:26,851 - lava_callback - DEBUG - Processing node 69ddc8eec2164e674d7225a3: baseline-arm-baylibre 2026-04-16 04:56:26,852 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc8eec2164e674d7225a3 2026-04-16 04:56:26,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:56:26,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc8eec2164e674d7225a3 HTTP/1.1" 200 None 2026-04-16 04:56:26,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:56:26,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 04:56:26,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:56:26,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc8eec2164e674d7225a3 HTTP/1.1" 200 None 2026-04-16 04:56:26,912 - lava_callback - ERROR - Error processing callback for node 69ddc8eec2164e674d7225a3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56838 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:56:59,002 - lava_callback - INFO - Received callback for node 69ddc910c2164e674d7225c9 INFO: 172.21.0.1:56850 - "POST /node/69ddc910c2164e674d7225c9 HTTP/1.0" 202 Accepted 2026-04-16 04:56:59,007 - lava_callback - INFO - Starting async job submit for node 69ddc910c2164e674d7225c9 2026-04-16 04:56:59,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:56:59,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc910c2164e674d7225c9 HTTP/1.1" 200 None 2026-04-16 04:56:59,023 - lava_callback - DEBUG - Processing node 69ddc910c2164e674d7225c9: baseline-arm-clabbe 2026-04-16 04:56:59,023 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc910c2164e674d7225c9 2026-04-16 04:56:59,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:56:59,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc910c2164e674d7225c9 HTTP/1.1" 200 None 2026-04-16 04:56:59,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:56:59,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 04:56:59,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:56:59,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc910c2164e674d7225c9 HTTP/1.1" 200 None 2026-04-16 04:56:59,104 - lava_callback - ERROR - Error processing callback for node 69ddc910c2164e674d7225c9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34068 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:57:26,900 - lava_callback - INFO - Received callback for node 69ddc92cc2164e674d7225fb INFO: 172.21.0.1:34080 - "POST /node/69ddc92cc2164e674d7225fb HTTP/1.0" 202 Accepted 2026-04-16 04:57:26,905 - lava_callback - INFO - Starting async job submit for node 69ddc92cc2164e674d7225fb 2026-04-16 04:57:26,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:57:26,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc92cc2164e674d7225fb HTTP/1.1" 200 None 2026-04-16 04:57:26,921 - lava_callback - DEBUG - Processing node 69ddc92cc2164e674d7225fb: baseline-arm-baylibre 2026-04-16 04:57:26,921 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc92cc2164e674d7225fb 2026-04-16 04:57:26,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:57:26,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc92cc2164e674d7225fb HTTP/1.1" 200 None 2026-04-16 04:57:26,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:57:26,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 04:57:26,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:57:26,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc92cc2164e674d7225fb HTTP/1.1" 200 None 2026-04-16 04:57:26,968 - lava_callback - ERROR - Error processing callback for node 69ddc92cc2164e674d7225fb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36528 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:58:06,878 - lava_callback - INFO - Received callback for node 69ddc94fc2164e674d72260e INFO: 172.21.0.1:36530 - "POST /node/69ddc94fc2164e674d72260e HTTP/1.0" 202 Accepted 2026-04-16 04:58:06,884 - lava_callback - INFO - Starting async job submit for node 69ddc94fc2164e674d72260e 2026-04-16 04:58:06,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:58:06,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc94fc2164e674d72260e HTTP/1.1" 200 None 2026-04-16 04:58:06,900 - lava_callback - DEBUG - Processing node 69ddc94fc2164e674d72260e: baseline-arm-baylibre 2026-04-16 04:58:06,901 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc94fc2164e674d72260e 2026-04-16 04:58:06,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:58:06,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc94fc2164e674d72260e HTTP/1.1" 200 None 2026-04-16 04:58:06,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:58:06,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 04:58:06,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:58:06,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc94fc2164e674d72260e HTTP/1.1" 200 None 2026-04-16 04:58:06,952 - lava_callback - ERROR - Error processing callback for node 69ddc94fc2164e674d72260e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44364 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:58:39,065 - lava_callback - INFO - Received callback for node 69ddc970c2164e674d72262e INFO: 172.21.0.1:44366 - "POST /node/69ddc970c2164e674d72262e HTTP/1.0" 202 Accepted 2026-04-16 04:58:39,071 - lava_callback - INFO - Starting async job submit for node 69ddc970c2164e674d72262e 2026-04-16 04:58:39,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:58:39,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc970c2164e674d72262e HTTP/1.1" 200 None 2026-04-16 04:58:39,087 - lava_callback - DEBUG - Processing node 69ddc970c2164e674d72262e: baseline-arm-clabbe 2026-04-16 04:58:39,087 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc970c2164e674d72262e 2026-04-16 04:58:39,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:58:39,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc970c2164e674d72262e HTTP/1.1" 200 None 2026-04-16 04:58:39,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:58:39,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 04:58:39,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:58:39,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc970c2164e674d72262e HTTP/1.1" 200 None 2026-04-16 04:58:39,139 - lava_callback - ERROR - Error processing callback for node 69ddc970c2164e674d72262e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48006 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:59:19,062 - lava_callback - INFO - Received callback for node 69ddc999c2164e674d722675 INFO: 172.21.0.1:48012 - "POST /node/69ddc999c2164e674d722675 HTTP/1.0" 202 Accepted 2026-04-16 04:59:19,067 - lava_callback - INFO - Starting async job submit for node 69ddc999c2164e674d722675 2026-04-16 04:59:19,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:59:19,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc999c2164e674d722675 HTTP/1.1" 200 None 2026-04-16 04:59:19,083 - lava_callback - DEBUG - Processing node 69ddc999c2164e674d722675: baseline-arm-clabbe 2026-04-16 04:59:19,084 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc999c2164e674d722675 2026-04-16 04:59:19,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:59:19,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc999c2164e674d722675 HTTP/1.1" 200 None 2026-04-16 04:59:19,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:59:19,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 04:59:19,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:59:19,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc999c2164e674d722675 HTTP/1.1" 200 None 2026-04-16 04:59:19,132 - lava_callback - ERROR - Error processing callback for node 69ddc999c2164e674d722675: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53904 - "GET / HTTP/1.0" 200 OK 2026-04-16 04:59:59,164 - lava_callback - INFO - Received callback for node 69ddc9bac2164e674d72268b INFO: 172.21.0.1:53906 - "POST /node/69ddc9bac2164e674d72268b HTTP/1.0" 202 Accepted 2026-04-16 04:59:59,170 - lava_callback - INFO - Starting async job submit for node 69ddc9bac2164e674d72268b 2026-04-16 04:59:59,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:59:59,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc9bac2164e674d72268b HTTP/1.1" 200 None 2026-04-16 04:59:59,186 - lava_callback - DEBUG - Processing node 69ddc9bac2164e674d72268b: baseline-arm-clabbe 2026-04-16 04:59:59,187 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc9bac2164e674d72268b 2026-04-16 04:59:59,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:59:59,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc9bac2164e674d72268b HTTP/1.1" 200 None 2026-04-16 04:59:59,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:59:59,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 04:59:59,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 04:59:59,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc9bac2164e674d72268b HTTP/1.1" 200 None 2026-04-16 04:59:59,271 - lava_callback - ERROR - Error processing callback for node 69ddc9bac2164e674d72268b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37312 - "GET / HTTP/1.0" 200 OK 2026-04-16 05:00:19,165 - lava_callback - INFO - Received callback for node 69ddc9d9c2164e674d7226af INFO: 172.21.0.1:37326 - "POST /node/69ddc9d9c2164e674d7226af HTTP/1.0" 202 Accepted 2026-04-16 05:00:19,171 - lava_callback - INFO - Starting async job submit for node 69ddc9d9c2164e674d7226af 2026-04-16 05:00:19,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:00:19,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc9d9c2164e674d7226af HTTP/1.1" 200 None 2026-04-16 05:00:19,187 - lava_callback - DEBUG - Processing node 69ddc9d9c2164e674d7226af: baseline-arm-clabbe 2026-04-16 05:00:19,188 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddc9d9c2164e674d7226af 2026-04-16 05:00:19,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:00:19,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddc9d9c2164e674d7226af HTTP/1.1" 200 None 2026-04-16 05:00:19,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:00:19,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 05:00:19,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:00:19,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddc9d9c2164e674d7226af HTTP/1.1" 200 None 2026-04-16 05:00:19,240 - lava_callback - ERROR - Error processing callback for node 69ddc9d9c2164e674d7226af: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57808 - "GET / HTTP/1.0" 200 OK 2026-04-16 05:01:19,164 - lava_callback - INFO - Received callback for node 69ddca19c2164e674d72272b INFO: 172.21.0.1:57820 - "POST /node/69ddca19c2164e674d72272b HTTP/1.0" 202 Accepted 2026-04-16 05:01:19,169 - lava_callback - INFO - Starting async job submit for node 69ddca19c2164e674d72272b 2026-04-16 05:01:19,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:01:19,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddca19c2164e674d72272b HTTP/1.1" 200 None 2026-04-16 05:01:19,823 - lava_callback - DEBUG - Processing node 69ddca19c2164e674d72272b: baseline-arm-clabbe 2026-04-16 05:01:19,823 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddca19c2164e674d72272b 2026-04-16 05:01:19,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:01:19,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddca19c2164e674d72272b HTTP/1.1" 200 None 2026-04-16 05:01:19,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:01:19,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 05:01:19,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:01:19,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddca19c2164e674d72272b HTTP/1.1" 200 None 2026-04-16 05:01:19,978 - lava_callback - ERROR - Error processing callback for node 69ddca19c2164e674d72272b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50434 - "GET / HTTP/1.0" 200 OK 2026-04-16 05:01:59,172 - lava_callback - INFO - Received callback for node 69ddca38c2164e674d722750 INFO: 172.21.0.1:50436 - "POST /node/69ddca38c2164e674d722750 HTTP/1.0" 202 Accepted 2026-04-16 05:01:59,177 - lava_callback - INFO - Starting async job submit for node 69ddca38c2164e674d722750 2026-04-16 05:01:59,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:01:59,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddca38c2164e674d722750 HTTP/1.1" 200 None 2026-04-16 05:01:59,194 - lava_callback - DEBUG - Processing node 69ddca38c2164e674d722750: baseline-arm-clabbe 2026-04-16 05:01:59,194 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddca38c2164e674d722750 2026-04-16 05:01:59,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:01:59,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddca38c2164e674d722750 HTTP/1.1" 200 None 2026-04-16 05:01:59,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:01:59,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 05:01:59,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:01:59,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddca38c2164e674d722750 HTTP/1.1" 200 None 2026-04-16 05:01:59,249 - lava_callback - ERROR - Error processing callback for node 69ddca38c2164e674d722750: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53814 - "GET / HTTP/1.0" 200 OK 2026-04-16 05:02:19,215 - lava_callback - INFO - Received callback for node 69ddca57c2164e674d722786 INFO: 172.21.0.1:53830 - "POST /node/69ddca57c2164e674d722786 HTTP/1.0" 202 Accepted 2026-04-16 05:02:19,221 - lava_callback - INFO - Starting async job submit for node 69ddca57c2164e674d722786 2026-04-16 05:02:19,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:02:19,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddca57c2164e674d722786 HTTP/1.1" 200 None 2026-04-16 05:02:19,237 - lava_callback - DEBUG - Processing node 69ddca57c2164e674d722786: baseline-arm-clabbe 2026-04-16 05:02:19,237 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddca57c2164e674d722786 2026-04-16 05:02:19,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:02:19,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddca57c2164e674d722786 HTTP/1.1" 200 None 2026-04-16 05:02:19,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:02:19,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 05:02:19,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:02:19,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddca57c2164e674d722786 HTTP/1.1" 200 None 2026-04-16 05:02:19,310 - lava_callback - ERROR - Error processing callback for node 69ddca57c2164e674d722786: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59128 - "GET / HTTP/1.0" 200 OK 2026-04-16 05:02:47,246 - lava_callback - INFO - Received callback for node 69ddca6dc2164e674d7227bc INFO: 172.21.0.1:59138 - "POST /node/69ddca6dc2164e674d7227bc HTTP/1.0" 202 Accepted 2026-04-16 05:02:47,251 - lava_callback - INFO - Starting async job submit for node 69ddca6dc2164e674d7227bc 2026-04-16 05:02:47,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:02:47,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddca6dc2164e674d7227bc HTTP/1.1" 200 None 2026-04-16 05:02:47,267 - lava_callback - DEBUG - Processing node 69ddca6dc2164e674d7227bc: baseline-arm-baylibre 2026-04-16 05:02:47,267 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddca6dc2164e674d7227bc 2026-04-16 05:02:47,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:02:47,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddca6dc2164e674d7227bc HTTP/1.1" 200 None 2026-04-16 05:02:47,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:02:47,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 05:02:47,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:02:47,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddca6dc2164e674d7227bc HTTP/1.1" 200 None 2026-04-16 05:02:47,317 - lava_callback - ERROR - Error processing callback for node 69ddca6dc2164e674d7227bc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52850 - "GET / HTTP/1.0" 200 OK 2026-04-16 05:03:27,203 - lava_callback - INFO - Received callback for node 69ddca8ac2164e674d7227ce INFO: 172.21.0.1:52856 - "POST /node/69ddca8ac2164e674d7227ce HTTP/1.0" 202 Accepted 2026-04-16 05:03:27,208 - lava_callback - INFO - Starting async job submit for node 69ddca8ac2164e674d7227ce 2026-04-16 05:03:27,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:03:27,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddca8ac2164e674d7227ce HTTP/1.1" 200 None 2026-04-16 05:03:27,228 - lava_callback - DEBUG - Processing node 69ddca8ac2164e674d7227ce: baseline-arm-baylibre 2026-04-16 05:03:27,228 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddca8ac2164e674d7227ce 2026-04-16 05:03:27,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:03:27,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddca8ac2164e674d7227ce HTTP/1.1" 200 None 2026-04-16 05:03:27,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:03:27,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 05:03:27,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:03:27,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddca8ac2164e674d7227ce HTTP/1.1" 200 None 2026-04-16 05:03:27,274 - lava_callback - ERROR - Error processing callback for node 69ddca8ac2164e674d7227ce: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40892 - "GET / HTTP/1.0" 200 OK 2026-04-16 05:03:59,306 - lava_callback - INFO - Received callback for node 69ddcaaec2164e674d72282b INFO: 172.21.0.1:40896 - "POST /node/69ddcaaec2164e674d72282b HTTP/1.0" 202 Accepted 2026-04-16 05:03:59,311 - lava_callback - INFO - Starting async job submit for node 69ddcaaec2164e674d72282b 2026-04-16 05:03:59,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:03:59,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddcaaec2164e674d72282b HTTP/1.1" 200 None 2026-04-16 05:03:59,328 - lava_callback - DEBUG - Processing node 69ddcaaec2164e674d72282b: baseline-arm-clabbe 2026-04-16 05:03:59,328 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddcaaec2164e674d72282b 2026-04-16 05:03:59,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:03:59,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddcaaec2164e674d72282b HTTP/1.1" 200 None 2026-04-16 05:03:59,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:03:59,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 05:03:59,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:03:59,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddcaaec2164e674d72282b HTTP/1.1" 200 None 2026-04-16 05:03:59,376 - lava_callback - ERROR - Error processing callback for node 69ddcaaec2164e674d72282b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59856 - "GET / HTTP/1.0" 200 OK 2026-04-16 05:04:19,262 - lava_callback - INFO - Received callback for node 69ddcacfc2164e674d722852 INFO: 172.21.0.1:59870 - "POST /node/69ddcacfc2164e674d722852 HTTP/1.0" 202 Accepted 2026-04-16 05:04:19,268 - lava_callback - INFO - Starting async job submit for node 69ddcacfc2164e674d722852 2026-04-16 05:04:19,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:04:19,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddcacfc2164e674d722852 HTTP/1.1" 200 None 2026-04-16 05:04:19,289 - lava_callback - DEBUG - Processing node 69ddcacfc2164e674d722852: baseline-arm-clabbe 2026-04-16 05:04:19,289 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddcacfc2164e674d722852 2026-04-16 05:04:19,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:04:19,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddcacfc2164e674d722852 HTTP/1.1" 200 None 2026-04-16 05:04:19,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:04:19,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 05:04:19,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:04:19,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddcacfc2164e674d722852 HTTP/1.1" 200 None 2026-04-16 05:04:19,344 - lava_callback - ERROR - Error processing callback for node 69ddcacfc2164e674d722852: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59476 - "GET / HTTP/1.0" 200 OK 2026-04-16 05:05:27,370 - lava_callback - INFO - Received callback for node 69ddcb06c2164e674d7228ab INFO: 172.21.0.1:59484 - "POST /node/69ddcb06c2164e674d7228ab HTTP/1.0" 202 Accepted 2026-04-16 05:05:27,375 - lava_callback - INFO - Starting async job submit for node 69ddcb06c2164e674d7228ab 2026-04-16 05:05:27,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:05:27,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddcb06c2164e674d7228ab HTTP/1.1" 200 None 2026-04-16 05:05:27,407 - lava_callback - DEBUG - Processing node 69ddcb06c2164e674d7228ab: baseline-arm-baylibre 2026-04-16 05:05:27,407 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddcb06c2164e674d7228ab 2026-04-16 05:05:27,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:05:27,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddcb06c2164e674d7228ab HTTP/1.1" 200 None 2026-04-16 05:05:27,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:05:27,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 05:05:27,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:05:27,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddcb06c2164e674d7228ab HTTP/1.1" 200 None 2026-04-16 05:05:27,499 - lava_callback - ERROR - Error processing callback for node 69ddcb06c2164e674d7228ab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38026 - "GET / HTTP/1.0" 200 OK 2026-04-16 05:05:59,354 - lava_callback - INFO - Received callback for node 69ddcb2bc2164e674d7228d7 INFO: 172.21.0.1:38036 - "POST /node/69ddcb2bc2164e674d7228d7 HTTP/1.0" 202 Accepted 2026-04-16 05:05:59,360 - lava_callback - INFO - Starting async job submit for node 69ddcb2bc2164e674d7228d7 2026-04-16 05:05:59,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:05:59,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddcb2bc2164e674d7228d7 HTTP/1.1" 200 None 2026-04-16 05:05:59,376 - lava_callback - DEBUG - Processing node 69ddcb2bc2164e674d7228d7: baseline-arm-clabbe 2026-04-16 05:05:59,377 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddcb2bc2164e674d7228d7 2026-04-16 05:05:59,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:05:59,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddcb2bc2164e674d7228d7 HTTP/1.1" 200 None 2026-04-16 05:05:59,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:05:59,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 05:05:59,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:05:59,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddcb2bc2164e674d7228d7 HTTP/1.1" 200 None 2026-04-16 05:05:59,425 - lava_callback - ERROR - Error processing callback for node 69ddcb2bc2164e674d7228d7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49600 - "GET / HTTP/1.0" 200 OK 2026-04-16 05:06:39,358 - lava_callback - INFO - Received callback for node 69ddcb4cc2164e674d722904 INFO: 172.21.0.1:49602 - "POST /node/69ddcb4cc2164e674d722904 HTTP/1.0" 202 Accepted 2026-04-16 05:06:39,364 - lava_callback - INFO - Starting async job submit for node 69ddcb4cc2164e674d722904 2026-04-16 05:06:39,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:06:39,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddcb4cc2164e674d722904 HTTP/1.1" 200 None 2026-04-16 05:06:39,380 - lava_callback - DEBUG - Processing node 69ddcb4cc2164e674d722904: baseline-arm-clabbe 2026-04-16 05:06:39,380 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddcb4cc2164e674d722904 2026-04-16 05:06:39,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:06:39,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddcb4cc2164e674d722904 HTTP/1.1" 200 None 2026-04-16 05:06:39,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:06:39,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 05:06:39,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:06:39,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddcb4cc2164e674d722904 HTTP/1.1" 200 None 2026-04-16 05:06:39,430 - lava_callback - ERROR - Error processing callback for node 69ddcb4cc2164e674d722904: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54080 - "GET / HTTP/1.0" 200 OK 2026-04-16 05:06:59,466 - lava_callback - INFO - Received callback for node 69ddcb6cc2164e674d722925 INFO: 172.21.0.1:54096 - "POST /node/69ddcb6cc2164e674d722925 HTTP/1.0" 202 Accepted 2026-04-16 05:06:59,472 - lava_callback - INFO - Starting async job submit for node 69ddcb6cc2164e674d722925 2026-04-16 05:06:59,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:06:59,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddcb6cc2164e674d722925 HTTP/1.1" 200 None 2026-04-16 05:06:59,495 - lava_callback - DEBUG - Processing node 69ddcb6cc2164e674d722925: baseline-arm-clabbe 2026-04-16 05:06:59,496 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddcb6cc2164e674d722925 2026-04-16 05:06:59,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:06:59,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddcb6cc2164e674d722925 HTTP/1.1" 200 None 2026-04-16 05:06:59,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:06:59,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 05:06:59,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:06:59,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddcb6cc2164e674d722925 HTTP/1.1" 200 None 2026-04-16 05:06:59,545 - lava_callback - ERROR - Error processing callback for node 69ddcb6cc2164e674d722925: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50338 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49774 - "GET / HTTP/1.0" 200 OK 2026-04-16 05:07:39,390 - lava_callback - INFO - Received callback for node 69ddcb89c2164e674d72295e INFO: 172.21.0.1:49782 - "POST /node/69ddcb89c2164e674d72295e HTTP/1.0" 202 Accepted 2026-04-16 05:07:39,396 - lava_callback - INFO - Starting async job submit for node 69ddcb89c2164e674d72295e 2026-04-16 05:07:39,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:07:39,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddcb89c2164e674d72295e HTTP/1.1" 200 None 2026-04-16 05:07:39,426 - lava_callback - DEBUG - Processing node 69ddcb89c2164e674d72295e: baseline-arm-clabbe 2026-04-16 05:07:39,426 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddcb89c2164e674d72295e 2026-04-16 05:07:39,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:07:39,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddcb89c2164e674d72295e HTTP/1.1" 200 None 2026-04-16 05:07:39,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:07:39,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 05:07:39,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:07:39,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddcb89c2164e674d72295e HTTP/1.1" 200 None 2026-04-16 05:07:39,558 - lava_callback - ERROR - Error processing callback for node 69ddcb89c2164e674d72295e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49298 - "GET / HTTP/1.0" 200 OK 2026-04-16 05:07:59,469 - lava_callback - INFO - Received callback for node 69ddcbacc2164e674d722981 INFO: 172.21.0.1:49308 - "POST /node/69ddcbacc2164e674d722981 HTTP/1.0" 202 Accepted 2026-04-16 05:07:59,475 - lava_callback - INFO - Starting async job submit for node 69ddcbacc2164e674d722981 2026-04-16 05:07:59,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:07:59,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddcbacc2164e674d722981 HTTP/1.1" 200 None 2026-04-16 05:07:59,495 - lava_callback - DEBUG - Processing node 69ddcbacc2164e674d722981: baseline-arm-clabbe 2026-04-16 05:07:59,495 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddcbacc2164e674d722981 2026-04-16 05:07:59,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:07:59,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddcbacc2164e674d722981 HTTP/1.1" 200 None 2026-04-16 05:07:59,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:07:59,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 05:07:59,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:07:59,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddcbacc2164e674d722981 HTTP/1.1" 200 None 2026-04-16 05:07:59,561 - lava_callback - ERROR - Error processing callback for node 69ddcbacc2164e674d722981: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60878 - "GET / HTTP/1.0" 200 OK 2026-04-16 05:08:39,455 - lava_callback - INFO - Received callback for node 69ddcbd4c2164e674d72299b INFO: 172.21.0.1:60882 - "POST /node/69ddcbd4c2164e674d72299b HTTP/1.0" 202 Accepted 2026-04-16 05:08:39,460 - lava_callback - INFO - Starting async job submit for node 69ddcbd4c2164e674d72299b 2026-04-16 05:08:39,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:08:39,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddcbd4c2164e674d72299b HTTP/1.1" 200 None 2026-04-16 05:08:39,481 - lava_callback - DEBUG - Processing node 69ddcbd4c2164e674d72299b: baseline-arm-clabbe 2026-04-16 05:08:39,481 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddcbd4c2164e674d72299b 2026-04-16 05:08:39,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:08:39,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddcbd4c2164e674d72299b HTTP/1.1" 200 None 2026-04-16 05:08:39,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:08:39,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 05:08:39,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:08:39,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddcbd4c2164e674d72299b HTTP/1.1" 200 None 2026-04-16 05:08:39,531 - lava_callback - ERROR - Error processing callback for node 69ddcbd4c2164e674d72299b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35204 - "GET / HTTP/1.0" 200 OK 2026-04-16 05:09:19,523 - lava_callback - INFO - Received callback for node 69ddcbf1c2164e674d7229e6 INFO: 172.21.0.1:35210 - "POST /node/69ddcbf1c2164e674d7229e6 HTTP/1.0" 202 Accepted 2026-04-16 05:09:19,533 - lava_callback - INFO - Starting async job submit for node 69ddcbf1c2164e674d7229e6 2026-04-16 05:09:19,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:09:19,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddcbf1c2164e674d7229e6 HTTP/1.1" 200 None 2026-04-16 05:09:19,600 - lava_callback - DEBUG - Processing node 69ddcbf1c2164e674d7229e6: baseline-arm-clabbe 2026-04-16 05:09:19,600 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddcbf1c2164e674d7229e6 2026-04-16 05:09:19,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:09:19,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddcbf1c2164e674d7229e6 HTTP/1.1" 200 None 2026-04-16 05:09:19,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:09:19,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 05:09:19,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:09:19,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddcbf1c2164e674d7229e6 HTTP/1.1" 200 None 2026-04-16 05:09:19,664 - lava_callback - ERROR - Error processing callback for node 69ddcbf1c2164e674d7229e6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34058 - "GET / HTTP/1.0" 200 OK 2026-04-16 05:09:59,519 - lava_callback - INFO - Received callback for node 69ddcc14c2164e674d7229f6 INFO: 172.21.0.1:34060 - "POST /node/69ddcc14c2164e674d7229f6 HTTP/1.0" 202 Accepted 2026-04-16 05:09:59,524 - lava_callback - INFO - Starting async job submit for node 69ddcc14c2164e674d7229f6 2026-04-16 05:09:59,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:09:59,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddcc14c2164e674d7229f6 HTTP/1.1" 200 None 2026-04-16 05:09:59,550 - lava_callback - DEBUG - Processing node 69ddcc14c2164e674d7229f6: baseline-arm-clabbe 2026-04-16 05:09:59,550 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddcc14c2164e674d7229f6 2026-04-16 05:09:59,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:09:59,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddcc14c2164e674d7229f6 HTTP/1.1" 200 None 2026-04-16 05:09:59,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:09:59,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 05:09:59,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:09:59,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddcc14c2164e674d7229f6 HTTP/1.1" 200 None 2026-04-16 05:09:59,600 - lava_callback - ERROR - Error processing callback for node 69ddcc14c2164e674d7229f6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32816 - "GET / HTTP/1.0" 200 OK 2026-04-16 05:10:19,502 - lava_callback - INFO - Received callback for node 69ddcc36c2164e674d722a29 INFO: 172.21.0.1:32828 - "POST /node/69ddcc36c2164e674d722a29 HTTP/1.0" 202 Accepted 2026-04-16 05:10:19,508 - lava_callback - INFO - Starting async job submit for node 69ddcc36c2164e674d722a29 2026-04-16 05:10:19,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:10:19,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddcc36c2164e674d722a29 HTTP/1.1" 200 None 2026-04-16 05:10:19,524 - lava_callback - DEBUG - Processing node 69ddcc36c2164e674d722a29: baseline-arm-clabbe 2026-04-16 05:10:19,524 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddcc36c2164e674d722a29 2026-04-16 05:10:19,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:10:19,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddcc36c2164e674d722a29 HTTP/1.1" 200 None 2026-04-16 05:10:19,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:10:19,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 05:10:19,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:10:19,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddcc36c2164e674d722a29 HTTP/1.1" 200 None 2026-04-16 05:10:19,588 - lava_callback - ERROR - Error processing callback for node 69ddcc36c2164e674d722a29: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58500 - "GET / HTTP/1.0" 200 OK 2026-04-16 05:10:59,573 - lava_callback - INFO - Received callback for node 69ddcc5bc2164e674d722a3b INFO: 172.21.0.1:58512 - "POST /node/69ddcc5bc2164e674d722a3b HTTP/1.0" 202 Accepted 2026-04-16 05:10:59,579 - lava_callback - INFO - Starting async job submit for node 69ddcc5bc2164e674d722a3b 2026-04-16 05:10:59,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:10:59,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddcc5bc2164e674d722a3b HTTP/1.1" 200 None 2026-04-16 05:10:59,595 - lava_callback - DEBUG - Processing node 69ddcc5bc2164e674d722a3b: baseline-arm-clabbe 2026-04-16 05:10:59,595 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddcc5bc2164e674d722a3b 2026-04-16 05:10:59,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:10:59,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddcc5bc2164e674d722a3b HTTP/1.1" 200 None 2026-04-16 05:10:59,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:10:59,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 05:10:59,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:10:59,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddcc5bc2164e674d722a3b HTTP/1.1" 200 None 2026-04-16 05:10:59,672 - lava_callback - ERROR - Error processing callback for node 69ddcc5bc2164e674d722a3b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36736 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34794 - "GET / HTTP/1.0" 200 OK 2026-04-16 05:11:39,614 - lava_callback - INFO - Received callback for node 69ddcc7cc2164e674d722a65 INFO: 172.21.0.1:34804 - "POST /node/69ddcc7cc2164e674d722a65 HTTP/1.0" 202 Accepted 2026-04-16 05:11:39,620 - lava_callback - INFO - Starting async job submit for node 69ddcc7cc2164e674d722a65 2026-04-16 05:11:39,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:11:39,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddcc7cc2164e674d722a65 HTTP/1.1" 200 None 2026-04-16 05:11:39,636 - lava_callback - DEBUG - Processing node 69ddcc7cc2164e674d722a65: baseline-arm-clabbe 2026-04-16 05:11:39,636 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddcc7cc2164e674d722a65 2026-04-16 05:11:39,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:11:39,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddcc7cc2164e674d722a65 HTTP/1.1" 200 None 2026-04-16 05:11:39,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:11:39,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 05:11:39,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:11:39,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddcc7cc2164e674d722a65 HTTP/1.1" 200 None 2026-04-16 05:11:39,697 - lava_callback - ERROR - Error processing callback for node 69ddcc7cc2164e674d722a65: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34810 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34820 - "GET / HTTP/1.0" 200 OK 2026-04-16 05:12:19,637 - lava_callback - INFO - Received callback for node 69ddcc9fc2164e674d722a7c INFO: 172.21.0.1:34824 - "POST /node/69ddcc9fc2164e674d722a7c HTTP/1.0" 202 Accepted 2026-04-16 05:12:19,642 - lava_callback - INFO - Starting async job submit for node 69ddcc9fc2164e674d722a7c 2026-04-16 05:12:19,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:12:19,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddcc9fc2164e674d722a7c HTTP/1.1" 200 None 2026-04-16 05:12:19,685 - lava_callback - DEBUG - Processing node 69ddcc9fc2164e674d722a7c: baseline-arm-clabbe 2026-04-16 05:12:19,686 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddcc9fc2164e674d722a7c 2026-04-16 05:12:19,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:12:19,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddcc9fc2164e674d722a7c HTTP/1.1" 200 None 2026-04-16 05:12:19,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:12:19,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da73fe81dd6b543e75e283 HTTP/1.1" 200 None 2026-04-16 05:12:19,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:12:19,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddcc9fc2164e674d722a7c HTTP/1.1" 200 None 2026-04-16 05:12:19,801 - lava_callback - ERROR - Error processing callback for node 69ddcc9fc2164e674d722a7c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50416 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45642 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54708 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49244 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46192 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53496 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38968 - "GET / HTTP/1.0" 200 OK 2026-04-16 05:46:29,661 - lava_callback - INFO - Received callback for node 69ddd4a6c2164e674d722b37 INFO: 172.21.0.1:38984 - "POST /node/69ddd4a6c2164e674d722b37 HTTP/1.0" 202 Accepted 2026-04-16 05:46:29,667 - lava_callback - INFO - Starting async job submit for node 69ddd4a6c2164e674d722b37 2026-04-16 05:46:29,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:46:29,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd4a6c2164e674d722b37 HTTP/1.1" 200 None 2026-04-16 05:46:29,683 - lava_callback - DEBUG - Processing node 69ddd4a6c2164e674d722b37: baseline-arm64-baylibre 2026-04-16 05:46:29,684 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddd4a6c2164e674d722b37 2026-04-16 05:46:29,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:46:29,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd4a6c2164e674d722b37 HTTP/1.1" 200 None 2026-04-16 05:46:29,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:46:29,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-16 05:46:29,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:46:29,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddd4a6c2164e674d722b37 HTTP/1.1" 200 None 2026-04-16 05:46:29,751 - lava_callback - ERROR - Error processing callback for node 69ddd4a6c2164e674d722b37: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48342 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37366 - "GET / HTTP/1.0" 200 OK 2026-04-16 05:48:29,640 - lava_callback - INFO - Received callback for node 69ddd51ec2164e674d722b7a INFO: 172.21.0.1:37376 - "POST /node/69ddd51ec2164e674d722b7a HTTP/1.0" 202 Accepted 2026-04-16 05:48:29,646 - lava_callback - INFO - Starting async job submit for node 69ddd51ec2164e674d722b7a 2026-04-16 05:48:29,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:48:29,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd51ec2164e674d722b7a HTTP/1.1" 200 None 2026-04-16 05:48:29,662 - lava_callback - DEBUG - Processing node 69ddd51ec2164e674d722b7a: baseline-arm64-baylibre 2026-04-16 05:48:29,663 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddd51ec2164e674d722b7a 2026-04-16 05:48:29,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:48:29,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd51ec2164e674d722b7a HTTP/1.1" 200 None 2026-04-16 05:48:29,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:48:29,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-16 05:48:29,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:48:29,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddd51ec2164e674d722b7a HTTP/1.1" 200 None 2026-04-16 05:48:29,731 - lava_callback - ERROR - Error processing callback for node 69ddd51ec2164e674d722b7a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51178 - "GET / HTTP/1.0" 200 OK 2026-04-16 05:50:29,749 - lava_callback - INFO - Received callback for node 69ddd596c2164e674d722bba INFO: 172.21.0.1:36268 - "POST /node/69ddd596c2164e674d722bba HTTP/1.0" 202 Accepted 2026-04-16 05:50:29,755 - lava_callback - INFO - Starting async job submit for node 69ddd596c2164e674d722bba 2026-04-16 05:50:29,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:50:29,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd596c2164e674d722bba HTTP/1.1" 200 None 2026-04-16 05:50:29,771 - lava_callback - DEBUG - Processing node 69ddd596c2164e674d722bba: baseline-arm64-baylibre 2026-04-16 05:50:29,771 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddd596c2164e674d722bba 2026-04-16 05:50:29,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:50:29,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd596c2164e674d722bba HTTP/1.1" 200 None 2026-04-16 05:50:29,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:50:29,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-16 05:50:29,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:50:29,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddd596c2164e674d722bba HTTP/1.1" 200 None 2026-04-16 05:50:29,996 - lava_callback - ERROR - Error processing callback for node 69ddd596c2164e674d722bba: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50582 - "GET / HTTP/1.0" 200 OK 2026-04-16 05:51:50,071 - lava_callback - INFO - Received callback for node 69ddd5e6c2164e674d722beb INFO: 172.21.0.1:57810 - "POST /node/69ddd5e6c2164e674d722beb HTTP/1.0" 202 Accepted 2026-04-16 05:51:50,077 - lava_callback - INFO - Starting async job submit for node 69ddd5e6c2164e674d722beb 2026-04-16 05:51:50,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:51:50,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd5e6c2164e674d722beb HTTP/1.1" 200 None 2026-04-16 05:51:50,104 - lava_callback - DEBUG - Processing node 69ddd5e6c2164e674d722beb: baseline-arm64-baylibre 2026-04-16 05:51:50,105 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddd5e6c2164e674d722beb 2026-04-16 05:51:50,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:51:50,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd5e6c2164e674d722beb HTTP/1.1" 200 None 2026-04-16 05:51:50,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:51:50,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-16 05:51:50,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:51:50,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddd5e6c2164e674d722beb HTTP/1.1" 200 None 2026-04-16 05:51:50,156 - lava_callback - ERROR - Error processing callback for node 69ddd5e6c2164e674d722beb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49258 - "GET /node/69903c97985e4efca431e043%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:49268 - "GET /node/69401a6d575bc060ce1525f9%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:41872 - "GET / HTTP/1.0" 200 OK 2026-04-16 05:52:49,862 - lava_callback - INFO - Received callback for node 69ddd62ac2164e674d722c62 INFO: 172.21.0.1:42598 - "POST /node/69ddd62ac2164e674d722c62 HTTP/1.0" 202 Accepted 2026-04-16 05:52:49,868 - lava_callback - INFO - Starting async job submit for node 69ddd62ac2164e674d722c62 2026-04-16 05:52:49,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:52:49,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd62ac2164e674d722c62 HTTP/1.1" 200 None 2026-04-16 05:52:49,885 - lava_callback - DEBUG - Processing node 69ddd62ac2164e674d722c62: baseline-arm64-baylibre 2026-04-16 05:52:49,886 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddd62ac2164e674d722c62 2026-04-16 05:52:49,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:52:49,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd62ac2164e674d722c62 HTTP/1.1" 200 None 2026-04-16 05:52:49,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:52:49,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-16 05:52:49,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:52:49,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddd62ac2164e674d722c62 HTTP/1.1" 200 None 2026-04-16 05:52:49,939 - lava_callback - ERROR - Error processing callback for node 69ddd62ac2164e674d722c62: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42610 - "GET /node/693f9ea00d8ce4018da99712%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:42618 - "GET /node/6992fd7831166481c8dded81%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:55878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52370 - "GET / HTTP/1.0" 200 OK 2026-04-16 05:54:09,979 - lava_callback - INFO - Received callback for node 69ddd677c2164e674d722ca2 INFO: 172.21.0.1:48462 - "POST /node/69ddd677c2164e674d722ca2 HTTP/1.0" 202 Accepted 2026-04-16 05:54:09,986 - lava_callback - INFO - Starting async job submit for node 69ddd677c2164e674d722ca2 2026-04-16 05:54:09,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:54:10,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd677c2164e674d722ca2 HTTP/1.1" 200 None 2026-04-16 05:54:10,005 - lava_callback - DEBUG - Processing node 69ddd677c2164e674d722ca2: baseline-arm64-baylibre 2026-04-16 05:54:10,005 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddd677c2164e674d722ca2 2026-04-16 05:54:10,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:54:10,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd677c2164e674d722ca2 HTTP/1.1" 200 None 2026-04-16 05:54:10,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:54:10,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-16 05:54:10,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:54:10,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddd677c2164e674d722ca2 HTTP/1.1" 200 None 2026-04-16 05:54:10,064 - lava_callback - ERROR - Error processing callback for node 69ddd677c2164e674d722ca2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33008 - "GET /node/69938431cebe99dd8e06f870%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:35234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42150 - "GET /node/693f6eca0d8ce4018da92b81%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:42160 - "GET /node/698bd8091e517752bab8b567%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:38102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54170 - "GET / HTTP/1.0" 200 OK 2026-04-16 05:55:30,082 - lava_callback - INFO - Received callback for node 69ddd6c3c2164e674d722cf9 INFO: 172.21.0.1:36774 - "POST /node/69ddd6c3c2164e674d722cf9 HTTP/1.0" 202 Accepted 2026-04-16 05:55:30,088 - lava_callback - INFO - Starting async job submit for node 69ddd6c3c2164e674d722cf9 2026-04-16 05:55:30,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:55:30,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd6c3c2164e674d722cf9 HTTP/1.1" 200 None 2026-04-16 05:55:30,110 - lava_callback - DEBUG - Processing node 69ddd6c3c2164e674d722cf9: baseline-arm64-baylibre 2026-04-16 05:55:30,110 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddd6c3c2164e674d722cf9 2026-04-16 05:55:30,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:55:30,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd6c3c2164e674d722cf9 HTTP/1.1" 200 None 2026-04-16 05:55:30,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:55:30,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-16 05:55:30,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:55:30,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddd6c3c2164e674d722cf9 HTTP/1.1" 200 None 2026-04-16 05:55:30,157 - lava_callback - ERROR - Error processing callback for node 69ddd6c3c2164e674d722cf9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57676 - "GET / HTTP/1.0" 200 OK 2026-04-16 05:56:30,019 - lava_callback - INFO - Received callback for node 69ddd706c2164e674d722d5e INFO: 172.21.0.1:51756 - "POST /node/69ddd706c2164e674d722d5e HTTP/1.0" 202 Accepted 2026-04-16 05:56:30,028 - lava_callback - INFO - Starting async job submit for node 69ddd706c2164e674d722d5e 2026-04-16 05:56:30,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:56:30,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd706c2164e674d722d5e HTTP/1.1" 200 None 2026-04-16 05:56:30,047 - lava_callback - DEBUG - Processing node 69ddd706c2164e674d722d5e: baseline-arm64-baylibre 2026-04-16 05:56:30,048 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddd706c2164e674d722d5e 2026-04-16 05:56:30,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:56:30,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd706c2164e674d722d5e HTTP/1.1" 200 None 2026-04-16 05:56:30,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:56:30,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-16 05:56:30,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:56:30,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddd706c2164e674d722d5e HTTP/1.1" 200 None 2026-04-16 05:56:30,106 - lava_callback - ERROR - Error processing callback for node 69ddd706c2164e674d722d5e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33306 - "GET /node/69a46f72a327b98156690292%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:40190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42696 - "GET /node/6992d9f531166481c8dd422b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:42708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34868 - "GET / HTTP/1.0" 200 OK 2026-04-16 05:57:50,231 - lava_callback - INFO - Received callback for node 69ddd751c2164e674d722d94 INFO: 172.21.0.1:50964 - "POST /node/69ddd751c2164e674d722d94 HTTP/1.0" 202 Accepted 2026-04-16 05:57:50,236 - lava_callback - INFO - Starting async job submit for node 69ddd751c2164e674d722d94 2026-04-16 05:57:50,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:57:50,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd751c2164e674d722d94 HTTP/1.1" 200 None 2026-04-16 05:57:50,261 - lava_callback - DEBUG - Processing node 69ddd751c2164e674d722d94: baseline-arm64-baylibre 2026-04-16 05:57:50,262 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddd751c2164e674d722d94 2026-04-16 05:57:50,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:57:50,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd751c2164e674d722d94 HTTP/1.1" 200 None 2026-04-16 05:57:50,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:57:50,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-16 05:57:50,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:57:50,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddd751c2164e674d722d94 HTTP/1.1" 200 None 2026-04-16 05:57:50,316 - lava_callback - ERROR - Error processing callback for node 69ddd751c2164e674d722d94: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49392 - "GET / HTTP/1.0" 200 OK 2026-04-16 05:59:01,544 - lava_callback - INFO - Received callback for node 69ddd7a2c2164e674d722df0 INFO: 172.21.0.1:43272 - "POST /node/69ddd7a2c2164e674d722df0 HTTP/1.0" 202 Accepted 2026-04-16 05:59:01,550 - lava_callback - INFO - Starting async job submit for node 69ddd7a2c2164e674d722df0 2026-04-16 05:59:01,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:59:01,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd7a2c2164e674d722df0 HTTP/1.1" 200 None 2026-04-16 05:59:01,566 - lava_callback - DEBUG - Processing node 69ddd7a2c2164e674d722df0: baseline-arm64-clabbe 2026-04-16 05:59:01,567 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddd7a2c2164e674d722df0 2026-04-16 05:59:01,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:59:01,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd7a2c2164e674d722df0 HTTP/1.1" 200 None 2026-04-16 05:59:01,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:59:01,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-16 05:59:01,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 05:59:01,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddd7a2c2164e674d722df0 HTTP/1.1" 200 None 2026-04-16 05:59:01,615 - lava_callback - ERROR - Error processing callback for node 69ddd7a2c2164e674d722df0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35776 - "GET /node/69937335cebe99dd8e069dfb%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:35782 - "GET /node/693f3f2024745582e399f177%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-16 06:00:21,595 - lava_callback - INFO - Received callback for node 69ddd7f2c2164e674d722e42 INFO: 172.21.0.1:41214 - "POST /node/69ddd7f2c2164e674d722e42 HTTP/1.0" 202 Accepted 2026-04-16 06:00:21,601 - lava_callback - INFO - Starting async job submit for node 69ddd7f2c2164e674d722e42 2026-04-16 06:00:21,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:00:21,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd7f2c2164e674d722e42 HTTP/1.1" 200 None 2026-04-16 06:00:21,617 - lava_callback - DEBUG - Processing node 69ddd7f2c2164e674d722e42: baseline-arm64-clabbe 2026-04-16 06:00:21,617 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddd7f2c2164e674d722e42 2026-04-16 06:00:21,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:00:21,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd7f2c2164e674d722e42 HTTP/1.1" 200 None 2026-04-16 06:00:21,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:00:21,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-16 06:00:21,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:00:21,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddd7f2c2164e674d722e42 HTTP/1.1" 200 None 2026-04-16 06:00:21,675 - lava_callback - ERROR - Error processing callback for node 69ddd7f2c2164e674d722e42: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59122 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:01:41,638 - lava_callback - INFO - Received callback for node 69ddd83dc2164e674d722e8d INFO: 172.21.0.1:35454 - "POST /node/69ddd83dc2164e674d722e8d HTTP/1.0" 202 Accepted 2026-04-16 06:01:41,643 - lava_callback - INFO - Starting async job submit for node 69ddd83dc2164e674d722e8d 2026-04-16 06:01:41,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:01:41,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd83dc2164e674d722e8d HTTP/1.1" 200 None 2026-04-16 06:01:41,659 - lava_callback - DEBUG - Processing node 69ddd83dc2164e674d722e8d: baseline-arm64-clabbe 2026-04-16 06:01:41,659 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddd83dc2164e674d722e8d 2026-04-16 06:01:41,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:01:41,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd83dc2164e674d722e8d HTTP/1.1" 200 None 2026-04-16 06:01:41,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:01:41,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-16 06:01:41,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:01:41,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddd83dc2164e674d722e8d HTTP/1.1" 200 None 2026-04-16 06:01:41,706 - lava_callback - ERROR - Error processing callback for node 69ddd83dc2164e674d722e8d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35460 - "GET /node/69cf7f5f000c489abc2c01da%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:35466 - "GET /node/6983ed38969566dcb0d29a7f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:35474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48902 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:03:01,704 - lava_callback - INFO - Received callback for node 69ddd885c2164e674d722ee8 INFO: 172.21.0.1:42864 - "POST /node/69ddd885c2164e674d722ee8 HTTP/1.0" 202 Accepted 2026-04-16 06:03:01,710 - lava_callback - INFO - Starting async job submit for node 69ddd885c2164e674d722ee8 2026-04-16 06:03:01,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:03:01,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd885c2164e674d722ee8 HTTP/1.1" 200 None 2026-04-16 06:03:01,726 - lava_callback - DEBUG - Processing node 69ddd885c2164e674d722ee8: baseline-arm64-clabbe 2026-04-16 06:03:01,727 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddd885c2164e674d722ee8 2026-04-16 06:03:01,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:03:01,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd885c2164e674d722ee8 HTTP/1.1" 200 None 2026-04-16 06:03:01,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:03:01,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-16 06:03:01,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:03:01,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddd885c2164e674d722ee8 HTTP/1.1" 200 None 2026-04-16 06:03:01,773 - lava_callback - ERROR - Error processing callback for node 69ddd885c2164e674d722ee8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54960 - "GET /node/6988bbe39fc35f969e1eccf8%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:54972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45562 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:04:21,879 - lava_callback - INFO - Received callback for node 69ddd8d7c2164e674d722f28 INFO: 172.21.0.1:54276 - "POST /node/69ddd8d7c2164e674d722f28 HTTP/1.0" 202 Accepted 2026-04-16 06:04:21,885 - lava_callback - INFO - Starting async job submit for node 69ddd8d7c2164e674d722f28 2026-04-16 06:04:21,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:04:21,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd8d7c2164e674d722f28 HTTP/1.1" 200 None 2026-04-16 06:04:21,901 - lava_callback - DEBUG - Processing node 69ddd8d7c2164e674d722f28: baseline-arm64-clabbe 2026-04-16 06:04:21,901 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddd8d7c2164e674d722f28 2026-04-16 06:04:21,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:04:21,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd8d7c2164e674d722f28 HTTP/1.1" 200 None 2026-04-16 06:04:21,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:04:21,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-16 06:04:21,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:04:21,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddd8d7c2164e674d722f28 HTTP/1.1" 200 None 2026-04-16 06:04:21,950 - lava_callback - ERROR - Error processing callback for node 69ddd8d7c2164e674d722f28: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35892 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:05:30,555 - lava_callback - INFO - Received callback for node 69ddd91ec2164e674d722f61 INFO: 172.21.0.1:49344 - "POST /node/69ddd91ec2164e674d722f61 HTTP/1.0" 202 Accepted 2026-04-16 06:05:30,561 - lava_callback - INFO - Starting async job submit for node 69ddd91ec2164e674d722f61 2026-04-16 06:05:30,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:05:30,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd91ec2164e674d722f61 HTTP/1.1" 200 None 2026-04-16 06:05:30,576 - lava_callback - DEBUG - Processing node 69ddd91ec2164e674d722f61: baseline-arm64-baylibre 2026-04-16 06:05:30,576 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddd91ec2164e674d722f61 2026-04-16 06:05:30,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:05:30,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd91ec2164e674d722f61 HTTP/1.1" 200 None 2026-04-16 06:05:30,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:05:30,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-16 06:05:30,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:05:30,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddd91ec2164e674d722f61 HTTP/1.1" 200 None 2026-04-16 06:05:30,626 - lava_callback - ERROR - Error processing callback for node 69ddd91ec2164e674d722f61: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49348 - "GET /node/6992d95531166481c8dd3fbb%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:49358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36292 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:07:01,848 - lava_callback - INFO - Received callback for node 69ddd979c2164e674d722f96 INFO: 172.21.0.1:54904 - "POST /node/69ddd979c2164e674d722f96 HTTP/1.0" 202 Accepted 2026-04-16 06:07:01,854 - lava_callback - INFO - Starting async job submit for node 69ddd979c2164e674d722f96 2026-04-16 06:07:01,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:07:01,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd979c2164e674d722f96 HTTP/1.1" 200 None 2026-04-16 06:07:01,870 - lava_callback - DEBUG - Processing node 69ddd979c2164e674d722f96: baseline-arm64-clabbe 2026-04-16 06:07:01,870 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddd979c2164e674d722f96 2026-04-16 06:07:01,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:07:01,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd979c2164e674d722f96 HTTP/1.1" 200 None 2026-04-16 06:07:01,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:07:01,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-16 06:07:01,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:07:01,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddd979c2164e674d722f96 HTTP/1.1" 200 None 2026-04-16 06:07:01,925 - lava_callback - ERROR - Error processing callback for node 69ddd979c2164e674d722f96: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52180 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:08:21,861 - lava_callback - INFO - Received callback for node 69ddd9c4c2164e674d722fdf INFO: 172.21.0.1:53502 - "POST /node/69ddd9c4c2164e674d722fdf HTTP/1.0" 202 Accepted 2026-04-16 06:08:21,867 - lava_callback - INFO - Starting async job submit for node 69ddd9c4c2164e674d722fdf 2026-04-16 06:08:21,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:08:21,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd9c4c2164e674d722fdf HTTP/1.1" 200 None 2026-04-16 06:08:21,894 - lava_callback - DEBUG - Processing node 69ddd9c4c2164e674d722fdf: baseline-arm64-clabbe 2026-04-16 06:08:21,894 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddd9c4c2164e674d722fdf 2026-04-16 06:08:21,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:08:21,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddd9c4c2164e674d722fdf HTTP/1.1" 200 None 2026-04-16 06:08:21,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:08:21,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-16 06:08:21,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:08:21,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddd9c4c2164e674d722fdf HTTP/1.1" 200 None 2026-04-16 06:08:21,944 - lava_callback - ERROR - Error processing callback for node 69ddd9c4c2164e674d722fdf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48142 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:09:21,938 - lava_callback - INFO - Received callback for node 69ddda0cc2164e674d723049 INFO: 172.21.0.1:35826 - "POST /node/69ddda0cc2164e674d723049 HTTP/1.0" 202 Accepted 2026-04-16 06:09:21,943 - lava_callback - INFO - Starting async job submit for node 69ddda0cc2164e674d723049 2026-04-16 06:09:21,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:09:21,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddda0cc2164e674d723049 HTTP/1.1" 200 None 2026-04-16 06:09:21,968 - lava_callback - DEBUG - Processing node 69ddda0cc2164e674d723049: baseline-arm64-clabbe 2026-04-16 06:09:21,968 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddda0cc2164e674d723049 2026-04-16 06:09:21,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:09:21,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddda0cc2164e674d723049 HTTP/1.1" 200 None 2026-04-16 06:09:21,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:09:21,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-16 06:09:21,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:09:22,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddda0cc2164e674d723049 HTTP/1.1" 200 None 2026-04-16 06:09:22,018 - lava_callback - ERROR - Error processing callback for node 69ddda0cc2164e674d723049: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41074 - "GET /node/695370da31522df6df79dcdd%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:41088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49330 - "GET /node/69846a683a8748f282086cea%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:47190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43812 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:10:42,021 - lava_callback - INFO - Received callback for node 69ddda59c2164e674d723070 INFO: 172.21.0.1:38244 - "POST /node/69ddda59c2164e674d723070 HTTP/1.0" 202 Accepted 2026-04-16 06:10:42,026 - lava_callback - INFO - Starting async job submit for node 69ddda59c2164e674d723070 2026-04-16 06:10:42,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:10:42,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddda59c2164e674d723070 HTTP/1.1" 200 None 2026-04-16 06:10:42,058 - lava_callback - DEBUG - Processing node 69ddda59c2164e674d723070: baseline-arm64-clabbe 2026-04-16 06:10:42,059 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddda59c2164e674d723070 2026-04-16 06:10:42,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:10:42,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddda59c2164e674d723070 HTTP/1.1" 200 None 2026-04-16 06:10:42,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:10:42,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-16 06:10:42,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:10:42,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddda59c2164e674d723070 HTTP/1.1" 200 None 2026-04-16 06:10:42,112 - lava_callback - ERROR - Error processing callback for node 69ddda59c2164e674d723070: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43258 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:13:10,933 - lava_callback - INFO - Received callback for node 69dddae2c2164e674d72311b INFO: 172.21.0.1:48766 - "POST /node/69dddae2c2164e674d72311b HTTP/1.0" 202 Accepted 2026-04-16 06:13:10,939 - lava_callback - INFO - Starting async job submit for node 69dddae2c2164e674d72311b 2026-04-16 06:13:10,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:13:10,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dddae2c2164e674d72311b HTTP/1.1" 200 None 2026-04-16 06:13:10,955 - lava_callback - DEBUG - Processing node 69dddae2c2164e674d72311b: baseline-arm64-baylibre 2026-04-16 06:13:10,955 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dddae2c2164e674d72311b 2026-04-16 06:13:10,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:13:10,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dddae2c2164e674d72311b HTTP/1.1" 200 None 2026-04-16 06:13:10,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:13:10,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-16 06:13:10,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:13:11,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dddae2c2164e674d72311b HTTP/1.1" 200 None 2026-04-16 06:13:11,006 - lava_callback - ERROR - Error processing callback for node 69dddae2c2164e674d72311b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48778 - "GET /node/6992fd7531166481c8dded66%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:48786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55632 - "GET /node/6937dd8ca4c94886b94bee8a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:55634 - "GET /node/693e2dc9407f32424eb594b0%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:55646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33996 - "GET /node/695f75724e4af301aa86457a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:34010 - "GET /node/698a0f0a22b4cc0f227ad8dd%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:35416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34786 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:14:22,120 - lava_callback - INFO - Received callback for node 69dddb33c2164e674d723164 INFO: 172.21.0.1:51028 - "POST /node/69dddb33c2164e674d723164 HTTP/1.0" 202 Accepted 2026-04-16 06:14:22,125 - lava_callback - INFO - Starting async job submit for node 69dddb33c2164e674d723164 2026-04-16 06:14:22,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:14:22,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dddb33c2164e674d723164 HTTP/1.1" 200 None 2026-04-16 06:14:22,144 - lava_callback - DEBUG - Processing node 69dddb33c2164e674d723164: baseline-arm64-clabbe 2026-04-16 06:14:22,144 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dddb33c2164e674d723164 2026-04-16 06:14:22,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:14:22,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dddb33c2164e674d723164 HTTP/1.1" 200 None 2026-04-16 06:14:22,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:14:22,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-16 06:14:22,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:14:22,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dddb33c2164e674d723164 HTTP/1.1" 200 None 2026-04-16 06:14:22,198 - lava_callback - ERROR - Error processing callback for node 69dddb33c2164e674d723164: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58866 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:15:42,200 - lava_callback - INFO - Received callback for node 69dddb7bc2164e674d7231ca INFO: 172.21.0.1:40422 - "POST /node/69dddb7bc2164e674d7231ca HTTP/1.0" 202 Accepted 2026-04-16 06:15:42,206 - lava_callback - INFO - Starting async job submit for node 69dddb7bc2164e674d7231ca 2026-04-16 06:15:42,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:15:42,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dddb7bc2164e674d7231ca HTTP/1.1" 200 None 2026-04-16 06:15:42,229 - lava_callback - DEBUG - Processing node 69dddb7bc2164e674d7231ca: baseline-arm64-clabbe 2026-04-16 06:15:42,229 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dddb7bc2164e674d7231ca 2026-04-16 06:15:42,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:15:42,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dddb7bc2164e674d7231ca HTTP/1.1" 200 None 2026-04-16 06:15:42,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:15:42,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-16 06:15:42,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:15:42,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dddb7bc2164e674d7231ca HTTP/1.1" 200 None 2026-04-16 06:15:42,287 - lava_callback - ERROR - Error processing callback for node 69dddb7bc2164e674d7231ca: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35712 - "GET /node/69a1be5669d5b6151c03ae23%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:35720 - "GET /node/698f915e3013abef95d033f7%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:35734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58412 - "GET /node/69867d94177ca0f097bd5210%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:58424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58192 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:16:42,229 - lava_callback - INFO - Received callback for node 69dddbc4c2164e674d72320b INFO: 172.21.0.1:38240 - "POST /node/69dddbc4c2164e674d72320b HTTP/1.0" 202 Accepted 2026-04-16 06:16:42,234 - lava_callback - INFO - Starting async job submit for node 69dddbc4c2164e674d72320b 2026-04-16 06:16:42,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:16:42,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dddbc4c2164e674d72320b HTTP/1.1" 200 None 2026-04-16 06:16:42,250 - lava_callback - DEBUG - Processing node 69dddbc4c2164e674d72320b: baseline-arm64-clabbe 2026-04-16 06:16:42,250 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dddbc4c2164e674d72320b 2026-04-16 06:16:42,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:16:42,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dddbc4c2164e674d72320b HTTP/1.1" 200 None 2026-04-16 06:16:42,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:16:42,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-16 06:16:42,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:16:42,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dddbc4c2164e674d72320b HTTP/1.1" 200 None 2026-04-16 06:16:42,307 - lava_callback - ERROR - Error processing callback for node 69dddbc4c2164e674d72320b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51518 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:17:51,173 - lava_callback - INFO - Received callback for node 69dddc08c2164e674d723260 INFO: 172.21.0.1:52272 - "POST /node/69dddc08c2164e674d723260 HTTP/1.0" 202 Accepted 2026-04-16 06:17:51,178 - lava_callback - INFO - Starting async job submit for node 69dddc08c2164e674d723260 2026-04-16 06:17:51,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:17:51,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dddc08c2164e674d723260 HTTP/1.1" 200 None 2026-04-16 06:17:51,194 - lava_callback - DEBUG - Processing node 69dddc08c2164e674d723260: baseline-arm64-baylibre 2026-04-16 06:17:51,194 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dddc08c2164e674d723260 2026-04-16 06:17:51,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:17:51,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dddc08c2164e674d723260 HTTP/1.1" 200 None 2026-04-16 06:17:51,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:17:51,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-16 06:17:51,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:17:51,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dddc08c2164e674d723260 HTTP/1.1" 200 None 2026-04-16 06:17:51,243 - lava_callback - ERROR - Error processing callback for node 69dddc08c2164e674d723260: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53998 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:19:22,269 - lava_callback - INFO - Received callback for node 69dddc59c2164e674d7232aa INFO: 172.21.0.1:42246 - "POST /node/69dddc59c2164e674d7232aa HTTP/1.0" 202 Accepted 2026-04-16 06:19:22,275 - lava_callback - INFO - Starting async job submit for node 69dddc59c2164e674d7232aa 2026-04-16 06:19:22,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:19:22,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dddc59c2164e674d7232aa HTTP/1.1" 200 None 2026-04-16 06:19:22,291 - lava_callback - DEBUG - Processing node 69dddc59c2164e674d7232aa: baseline-arm64-clabbe 2026-04-16 06:19:22,291 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dddc59c2164e674d7232aa 2026-04-16 06:19:22,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:19:22,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dddc59c2164e674d7232aa HTTP/1.1" 200 None 2026-04-16 06:19:22,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:19:22,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-16 06:19:22,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:19:22,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dddc59c2164e674d7232aa HTTP/1.1" 200 None 2026-04-16 06:19:22,338 - lava_callback - ERROR - Error processing callback for node 69dddc59c2164e674d7232aa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42178 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:20:31,356 - lava_callback - INFO - Received callback for node 69dddca6c2164e674d7232dd INFO: 172.21.0.1:50180 - "POST /node/69dddca6c2164e674d7232dd HTTP/1.0" 202 Accepted 2026-04-16 06:20:31,363 - lava_callback - INFO - Starting async job submit for node 69dddca6c2164e674d7232dd 2026-04-16 06:20:31,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:20:31,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dddca6c2164e674d7232dd HTTP/1.1" 200 None 2026-04-16 06:20:31,380 - lava_callback - DEBUG - Processing node 69dddca6c2164e674d7232dd: baseline-arm64-baylibre 2026-04-16 06:20:31,380 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dddca6c2164e674d7232dd 2026-04-16 06:20:31,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:20:31,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dddca6c2164e674d7232dd HTTP/1.1" 200 None 2026-04-16 06:20:31,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:20:31,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-16 06:20:31,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:20:31,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dddca6c2164e674d7232dd HTTP/1.1" 200 None 2026-04-16 06:20:31,436 - lava_callback - ERROR - Error processing callback for node 69dddca6c2164e674d7232dd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37052 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:21:51,420 - lava_callback - INFO - Received callback for node 69dddcf3c2164e674d723316 INFO: 172.21.0.1:48936 - "POST /node/69dddcf3c2164e674d723316 HTTP/1.0" 202 Accepted 2026-04-16 06:21:51,426 - lava_callback - INFO - Starting async job submit for node 69dddcf3c2164e674d723316 2026-04-16 06:21:51,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:21:51,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dddcf3c2164e674d723316 HTTP/1.1" 200 None 2026-04-16 06:21:51,441 - lava_callback - DEBUG - Processing node 69dddcf3c2164e674d723316: baseline-arm64-baylibre 2026-04-16 06:21:51,441 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dddcf3c2164e674d723316 2026-04-16 06:21:51,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:21:51,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dddcf3c2164e674d723316 HTTP/1.1" 200 None 2026-04-16 06:21:51,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:21:51,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-16 06:21:51,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:21:51,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dddcf3c2164e674d723316 HTTP/1.1" 200 None 2026-04-16 06:21:51,674 - lava_callback - ERROR - Error processing callback for node 69dddcf3c2164e674d723316: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58860 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:23:22,477 - lava_callback - INFO - Received callback for node 69dddd44c2164e674d72335b INFO: 172.21.0.1:39688 - "POST /node/69dddd44c2164e674d72335b HTTP/1.0" 202 Accepted 2026-04-16 06:23:22,483 - lava_callback - INFO - Starting async job submit for node 69dddd44c2164e674d72335b 2026-04-16 06:23:22,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:23:22,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dddd44c2164e674d72335b HTTP/1.1" 200 None 2026-04-16 06:23:22,502 - lava_callback - DEBUG - Processing node 69dddd44c2164e674d72335b: baseline-arm64-clabbe 2026-04-16 06:23:22,502 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dddd44c2164e674d72335b 2026-04-16 06:23:22,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:23:22,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dddd44c2164e674d72335b HTTP/1.1" 200 None 2026-04-16 06:23:22,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:23:22,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69da740b81dd6b543e75e292 HTTP/1.1" 200 None 2026-04-16 06:23:22,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:23:22,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dddd44c2164e674d72335b HTTP/1.1" 200 None 2026-04-16 06:23:22,553 - lava_callback - ERROR - Error processing callback for node 69dddd44c2164e674d72335b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33816 - "GET /node/695f75734e4af301aa86457d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:33826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45436 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50680 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36092 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:35:52,414 - lava_callback - INFO - Received callback for node 69dde033c2164e674d723528 INFO: 172.21.0.1:42186 - "POST /node/69dde033c2164e674d723528 HTTP/1.0" 202 Accepted 2026-04-16 06:35:52,419 - lava_callback - INFO - Starting async job submit for node 69dde033c2164e674d723528 2026-04-16 06:35:52,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:35:52,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde033c2164e674d723528 HTTP/1.1" 200 None 2026-04-16 06:35:52,436 - lava_callback - DEBUG - Processing node 69dde033c2164e674d723528: baseline-arm64-baylibre 2026-04-16 06:35:52,436 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde033c2164e674d723528 2026-04-16 06:35:52,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:35:52,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde033c2164e674d723528 HTTP/1.1" 200 None 2026-04-16 06:35:52,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:35:52,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd171917c944d2f17d8b46 HTTP/1.1" 200 None 2026-04-16 06:35:52,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:35:52,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde033c2164e674d723528 HTTP/1.1" 200 None 2026-04-16 06:35:52,487 - lava_callback - ERROR - Error processing callback for node 69dde033c2164e674d723528: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53174 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:36:52,143 - lava_callback - INFO - Received callback for node 69dde076c2164e674d723558 INFO: 172.21.0.1:40484 - "POST /node/69dde076c2164e674d723558 HTTP/1.0" 202 Accepted 2026-04-16 06:36:52,149 - lava_callback - INFO - Starting async job submit for node 69dde076c2164e674d723558 2026-04-16 06:36:52,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:36:52,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde076c2164e674d723558 HTTP/1.1" 200 None 2026-04-16 06:36:52,166 - lava_callback - DEBUG - Processing node 69dde076c2164e674d723558: baseline-arm-baylibre 2026-04-16 06:36:52,166 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde076c2164e674d723558 2026-04-16 06:36:52,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:36:52,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde076c2164e674d723558 HTTP/1.1" 200 None 2026-04-16 06:36:52,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:36:52,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 06:36:52,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:36:52,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde076c2164e674d723558 HTTP/1.1" 200 None 2026-04-16 06:36:52,214 - lava_callback - ERROR - Error processing callback for node 69dde076c2164e674d723558: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33308 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49754 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:38:32,275 - lava_callback - INFO - Received callback for node 69dde0dac2164e674d723589 INFO: 172.21.0.1:55764 - "POST /node/69dde0dac2164e674d723589 HTTP/1.0" 202 Accepted 2026-04-16 06:38:32,280 - lava_callback - INFO - Starting async job submit for node 69dde0dac2164e674d723589 2026-04-16 06:38:32,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:38:32,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde0dac2164e674d723589 HTTP/1.1" 200 None 2026-04-16 06:38:32,297 - lava_callback - DEBUG - Processing node 69dde0dac2164e674d723589: baseline-arm-baylibre 2026-04-16 06:38:32,297 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde0dac2164e674d723589 2026-04-16 06:38:32,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:38:32,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde0dac2164e674d723589 HTTP/1.1" 200 None 2026-04-16 06:38:32,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:38:32,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 06:38:32,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:38:32,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde0dac2164e674d723589 HTTP/1.1" 200 None 2026-04-16 06:38:32,346 - lava_callback - ERROR - Error processing callback for node 69dde0dac2164e674d723589: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42386 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:39:12,253 - lava_callback - INFO - Received callback for node 69dde103c2164e674d7235b3 INFO: 172.21.0.1:43468 - "POST /node/69dde103c2164e674d7235b3 HTTP/1.0" 202 Accepted 2026-04-16 06:39:12,259 - lava_callback - INFO - Starting async job submit for node 69dde103c2164e674d7235b3 2026-04-16 06:39:12,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:39:12,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde103c2164e674d7235b3 HTTP/1.1" 200 None 2026-04-16 06:39:12,276 - lava_callback - DEBUG - Processing node 69dde103c2164e674d7235b3: baseline-arm-baylibre 2026-04-16 06:39:12,276 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde103c2164e674d7235b3 2026-04-16 06:39:12,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:39:12,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde103c2164e674d7235b3 HTTP/1.1" 200 None 2026-04-16 06:39:12,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:39:12,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 06:39:12,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:39:12,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde103c2164e674d7235b3 HTTP/1.1" 200 None 2026-04-16 06:39:12,330 - lava_callback - ERROR - Error processing callback for node 69dde103c2164e674d7235b3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37196 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:39:52,368 - lava_callback - INFO - Received callback for node 69dde131c2164e674d7235f7 INFO: 172.21.0.1:39188 - "POST /node/69dde131c2164e674d7235f7 HTTP/1.0" 202 Accepted 2026-04-16 06:39:52,374 - lava_callback - INFO - Starting async job submit for node 69dde131c2164e674d7235f7 2026-04-16 06:39:52,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:39:52,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde131c2164e674d7235f7 HTTP/1.1" 200 None 2026-04-16 06:39:52,390 - lava_callback - DEBUG - Processing node 69dde131c2164e674d7235f7: baseline-arm64-baylibre 2026-04-16 06:39:52,391 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde131c2164e674d7235f7 2026-04-16 06:39:52,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:39:52,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde131c2164e674d7235f7 HTTP/1.1" 200 None 2026-04-16 06:39:52,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:39:52,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd171917c944d2f17d8b46 HTTP/1.1" 200 None 2026-04-16 06:39:52,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:39:52,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde131c2164e674d7235f7 HTTP/1.1" 200 None 2026-04-16 06:39:52,440 - lava_callback - ERROR - Error processing callback for node 69dde131c2164e674d7235f7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44076 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:43:12,553 - lava_callback - INFO - Received callback for node 69dde1f3c2164e674d7236c9 INFO: 172.21.0.1:34248 - "POST /node/69dde1f3c2164e674d7236c9 HTTP/1.0" 202 Accepted 2026-04-16 06:43:12,561 - lava_callback - INFO - Starting async job submit for node 69dde1f3c2164e674d7236c9 2026-04-16 06:43:12,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:43:12,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde1f3c2164e674d7236c9 HTTP/1.1" 200 None 2026-04-16 06:43:12,611 - lava_callback - DEBUG - Processing node 69dde1f3c2164e674d7236c9: baseline-arm-baylibre 2026-04-16 06:43:12,611 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde1f3c2164e674d7236c9 2026-04-16 06:43:12,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:43:12,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde1f3c2164e674d7236c9 HTTP/1.1" 200 None 2026-04-16 06:43:12,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:43:12,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-16 06:43:12,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:43:12,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde1f3c2164e674d7236c9 HTTP/1.1" 200 None 2026-04-16 06:43:12,683 - lava_callback - ERROR - Error processing callback for node 69dde1f3c2164e674d7236c9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49980 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:43:32,510 - lava_callback - INFO - Received callback for node 69dde212c2164e674d7236ef INFO: 172.21.0.1:48572 - "POST /node/69dde212c2164e674d7236ef HTTP/1.0" 202 Accepted 2026-04-16 06:43:32,515 - lava_callback - INFO - Starting async job submit for node 69dde212c2164e674d7236ef 2026-04-16 06:43:32,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:43:32,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde212c2164e674d7236ef HTTP/1.1" 200 None 2026-04-16 06:43:32,541 - lava_callback - DEBUG - Processing node 69dde212c2164e674d7236ef: baseline-arm-baylibre 2026-04-16 06:43:32,541 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde212c2164e674d7236ef 2026-04-16 06:43:32,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:43:32,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde212c2164e674d7236ef HTTP/1.1" 200 None 2026-04-16 06:43:32,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:43:32,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-16 06:43:32,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:43:32,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde212c2164e674d7236ef HTTP/1.1" 200 None 2026-04-16 06:43:32,597 - lava_callback - ERROR - Error processing callback for node 69dde212c2164e674d7236ef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48610 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:44:52,666 - lava_callback - INFO - Received callback for node 69dde257c2164e674d723736 INFO: 172.21.0.1:44380 - "POST /node/69dde257c2164e674d723736 HTTP/1.0" 202 Accepted 2026-04-16 06:44:52,672 - lava_callback - INFO - Starting async job submit for node 69dde257c2164e674d723736 2026-04-16 06:44:52,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:44:52,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde257c2164e674d723736 HTTP/1.1" 200 None 2026-04-16 06:44:52,698 - lava_callback - DEBUG - Processing node 69dde257c2164e674d723736: baseline-arm-baylibre 2026-04-16 06:44:52,698 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde257c2164e674d723736 2026-04-16 06:44:52,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:44:52,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde257c2164e674d723736 HTTP/1.1" 200 None 2026-04-16 06:44:52,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:44:52,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-16 06:44:52,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:44:52,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde257c2164e674d723736 HTTP/1.1" 200 None 2026-04-16 06:44:52,751 - lava_callback - ERROR - Error processing callback for node 69dde257c2164e674d723736: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41090 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:46:23,468 - lava_callback - INFO - Received callback for node 69dde2bbc2164e674d7237bc INFO: 172.21.0.1:50538 - "POST /node/69dde2bbc2164e674d7237bc HTTP/1.0" 202 Accepted 2026-04-16 06:46:23,474 - lava_callback - INFO - Starting async job submit for node 69dde2bbc2164e674d7237bc 2026-04-16 06:46:23,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:46:23,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde2bbc2164e674d7237bc HTTP/1.1" 200 None 2026-04-16 06:46:23,489 - lava_callback - DEBUG - Processing node 69dde2bbc2164e674d7237bc: baseline-arm-clabbe 2026-04-16 06:46:23,489 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde2bbc2164e674d7237bc 2026-04-16 06:46:23,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:46:23,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde2bbc2164e674d7237bc HTTP/1.1" 200 None 2026-04-16 06:46:23,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:46:23,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-16 06:46:23,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:46:23,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde2bbc2164e674d7237bc HTTP/1.1" 200 None 2026-04-16 06:46:23,536 - lava_callback - ERROR - Error processing callback for node 69dde2bbc2164e674d7237bc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51408 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:47:03,473 - lava_callback - INFO - Received callback for node 69dde2dec2164e674d7237db INFO: 172.21.0.1:59160 - "POST /node/69dde2dec2164e674d7237db HTTP/1.0" 202 Accepted 2026-04-16 06:47:03,478 - lava_callback - INFO - Starting async job submit for node 69dde2dec2164e674d7237db 2026-04-16 06:47:03,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:47:03,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde2dec2164e674d7237db HTTP/1.1" 200 None 2026-04-16 06:47:03,495 - lava_callback - DEBUG - Processing node 69dde2dec2164e674d7237db: baseline-arm-clabbe 2026-04-16 06:47:03,495 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde2dec2164e674d7237db 2026-04-16 06:47:03,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:47:03,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde2dec2164e674d7237db HTTP/1.1" 200 None 2026-04-16 06:47:03,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:47:03,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-16 06:47:03,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:47:03,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde2dec2164e674d7237db HTTP/1.1" 200 None 2026-04-16 06:47:03,545 - lava_callback - ERROR - Error processing callback for node 69dde2dec2164e674d7237db: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44508 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:47:43,589 - lava_callback - INFO - Received callback for node 69dde301c2164e674d723800 INFO: 172.21.0.1:40972 - "POST /node/69dde301c2164e674d723800 HTTP/1.0" 202 Accepted 2026-04-16 06:47:43,594 - lava_callback - INFO - Starting async job submit for node 69dde301c2164e674d723800 2026-04-16 06:47:43,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:47:43,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde301c2164e674d723800 HTTP/1.1" 200 None 2026-04-16 06:47:43,616 - lava_callback - DEBUG - Processing node 69dde301c2164e674d723800: baseline-arm-clabbe 2026-04-16 06:47:43,616 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde301c2164e674d723800 2026-04-16 06:47:43,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:47:43,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde301c2164e674d723800 HTTP/1.1" 200 None 2026-04-16 06:47:43,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:47:43,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-16 06:47:43,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:47:43,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde301c2164e674d723800 HTTP/1.1" 200 None 2026-04-16 06:47:43,667 - lava_callback - ERROR - Error processing callback for node 69dde301c2164e674d723800: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56594 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:48:23,549 - lava_callback - INFO - Received callback for node 69dde321c2164e674d723827 INFO: 172.21.0.1:57574 - "POST /node/69dde321c2164e674d723827 HTTP/1.0" 202 Accepted 2026-04-16 06:48:23,555 - lava_callback - INFO - Starting async job submit for node 69dde321c2164e674d723827 2026-04-16 06:48:23,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:48:23,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde321c2164e674d723827 HTTP/1.1" 200 None 2026-04-16 06:48:23,571 - lava_callback - DEBUG - Processing node 69dde321c2164e674d723827: baseline-arm-clabbe 2026-04-16 06:48:23,572 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde321c2164e674d723827 2026-04-16 06:48:23,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:48:23,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde321c2164e674d723827 HTTP/1.1" 200 None 2026-04-16 06:48:23,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:48:23,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-16 06:48:23,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:48:23,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde321c2164e674d723827 HTTP/1.1" 200 None 2026-04-16 06:48:23,627 - lava_callback - ERROR - Error processing callback for node 69dde321c2164e674d723827: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43162 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:48:43,596 - lava_callback - INFO - Received callback for node 69dde343c2164e674d723853 INFO: 172.21.0.1:53258 - "POST /node/69dde343c2164e674d723853 HTTP/1.0" 202 Accepted 2026-04-16 06:48:43,602 - lava_callback - INFO - Starting async job submit for node 69dde343c2164e674d723853 2026-04-16 06:48:43,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:48:43,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde343c2164e674d723853 HTTP/1.1" 200 None 2026-04-16 06:48:43,618 - lava_callback - DEBUG - Processing node 69dde343c2164e674d723853: baseline-arm-clabbe 2026-04-16 06:48:43,618 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde343c2164e674d723853 2026-04-16 06:48:43,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:48:43,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde343c2164e674d723853 HTTP/1.1" 200 None 2026-04-16 06:48:43,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:48:43,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-16 06:48:43,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:48:43,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde343c2164e674d723853 HTTP/1.1" 200 None 2026-04-16 06:48:43,674 - lava_callback - ERROR - Error processing callback for node 69dde343c2164e674d723853: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53286 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:49:23,561 - lava_callback - INFO - Received callback for node 69dde364c2164e674d723875 INFO: 172.21.0.1:39974 - "POST /node/69dde364c2164e674d723875 HTTP/1.0" 202 Accepted 2026-04-16 06:49:23,567 - lava_callback - INFO - Starting async job submit for node 69dde364c2164e674d723875 2026-04-16 06:49:23,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:49:23,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde364c2164e674d723875 HTTP/1.1" 200 None 2026-04-16 06:49:23,583 - lava_callback - DEBUG - Processing node 69dde364c2164e674d723875: baseline-arm-clabbe 2026-04-16 06:49:23,583 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde364c2164e674d723875 2026-04-16 06:49:23,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:49:23,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde364c2164e674d723875 HTTP/1.1" 200 None 2026-04-16 06:49:23,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:49:23,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-16 06:49:23,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:49:23,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde364c2164e674d723875 HTTP/1.1" 200 None 2026-04-16 06:49:23,649 - lava_callback - ERROR - Error processing callback for node 69dde364c2164e674d723875: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39704 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:49:43,580 - lava_callback - INFO - Received callback for node 69dde383c2164e674d7238a5 INFO: 172.21.0.1:60012 - "POST /node/69dde383c2164e674d7238a5 HTTP/1.0" 202 Accepted 2026-04-16 06:49:43,585 - lava_callback - INFO - Starting async job submit for node 69dde383c2164e674d7238a5 2026-04-16 06:49:43,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:49:43,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde383c2164e674d7238a5 HTTP/1.1" 200 None 2026-04-16 06:49:43,601 - lava_callback - DEBUG - Processing node 69dde383c2164e674d7238a5: baseline-arm-clabbe 2026-04-16 06:49:43,602 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde383c2164e674d7238a5 2026-04-16 06:49:43,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:49:43,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde383c2164e674d7238a5 HTTP/1.1" 200 None 2026-04-16 06:49:43,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:49:43,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-16 06:49:43,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:49:43,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde383c2164e674d7238a5 HTTP/1.1" 200 None 2026-04-16 06:49:43,661 - lava_callback - ERROR - Error processing callback for node 69dde383c2164e674d7238a5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54836 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:50:23,624 - lava_callback - INFO - Received callback for node 69dde3a7c2164e674d7238f0 INFO: 172.21.0.1:48022 - "POST /node/69dde3a7c2164e674d7238f0 HTTP/1.0" 202 Accepted 2026-04-16 06:50:23,630 - lava_callback - INFO - Starting async job submit for node 69dde3a7c2164e674d7238f0 2026-04-16 06:50:23,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:50:23,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde3a7c2164e674d7238f0 HTTP/1.1" 200 None 2026-04-16 06:50:23,646 - lava_callback - DEBUG - Processing node 69dde3a7c2164e674d7238f0: baseline-arm-clabbe 2026-04-16 06:50:23,646 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde3a7c2164e674d7238f0 2026-04-16 06:50:23,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:50:23,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde3a7c2164e674d7238f0 HTTP/1.1" 200 None 2026-04-16 06:50:23,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:50:23,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-16 06:50:23,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:50:23,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde3a7c2164e674d7238f0 HTTP/1.1" 200 None 2026-04-16 06:50:23,703 - lava_callback - ERROR - Error processing callback for node 69dde3a7c2164e674d7238f0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45070 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:51:03,678 - lava_callback - INFO - Received callback for node 69dde3c8c2164e674d723920 INFO: 172.21.0.1:59976 - "POST /node/69dde3c8c2164e674d723920 HTTP/1.0" 202 Accepted 2026-04-16 06:51:03,684 - lava_callback - INFO - Starting async job submit for node 69dde3c8c2164e674d723920 2026-04-16 06:51:03,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:51:03,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde3c8c2164e674d723920 HTTP/1.1" 200 None 2026-04-16 06:51:03,700 - lava_callback - DEBUG - Processing node 69dde3c8c2164e674d723920: baseline-arm-clabbe 2026-04-16 06:51:03,700 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde3c8c2164e674d723920 2026-04-16 06:51:03,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:51:03,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde3c8c2164e674d723920 HTTP/1.1" 200 None 2026-04-16 06:51:03,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:51:03,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-16 06:51:03,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:51:03,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde3c8c2164e674d723920 HTTP/1.1" 200 None 2026-04-16 06:51:03,747 - lava_callback - ERROR - Error processing callback for node 69dde3c8c2164e674d723920: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36810 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:53:43,816 - lava_callback - INFO - Received callback for node 69dde462c2164e674d7239e0 INFO: 172.21.0.1:45992 - "POST /node/69dde462c2164e674d7239e0 HTTP/1.0" 202 Accepted 2026-04-16 06:53:43,822 - lava_callback - INFO - Starting async job submit for node 69dde462c2164e674d7239e0 2026-04-16 06:53:43,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:53:43,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde462c2164e674d7239e0 HTTP/1.1" 200 None 2026-04-16 06:53:43,838 - lava_callback - DEBUG - Processing node 69dde462c2164e674d7239e0: baseline-arm64-clabbe 2026-04-16 06:53:43,838 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde462c2164e674d7239e0 2026-04-16 06:53:43,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:53:43,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde462c2164e674d7239e0 HTTP/1.1" 200 None 2026-04-16 06:53:43,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:53:43,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd171917c944d2f17d8b46 HTTP/1.1" 200 None 2026-04-16 06:53:43,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:53:43,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde462c2164e674d7239e0 HTTP/1.1" 200 None 2026-04-16 06:53:43,887 - lava_callback - ERROR - Error processing callback for node 69dde462c2164e674d7239e0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55820 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:54:23,735 - lava_callback - INFO - Received callback for node 69dde49cc2164e674d723a47 INFO: 172.21.0.1:60150 - "POST /node/69dde49cc2164e674d723a47 HTTP/1.0" 202 Accepted 2026-04-16 06:54:23,741 - lava_callback - INFO - Starting async job submit for node 69dde49cc2164e674d723a47 2026-04-16 06:54:23,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:54:23,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde49cc2164e674d723a47 HTTP/1.1" 200 None 2026-04-16 06:54:23,757 - lava_callback - DEBUG - Processing node 69dde49cc2164e674d723a47: baseline-arm-clabbe 2026-04-16 06:54:23,757 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde49cc2164e674d723a47 2026-04-16 06:54:23,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:54:23,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde49cc2164e674d723a47 HTTP/1.1" 200 None 2026-04-16 06:54:23,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:54:23,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-16 06:54:23,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:54:23,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde49cc2164e674d723a47 HTTP/1.1" 200 None 2026-04-16 06:54:23,814 - lava_callback - ERROR - Error processing callback for node 69dde49cc2164e674d723a47: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41714 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:55:03,817 - lava_callback - INFO - Received callback for node 69dde4c2c2164e674d723a60 INFO: 172.21.0.1:54226 - "POST /node/69dde4c2c2164e674d723a60 HTTP/1.0" 202 Accepted 2026-04-16 06:55:03,823 - lava_callback - INFO - Starting async job submit for node 69dde4c2c2164e674d723a60 2026-04-16 06:55:03,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:55:03,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde4c2c2164e674d723a60 HTTP/1.1" 200 None 2026-04-16 06:55:03,840 - lava_callback - DEBUG - Processing node 69dde4c2c2164e674d723a60: baseline-arm-clabbe 2026-04-16 06:55:03,840 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde4c2c2164e674d723a60 2026-04-16 06:55:03,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:55:03,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde4c2c2164e674d723a60 HTTP/1.1" 200 None 2026-04-16 06:55:03,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:55:03,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-16 06:55:03,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:55:03,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde4c2c2164e674d723a60 HTTP/1.1" 200 None 2026-04-16 06:55:03,890 - lava_callback - ERROR - Error processing callback for node 69dde4c2c2164e674d723a60: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35984 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:56:03,923 - lava_callback - INFO - Received callback for node 69dde4f1c2164e674d723ab7 INFO: 172.21.0.1:49750 - "POST /node/69dde4f1c2164e674d723ab7 HTTP/1.0" 202 Accepted 2026-04-16 06:56:03,929 - lava_callback - INFO - Starting async job submit for node 69dde4f1c2164e674d723ab7 2026-04-16 06:56:03,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:56:03,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde4f1c2164e674d723ab7 HTTP/1.1" 200 None 2026-04-16 06:56:03,945 - lava_callback - DEBUG - Processing node 69dde4f1c2164e674d723ab7: baseline-arm64-clabbe 2026-04-16 06:56:03,945 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde4f1c2164e674d723ab7 2026-04-16 06:56:03,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:56:03,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde4f1c2164e674d723ab7 HTTP/1.1" 200 None 2026-04-16 06:56:03,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:56:03,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd171917c944d2f17d8b46 HTTP/1.1" 200 None 2026-04-16 06:56:03,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:56:03,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde4f1c2164e674d723ab7 HTTP/1.1" 200 None 2026-04-16 06:56:03,998 - lava_callback - ERROR - Error processing callback for node 69dde4f1c2164e674d723ab7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43732 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:57:03,977 - lava_callback - INFO - Received callback for node 69dde529c2164e674d723b14 INFO: 172.21.0.1:51088 - "POST /node/69dde529c2164e674d723b14 HTTP/1.0" 202 Accepted 2026-04-16 06:57:03,982 - lava_callback - INFO - Starting async job submit for node 69dde529c2164e674d723b14 2026-04-16 06:57:03,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:57:03,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde529c2164e674d723b14 HTTP/1.1" 200 None 2026-04-16 06:57:03,998 - lava_callback - DEBUG - Processing node 69dde529c2164e674d723b14: baseline-arm-clabbe 2026-04-16 06:57:03,998 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde529c2164e674d723b14 2026-04-16 06:57:03,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:57:04,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde529c2164e674d723b14 HTTP/1.1" 200 None 2026-04-16 06:57:04,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:57:04,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-16 06:57:04,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:57:04,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde529c2164e674d723b14 HTTP/1.1" 200 None 2026-04-16 06:57:04,054 - lava_callback - ERROR - Error processing callback for node 69dde529c2164e674d723b14: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33288 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:57:23,886 - lava_callback - INFO - Received callback for node 69dde54bc2164e674d723b42 INFO: 172.21.0.1:40114 - "POST /node/69dde54bc2164e674d723b42 HTTP/1.0" 202 Accepted 2026-04-16 06:57:23,892 - lava_callback - INFO - Starting async job submit for node 69dde54bc2164e674d723b42 2026-04-16 06:57:23,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:57:23,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde54bc2164e674d723b42 HTTP/1.1" 200 None 2026-04-16 06:57:23,908 - lava_callback - DEBUG - Processing node 69dde54bc2164e674d723b42: baseline-arm-clabbe 2026-04-16 06:57:23,909 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde54bc2164e674d723b42 2026-04-16 06:57:23,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:57:23,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde54bc2164e674d723b42 HTTP/1.1" 200 None 2026-04-16 06:57:23,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:57:23,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-16 06:57:23,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:57:23,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde54bc2164e674d723b42 HTTP/1.1" 200 None 2026-04-16 06:57:23,959 - lava_callback - ERROR - Error processing callback for node 69dde54bc2164e674d723b42: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38604 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:58:24,145 - lava_callback - INFO - Received callback for node 69dde57ac2164e674d723b6d INFO: 172.21.0.1:44366 - "POST /node/69dde57ac2164e674d723b6d HTTP/1.0" 202 Accepted 2026-04-16 06:58:24,151 - lava_callback - INFO - Starting async job submit for node 69dde57ac2164e674d723b6d 2026-04-16 06:58:24,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:58:24,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde57ac2164e674d723b6d HTTP/1.1" 200 None 2026-04-16 06:58:24,167 - lava_callback - DEBUG - Processing node 69dde57ac2164e674d723b6d: baseline-arm64-clabbe 2026-04-16 06:58:24,167 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde57ac2164e674d723b6d 2026-04-16 06:58:24,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:58:24,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde57ac2164e674d723b6d HTTP/1.1" 200 None 2026-04-16 06:58:24,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:58:24,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd171917c944d2f17d8b46 HTTP/1.1" 200 None 2026-04-16 06:58:24,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:58:24,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde57ac2164e674d723b6d HTTP/1.1" 200 None 2026-04-16 06:58:24,231 - lava_callback - ERROR - Error processing callback for node 69dde57ac2164e674d723b6d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48584 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:59:03,996 - lava_callback - INFO - Received callback for node 69dde5b3c2164e674d723bbb INFO: 172.21.0.1:46460 - "POST /node/69dde5b3c2164e674d723bbb HTTP/1.0" 202 Accepted 2026-04-16 06:59:04,002 - lava_callback - INFO - Starting async job submit for node 69dde5b3c2164e674d723bbb 2026-04-16 06:59:04,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:59:04,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde5b3c2164e674d723bbb HTTP/1.1" 200 None 2026-04-16 06:59:04,017 - lava_callback - DEBUG - Processing node 69dde5b3c2164e674d723bbb: baseline-arm-clabbe 2026-04-16 06:59:04,017 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde5b3c2164e674d723bbb 2026-04-16 06:59:04,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:59:04,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde5b3c2164e674d723bbb HTTP/1.1" 200 None 2026-04-16 06:59:04,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:59:04,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-16 06:59:04,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:59:04,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde5b3c2164e674d723bbb HTTP/1.1" 200 None 2026-04-16 06:59:04,067 - lava_callback - ERROR - Error processing callback for node 69dde5b3c2164e674d723bbb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54468 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34436 - "GET / HTTP/1.0" 200 OK 2026-04-16 06:59:44,015 - lava_callback - INFO - Received callback for node 69dde5d5c2164e674d723be8 INFO: 172.21.0.1:48736 - "POST /node/69dde5d5c2164e674d723be8 HTTP/1.0" 202 Accepted 2026-04-16 06:59:44,020 - lava_callback - INFO - Starting async job submit for node 69dde5d5c2164e674d723be8 2026-04-16 06:59:44,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:59:44,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde5d5c2164e674d723be8 HTTP/1.1" 200 None 2026-04-16 06:59:44,037 - lava_callback - DEBUG - Processing node 69dde5d5c2164e674d723be8: baseline-arm-clabbe 2026-04-16 06:59:44,037 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde5d5c2164e674d723be8 2026-04-16 06:59:44,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:59:44,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde5d5c2164e674d723be8 HTTP/1.1" 200 None 2026-04-16 06:59:44,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:59:44,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 06:59:44,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 06:59:44,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde5d5c2164e674d723be8 HTTP/1.1" 200 None 2026-04-16 06:59:44,086 - lava_callback - ERROR - Error processing callback for node 69dde5d5c2164e674d723be8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59294 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32796 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:00:44,082 - lava_callback - INFO - Received callback for node 69dde607c2164e674d723c20 INFO: 172.21.0.1:56914 - "POST /node/69dde607c2164e674d723c20 HTTP/1.0" 202 Accepted 2026-04-16 07:00:44,088 - lava_callback - INFO - Starting async job submit for node 69dde607c2164e674d723c20 2026-04-16 07:00:44,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:00:44,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde607c2164e674d723c20 HTTP/1.1" 200 None 2026-04-16 07:00:44,110 - lava_callback - DEBUG - Processing node 69dde607c2164e674d723c20: baseline-arm64-clabbe 2026-04-16 07:00:44,111 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde607c2164e674d723c20 2026-04-16 07:00:44,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:00:44,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde607c2164e674d723c20 HTTP/1.1" 200 None 2026-04-16 07:00:44,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:00:44,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd171917c944d2f17d8b46 HTTP/1.1" 200 None 2026-04-16 07:00:44,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:00:44,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde607c2164e674d723c20 HTTP/1.1" 200 None 2026-04-16 07:00:44,164 - lava_callback - ERROR - Error processing callback for node 69dde607c2164e674d723c20: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54996 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:01:24,090 - lava_callback - INFO - Received callback for node 69dde640c2164e674d723c89 INFO: 172.21.0.1:55642 - "POST /node/69dde640c2164e674d723c89 HTTP/1.0" 202 Accepted 2026-04-16 07:01:24,096 - lava_callback - INFO - Starting async job submit for node 69dde640c2164e674d723c89 2026-04-16 07:01:24,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:01:24,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde640c2164e674d723c89 HTTP/1.1" 200 None 2026-04-16 07:01:24,111 - lava_callback - DEBUG - Processing node 69dde640c2164e674d723c89: baseline-arm-clabbe 2026-04-16 07:01:24,111 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde640c2164e674d723c89 2026-04-16 07:01:24,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:01:24,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde640c2164e674d723c89 HTTP/1.1" 200 None 2026-04-16 07:01:24,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:01:24,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-16 07:01:24,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:01:24,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde640c2164e674d723c89 HTTP/1.1" 200 None 2026-04-16 07:01:24,159 - lava_callback - ERROR - Error processing callback for node 69dde640c2164e674d723c89: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51382 - "GET /node/69bcaaafb4744551b27fd2e9%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:51392 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51408 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:02:24,145 - lava_callback - INFO - Received callback for node 69dde671c2164e674d723ca2 INFO: 172.21.0.1:38828 - "POST /node/69dde671c2164e674d723ca2 HTTP/1.0" 202 Accepted 2026-04-16 07:02:24,151 - lava_callback - INFO - Starting async job submit for node 69dde671c2164e674d723ca2 2026-04-16 07:02:24,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:02:24,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde671c2164e674d723ca2 HTTP/1.1" 200 None 2026-04-16 07:02:24,168 - lava_callback - DEBUG - Processing node 69dde671c2164e674d723ca2: baseline-arm64-clabbe 2026-04-16 07:02:24,168 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde671c2164e674d723ca2 2026-04-16 07:02:24,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:02:24,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde671c2164e674d723ca2 HTTP/1.1" 200 None 2026-04-16 07:02:24,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:02:24,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd171917c944d2f17d8b46 HTTP/1.1" 200 None 2026-04-16 07:02:24,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:02:24,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde671c2164e674d723ca2 HTTP/1.1" 200 None 2026-04-16 07:02:24,220 - lava_callback - ERROR - Error processing callback for node 69dde671c2164e674d723ca2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60810 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60818 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:03:24,191 - lava_callback - INFO - Received callback for node 69dde6adc2164e674d723cdd INFO: 172.21.0.1:40672 - "POST /node/69dde6adc2164e674d723cdd HTTP/1.0" 202 Accepted 2026-04-16 07:03:24,197 - lava_callback - INFO - Starting async job submit for node 69dde6adc2164e674d723cdd 2026-04-16 07:03:24,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:03:24,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde6adc2164e674d723cdd HTTP/1.1" 200 None 2026-04-16 07:03:24,213 - lava_callback - DEBUG - Processing node 69dde6adc2164e674d723cdd: baseline-arm-clabbe 2026-04-16 07:03:24,213 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde6adc2164e674d723cdd 2026-04-16 07:03:24,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:03:24,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde6adc2164e674d723cdd HTTP/1.1" 200 None 2026-04-16 07:03:24,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:03:24,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-16 07:03:24,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:03:24,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde6adc2164e674d723cdd HTTP/1.1" 200 None 2026-04-16 07:03:24,287 - lava_callback - ERROR - Error processing callback for node 69dde6adc2164e674d723cdd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33522 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:04:04,206 - lava_callback - INFO - Received callback for node 69dde6d1c2164e674d723d1a INFO: 172.21.0.1:39236 - "POST /node/69dde6d1c2164e674d723d1a HTTP/1.0" 202 Accepted 2026-04-16 07:04:04,215 - lava_callback - INFO - Starting async job submit for node 69dde6d1c2164e674d723d1a 2026-04-16 07:04:04,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:04:04,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde6d1c2164e674d723d1a HTTP/1.1" 200 None 2026-04-16 07:04:04,238 - lava_callback - DEBUG - Processing node 69dde6d1c2164e674d723d1a: baseline-arm-clabbe 2026-04-16 07:04:04,238 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde6d1c2164e674d723d1a 2026-04-16 07:04:04,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:04:04,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde6d1c2164e674d723d1a HTTP/1.1" 200 None 2026-04-16 07:04:04,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:04:04,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-16 07:04:04,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:04:04,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde6d1c2164e674d723d1a HTTP/1.1" 200 None 2026-04-16 07:04:04,288 - lava_callback - ERROR - Error processing callback for node 69dde6d1c2164e674d723d1a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46512 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46528 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:04:24,280 - lava_callback - INFO - Received callback for node 69dde6f4c2164e674d723d2f INFO: 172.21.0.1:45394 - "POST /node/69dde6f4c2164e674d723d2f HTTP/1.0" 202 Accepted 2026-04-16 07:04:24,285 - lava_callback - INFO - Starting async job submit for node 69dde6f4c2164e674d723d2f 2026-04-16 07:04:24,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:04:24,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde6f4c2164e674d723d2f HTTP/1.1" 200 None 2026-04-16 07:04:24,303 - lava_callback - DEBUG - Processing node 69dde6f4c2164e674d723d2f: baseline-arm-clabbe 2026-04-16 07:04:24,303 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde6f4c2164e674d723d2f 2026-04-16 07:04:24,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:04:24,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde6f4c2164e674d723d2f HTTP/1.1" 200 None 2026-04-16 07:04:24,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:04:24,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-16 07:04:24,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:04:24,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde6f4c2164e674d723d2f HTTP/1.1" 200 None 2026-04-16 07:04:24,353 - lava_callback - ERROR - Error processing callback for node 69dde6f4c2164e674d723d2f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59334 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:05:24,291 - lava_callback - INFO - Received callback for node 69dde723c2164e674d723d49 INFO: 172.21.0.1:58944 - "POST /node/69dde723c2164e674d723d49 HTTP/1.0" 202 Accepted 2026-04-16 07:05:24,296 - lava_callback - INFO - Starting async job submit for node 69dde723c2164e674d723d49 2026-04-16 07:05:24,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:05:24,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde723c2164e674d723d49 HTTP/1.1" 200 None 2026-04-16 07:05:24,312 - lava_callback - DEBUG - Processing node 69dde723c2164e674d723d49: baseline-arm64-clabbe 2026-04-16 07:05:24,313 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde723c2164e674d723d49 2026-04-16 07:05:24,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:05:24,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde723c2164e674d723d49 HTTP/1.1" 200 None 2026-04-16 07:05:24,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:05:24,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd171917c944d2f17d8b46 HTTP/1.1" 200 None 2026-04-16 07:05:24,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:05:24,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde723c2164e674d723d49 HTTP/1.1" 200 None 2026-04-16 07:05:24,362 - lava_callback - ERROR - Error processing callback for node 69dde723c2164e674d723d49: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60170 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:06:24,359 - lava_callback - INFO - Received callback for node 69dde75cc2164e674d723da5 INFO: 172.21.0.1:33644 - "POST /node/69dde75cc2164e674d723da5 HTTP/1.0" 202 Accepted 2026-04-16 07:06:24,365 - lava_callback - INFO - Starting async job submit for node 69dde75cc2164e674d723da5 2026-04-16 07:06:24,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:06:24,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde75cc2164e674d723da5 HTTP/1.1" 200 None 2026-04-16 07:06:24,381 - lava_callback - DEBUG - Processing node 69dde75cc2164e674d723da5: baseline-arm-clabbe 2026-04-16 07:06:24,382 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde75cc2164e674d723da5 2026-04-16 07:06:24,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:06:24,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde75cc2164e674d723da5 HTTP/1.1" 200 None 2026-04-16 07:06:24,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:06:24,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 07:06:24,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:06:24,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde75cc2164e674d723da5 HTTP/1.1" 200 None 2026-04-16 07:06:24,457 - lava_callback - ERROR - Error processing callback for node 69dde75cc2164e674d723da5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41992 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:06:44,326 - lava_callback - INFO - Received callback for node 69dde77ac2164e674d723dce INFO: 172.21.0.1:39542 - "POST /node/69dde77ac2164e674d723dce HTTP/1.0" 202 Accepted 2026-04-16 07:06:44,331 - lava_callback - INFO - Starting async job submit for node 69dde77ac2164e674d723dce 2026-04-16 07:06:44,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:06:44,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde77ac2164e674d723dce HTTP/1.1" 200 None 2026-04-16 07:06:44,351 - lava_callback - DEBUG - Processing node 69dde77ac2164e674d723dce: baseline-arm-clabbe 2026-04-16 07:06:44,351 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde77ac2164e674d723dce 2026-04-16 07:06:44,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:06:44,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde77ac2164e674d723dce HTTP/1.1" 200 None 2026-04-16 07:06:44,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:06:44,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 07:06:44,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:06:44,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde77ac2164e674d723dce HTTP/1.1" 200 None 2026-04-16 07:06:44,400 - lava_callback - ERROR - Error processing callback for node 69dde77ac2164e674d723dce: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52564 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:07:24,400 - lava_callback - INFO - Received callback for node 69dde7a9c2164e674d723e0b INFO: 172.21.0.1:41392 - "POST /node/69dde7a9c2164e674d723e0b HTTP/1.0" 202 Accepted 2026-04-16 07:07:24,406 - lava_callback - INFO - Starting async job submit for node 69dde7a9c2164e674d723e0b 2026-04-16 07:07:24,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:07:24,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde7a9c2164e674d723e0b HTTP/1.1" 200 None 2026-04-16 07:07:24,422 - lava_callback - DEBUG - Processing node 69dde7a9c2164e674d723e0b: baseline-arm64-clabbe 2026-04-16 07:07:24,422 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde7a9c2164e674d723e0b 2026-04-16 07:07:24,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:07:24,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde7a9c2164e674d723e0b HTTP/1.1" 200 None 2026-04-16 07:07:24,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:07:24,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd171917c944d2f17d8b46 HTTP/1.1" 200 None 2026-04-16 07:07:24,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:07:24,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde7a9c2164e674d723e0b HTTP/1.1" 200 None 2026-04-16 07:07:24,478 - lava_callback - ERROR - Error processing callback for node 69dde7a9c2164e674d723e0b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49360 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53406 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:08:33,878 - lava_callback - INFO - Received callback for node 69dde7ddc2164e674d723e47 INFO: 172.21.0.1:56738 - "POST /node/69dde7ddc2164e674d723e47 HTTP/1.0" 202 Accepted 2026-04-16 07:08:33,884 - lava_callback - INFO - Starting async job submit for node 69dde7ddc2164e674d723e47 2026-04-16 07:08:33,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:08:33,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde7ddc2164e674d723e47 HTTP/1.1" 200 None 2026-04-16 07:08:33,900 - lava_callback - DEBUG - Processing node 69dde7ddc2164e674d723e47: baseline-arm-baylibre 2026-04-16 07:08:33,900 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde7ddc2164e674d723e47 2026-04-16 07:08:33,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:08:33,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde7ddc2164e674d723e47 HTTP/1.1" 200 None 2026-04-16 07:08:33,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:08:33,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 07:08:33,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:08:33,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde7ddc2164e674d723e47 HTTP/1.1" 200 None 2026-04-16 07:08:33,950 - lava_callback - ERROR - Error processing callback for node 69dde7ddc2164e674d723e47: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49132 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:09:04,429 - lava_callback - INFO - Received callback for node 69dde802c2164e674d723e89 INFO: 172.21.0.1:42624 - "POST /node/69dde802c2164e674d723e89 HTTP/1.0" 202 Accepted 2026-04-16 07:09:04,435 - lava_callback - INFO - Starting async job submit for node 69dde802c2164e674d723e89 2026-04-16 07:09:04,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:09:04,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde802c2164e674d723e89 HTTP/1.1" 200 None 2026-04-16 07:09:04,453 - lava_callback - DEBUG - Processing node 69dde802c2164e674d723e89: baseline-arm-clabbe 2026-04-16 07:09:04,454 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde802c2164e674d723e89 2026-04-16 07:09:04,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:09:04,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde802c2164e674d723e89 HTTP/1.1" 200 None 2026-04-16 07:09:04,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:09:04,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 07:09:04,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:09:04,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde802c2164e674d723e89 HTTP/1.1" 200 None 2026-04-16 07:09:04,503 - lava_callback - ERROR - Error processing callback for node 69dde802c2164e674d723e89: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57942 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36616 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:09:44,521 - lava_callback - INFO - Received callback for node 69dde823c2164e674d723ea7 INFO: 172.21.0.1:37380 - "POST /node/69dde823c2164e674d723ea7 HTTP/1.0" 202 Accepted 2026-04-16 07:09:44,527 - lava_callback - INFO - Starting async job submit for node 69dde823c2164e674d723ea7 2026-04-16 07:09:44,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:09:44,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde823c2164e674d723ea7 HTTP/1.1" 200 None 2026-04-16 07:09:44,544 - lava_callback - DEBUG - Processing node 69dde823c2164e674d723ea7: baseline-arm-clabbe 2026-04-16 07:09:44,544 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde823c2164e674d723ea7 2026-04-16 07:09:44,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:09:44,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde823c2164e674d723ea7 HTTP/1.1" 200 None 2026-04-16 07:09:44,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:09:44,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 07:09:44,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:09:44,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde823c2164e674d723ea7 HTTP/1.1" 200 None 2026-04-16 07:09:44,605 - lava_callback - ERROR - Error processing callback for node 69dde823c2164e674d723ea7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51074 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:15:44,744 - lava_callback - INFO - Received callback for node 69dde98fc2164e674d72404d INFO: 172.21.0.1:56712 - "POST /node/69dde98fc2164e674d72404d HTTP/1.0" 202 Accepted 2026-04-16 07:15:44,749 - lava_callback - INFO - Starting async job submit for node 69dde98fc2164e674d72404d 2026-04-16 07:15:44,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:15:44,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde98fc2164e674d72404d HTTP/1.1" 200 None 2026-04-16 07:15:44,766 - lava_callback - DEBUG - Processing node 69dde98fc2164e674d72404d: baseline-arm-clabbe 2026-04-16 07:15:44,766 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde98fc2164e674d72404d 2026-04-16 07:15:44,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:15:44,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde98fc2164e674d72404d HTTP/1.1" 200 None 2026-04-16 07:15:44,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:15:44,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 07:15:44,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:15:44,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde98fc2164e674d72404d HTTP/1.1" 200 None 2026-04-16 07:15:44,824 - lava_callback - ERROR - Error processing callback for node 69dde98fc2164e674d72404d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56570 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:16:14,316 - lava_callback - INFO - Received callback for node 69dde9adc2164e674d72406d INFO: 172.21.0.1:39288 - "POST /node/69dde9adc2164e674d72406d HTTP/1.0" 202 Accepted 2026-04-16 07:16:14,321 - lava_callback - INFO - Starting async job submit for node 69dde9adc2164e674d72406d 2026-04-16 07:16:14,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:16:14,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde9adc2164e674d72406d HTTP/1.1" 200 None 2026-04-16 07:16:14,338 - lava_callback - DEBUG - Processing node 69dde9adc2164e674d72406d: baseline-arm-baylibre 2026-04-16 07:16:14,338 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde9adc2164e674d72406d 2026-04-16 07:16:14,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:16:14,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde9adc2164e674d72406d HTTP/1.1" 200 None 2026-04-16 07:16:14,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:16:14,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 07:16:14,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:16:14,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde9adc2164e674d72406d HTTP/1.1" 200 None 2026-04-16 07:16:14,387 - lava_callback - ERROR - Error processing callback for node 69dde9adc2164e674d72406d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59392 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58726 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:17:34,409 - lava_callback - INFO - Received callback for node 69dde9fac2164e674d7240b6 INFO: 172.21.0.1:38970 - "POST /node/69dde9fac2164e674d7240b6 HTTP/1.0" 202 Accepted 2026-04-16 07:17:34,415 - lava_callback - INFO - Starting async job submit for node 69dde9fac2164e674d7240b6 2026-04-16 07:17:34,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:17:34,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde9fac2164e674d7240b6 HTTP/1.1" 200 None 2026-04-16 07:17:34,432 - lava_callback - DEBUG - Processing node 69dde9fac2164e674d7240b6: baseline-arm64-baylibre 2026-04-16 07:17:34,432 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dde9fac2164e674d7240b6 2026-04-16 07:17:34,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:17:34,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dde9fac2164e674d7240b6 HTTP/1.1" 200 None 2026-04-16 07:17:34,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:17:34,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-16 07:17:34,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:17:34,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dde9fac2164e674d7240b6 HTTP/1.1" 200 None 2026-04-16 07:17:34,480 - lava_callback - ERROR - Error processing callback for node 69dde9fac2164e674d7240b6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49952 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:18:54,485 - lava_callback - INFO - Received callback for node 69ddea49c2164e674d7240e9 INFO: 172.21.0.1:40312 - "POST /node/69ddea49c2164e674d7240e9 HTTP/1.0" 202 Accepted 2026-04-16 07:18:54,492 - lava_callback - INFO - Starting async job submit for node 69ddea49c2164e674d7240e9 2026-04-16 07:18:54,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:18:54,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddea49c2164e674d7240e9 HTTP/1.1" 200 None 2026-04-16 07:18:54,522 - lava_callback - DEBUG - Processing node 69ddea49c2164e674d7240e9: baseline-arm64-baylibre 2026-04-16 07:18:54,522 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddea49c2164e674d7240e9 2026-04-16 07:18:54,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:18:54,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddea49c2164e674d7240e9 HTTP/1.1" 200 None 2026-04-16 07:18:54,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:18:54,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-16 07:18:54,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:18:54,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddea49c2164e674d7240e9 HTTP/1.1" 200 None 2026-04-16 07:18:54,571 - lava_callback - ERROR - Error processing callback for node 69ddea49c2164e674d7240e9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55948 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:20:14,453 - lava_callback - INFO - Received callback for node 69ddea99c2164e674d72414c INFO: 172.21.0.1:41706 - "POST /node/69ddea99c2164e674d72414c HTTP/1.0" 202 Accepted 2026-04-16 07:20:14,461 - lava_callback - INFO - Starting async job submit for node 69ddea99c2164e674d72414c 2026-04-16 07:20:14,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:20:14,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddea99c2164e674d72414c HTTP/1.1" 200 None 2026-04-16 07:20:14,479 - lava_callback - DEBUG - Processing node 69ddea99c2164e674d72414c: baseline-arm64-baylibre 2026-04-16 07:20:14,479 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddea99c2164e674d72414c 2026-04-16 07:20:14,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:20:14,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddea99c2164e674d72414c HTTP/1.1" 200 None 2026-04-16 07:20:14,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:20:14,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-16 07:20:14,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:20:14,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddea99c2164e674d72414c HTTP/1.1" 200 None 2026-04-16 07:20:14,535 - lava_callback - ERROR - Error processing callback for node 69ddea99c2164e674d72414c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53210 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:22:24,930 - lava_callback - INFO - Received callback for node 69ddeb26c2164e674d7241d1 INFO: 172.21.0.1:54982 - "POST /node/69ddeb26c2164e674d7241d1 HTTP/1.0" 202 Accepted 2026-04-16 07:22:24,939 - lava_callback - INFO - Starting async job submit for node 69ddeb26c2164e674d7241d1 2026-04-16 07:22:24,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:22:24,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddeb26c2164e674d7241d1 HTTP/1.1" 200 None 2026-04-16 07:22:24,956 - lava_callback - DEBUG - Processing node 69ddeb26c2164e674d7241d1: baseline-arm-clabbe 2026-04-16 07:22:24,956 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddeb26c2164e674d7241d1 2026-04-16 07:22:24,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:22:24,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddeb26c2164e674d7241d1 HTTP/1.1" 200 None 2026-04-16 07:22:24,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:22:24,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 07:22:24,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:22:25,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddeb26c2164e674d7241d1 HTTP/1.1" 200 None 2026-04-16 07:22:25,022 - lava_callback - ERROR - Error processing callback for node 69ddeb26c2164e674d7241d1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56592 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:23:04,980 - lava_callback - INFO - Received callback for node 69ddeb48c2164e674d724213 INFO: 172.21.0.1:44466 - "POST /node/69ddeb48c2164e674d724213 HTTP/1.0" 202 Accepted 2026-04-16 07:23:04,986 - lava_callback - INFO - Starting async job submit for node 69ddeb48c2164e674d724213 2026-04-16 07:23:04,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:23:05,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddeb48c2164e674d724213 HTTP/1.1" 200 None 2026-04-16 07:23:05,002 - lava_callback - DEBUG - Processing node 69ddeb48c2164e674d724213: baseline-arm-clabbe 2026-04-16 07:23:05,003 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddeb48c2164e674d724213 2026-04-16 07:23:05,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:23:05,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddeb48c2164e674d724213 HTTP/1.1" 200 None 2026-04-16 07:23:05,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:23:05,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 07:23:05,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:23:05,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddeb48c2164e674d724213 HTTP/1.1" 200 None 2026-04-16 07:23:05,060 - lava_callback - ERROR - Error processing callback for node 69ddeb48c2164e674d724213: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60374 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58946 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:23:45,024 - lava_callback - INFO - Received callback for node 69ddeb78c2164e674d724227 INFO: 172.21.0.1:35190 - "POST /node/69ddeb78c2164e674d724227 HTTP/1.0" 202 Accepted 2026-04-16 07:23:45,030 - lava_callback - INFO - Starting async job submit for node 69ddeb78c2164e674d724227 2026-04-16 07:23:45,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:23:45,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddeb78c2164e674d724227 HTTP/1.1" 200 None 2026-04-16 07:23:45,050 - lava_callback - DEBUG - Processing node 69ddeb78c2164e674d724227: baseline-arm64-clabbe 2026-04-16 07:23:45,051 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddeb78c2164e674d724227 2026-04-16 07:23:45,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:23:45,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddeb78c2164e674d724227 HTTP/1.1" 200 None 2026-04-16 07:23:45,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:23:45,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-16 07:23:45,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:23:45,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddeb78c2164e674d724227 HTTP/1.1" 200 None 2026-04-16 07:23:45,106 - lava_callback - ERROR - Error processing callback for node 69ddeb78c2164e674d724227: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50488 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:25:05,128 - lava_callback - INFO - Received callback for node 69ddebc5c2164e674d724274 INFO: 172.21.0.1:45342 - "POST /node/69ddebc5c2164e674d724274 HTTP/1.0" 202 Accepted 2026-04-16 07:25:05,133 - lava_callback - INFO - Starting async job submit for node 69ddebc5c2164e674d724274 2026-04-16 07:25:05,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:25:05,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddebc5c2164e674d724274 HTTP/1.1" 200 None 2026-04-16 07:25:05,149 - lava_callback - DEBUG - Processing node 69ddebc5c2164e674d724274: baseline-arm64-clabbe 2026-04-16 07:25:05,150 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddebc5c2164e674d724274 2026-04-16 07:25:05,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:25:05,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddebc5c2164e674d724274 HTTP/1.1" 200 None 2026-04-16 07:25:05,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:25:05,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-16 07:25:05,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:25:05,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddebc5c2164e674d724274 HTTP/1.1" 200 None 2026-04-16 07:25:05,208 - lava_callback - ERROR - Error processing callback for node 69ddebc5c2164e674d724274: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35336 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39284 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39290 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:26:25,226 - lava_callback - INFO - Received callback for node 69ddec15c2164e674d7242b6 INFO: 172.21.0.1:46334 - "POST /node/69ddec15c2164e674d7242b6 HTTP/1.0" 202 Accepted 2026-04-16 07:26:25,234 - lava_callback - INFO - Starting async job submit for node 69ddec15c2164e674d7242b6 2026-04-16 07:26:25,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:26:25,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddec15c2164e674d7242b6 HTTP/1.1" 200 None 2026-04-16 07:26:25,260 - lava_callback - DEBUG - Processing node 69ddec15c2164e674d7242b6: baseline-arm64-clabbe 2026-04-16 07:26:25,260 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddec15c2164e674d7242b6 2026-04-16 07:26:25,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:26:25,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddec15c2164e674d7242b6 HTTP/1.1" 200 None 2026-04-16 07:26:25,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:26:25,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-16 07:26:25,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:26:25,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddec15c2164e674d7242b6 HTTP/1.1" 200 None 2026-04-16 07:26:25,329 - lava_callback - ERROR - Error processing callback for node 69ddec15c2164e674d7242b6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34148 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:27:45,232 - lava_callback - INFO - Received callback for node 69ddec64c2164e674d7242fc INFO: 172.21.0.1:34290 - "POST /node/69ddec64c2164e674d7242fc HTTP/1.0" 202 Accepted 2026-04-16 07:27:45,238 - lava_callback - INFO - Starting async job submit for node 69ddec64c2164e674d7242fc 2026-04-16 07:27:45,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:27:45,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddec64c2164e674d7242fc HTTP/1.1" 200 None 2026-04-16 07:27:45,253 - lava_callback - DEBUG - Processing node 69ddec64c2164e674d7242fc: baseline-arm64-clabbe 2026-04-16 07:27:45,253 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddec64c2164e674d7242fc 2026-04-16 07:27:45,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:27:45,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddec64c2164e674d7242fc HTTP/1.1" 200 None 2026-04-16 07:27:45,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:27:45,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-16 07:27:45,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:27:45,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddec64c2164e674d7242fc HTTP/1.1" 200 None 2026-04-16 07:27:45,309 - lava_callback - ERROR - Error processing callback for node 69ddec64c2164e674d7242fc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47274 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:29:05,322 - lava_callback - INFO - Received callback for node 69ddecafc2164e674d724351 INFO: 172.21.0.1:47494 - "POST /node/69ddecafc2164e674d724351 HTTP/1.0" 202 Accepted 2026-04-16 07:29:05,328 - lava_callback - INFO - Starting async job submit for node 69ddecafc2164e674d724351 2026-04-16 07:29:05,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:29:05,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddecafc2164e674d724351 HTTP/1.1" 200 None 2026-04-16 07:29:05,345 - lava_callback - DEBUG - Processing node 69ddecafc2164e674d724351: baseline-arm64-clabbe 2026-04-16 07:29:05,345 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddecafc2164e674d724351 2026-04-16 07:29:05,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:29:05,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddecafc2164e674d724351 HTTP/1.1" 200 None 2026-04-16 07:29:05,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:29:05,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-16 07:29:05,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:29:05,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddecafc2164e674d724351 HTTP/1.1" 200 None 2026-04-16 07:29:05,403 - lava_callback - ERROR - Error processing callback for node 69ddecafc2164e674d724351: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59708 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59720 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:30:25,334 - lava_callback - INFO - Received callback for node 69dded02c2164e674d72437f INFO: 172.21.0.1:47448 - "POST /node/69dded02c2164e674d72437f HTTP/1.0" 202 Accepted 2026-04-16 07:30:25,340 - lava_callback - INFO - Starting async job submit for node 69dded02c2164e674d72437f 2026-04-16 07:30:25,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:30:25,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dded02c2164e674d72437f HTTP/1.1" 200 None 2026-04-16 07:30:25,356 - lava_callback - DEBUG - Processing node 69dded02c2164e674d72437f: baseline-arm64-clabbe 2026-04-16 07:30:25,357 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dded02c2164e674d72437f 2026-04-16 07:30:25,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:30:25,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dded02c2164e674d72437f HTTP/1.1" 200 None 2026-04-16 07:30:25,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:30:25,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-16 07:30:25,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:30:25,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dded02c2164e674d72437f HTTP/1.1" 200 None 2026-04-16 07:30:25,409 - lava_callback - ERROR - Error processing callback for node 69dded02c2164e674d72437f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38958 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:31:25,360 - lava_callback - INFO - Received callback for node 69dded48c2164e674d7243ee INFO: 172.21.0.1:38604 - "POST /node/69dded48c2164e674d7243ee HTTP/1.0" 202 Accepted 2026-04-16 07:31:25,366 - lava_callback - INFO - Starting async job submit for node 69dded48c2164e674d7243ee 2026-04-16 07:31:25,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:31:25,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dded48c2164e674d7243ee HTTP/1.1" 200 None 2026-04-16 07:31:25,381 - lava_callback - DEBUG - Processing node 69dded48c2164e674d7243ee: baseline-arm64-clabbe 2026-04-16 07:31:25,381 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69dded48c2164e674d7243ee 2026-04-16 07:31:25,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:31:25,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dded48c2164e674d7243ee HTTP/1.1" 200 None 2026-04-16 07:31:25,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:31:25,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-16 07:31:25,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:31:25,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69dded48c2164e674d7243ee HTTP/1.1" 200 None 2026-04-16 07:31:25,437 - lava_callback - ERROR - Error processing callback for node 69dded48c2164e674d7243ee: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37726 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:33:05,422 - lava_callback - INFO - Received callback for node 69ddeda6c2164e674d72444e INFO: 172.21.0.1:54016 - "POST /node/69ddeda6c2164e674d72444e HTTP/1.0" 202 Accepted 2026-04-16 07:33:05,430 - lava_callback - INFO - Starting async job submit for node 69ddeda6c2164e674d72444e 2026-04-16 07:33:05,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:33:05,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddeda6c2164e674d72444e HTTP/1.1" 200 None 2026-04-16 07:33:05,458 - lava_callback - DEBUG - Processing node 69ddeda6c2164e674d72444e: baseline-arm-clabbe 2026-04-16 07:33:05,459 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddeda6c2164e674d72444e 2026-04-16 07:33:05,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:33:05,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddeda6c2164e674d72444e HTTP/1.1" 200 None 2026-04-16 07:33:05,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:33:05,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 07:33:05,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:33:05,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddeda6c2164e674d72444e HTTP/1.1" 200 None 2026-04-16 07:33:05,516 - lava_callback - ERROR - Error processing callback for node 69ddeda6c2164e674d72444e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36254 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:33:45,409 - lava_callback - INFO - Received callback for node 69ddedcac2164e674d724465 INFO: 172.21.0.1:59086 - "POST /node/69ddedcac2164e674d724465 HTTP/1.0" 202 Accepted 2026-04-16 07:33:45,415 - lava_callback - INFO - Starting async job submit for node 69ddedcac2164e674d724465 2026-04-16 07:33:45,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:33:45,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddedcac2164e674d724465 HTTP/1.1" 200 None 2026-04-16 07:33:45,432 - lava_callback - DEBUG - Processing node 69ddedcac2164e674d724465: baseline-arm-clabbe 2026-04-16 07:33:45,432 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddedcac2164e674d724465 2026-04-16 07:33:45,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:33:45,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddedcac2164e674d724465 HTTP/1.1" 200 None 2026-04-16 07:33:45,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:33:45,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 07:33:45,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:33:45,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddedcac2164e674d724465 HTTP/1.1" 200 None 2026-04-16 07:33:45,484 - lava_callback - ERROR - Error processing callback for node 69ddedcac2164e674d724465: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40974 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:34:45,515 - lava_callback - INFO - Received callback for node 69ddee06c2164e674d7244a7 INFO: 172.21.0.1:37148 - "POST /node/69ddee06c2164e674d7244a7 HTTP/1.0" 202 Accepted 2026-04-16 07:34:45,521 - lava_callback - INFO - Starting async job submit for node 69ddee06c2164e674d7244a7 2026-04-16 07:34:45,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:34:45,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddee06c2164e674d7244a7 HTTP/1.1" 200 None 2026-04-16 07:34:45,538 - lava_callback - DEBUG - Processing node 69ddee06c2164e674d7244a7: baseline-arm-clabbe 2026-04-16 07:34:45,538 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddee06c2164e674d7244a7 2026-04-16 07:34:45,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:34:45,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddee06c2164e674d7244a7 HTTP/1.1" 200 None 2026-04-16 07:34:45,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:34:45,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 07:34:45,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:34:45,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddee06c2164e674d7244a7 HTTP/1.1" 200 None 2026-04-16 07:34:45,596 - lava_callback - ERROR - Error processing callback for node 69ddee06c2164e674d7244a7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36652 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:35:05,516 - lava_callback - INFO - Received callback for node 69ddee24c2164e674d7244eb INFO: 172.21.0.1:38346 - "POST /node/69ddee24c2164e674d7244eb HTTP/1.0" 202 Accepted 2026-04-16 07:35:05,525 - lava_callback - INFO - Starting async job submit for node 69ddee24c2164e674d7244eb 2026-04-16 07:35:05,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:35:05,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddee24c2164e674d7244eb HTTP/1.1" 200 None 2026-04-16 07:35:05,543 - lava_callback - DEBUG - Processing node 69ddee24c2164e674d7244eb: baseline-arm-clabbe 2026-04-16 07:35:05,543 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddee24c2164e674d7244eb 2026-04-16 07:35:05,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:35:05,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddee24c2164e674d7244eb HTTP/1.1" 200 None 2026-04-16 07:35:05,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:35:05,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 07:35:05,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:35:05,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddee24c2164e674d7244eb HTTP/1.1" 200 None 2026-04-16 07:35:05,603 - lava_callback - ERROR - Error processing callback for node 69ddee24c2164e674d7244eb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56614 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:35:45,510 - lava_callback - INFO - Received callback for node 69ddee45c2164e674d724517 INFO: 172.21.0.1:47304 - "POST /node/69ddee45c2164e674d724517 HTTP/1.0" 202 Accepted 2026-04-16 07:35:45,517 - lava_callback - INFO - Starting async job submit for node 69ddee45c2164e674d724517 2026-04-16 07:35:45,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:35:45,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddee45c2164e674d724517 HTTP/1.1" 200 None 2026-04-16 07:35:45,539 - lava_callback - DEBUG - Processing node 69ddee45c2164e674d724517: baseline-arm-clabbe 2026-04-16 07:35:45,539 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddee45c2164e674d724517 2026-04-16 07:35:45,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:35:45,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddee45c2164e674d724517 HTTP/1.1" 200 None 2026-04-16 07:35:45,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:35:45,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-16 07:35:45,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:35:45,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddee45c2164e674d724517 HTTP/1.1" 200 None 2026-04-16 07:35:45,601 - lava_callback - ERROR - Error processing callback for node 69ddee45c2164e674d724517: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37374 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:36:25,525 - lava_callback - INFO - Received callback for node 69ddee6ac2164e674d724538 INFO: 172.21.0.1:53490 - "POST /node/69ddee6ac2164e674d724538 HTTP/1.0" 202 Accepted 2026-04-16 07:36:25,530 - lava_callback - INFO - Starting async job submit for node 69ddee6ac2164e674d724538 2026-04-16 07:36:25,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:36:25,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddee6ac2164e674d724538 HTTP/1.1" 200 None 2026-04-16 07:36:25,547 - lava_callback - DEBUG - Processing node 69ddee6ac2164e674d724538: baseline-arm-clabbe 2026-04-16 07:36:25,547 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddee6ac2164e674d724538 2026-04-16 07:36:25,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:36:25,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddee6ac2164e674d724538 HTTP/1.1" 200 None 2026-04-16 07:36:25,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:36:25,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 07:36:25,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:36:25,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddee6ac2164e674d724538 HTTP/1.1" 200 None 2026-04-16 07:36:25,610 - lava_callback - ERROR - Error processing callback for node 69ddee6ac2164e674d724538: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37878 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:37:05,616 - lava_callback - INFO - Received callback for node 69ddee8bc2164e674d724546 INFO: 172.21.0.1:39336 - "POST /node/69ddee8bc2164e674d724546 HTTP/1.0" 202 Accepted 2026-04-16 07:37:05,626 - lava_callback - INFO - Starting async job submit for node 69ddee8bc2164e674d724546 2026-04-16 07:37:05,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:37:05,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddee8bc2164e674d724546 HTTP/1.1" 200 None 2026-04-16 07:37:05,642 - lava_callback - DEBUG - Processing node 69ddee8bc2164e674d724546: baseline-arm-clabbe 2026-04-16 07:37:05,642 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddee8bc2164e674d724546 2026-04-16 07:37:05,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:37:05,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddee8bc2164e674d724546 HTTP/1.1" 200 None 2026-04-16 07:37:05,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:37:05,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 07:37:05,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:37:05,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddee8bc2164e674d724546 HTTP/1.1" 200 None 2026-04-16 07:37:05,700 - lava_callback - ERROR - Error processing callback for node 69ddee8bc2164e674d724546: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58362 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:37:25,565 - lava_callback - INFO - Received callback for node 69ddeeaac2164e674d724572 INFO: 172.21.0.1:36698 - "POST /node/69ddeeaac2164e674d724572 HTTP/1.0" 202 Accepted 2026-04-16 07:37:25,571 - lava_callback - INFO - Starting async job submit for node 69ddeeaac2164e674d724572 2026-04-16 07:37:25,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:37:25,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddeeaac2164e674d724572 HTTP/1.1" 200 None 2026-04-16 07:37:25,587 - lava_callback - DEBUG - Processing node 69ddeeaac2164e674d724572: baseline-arm-clabbe 2026-04-16 07:37:25,587 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddeeaac2164e674d724572 2026-04-16 07:37:25,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:37:25,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddeeaac2164e674d724572 HTTP/1.1" 200 None 2026-04-16 07:37:25,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:37:25,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 07:37:25,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:37:25,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddeeaac2164e674d724572 HTTP/1.1" 200 None 2026-04-16 07:37:25,635 - lava_callback - ERROR - Error processing callback for node 69ddeeaac2164e674d724572: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38972 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:38:05,619 - lava_callback - INFO - Received callback for node 69ddeecfc2164e674d7245a9 INFO: 172.21.0.1:55422 - "POST /node/69ddeecfc2164e674d7245a9 HTTP/1.0" 202 Accepted 2026-04-16 07:38:05,625 - lava_callback - INFO - Starting async job submit for node 69ddeecfc2164e674d7245a9 2026-04-16 07:38:05,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:38:05,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddeecfc2164e674d7245a9 HTTP/1.1" 200 None 2026-04-16 07:38:05,677 - lava_callback - DEBUG - Processing node 69ddeecfc2164e674d7245a9: baseline-arm-clabbe 2026-04-16 07:38:05,678 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddeecfc2164e674d7245a9 2026-04-16 07:38:05,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:38:05,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddeecfc2164e674d7245a9 HTTP/1.1" 200 None 2026-04-16 07:38:05,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:38:05,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-16 07:38:05,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:38:05,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddeecfc2164e674d7245a9 HTTP/1.1" 200 None 2026-04-16 07:38:05,731 - lava_callback - ERROR - Error processing callback for node 69ddeecfc2164e674d7245a9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39212 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:38:45,650 - lava_callback - INFO - Received callback for node 69ddeeefc2164e674d7245d2 INFO: 172.21.0.1:45220 - "POST /node/69ddeeefc2164e674d7245d2 HTTP/1.0" 202 Accepted 2026-04-16 07:38:45,656 - lava_callback - INFO - Starting async job submit for node 69ddeeefc2164e674d7245d2 2026-04-16 07:38:45,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:38:45,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddeeefc2164e674d7245d2 HTTP/1.1" 200 None 2026-04-16 07:38:45,674 - lava_callback - DEBUG - Processing node 69ddeeefc2164e674d7245d2: baseline-arm-clabbe 2026-04-16 07:38:45,675 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddeeefc2164e674d7245d2 2026-04-16 07:38:45,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:38:45,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddeeefc2164e674d7245d2 HTTP/1.1" 200 None 2026-04-16 07:38:45,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:38:45,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-16 07:38:45,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:38:45,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddeeefc2164e674d7245d2 HTTP/1.1" 200 None 2026-04-16 07:38:45,736 - lava_callback - ERROR - Error processing callback for node 69ddeeefc2164e674d7245d2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39790 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:39:05,679 - lava_callback - INFO - Received callback for node 69ddef14c2164e674d7245e6 INFO: 172.21.0.1:49778 - "POST /node/69ddef14c2164e674d7245e6 HTTP/1.0" 202 Accepted 2026-04-16 07:39:05,688 - lava_callback - INFO - Starting async job submit for node 69ddef14c2164e674d7245e6 2026-04-16 07:39:05,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:39:05,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddef14c2164e674d7245e6 HTTP/1.1" 200 None 2026-04-16 07:39:05,706 - lava_callback - DEBUG - Processing node 69ddef14c2164e674d7245e6: baseline-arm-clabbe 2026-04-16 07:39:05,706 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddef14c2164e674d7245e6 2026-04-16 07:39:05,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:39:05,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddef14c2164e674d7245e6 HTTP/1.1" 200 None 2026-04-16 07:39:05,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:39:05,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 07:39:05,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:39:05,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddef14c2164e674d7245e6 HTTP/1.1" 200 None 2026-04-16 07:39:05,775 - lava_callback - ERROR - Error processing callback for node 69ddef14c2164e674d7245e6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44328 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:39:45,669 - lava_callback - INFO - Received callback for node 69ddef36c2164e674d724602 INFO: 172.21.0.1:53532 - "POST /node/69ddef36c2164e674d724602 HTTP/1.0" 202 Accepted 2026-04-16 07:39:45,678 - lava_callback - INFO - Starting async job submit for node 69ddef36c2164e674d724602 2026-04-16 07:39:45,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:39:45,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddef36c2164e674d724602 HTTP/1.1" 200 None 2026-04-16 07:39:45,719 - lava_callback - DEBUG - Processing node 69ddef36c2164e674d724602: baseline-arm-clabbe 2026-04-16 07:39:45,719 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddef36c2164e674d724602 2026-04-16 07:39:45,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:39:45,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddef36c2164e674d724602 HTTP/1.1" 200 None 2026-04-16 07:39:45,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:39:45,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 07:39:45,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:39:45,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddef36c2164e674d724602 HTTP/1.1" 200 None 2026-04-16 07:39:45,778 - lava_callback - ERROR - Error processing callback for node 69ddef36c2164e674d724602: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47090 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:40:25,759 - lava_callback - INFO - Received callback for node 69ddef58c2164e674d72461f INFO: 172.21.0.1:53342 - "POST /node/69ddef58c2164e674d72461f HTTP/1.0" 202 Accepted 2026-04-16 07:40:25,765 - lava_callback - INFO - Starting async job submit for node 69ddef58c2164e674d72461f 2026-04-16 07:40:25,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:40:25,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddef58c2164e674d72461f HTTP/1.1" 200 None 2026-04-16 07:40:25,781 - lava_callback - DEBUG - Processing node 69ddef58c2164e674d72461f: baseline-arm-clabbe 2026-04-16 07:40:25,781 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddef58c2164e674d72461f 2026-04-16 07:40:25,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:40:25,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddef58c2164e674d72461f HTTP/1.1" 200 None 2026-04-16 07:40:25,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:40:25,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-16 07:40:25,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:40:25,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddef58c2164e674d72461f HTTP/1.1" 200 None 2026-04-16 07:40:25,841 - lava_callback - ERROR - Error processing callback for node 69ddef58c2164e674d72461f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51834 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:40:45,738 - lava_callback - INFO - Received callback for node 69ddef78c2164e674d724642 INFO: 172.21.0.1:51618 - "POST /node/69ddef78c2164e674d724642 HTTP/1.0" 202 Accepted 2026-04-16 07:40:45,747 - lava_callback - INFO - Starting async job submit for node 69ddef78c2164e674d724642 2026-04-16 07:40:45,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:40:45,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddef78c2164e674d724642 HTTP/1.1" 200 None 2026-04-16 07:40:45,763 - lava_callback - DEBUG - Processing node 69ddef78c2164e674d724642: baseline-arm-clabbe 2026-04-16 07:40:45,763 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddef78c2164e674d724642 2026-04-16 07:40:45,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:40:45,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddef78c2164e674d724642 HTTP/1.1" 200 None 2026-04-16 07:40:45,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:40:45,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 07:40:45,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:40:45,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddef78c2164e674d724642 HTTP/1.1" 200 None 2026-04-16 07:40:45,833 - lava_callback - ERROR - Error processing callback for node 69ddef78c2164e674d724642: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44970 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44982 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:41:25,757 - lava_callback - INFO - Received callback for node 69ddef9ac2164e674d724676 INFO: 172.21.0.1:37128 - "POST /node/69ddef9ac2164e674d724676 HTTP/1.0" 202 Accepted 2026-04-16 07:41:25,766 - lava_callback - INFO - Starting async job submit for node 69ddef9ac2164e674d724676 2026-04-16 07:41:25,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:41:25,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddef9ac2164e674d724676 HTTP/1.1" 200 None 2026-04-16 07:41:25,783 - lava_callback - DEBUG - Processing node 69ddef9ac2164e674d724676: baseline-arm-clabbe 2026-04-16 07:41:25,783 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddef9ac2164e674d724676 2026-04-16 07:41:25,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:41:25,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddef9ac2164e674d724676 HTTP/1.1" 200 None 2026-04-16 07:41:25,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:41:25,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-16 07:41:25,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:41:25,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddef9ac2164e674d724676 HTTP/1.1" 200 None 2026-04-16 07:41:25,847 - lava_callback - ERROR - Error processing callback for node 69ddef9ac2164e674d724676: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59704 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:42:05,761 - lava_callback - INFO - Received callback for node 69ddefbac2164e674d7246b1 INFO: 172.21.0.1:48670 - "POST /node/69ddefbac2164e674d7246b1 HTTP/1.0" 202 Accepted 2026-04-16 07:42:05,767 - lava_callback - INFO - Starting async job submit for node 69ddefbac2164e674d7246b1 2026-04-16 07:42:05,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:42:05,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddefbac2164e674d7246b1 HTTP/1.1" 200 None 2026-04-16 07:42:05,788 - lava_callback - DEBUG - Processing node 69ddefbac2164e674d7246b1: baseline-arm-clabbe 2026-04-16 07:42:05,788 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddefbac2164e674d7246b1 2026-04-16 07:42:05,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:42:05,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddefbac2164e674d7246b1 HTTP/1.1" 200 None 2026-04-16 07:42:05,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:42:05,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-16 07:42:05,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:42:05,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddefbac2164e674d7246b1 HTTP/1.1" 200 None 2026-04-16 07:42:05,858 - lava_callback - ERROR - Error processing callback for node 69ddefbac2164e674d7246b1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59654 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:42:25,813 - lava_callback - INFO - Received callback for node 69ddefd8c2164e674d7246e5 INFO: 172.21.0.1:34228 - "POST /node/69ddefd8c2164e674d7246e5 HTTP/1.0" 202 Accepted 2026-04-16 07:42:25,823 - lava_callback - INFO - Starting async job submit for node 69ddefd8c2164e674d7246e5 2026-04-16 07:42:25,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:42:25,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddefd8c2164e674d7246e5 HTTP/1.1" 200 None 2026-04-16 07:42:25,840 - lava_callback - DEBUG - Processing node 69ddefd8c2164e674d7246e5: baseline-arm-clabbe 2026-04-16 07:42:25,840 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddefd8c2164e674d7246e5 2026-04-16 07:42:25,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:42:25,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddefd8c2164e674d7246e5 HTTP/1.1" 200 None 2026-04-16 07:42:25,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:42:25,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 07:42:25,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:42:25,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddefd8c2164e674d7246e5 HTTP/1.1" 200 None 2026-04-16 07:42:25,902 - lava_callback - ERROR - Error processing callback for node 69ddefd8c2164e674d7246e5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48960 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:43:05,810 - lava_callback - INFO - Received callback for node 69ddeffcc2164e674d7246fe INFO: 172.21.0.1:35462 - "POST /node/69ddeffcc2164e674d7246fe HTTP/1.0" 202 Accepted 2026-04-16 07:43:05,820 - lava_callback - INFO - Starting async job submit for node 69ddeffcc2164e674d7246fe 2026-04-16 07:43:05,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:43:05,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddeffcc2164e674d7246fe HTTP/1.1" 200 None 2026-04-16 07:43:05,837 - lava_callback - DEBUG - Processing node 69ddeffcc2164e674d7246fe: baseline-arm-clabbe 2026-04-16 07:43:05,837 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddeffcc2164e674d7246fe 2026-04-16 07:43:05,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:43:05,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddeffcc2164e674d7246fe HTTP/1.1" 200 None 2026-04-16 07:43:05,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:43:05,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-16 07:43:05,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:43:05,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddeffcc2164e674d7246fe HTTP/1.1" 200 None 2026-04-16 07:43:05,896 - lava_callback - ERROR - Error processing callback for node 69ddeffcc2164e674d7246fe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54002 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:43:45,890 - lava_callback - INFO - Received callback for node 69ddf01dc2164e674d724716 INFO: 172.21.0.1:44644 - "POST /node/69ddf01dc2164e674d724716 HTTP/1.0" 202 Accepted 2026-04-16 07:43:45,896 - lava_callback - INFO - Starting async job submit for node 69ddf01dc2164e674d724716 2026-04-16 07:43:45,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:43:45,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf01dc2164e674d724716 HTTP/1.1" 200 None 2026-04-16 07:43:45,912 - lava_callback - DEBUG - Processing node 69ddf01dc2164e674d724716: baseline-arm-clabbe 2026-04-16 07:43:45,912 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddf01dc2164e674d724716 2026-04-16 07:43:45,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:43:45,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf01dc2164e674d724716 HTTP/1.1" 200 None 2026-04-16 07:43:45,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:43:45,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-16 07:43:45,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:43:45,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddf01dc2164e674d724716 HTTP/1.1" 200 None 2026-04-16 07:43:45,960 - lava_callback - ERROR - Error processing callback for node 69ddf01dc2164e674d724716: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60288 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:44:05,809 - lava_callback - INFO - Received callback for node 69ddf03ec2164e674d724733 INFO: 172.21.0.1:37078 - "POST /node/69ddf03ec2164e674d724733 HTTP/1.0" 202 Accepted 2026-04-16 07:44:05,815 - lava_callback - INFO - Starting async job submit for node 69ddf03ec2164e674d724733 2026-04-16 07:44:05,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:44:05,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf03ec2164e674d724733 HTTP/1.1" 200 None 2026-04-16 07:44:05,838 - lava_callback - DEBUG - Processing node 69ddf03ec2164e674d724733: baseline-arm-clabbe 2026-04-16 07:44:05,838 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddf03ec2164e674d724733 2026-04-16 07:44:05,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:44:05,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf03ec2164e674d724733 HTTP/1.1" 200 None 2026-04-16 07:44:05,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:44:05,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae47d0a04df09a44e84f8 HTTP/1.1" 200 None 2026-04-16 07:44:05,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:44:05,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddf03ec2164e674d724733 HTTP/1.1" 200 None 2026-04-16 07:44:05,915 - lava_callback - ERROR - Error processing callback for node 69ddf03ec2164e674d724733: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50468 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:44:45,883 - lava_callback - INFO - Received callback for node 69ddf060c2164e674d72474e INFO: 172.21.0.1:48184 - "POST /node/69ddf060c2164e674d72474e HTTP/1.0" 202 Accepted 2026-04-16 07:44:45,891 - lava_callback - INFO - Starting async job submit for node 69ddf060c2164e674d72474e 2026-04-16 07:44:45,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:44:45,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf060c2164e674d72474e HTTP/1.1" 200 None 2026-04-16 07:44:45,914 - lava_callback - DEBUG - Processing node 69ddf060c2164e674d72474e: baseline-arm-clabbe 2026-04-16 07:44:45,914 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddf060c2164e674d72474e 2026-04-16 07:44:45,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:44:45,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf060c2164e674d72474e HTTP/1.1" 200 None 2026-04-16 07:44:45,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:44:45,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 07:44:45,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:44:45,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddf060c2164e674d72474e HTTP/1.1" 200 None 2026-04-16 07:44:45,964 - lava_callback - ERROR - Error processing callback for node 69ddf060c2164e674d72474e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48698 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-16 07:45:15,996 - lava_callback - INFO - Received callback for node 69ddf086c2164e674d72476c INFO: 172.21.0.1:48704 - "POST /node/69ddf086c2164e674d72476c HTTP/1.0" 202 Accepted 2026-04-16 07:45:16,003 - lava_callback - INFO - Starting async job submit for node 69ddf086c2164e674d72476c 2026-04-16 07:45:16,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:45:16,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf086c2164e674d72476c HTTP/1.1" 200 None 2026-04-16 07:45:16,027 - lava_callback - DEBUG - Processing node 69ddf086c2164e674d72476c: baseline-arm64-baylibre 2026-04-16 07:45:16,027 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddf086c2164e674d72476c 2026-04-16 07:45:16,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:45:16,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf086c2164e674d72476c HTTP/1.1" 200 None 2026-04-16 07:45:16,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:45:16,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d841b2b28893fa2e230976 HTTP/1.1" 200 None 2026-04-16 07:45:16,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:45:16,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddf086c2164e674d72476c HTTP/1.1" 200 None 2026-04-16 07:45:16,091 - lava_callback - ERROR - Error processing callback for node 69ddf086c2164e674d72476c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45438 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:46:35,961 - lava_callback - INFO - Received callback for node 69ddf0cfc2164e674d7247dc INFO: 172.21.0.1:45916 - "POST /node/69ddf0cfc2164e674d7247dc HTTP/1.0" 202 Accepted 2026-04-16 07:46:35,967 - lava_callback - INFO - Starting async job submit for node 69ddf0cfc2164e674d7247dc 2026-04-16 07:46:35,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:46:35,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf0cfc2164e674d7247dc HTTP/1.1" 200 None 2026-04-16 07:46:35,987 - lava_callback - DEBUG - Processing node 69ddf0cfc2164e674d7247dc: baseline-arm64-baylibre 2026-04-16 07:46:35,988 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddf0cfc2164e674d7247dc 2026-04-16 07:46:35,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:46:36,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf0cfc2164e674d7247dc HTTP/1.1" 200 None 2026-04-16 07:46:36,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:46:36,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d841b2b28893fa2e230976 HTTP/1.1" 200 None 2026-04-16 07:46:36,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:46:36,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddf0cfc2164e674d7247dc HTTP/1.1" 200 None 2026-04-16 07:46:36,045 - lava_callback - ERROR - Error processing callback for node 69ddf0cfc2164e674d7247dc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48686 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:47:46,044 - lava_callback - INFO - Received callback for node 69ddf115c2164e674d724812 INFO: 172.21.0.1:54010 - "POST /node/69ddf115c2164e674d724812 HTTP/1.0" 202 Accepted 2026-04-16 07:47:46,052 - lava_callback - INFO - Starting async job submit for node 69ddf115c2164e674d724812 2026-04-16 07:47:46,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:47:46,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf115c2164e674d724812 HTTP/1.1" 200 None 2026-04-16 07:47:46,087 - lava_callback - DEBUG - Processing node 69ddf115c2164e674d724812: baseline-arm-clabbe 2026-04-16 07:47:46,087 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddf115c2164e674d724812 2026-04-16 07:47:46,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:47:46,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf115c2164e674d724812 HTTP/1.1" 200 None 2026-04-16 07:47:46,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:47:46,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 07:47:46,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:47:46,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddf115c2164e674d724812 HTTP/1.1" 200 None 2026-04-16 07:47:46,140 - lava_callback - ERROR - Error processing callback for node 69ddf115c2164e674d724812: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59456 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-16 07:48:16,007 - lava_callback - INFO - Received callback for node 69ddf13dc2164e674d724838 INFO: 172.21.0.1:59464 - "POST /node/69ddf13dc2164e674d724838 HTTP/1.0" 202 Accepted 2026-04-16 07:48:16,018 - lava_callback - INFO - Starting async job submit for node 69ddf13dc2164e674d724838 2026-04-16 07:48:16,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:48:16,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf13dc2164e674d724838 HTTP/1.1" 200 None 2026-04-16 07:48:16,048 - lava_callback - DEBUG - Processing node 69ddf13dc2164e674d724838: baseline-arm64-baylibre 2026-04-16 07:48:16,048 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddf13dc2164e674d724838 2026-04-16 07:48:16,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:48:16,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf13dc2164e674d724838 HTTP/1.1" 200 None 2026-04-16 07:48:16,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:48:16,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d841b2b28893fa2e230976 HTTP/1.1" 200 None 2026-04-16 07:48:16,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:48:16,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddf13dc2164e674d724838 HTTP/1.1" 200 None 2026-04-16 07:48:16,108 - lava_callback - ERROR - Error processing callback for node 69ddf13dc2164e674d724838: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32896 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:49:26,094 - lava_callback - INFO - Received callback for node 69ddf17dc2164e674d724899 INFO: 172.21.0.1:60040 - "POST /node/69ddf17dc2164e674d724899 HTTP/1.0" 202 Accepted 2026-04-16 07:49:26,103 - lava_callback - INFO - Starting async job submit for node 69ddf17dc2164e674d724899 2026-04-16 07:49:26,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:49:26,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf17dc2164e674d724899 HTTP/1.1" 200 None 2026-04-16 07:49:26,131 - lava_callback - DEBUG - Processing node 69ddf17dc2164e674d724899: baseline-arm-clabbe 2026-04-16 07:49:26,132 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddf17dc2164e674d724899 2026-04-16 07:49:26,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:49:26,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf17dc2164e674d724899 HTTP/1.1" 200 None 2026-04-16 07:49:26,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:49:26,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 07:49:26,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:49:26,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddf17dc2164e674d724899 HTTP/1.1" 200 None 2026-04-16 07:49:26,189 - lava_callback - ERROR - Error processing callback for node 69ddf17dc2164e674d724899: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50180 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:50:06,160 - lava_callback - INFO - Received callback for node 69ddf19ec2164e674d7248c4 INFO: 172.21.0.1:55208 - "POST /node/69ddf19ec2164e674d7248c4 HTTP/1.0" 202 Accepted 2026-04-16 07:50:06,166 - lava_callback - INFO - Starting async job submit for node 69ddf19ec2164e674d7248c4 2026-04-16 07:50:06,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:50:06,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf19ec2164e674d7248c4 HTTP/1.1" 200 None 2026-04-16 07:50:06,182 - lava_callback - DEBUG - Processing node 69ddf19ec2164e674d7248c4: baseline-arm-clabbe 2026-04-16 07:50:06,182 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddf19ec2164e674d7248c4 2026-04-16 07:50:06,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:50:06,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf19ec2164e674d7248c4 HTTP/1.1" 200 None 2026-04-16 07:50:06,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:50:06,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 07:50:06,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:50:06,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddf19ec2164e674d7248c4 HTTP/1.1" 200 None 2026-04-16 07:50:06,283 - lava_callback - ERROR - Error processing callback for node 69ddf19ec2164e674d7248c4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46602 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:50:26,181 - lava_callback - INFO - Received callback for node 69ddf1bec2164e674d7248e6 INFO: 172.21.0.1:47652 - "POST /node/69ddf1bec2164e674d7248e6 HTTP/1.0" 202 Accepted 2026-04-16 07:50:26,191 - lava_callback - INFO - Starting async job submit for node 69ddf1bec2164e674d7248e6 2026-04-16 07:50:26,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:50:26,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf1bec2164e674d7248e6 HTTP/1.1" 200 None 2026-04-16 07:50:26,206 - lava_callback - DEBUG - Processing node 69ddf1bec2164e674d7248e6: baseline-arm-clabbe 2026-04-16 07:50:26,207 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddf1bec2164e674d7248e6 2026-04-16 07:50:26,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:50:26,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf1bec2164e674d7248e6 HTTP/1.1" 200 None 2026-04-16 07:50:26,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:50:26,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 07:50:26,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:50:26,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddf1bec2164e674d7248e6 HTTP/1.1" 200 None 2026-04-16 07:50:26,256 - lava_callback - ERROR - Error processing callback for node 69ddf1bec2164e674d7248e6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44596 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:52:36,200 - lava_callback - INFO - Received callback for node 69ddf231c2164e674d724956 INFO: 172.21.0.1:42858 - "POST /node/69ddf231c2164e674d724956 HTTP/1.0" 202 Accepted 2026-04-16 07:52:36,208 - lava_callback - INFO - Starting async job submit for node 69ddf231c2164e674d724956 2026-04-16 07:52:36,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:42864 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:52:36,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf231c2164e674d724956 HTTP/1.1" 200 None 2026-04-16 07:52:36,230 - lava_callback - DEBUG - Processing node 69ddf231c2164e674d724956: baseline-arm64-baylibre 2026-04-16 07:52:36,230 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddf231c2164e674d724956 2026-04-16 07:52:36,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:52:36,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf231c2164e674d724956 HTTP/1.1" 200 None 2026-04-16 07:52:36,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:52:36,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-16 07:52:36,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:52:36,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddf231c2164e674d724956 HTTP/1.1" 200 None 2026-04-16 07:52:36,300 - lava_callback - ERROR - Error processing callback for node 69ddf231c2164e674d724956: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39056 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:53:46,282 - lava_callback - INFO - Received callback for node 69ddf27dc2164e674d724980 INFO: 172.21.0.1:40626 - "POST /node/69ddf27dc2164e674d724980 HTTP/1.0" 202 Accepted 2026-04-16 07:53:46,290 - lava_callback - INFO - Starting async job submit for node 69ddf27dc2164e674d724980 2026-04-16 07:53:46,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:53:46,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf27dc2164e674d724980 HTTP/1.1" 200 None 2026-04-16 07:53:46,317 - lava_callback - DEBUG - Processing node 69ddf27dc2164e674d724980: baseline-arm-clabbe 2026-04-16 07:53:46,317 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddf27dc2164e674d724980 2026-04-16 07:53:46,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:53:46,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf27dc2164e674d724980 HTTP/1.1" 200 None 2026-04-16 07:53:46,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:53:46,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 07:53:46,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:53:46,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddf27dc2164e674d724980 HTTP/1.1" 200 None 2026-04-16 07:53:46,384 - lava_callback - ERROR - Error processing callback for node 69ddf27dc2164e674d724980: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37374 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37390 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:54:26,272 - lava_callback - INFO - Received callback for node 69ddf2a0c2164e674d724992 INFO: 172.21.0.1:40702 - "POST /node/69ddf2a0c2164e674d724992 HTTP/1.0" 202 Accepted 2026-04-16 07:54:26,278 - lava_callback - INFO - Starting async job submit for node 69ddf2a0c2164e674d724992 2026-04-16 07:54:26,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:54:26,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf2a0c2164e674d724992 HTTP/1.1" 200 None 2026-04-16 07:54:26,300 - lava_callback - DEBUG - Processing node 69ddf2a0c2164e674d724992: baseline-arm-clabbe 2026-04-16 07:54:26,300 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddf2a0c2164e674d724992 2026-04-16 07:54:26,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:54:26,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf2a0c2164e674d724992 HTTP/1.1" 200 None 2026-04-16 07:54:26,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:54:26,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 07:54:26,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:54:26,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddf2a0c2164e674d724992 HTTP/1.1" 200 None 2026-04-16 07:54:26,369 - lava_callback - ERROR - Error processing callback for node 69ddf2a0c2164e674d724992: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40422 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:54:56,387 - lava_callback - INFO - Received callback for node 69ddf2c6c2164e674d7249c5 INFO: 172.21.0.1:37078 - "POST /node/69ddf2c6c2164e674d7249c5 HTTP/1.0" 202 Accepted 2026-04-16 07:54:56,394 - lava_callback - INFO - Starting async job submit for node 69ddf2c6c2164e674d7249c5 2026-04-16 07:54:56,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:54:56,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf2c6c2164e674d7249c5 HTTP/1.1" 200 None 2026-04-16 07:54:56,416 - lava_callback - DEBUG - Processing node 69ddf2c6c2164e674d7249c5: baseline-arm64-baylibre 2026-04-16 07:54:56,416 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddf2c6c2164e674d7249c5 2026-04-16 07:54:56,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:54:56,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf2c6c2164e674d7249c5 HTTP/1.1" 200 None 2026-04-16 07:54:56,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:54:56,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-16 07:54:56,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:54:56,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddf2c6c2164e674d7249c5 HTTP/1.1" 200 None 2026-04-16 07:54:56,481 - lava_callback - ERROR - Error processing callback for node 69ddf2c6c2164e674d7249c5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54956 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:56:06,364 - lava_callback - INFO - Received callback for node 69ddf30cc2164e674d724a04 INFO: 172.21.0.1:51902 - "POST /node/69ddf30cc2164e674d724a04 HTTP/1.0" 202 Accepted 2026-04-16 07:56:06,370 - lava_callback - INFO - Starting async job submit for node 69ddf30cc2164e674d724a04 2026-04-16 07:56:06,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:56:06,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf30cc2164e674d724a04 HTTP/1.1" 200 None 2026-04-16 07:56:06,386 - lava_callback - DEBUG - Processing node 69ddf30cc2164e674d724a04: baseline-arm-clabbe 2026-04-16 07:56:06,387 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddf30cc2164e674d724a04 2026-04-16 07:56:06,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:56:06,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf30cc2164e674d724a04 HTTP/1.1" 200 None 2026-04-16 07:56:06,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:56:06,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d8419eb28893fa2e230963 HTTP/1.1" 200 None 2026-04-16 07:56:06,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:56:06,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddf30cc2164e674d724a04 HTTP/1.1" 200 None 2026-04-16 07:56:06,452 - lava_callback - ERROR - Error processing callback for node 69ddf30cc2164e674d724a04: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42742 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:56:56,509 - lava_callback - INFO - Received callback for node 69ddf335c2164e674d724a2d INFO: 172.21.0.1:60720 - "POST /node/69ddf335c2164e674d724a2d HTTP/1.0" 202 Accepted 2026-04-16 07:56:56,515 - lava_callback - INFO - Starting async job submit for node 69ddf335c2164e674d724a2d 2026-04-16 07:56:56,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:60722 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:56:56,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf335c2164e674d724a2d HTTP/1.1" 200 None 2026-04-16 07:56:56,536 - lava_callback - DEBUG - Processing node 69ddf335c2164e674d724a2d: baseline-arm64-baylibre 2026-04-16 07:56:56,537 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddf335c2164e674d724a2d 2026-04-16 07:56:56,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:56:56,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf335c2164e674d724a2d HTTP/1.1" 200 None 2026-04-16 07:56:56,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:56:56,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-16 07:56:56,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:56:56,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddf335c2164e674d724a2d HTTP/1.1" 200 None 2026-04-16 07:56:56,585 - lava_callback - ERROR - Error processing callback for node 69ddf335c2164e674d724a2d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41416 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:57:56,513 - lava_callback - INFO - Received callback for node 69ddf383c2164e674d724a66 INFO: 172.21.0.1:41192 - "POST /node/69ddf383c2164e674d724a66 HTTP/1.0" 202 Accepted 2026-04-16 07:57:56,519 - lava_callback - INFO - Starting async job submit for node 69ddf383c2164e674d724a66 2026-04-16 07:57:56,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:41200 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:57:56,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf383c2164e674d724a66 HTTP/1.1" 200 None 2026-04-16 07:57:56,536 - lava_callback - DEBUG - Processing node 69ddf383c2164e674d724a66: baseline-arm64-baylibre 2026-04-16 07:57:56,536 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddf383c2164e674d724a66 2026-04-16 07:57:56,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:57:56,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf383c2164e674d724a66 HTTP/1.1" 200 None 2026-04-16 07:57:56,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:57:56,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-16 07:57:56,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:57:56,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddf383c2164e674d724a66 HTTP/1.1" 200 None 2026-04-16 07:57:56,587 - lava_callback - ERROR - Error processing callback for node 69ddf383c2164e674d724a66: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49800 - "GET / HTTP/1.0" 200 OK 2026-04-16 07:59:26,589 - lava_callback - INFO - Received callback for node 69ddf3d5c2164e674d724abf INFO: 172.21.0.1:49806 - "POST /node/69ddf3d5c2164e674d724abf HTTP/1.0" 202 Accepted 2026-04-16 07:59:26,595 - lava_callback - INFO - Starting async job submit for node 69ddf3d5c2164e674d724abf 2026-04-16 07:59:26,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:59:26,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf3d5c2164e674d724abf HTTP/1.1" 200 None 2026-04-16 07:59:26,610 - lava_callback - DEBUG - Processing node 69ddf3d5c2164e674d724abf: baseline-arm64-clabbe 2026-04-16 07:59:26,610 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddf3d5c2164e674d724abf 2026-04-16 07:59:26,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:59:26,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf3d5c2164e674d724abf HTTP/1.1" 200 None 2026-04-16 07:59:26,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:59:26,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-16 07:59:26,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 07:59:26,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddf3d5c2164e674d724abf HTTP/1.1" 200 None 2026-04-16 07:59:26,669 - lava_callback - ERROR - Error processing callback for node 69ddf3d5c2164e674d724abf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36266 - "GET /node/698c5088755d7811a41414dc%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:36268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48242 - "GET / HTTP/1.0" 200 OK 2026-04-16 08:00:46,710 - lava_callback - INFO - Received callback for node 69ddf421c2164e674d724af9 INFO: 172.21.0.1:48252 - "POST /node/69ddf421c2164e674d724af9 HTTP/1.0" 202 Accepted 2026-04-16 08:00:46,720 - lava_callback - INFO - Starting async job submit for node 69ddf421c2164e674d724af9 2026-04-16 08:00:46,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 08:00:46,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf421c2164e674d724af9 HTTP/1.1" 200 None 2026-04-16 08:00:46,738 - lava_callback - DEBUG - Processing node 69ddf421c2164e674d724af9: baseline-arm64-clabbe 2026-04-16 08:00:46,738 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddf421c2164e674d724af9 2026-04-16 08:00:46,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 08:00:46,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf421c2164e674d724af9 HTTP/1.1" 200 None 2026-04-16 08:00:46,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 08:00:46,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-16 08:00:46,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 08:00:46,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddf421c2164e674d724af9 HTTP/1.1" 200 None 2026-04-16 08:00:46,793 - lava_callback - ERROR - Error processing callback for node 69ddf421c2164e674d724af9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57434 - "GET /node/693b7ec641fb4c95097640c0%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:57436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57546 - "GET /node/6910cb87699dbc4cda8e2fac%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:50506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43032 - "GET / HTTP/1.0" 200 OK 2026-04-16 08:02:06,716 - lava_callback - INFO - Received callback for node 69ddf46ec2164e674d724b46 INFO: 172.21.0.1:43038 - "POST /node/69ddf46ec2164e674d724b46 HTTP/1.0" 202 Accepted 2026-04-16 08:02:06,722 - lava_callback - INFO - Starting async job submit for node 69ddf46ec2164e674d724b46 2026-04-16 08:02:06,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 08:02:06,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf46ec2164e674d724b46 HTTP/1.1" 200 None 2026-04-16 08:02:06,738 - lava_callback - DEBUG - Processing node 69ddf46ec2164e674d724b46: baseline-arm64-clabbe 2026-04-16 08:02:06,738 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddf46ec2164e674d724b46 2026-04-16 08:02:06,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 08:02:06,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf46ec2164e674d724b46 HTTP/1.1" 200 None 2026-04-16 08:02:06,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 08:02:06,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-16 08:02:06,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 08:02:06,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddf46ec2164e674d724b46 HTTP/1.1" 200 None 2026-04-16 08:02:06,869 - lava_callback - ERROR - Error processing callback for node 69ddf46ec2164e674d724b46: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37514 - "GET /node/693e79ef3c8f1be6d3cf07a4%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:37524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54930 - "GET /node/693e25b2407f32424eb57d6f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:54944 - "GET / HTTP/1.0" 200 OK 2026-04-16 08:03:26,749 - lava_callback - INFO - Received callback for node 69ddf4b9c2164e674d724b94 INFO: 172.21.0.1:54950 - "POST /node/69ddf4b9c2164e674d724b94 HTTP/1.0" 202 Accepted 2026-04-16 08:03:26,755 - lava_callback - INFO - Starting async job submit for node 69ddf4b9c2164e674d724b94 2026-04-16 08:03:26,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 08:03:26,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf4b9c2164e674d724b94 HTTP/1.1" 200 None 2026-04-16 08:03:26,771 - lava_callback - DEBUG - Processing node 69ddf4b9c2164e674d724b94: baseline-arm64-clabbe 2026-04-16 08:03:26,771 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddf4b9c2164e674d724b94 2026-04-16 08:03:26,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 08:03:26,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf4b9c2164e674d724b94 HTTP/1.1" 200 None 2026-04-16 08:03:26,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 08:03:26,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-16 08:03:26,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 08:03:26,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddf4b9c2164e674d724b94 HTTP/1.1" 200 None 2026-04-16 08:03:26,820 - lava_callback - ERROR - Error processing callback for node 69ddf4b9c2164e674d724b94: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53294 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50620 - "GET /node/69840be0969566dcb0d2bc30%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:50632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39002 - "GET / HTTP/1.0" 200 OK 2026-04-16 08:04:46,794 - lava_callback - INFO - Received callback for node 69ddf514c2164e674d724bc1 INFO: 172.21.0.1:39006 - "POST /node/69ddf514c2164e674d724bc1 HTTP/1.0" 202 Accepted 2026-04-16 08:04:46,804 - lava_callback - INFO - Starting async job submit for node 69ddf514c2164e674d724bc1 2026-04-16 08:04:46,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 08:04:46,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf514c2164e674d724bc1 HTTP/1.1" 200 None 2026-04-16 08:04:46,821 - lava_callback - DEBUG - Processing node 69ddf514c2164e674d724bc1: baseline-arm64-clabbe 2026-04-16 08:04:46,822 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddf514c2164e674d724bc1 2026-04-16 08:04:46,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 08:04:46,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf514c2164e674d724bc1 HTTP/1.1" 200 None 2026-04-16 08:04:46,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 08:04:46,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-16 08:04:46,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 08:04:46,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddf514c2164e674d724bc1 HTTP/1.1" 200 None 2026-04-16 08:04:46,881 - lava_callback - ERROR - Error processing callback for node 69ddf514c2164e674d724bc1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40736 - "GET / HTTP/1.0" 200 OK 2026-04-16 08:06:06,832 - lava_callback - INFO - Received callback for node 69ddf55dc2164e674d724c13 INFO: 172.21.0.1:40742 - "POST /node/69ddf55dc2164e674d724c13 HTTP/1.0" 202 Accepted 2026-04-16 08:06:06,837 - lava_callback - INFO - Starting async job submit for node 69ddf55dc2164e674d724c13 2026-04-16 08:06:06,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 08:06:06,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf55dc2164e674d724c13 HTTP/1.1" 200 None 2026-04-16 08:06:06,853 - lava_callback - DEBUG - Processing node 69ddf55dc2164e674d724c13: baseline-arm64-clabbe 2026-04-16 08:06:06,853 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddf55dc2164e674d724c13 2026-04-16 08:06:06,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 08:06:06,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf55dc2164e674d724c13 HTTP/1.1" 200 None 2026-04-16 08:06:06,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 08:06:06,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-16 08:06:06,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 08:06:06,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddf55dc2164e674d724c13 HTTP/1.1" 200 None 2026-04-16 08:06:06,902 - lava_callback - ERROR - Error processing callback for node 69ddf55dc2164e674d724c13: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49124 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60498 - "GET /node/69927f2798a8bdb31c395259%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:52912 - "GET /node/6992811798a8bdb31c395a13%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:52924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42594 - "GET / HTTP/1.0" 200 OK 2026-04-16 08:07:26,899 - lava_callback - INFO - Received callback for node 69ddf5abc2164e674d724c53 INFO: 172.21.0.1:42606 - "POST /node/69ddf5abc2164e674d724c53 HTTP/1.0" 202 Accepted 2026-04-16 08:07:26,905 - lava_callback - INFO - Starting async job submit for node 69ddf5abc2164e674d724c53 2026-04-16 08:07:26,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 08:07:26,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf5abc2164e674d724c53 HTTP/1.1" 200 None 2026-04-16 08:07:26,925 - lava_callback - DEBUG - Processing node 69ddf5abc2164e674d724c53: baseline-arm64-clabbe 2026-04-16 08:07:26,926 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddf5abc2164e674d724c53 2026-04-16 08:07:26,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 08:07:26,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf5abc2164e674d724c53 HTTP/1.1" 200 None 2026-04-16 08:07:26,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 08:07:26,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-16 08:07:26,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 08:07:26,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddf5abc2164e674d724c53 HTTP/1.1" 200 None 2026-04-16 08:07:26,980 - lava_callback - ERROR - Error processing callback for node 69ddf5abc2164e674d724c53: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41868 - "GET /node/69830f3a409235c29c0de6fd%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:41878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50342 - "GET /node/698a2b0d22b4cc0f227afc98%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:50344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38442 - "GET / HTTP/1.0" 200 OK 2026-04-16 08:10:57,307 - lava_callback - INFO - Received callback for node 69ddf682c2164e674d724d19 INFO: 172.21.0.1:38444 - "POST /node/69ddf682c2164e674d724d19 HTTP/1.0" 202 Accepted 2026-04-16 08:10:57,313 - lava_callback - INFO - Starting async job submit for node 69ddf682c2164e674d724d19 2026-04-16 08:10:57,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 08:10:57,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf682c2164e674d724d19 HTTP/1.1" 200 None 2026-04-16 08:10:57,329 - lava_callback - DEBUG - Processing node 69ddf682c2164e674d724d19: baseline-arm64-baylibre 2026-04-16 08:10:57,329 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddf682c2164e674d724d19 2026-04-16 08:10:57,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 08:10:57,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf682c2164e674d724d19 HTTP/1.1" 200 None 2026-04-16 08:10:57,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 08:10:57,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-16 08:10:57,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 08:10:57,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddf682c2164e674d724d19 HTTP/1.1" 200 None 2026-04-16 08:10:57,380 - lava_callback - ERROR - Error processing callback for node 69ddf682c2164e674d724d19: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33060 - "GET /node/698b93920a16aea5a0dc90b2%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:33066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36058 - "GET / HTTP/1.0" 200 OK 2026-04-16 08:11:57,297 - lava_callback - INFO - Received callback for node 69ddf6c9c2164e674d724d85 INFO: 172.21.0.1:36064 - "POST /node/69ddf6c9c2164e674d724d85 HTTP/1.0" 202 Accepted 2026-04-16 08:11:57,303 - lava_callback - INFO - Starting async job submit for node 69ddf6c9c2164e674d724d85 2026-04-16 08:11:57,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 08:11:57,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf6c9c2164e674d724d85 HTTP/1.1" 200 None 2026-04-16 08:11:57,320 - lava_callback - DEBUG - Processing node 69ddf6c9c2164e674d724d85: baseline-arm64-baylibre 2026-04-16 08:11:57,320 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ddf6c9c2164e674d724d85 2026-04-16 08:11:57,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 08:11:57,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ddf6c9c2164e674d724d85 HTTP/1.1" 200 None 2026-04-16 08:11:57,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 08:11:57,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dae4890a04df09a44e8507 HTTP/1.1" 200 None 2026-04-16 08:11:57,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-16 08:11:57,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ddf6c9c2164e674d724d85 HTTP/1.1" 200 None 2026-04-16 08:11:57,381 - lava_callback - ERROR - Error processing callback for node 69ddf6c9c2164e674d724d85: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 118, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43942 - "GET / HTTP/1.0" 200 OK INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1]