INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.21.0.1:59566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46536 - "GET / HTTP/1.0" 200 OK 2026-04-22 00:15:21,804 - lava_callback - INFO - Received callback for node 69e57013213831324628731b 2026-04-22 00:15:21,811 - lava_callback - INFO - Starting async job submit for node 69e57013213831324628731b INFO: 172.21.0.1:45040 - "POST /node/69e57013213831324628731b HTTP/1.0" 202 Accepted 2026-04-22 00:15:21,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:15:21,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e57013213831324628731b HTTP/1.1" 200 None 2026-04-22 00:15:21,833 - lava_callback - DEBUG - Processing node 69e57013213831324628731b: baseline-arm64-baylibre 2026-04-22 00:15:21,834 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e57013213831324628731b 2026-04-22 00:15:21,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:15:21,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e57013213831324628731b HTTP/1.1" 200 None 2026-04-22 00:15:21,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:15:21,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25ccc1863655daa998bbc HTTP/1.1" 200 None 2026-04-22 00:15:21,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:15:21,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e57013213831324628731b HTTP/1.1" 200 None 2026-04-22 00:15:21,897 - lava_callback - ERROR - Error processing callback for node 69e57013213831324628731b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56692 - "GET / HTTP/1.0" 200 OK 2026-04-22 00:16:41,681 - lava_callback - INFO - Received callback for node 69e570602138313246287341 INFO: 172.21.0.1:52646 - "POST /node/69e570602138313246287341 HTTP/1.0" 202 Accepted 2026-04-22 00:16:41,694 - lava_callback - INFO - Starting async job submit for node 69e570602138313246287341 2026-04-22 00:16:41,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:16:41,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e570602138313246287341 HTTP/1.1" 200 None 2026-04-22 00:16:41,712 - lava_callback - DEBUG - Processing node 69e570602138313246287341: baseline-arm64-baylibre 2026-04-22 00:16:41,712 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e570602138313246287341 2026-04-22 00:16:41,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:16:41,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e570602138313246287341 HTTP/1.1" 200 None INFO: 172.21.0.1:52654 - "GET / HTTP/1.0" 200 OK 2026-04-22 00:16:41,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:16:41,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25ccc1863655daa998bbc HTTP/1.1" 200 None 2026-04-22 00:16:41,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:16:41,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e570602138313246287341 HTTP/1.1" 200 None 2026-04-22 00:16:41,779 - lava_callback - ERROR - Error processing callback for node 69e570602138313246287341: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40116 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55852 - "GET / HTTP/1.0" 200 OK 2026-04-22 00:18:01,898 - lava_callback - INFO - Received callback for node 69e570ad2138313246287387 INFO: 172.21.0.1:51204 - "POST /node/69e570ad2138313246287387 HTTP/1.0" 202 Accepted 2026-04-22 00:18:01,906 - lava_callback - INFO - Starting async job submit for node 69e570ad2138313246287387 2026-04-22 00:18:01,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:18:01,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e570ad2138313246287387 HTTP/1.1" 200 None 2026-04-22 00:18:01,932 - lava_callback - DEBUG - Processing node 69e570ad2138313246287387: baseline-arm64-baylibre 2026-04-22 00:18:01,932 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e570ad2138313246287387 2026-04-22 00:18:01,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:18:01,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e570ad2138313246287387 HTTP/1.1" 200 None 2026-04-22 00:18:01,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:18:02,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25ccc1863655daa998bbc HTTP/1.1" 200 None 2026-04-22 00:18:02,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:18:02,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e570ad2138313246287387 HTTP/1.1" 200 None 2026-04-22 00:18:02,071 - lava_callback - ERROR - Error processing callback for node 69e570ad2138313246287387: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58540 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58554 - "GET / HTTP/1.0" 200 OK 2026-04-22 00:19:21,908 - lava_callback - INFO - Received callback for node 69e570fc21383132462873c9 INFO: 172.21.0.1:45714 - "POST /node/69e570fc21383132462873c9 HTTP/1.0" 202 Accepted 2026-04-22 00:19:21,914 - lava_callback - INFO - Starting async job submit for node 69e570fc21383132462873c9 2026-04-22 00:19:21,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:19:21,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e570fc21383132462873c9 HTTP/1.1" 200 None 2026-04-22 00:19:21,945 - lava_callback - DEBUG - Processing node 69e570fc21383132462873c9: baseline-arm64-baylibre 2026-04-22 00:19:21,945 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e570fc21383132462873c9 2026-04-22 00:19:21,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:19:21,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e570fc21383132462873c9 HTTP/1.1" 200 None 2026-04-22 00:19:21,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:19:21,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25ccc1863655daa998bbc HTTP/1.1" 200 None 2026-04-22 00:19:21,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:19:21,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e570fc21383132462873c9 HTTP/1.1" 200 None 2026-04-22 00:19:21,992 - lava_callback - ERROR - Error processing callback for node 69e570fc21383132462873c9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48006 - "GET / HTTP/1.0" 200 OK 2026-04-22 00:20:41,989 - lava_callback - INFO - Received callback for node 69e5714c21383132462873e6 INFO: 172.21.0.1:48016 - "POST /node/69e5714c21383132462873e6 HTTP/1.0" 202 Accepted 2026-04-22 00:20:41,994 - lava_callback - INFO - Starting async job submit for node 69e5714c21383132462873e6 2026-04-22 00:20:41,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:20:42,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5714c21383132462873e6 HTTP/1.1" 200 None 2026-04-22 00:20:42,020 - lava_callback - DEBUG - Processing node 69e5714c21383132462873e6: baseline-arm64-baylibre 2026-04-22 00:20:42,020 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5714c21383132462873e6 2026-04-22 00:20:42,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:20:42,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5714c21383132462873e6 HTTP/1.1" 200 None 2026-04-22 00:20:42,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:20:42,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25ccc1863655daa998bbc HTTP/1.1" 200 None 2026-04-22 00:20:42,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:20:42,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5714c21383132462873e6 HTTP/1.1" 200 None 2026-04-22 00:20:42,071 - lava_callback - ERROR - Error processing callback for node 69e5714c21383132462873e6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41310 - "GET / HTTP/1.0" 200 OK 2026-04-22 00:22:02,023 - lava_callback - INFO - Received callback for node 69e5719a2138313246287407 INFO: 172.21.0.1:35902 - "POST /node/69e5719a2138313246287407 HTTP/1.0" 202 Accepted 2026-04-22 00:22:02,029 - lava_callback - INFO - Starting async job submit for node 69e5719a2138313246287407 2026-04-22 00:22:02,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:22:02,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5719a2138313246287407 HTTP/1.1" 200 None 2026-04-22 00:22:02,045 - lava_callback - DEBUG - Processing node 69e5719a2138313246287407: baseline-arm64-baylibre 2026-04-22 00:22:02,045 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5719a2138313246287407 2026-04-22 00:22:02,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:22:02,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5719a2138313246287407 HTTP/1.1" 200 None 2026-04-22 00:22:02,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:22:02,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25ccc1863655daa998bbc HTTP/1.1" 200 None 2026-04-22 00:22:02,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:22:02,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5719a2138313246287407 HTTP/1.1" 200 None 2026-04-22 00:22:02,105 - lava_callback - ERROR - Error processing callback for node 69e5719a2138313246287407: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46184 - "GET / HTTP/1.0" 200 OK 2026-04-22 00:23:13,563 - lava_callback - INFO - Received callback for node 69e571ee213831324628742b INFO: 172.21.0.1:56434 - "POST /node/69e571ee213831324628742b HTTP/1.0" 202 Accepted 2026-04-22 00:23:13,570 - lava_callback - INFO - Starting async job submit for node 69e571ee213831324628742b 2026-04-22 00:23:13,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:23:13,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e571ee213831324628742b HTTP/1.1" 200 None 2026-04-22 00:23:13,587 - lava_callback - DEBUG - Processing node 69e571ee213831324628742b: baseline-arm64-clabbe 2026-04-22 00:23:13,587 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e571ee213831324628742b 2026-04-22 00:23:13,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:23:13,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e571ee213831324628742b HTTP/1.1" 200 None 2026-04-22 00:23:13,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:23:13,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25ccc1863655daa998bbc HTTP/1.1" 200 None 2026-04-22 00:23:13,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:23:13,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e571ee213831324628742b HTTP/1.1" 200 None 2026-04-22 00:23:13,641 - lava_callback - ERROR - Error processing callback for node 69e571ee213831324628742b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56436 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56086 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57384 - "GET / HTTP/1.0" 200 OK 2026-04-22 00:24:33,555 - lava_callback - INFO - Received callback for node 69e5723c2138313246287446 INFO: 172.21.0.1:60400 - "POST /node/69e5723c2138313246287446 HTTP/1.0" 202 Accepted 2026-04-22 00:24:33,561 - lava_callback - INFO - Starting async job submit for node 69e5723c2138313246287446 2026-04-22 00:24:33,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:24:33,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5723c2138313246287446 HTTP/1.1" 200 None 2026-04-22 00:24:33,584 - lava_callback - DEBUG - Processing node 69e5723c2138313246287446: baseline-arm64-clabbe 2026-04-22 00:24:33,584 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5723c2138313246287446 2026-04-22 00:24:33,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:24:33,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5723c2138313246287446 HTTP/1.1" 200 None 2026-04-22 00:24:33,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:24:33,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25ccc1863655daa998bbc HTTP/1.1" 200 None 2026-04-22 00:24:33,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:24:33,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5723c2138313246287446 HTTP/1.1" 200 None 2026-04-22 00:24:33,630 - lava_callback - ERROR - Error processing callback for node 69e5723c2138313246287446: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54174 - "GET / HTTP/1.0" 200 OK 2026-04-22 00:25:53,578 - lava_callback - INFO - Received callback for node 69e5728b2138313246287468 INFO: 172.21.0.1:60114 - "POST /node/69e5728b2138313246287468 HTTP/1.0" 202 Accepted 2026-04-22 00:25:53,584 - lava_callback - INFO - Starting async job submit for node 69e5728b2138313246287468 2026-04-22 00:25:53,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:25:53,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5728b2138313246287468 HTTP/1.1" 200 None 2026-04-22 00:25:53,600 - lava_callback - DEBUG - Processing node 69e5728b2138313246287468: baseline-arm64-clabbe 2026-04-22 00:25:53,600 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5728b2138313246287468 2026-04-22 00:25:53,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:25:53,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5728b2138313246287468 HTTP/1.1" 200 None 2026-04-22 00:25:53,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:25:53,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25ccc1863655daa998bbc HTTP/1.1" 200 None 2026-04-22 00:25:53,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:25:53,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5728b2138313246287468 HTTP/1.1" 200 None 2026-04-22 00:25:53,647 - lava_callback - ERROR - Error processing callback for node 69e5728b2138313246287468: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44550 - "GET / HTTP/1.0" 200 OK 2026-04-22 00:27:13,623 - lava_callback - INFO - Received callback for node 69e572d82138313246287491 INFO: 172.21.0.1:51798 - "POST /node/69e572d82138313246287491 HTTP/1.0" 202 Accepted 2026-04-22 00:27:13,629 - lava_callback - INFO - Starting async job submit for node 69e572d82138313246287491 2026-04-22 00:27:13,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:27:13,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e572d82138313246287491 HTTP/1.1" 200 None 2026-04-22 00:27:13,645 - lava_callback - DEBUG - Processing node 69e572d82138313246287491: baseline-arm64-clabbe 2026-04-22 00:27:13,645 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e572d82138313246287491 2026-04-22 00:27:13,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:27:13,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e572d82138313246287491 HTTP/1.1" 200 None 2026-04-22 00:27:13,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:27:13,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25ccc1863655daa998bbc HTTP/1.1" 200 None 2026-04-22 00:27:13,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:27:13,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e572d82138313246287491 HTTP/1.1" 200 None 2026-04-22 00:27:13,692 - lava_callback - ERROR - Error processing callback for node 69e572d82138313246287491: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39934 - "GET / HTTP/1.0" 200 OK 2026-04-22 00:28:33,700 - lava_callback - INFO - Received callback for node 69e573292138313246289b81 INFO: 172.21.0.1:40692 - "POST /node/69e573292138313246289b81 HTTP/1.0" 202 Accepted 2026-04-22 00:28:33,705 - lava_callback - INFO - Starting async job submit for node 69e573292138313246289b81 2026-04-22 00:28:33,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:28:33,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e573292138313246289b81 HTTP/1.1" 200 None 2026-04-22 00:28:33,721 - lava_callback - DEBUG - Processing node 69e573292138313246289b81: baseline-arm64-clabbe 2026-04-22 00:28:33,721 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e573292138313246289b81 2026-04-22 00:28:33,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:28:33,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e573292138313246289b81 HTTP/1.1" 200 None 2026-04-22 00:28:33,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:28:33,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25ccc1863655daa998bbc HTTP/1.1" 200 None 2026-04-22 00:28:33,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:28:33,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e573292138313246289b81 HTTP/1.1" 200 None 2026-04-22 00:28:33,769 - lava_callback - ERROR - Error processing callback for node 69e573292138313246289b81: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41786 - "GET / HTTP/1.0" 200 OK 2026-04-22 00:29:36,201 - lava_callback - INFO - Received callback for node 69e815f8afb86e738cacfcf1 INFO: 172.21.0.1:38780 - "POST /node/69e815f8afb86e738cacfcf1 HTTP/1.0" 202 Accepted 2026-04-22 00:29:36,207 - lava_callback - INFO - Starting async job submit for node 69e815f8afb86e738cacfcf1 2026-04-22 00:29:36,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:29:36,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e815f8afb86e738cacfcf1 HTTP/1.1" 200 None 2026-04-22 00:29:36,245 - lava_callback - DEBUG - Processing node 69e815f8afb86e738cacfcf1: baseline-arm 2026-04-22 00:29:36,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:38794 - "GET / HTTP/1.0" 200 OK 2026-04-22 00:29:36,574 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:29:36,576 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e815f8afb86e738cacfcf1/log.txt.gz 2026-04-22 00:29:36,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:29:36,812 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:29:36,814 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e815f8afb86e738cacfcf1/lava-logs.yaml 2026-04-22 00:29:36,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:29:36,916 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:29:36,918 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e815f8afb86e738cacfcf1/lava_callback.json.gz 2026-04-22 00:29:36,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:29:36,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e815f8afb86e738cacfcf1 HTTP/1.1" 200 None 2026-04-22 00:29:36,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:29:36,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813a3afb86e738cacfb99 HTTP/1.1" 200 None 2026-04-22 00:29:36,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:29:37,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e815f8afb86e738cacfcf1 HTTP/1.1" 200 None 2026-04-22 00:29:37,003 - lava_callback - INFO - Completed processing callback for node 69e815f8afb86e738cacfcf1 INFO: 172.21.0.1:34908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34924 - "GET / HTTP/1.0" 200 OK 2026-04-22 00:29:51,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:29:51,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-22 00:29:53,771 - lava_callback - INFO - Received callback for node 69e573772138313246289ba9 INFO: 172.21.0.1:43702 - "POST /node/69e573772138313246289ba9 HTTP/1.0" 202 Accepted 2026-04-22 00:29:53,777 - lava_callback - INFO - Starting async job submit for node 69e573772138313246289ba9 2026-04-22 00:29:53,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:29:53,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e573772138313246289ba9 HTTP/1.1" 200 None 2026-04-22 00:29:53,793 - lava_callback - DEBUG - Processing node 69e573772138313246289ba9: baseline-arm64-clabbe 2026-04-22 00:29:53,793 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e573772138313246289ba9 2026-04-22 00:29:53,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:29:53,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e573772138313246289ba9 HTTP/1.1" 200 None 2026-04-22 00:29:53,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:29:53,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25ccc1863655daa998bbc HTTP/1.1" 200 None 2026-04-22 00:29:53,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:29:53,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e573772138313246289ba9 HTTP/1.1" 200 None 2026-04-22 00:29:53,848 - lava_callback - ERROR - Error processing callback for node 69e573772138313246289ba9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45220 - "GET / HTTP/1.0" 200 OK 2026-04-22 00:31:13,839 - lava_callback - INFO - Received callback for node 69e573c52138313246289bc6 INFO: 172.21.0.1:42350 - "POST /node/69e573c52138313246289bc6 HTTP/1.0" 202 Accepted 2026-04-22 00:31:13,845 - lava_callback - INFO - Starting async job submit for node 69e573c52138313246289bc6 2026-04-22 00:31:13,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:31:13,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e573c52138313246289bc6 HTTP/1.1" 200 None 2026-04-22 00:31:13,864 - lava_callback - DEBUG - Processing node 69e573c52138313246289bc6: baseline-arm64-clabbe 2026-04-22 00:31:13,864 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e573c52138313246289bc6 2026-04-22 00:31:13,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:31:13,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e573c52138313246289bc6 HTTP/1.1" 200 None 2026-04-22 00:31:13,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:31:13,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25ccc1863655daa998bbc HTTP/1.1" 200 None 2026-04-22 00:31:13,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:31:13,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e573c52138313246289bc6 HTTP/1.1" 200 None 2026-04-22 00:31:13,922 - lava_callback - ERROR - Error processing callback for node 69e573c52138313246289bc6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60058 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37712 - "GET / HTTP/1.0" 200 OK 2026-04-22 00:36:20,480 - lava_callback - INFO - Received callback for node 69e817f8afb86e738cacfe31 INFO: 172.21.0.1:47366 - "POST /node/69e817f8afb86e738cacfe31 HTTP/1.0" 202 Accepted 2026-04-22 00:36:20,486 - lava_callback - INFO - Starting async job submit for node 69e817f8afb86e738cacfe31 2026-04-22 00:36:20,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:36:20,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e817f8afb86e738cacfe31 HTTP/1.1" 200 None 2026-04-22 00:36:20,505 - lava_callback - DEBUG - Processing node 69e817f8afb86e738cacfe31: baseline-arm 2026-04-22 00:36:20,510 - lava_callback - WARNING - Failed to upload log 2026-04-22 00:36:20,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:36:20,596 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:36:20,598 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e817f8afb86e738cacfe31/lava-logs.yaml 2026-04-22 00:36:20,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:36:20,682 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:36:20,684 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e817f8afb86e738cacfe31/lava_callback.json.gz 2026-04-22 00:36:20,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:36:20,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e817f8afb86e738cacfe31 HTTP/1.1" 200 None 2026-04-22 00:36:20,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:36:20,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8139bafb86e738cacfb7c HTTP/1.1" 200 None 2026-04-22 00:36:20,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:36:20,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e817f8afb86e738cacfe31 HTTP/1.1" 200 None 2026-04-22 00:36:20,798 - lava_callback - INFO - Completed processing callback for node 69e817f8afb86e738cacfe31 2026-04-22 00:36:21,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:36:21,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38302 - "GET / HTTP/1.0" 200 OK 2026-04-22 00:36:47,780 - lava_callback - INFO - Received callback for node 69e817f9afb86e738cacfe34 INFO: 172.21.0.1:38306 - "POST /node/69e817f9afb86e738cacfe34 HTTP/1.0" 202 Accepted 2026-04-22 00:36:47,827 - lava_callback - INFO - Starting async job submit for node 69e817f9afb86e738cacfe34 2026-04-22 00:36:47,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:36:47,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e817f9afb86e738cacfe34 HTTP/1.1" 200 None 2026-04-22 00:36:47,861 - lava_callback - DEBUG - Processing node 69e817f9afb86e738cacfe34: baseline-arm 2026-04-22 00:36:47,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:36:48,059 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:36:48,061 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e817f9afb86e738cacfe34/log.txt.gz 2026-04-22 00:36:48,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:36:48,232 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:36:48,234 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e817f9afb86e738cacfe34/lava-logs.yaml 2026-04-22 00:36:48,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:36:48,352 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:36:48,354 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e817f9afb86e738cacfe34/lava_callback.json.gz 2026-04-22 00:36:48,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:36:48,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e817f9afb86e738cacfe34 HTTP/1.1" 200 None 2026-04-22 00:36:48,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:36:48,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8139bafb86e738cacfb7c HTTP/1.1" 200 None 2026-04-22 00:36:48,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:36:48,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e817f9afb86e738cacfe34 HTTP/1.1" 200 None 2026-04-22 00:36:48,455 - lava_callback - INFO - Completed processing callback for node 69e817f9afb86e738cacfe34 2026-04-22 00:36:51,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:36:51,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60358 - "GET / HTTP/1.0" 200 OK 2026-04-22 00:36:58,758 - lava_callback - INFO - Received callback for node 69e817fcafb86e738cacfe3f INFO: 172.21.0.1:60360 - "POST /node/69e817fcafb86e738cacfe3f HTTP/1.0" 202 Accepted 2026-04-22 00:36:58,812 - lava_callback - INFO - Starting async job submit for node 69e817fcafb86e738cacfe3f 2026-04-22 00:36:58,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:36:58,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e817fcafb86e738cacfe3f HTTP/1.1" 200 None 2026-04-22 00:36:58,859 - lava_callback - DEBUG - Processing node 69e817fcafb86e738cacfe3f: baseline-arm 2026-04-22 00:36:58,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:36:59,058 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:36:59,060 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e817fcafb86e738cacfe3f/log.txt.gz 2026-04-22 00:36:59,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:36:59,275 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:36:59,276 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e817fcafb86e738cacfe3f/lava-logs.yaml 2026-04-22 00:36:59,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:36:59,532 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:36:59,534 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e817fcafb86e738cacfe3f/lava_callback.json.gz 2026-04-22 00:36:59,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:36:59,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e817fcafb86e738cacfe3f HTTP/1.1" 200 None 2026-04-22 00:36:59,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:36:59,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8139bafb86e738cacfb7c HTTP/1.1" 200 None 2026-04-22 00:36:59,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:36:59,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e817fcafb86e738cacfe3f HTTP/1.1" 200 None 2026-04-22 00:36:59,633 - lava_callback - INFO - Completed processing callback for node 69e817fcafb86e738cacfe3f INFO: 172.21.0.1:55328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60850 - "GET / HTTP/1.0" 200 OK 2026-04-22 00:37:21,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:37:21,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-22 00:37:25,107 - lava_callback - INFO - Received callback for node 69e817fbafb86e738cacfe3c INFO: 172.21.0.1:49544 - "POST /node/69e817fbafb86e738cacfe3c HTTP/1.0" 202 Accepted 2026-04-22 00:37:25,113 - lava_callback - INFO - Starting async job submit for node 69e817fbafb86e738cacfe3c 2026-04-22 00:37:25,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:37:25,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e817fbafb86e738cacfe3c HTTP/1.1" 200 None 2026-04-22 00:37:25,152 - lava_callback - DEBUG - Processing node 69e817fbafb86e738cacfe3c: baseline-arm 2026-04-22 00:37:25,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:37:25,475 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:37:25,477 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e817fbafb86e738cacfe3c/log.txt.gz 2026-04-22 00:37:25,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:37:25,758 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:37:25,760 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e817fbafb86e738cacfe3c/lava-logs.yaml 2026-04-22 00:37:25,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:37:25,867 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:37:25,868 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e817fbafb86e738cacfe3c/lava_callback.json.gz 2026-04-22 00:37:25,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:37:25,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e817fbafb86e738cacfe3c HTTP/1.1" 200 None 2026-04-22 00:37:25,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:37:25,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8139bafb86e738cacfb7c HTTP/1.1" 200 None 2026-04-22 00:37:25,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:37:25,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e817fbafb86e738cacfe3c HTTP/1.1" 200 None 2026-04-22 00:37:25,946 - lava_callback - INFO - Completed processing callback for node 69e817fbafb86e738cacfe3c INFO: 172.21.0.1:49558 - "GET / HTTP/1.0" 200 OK 2026-04-22 00:37:34,034 - lava_callback - INFO - Received callback for node 69e5753f2138313246289bf7 INFO: 172.21.0.1:42776 - "POST /node/69e5753f2138313246289bf7 HTTP/1.0" 202 Accepted 2026-04-22 00:37:34,041 - lava_callback - INFO - Starting async job submit for node 69e5753f2138313246289bf7 2026-04-22 00:37:34,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:37:34,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5753f2138313246289bf7 HTTP/1.1" 200 None 2026-04-22 00:37:34,056 - lava_callback - DEBUG - Processing node 69e5753f2138313246289bf7: baseline-arm-clabbe 2026-04-22 00:37:34,056 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5753f2138313246289bf7 2026-04-22 00:37:34,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:37:34,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5753f2138313246289bf7 HTTP/1.1" 200 None 2026-04-22 00:37:34,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:37:34,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-22 00:37:34,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:37:34,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5753f2138313246289bf7 HTTP/1.1" 200 None 2026-04-22 00:37:34,113 - lava_callback - ERROR - Error processing callback for node 69e5753f2138313246289bf7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42790 - "GET / HTTP/1.0" 200 OK 2026-04-22 00:37:38,840 - lava_callback - INFO - Received callback for node 69e817f7afb86e738cacfe2e INFO: 172.21.0.1:42794 - "POST /node/69e817f7afb86e738cacfe2e HTTP/1.0" 202 Accepted 2026-04-22 00:37:38,850 - lava_callback - INFO - Starting async job submit for node 69e817f7afb86e738cacfe2e 2026-04-22 00:37:38,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:37:38,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e817f7afb86e738cacfe2e HTTP/1.1" 200 None 2026-04-22 00:37:38,888 - lava_callback - DEBUG - Processing node 69e817f7afb86e738cacfe2e: baseline-arm 2026-04-22 00:37:39,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:37:39,158 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:37:39,160 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e817f7afb86e738cacfe2e/log.txt.gz 2026-04-22 00:37:39,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:37:39,415 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:37:39,417 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e817f7afb86e738cacfe2e/lava-logs.yaml 2026-04-22 00:37:39,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:37:39,513 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:37:39,514 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e817f7afb86e738cacfe2e/lava_callback.json.gz 2026-04-22 00:37:39,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:37:39,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e817f7afb86e738cacfe2e HTTP/1.1" 200 None 2026-04-22 00:37:39,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:37:39,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8139bafb86e738cacfb7c HTTP/1.1" 200 None 2026-04-22 00:37:39,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:37:39,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e817f7afb86e738cacfe2e HTTP/1.1" 200 None 2026-04-22 00:37:39,588 - lava_callback - INFO - Completed processing callback for node 69e817f7afb86e738cacfe2e INFO: 172.21.0.1:42174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42184 - "GET / HTTP/1.0" 200 OK 2026-04-22 00:37:49,077 - lava_callback - INFO - Received callback for node 69e81817afb86e738cacfed2 INFO: 172.21.0.1:42200 - "POST /node/69e81817afb86e738cacfed2 HTTP/1.0" 202 Accepted 2026-04-22 00:37:49,125 - lava_callback - INFO - Starting async job submit for node 69e81817afb86e738cacfed2 2026-04-22 00:37:49,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:37:49,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81817afb86e738cacfed2 HTTP/1.1" 200 None 2026-04-22 00:37:49,168 - lava_callback - DEBUG - Processing node 69e81817afb86e738cacfed2: baseline-arm-pengutronix 2026-04-22 00:37:49,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:37:49,372 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:37:49,373 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e81817afb86e738cacfed2/log.txt.gz 2026-04-22 00:37:49,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:37:49,591 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:37:49,592 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e81817afb86e738cacfed2/lava-logs.yaml 2026-04-22 00:37:49,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:37:49,672 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:37:49,674 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e81817afb86e738cacfed2/lava_callback.json.gz 2026-04-22 00:37:49,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:37:49,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81817afb86e738cacfed2 HTTP/1.1" 200 None 2026-04-22 00:37:49,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:37:49,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8139bafb86e738cacfb7c HTTP/1.1" 200 None 2026-04-22 00:37:49,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:37:49,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e81817afb86e738cacfed2 HTTP/1.1" 200 None 2026-04-22 00:37:49,753 - lava_callback - INFO - Completed processing callback for node 69e81817afb86e738cacfed2 2026-04-22 00:37:51,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:37:51,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-22 00:37:53,674 - lava_callback - INFO - Received callback for node 69e81814afb86e738cacfecc INFO: 172.21.0.1:36302 - "POST /node/69e81814afb86e738cacfecc HTTP/1.0" 202 Accepted 2026-04-22 00:37:53,680 - lava_callback - INFO - Starting async job submit for node 69e81814afb86e738cacfecc 2026-04-22 00:37:53,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:37:53,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81814afb86e738cacfecc HTTP/1.1" 200 None 2026-04-22 00:37:53,717 - lava_callback - DEBUG - Processing node 69e81814afb86e738cacfecc: baseline-arm-pengutronix 2026-04-22 00:37:53,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:37:53,965 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:37:53,967 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e81814afb86e738cacfecc/log.txt.gz 2026-04-22 00:37:54,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:37:54,198 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:37:54,200 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e81814afb86e738cacfecc/lava-logs.yaml 2026-04-22 00:37:54,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:37:54,327 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:37:54,329 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e81814afb86e738cacfecc/lava_callback.json.gz 2026-04-22 00:37:54,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:37:54,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81814afb86e738cacfecc HTTP/1.1" 200 None 2026-04-22 00:37:54,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:37:54,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8139bafb86e738cacfb7c HTTP/1.1" 200 None 2026-04-22 00:37:54,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:37:54,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e81814afb86e738cacfecc HTTP/1.1" 200 None 2026-04-22 00:37:54,410 - lava_callback - INFO - Completed processing callback for node 69e81814afb86e738cacfecc 2026-04-22 00:37:55,000 - lava_callback - INFO - Received callback for node 69e81816afb86e738cacfecf INFO: 172.21.0.1:36312 - "POST /node/69e81816afb86e738cacfecf HTTP/1.0" 202 Accepted 2026-04-22 00:37:55,006 - lava_callback - INFO - Starting async job submit for node 69e81816afb86e738cacfecf 2026-04-22 00:37:55,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:37:55,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81816afb86e738cacfecf HTTP/1.1" 200 None 2026-04-22 00:37:55,041 - lava_callback - DEBUG - Processing node 69e81816afb86e738cacfecf: baseline-arm-pengutronix 2026-04-22 00:37:55,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:37:55,292 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:37:55,294 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e81816afb86e738cacfecf/log.txt.gz 2026-04-22 00:37:55,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:37:55,512 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:37:55,514 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e81816afb86e738cacfecf/lava-logs.yaml 2026-04-22 00:37:55,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:37:55,614 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:37:55,615 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69e81816afb86e738cacfecf/lava_callback.json.gz 2026-04-22 00:37:55,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:37:55,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81816afb86e738cacfecf HTTP/1.1" 200 None 2026-04-22 00:37:55,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:37:55,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8139bafb86e738cacfb7c HTTP/1.1" 200 None 2026-04-22 00:37:55,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:37:55,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e81816afb86e738cacfecf HTTP/1.1" 200 None 2026-04-22 00:37:55,687 - lava_callback - INFO - Completed processing callback for node 69e81816afb86e738cacfecf INFO: 172.21.0.1:36318 - "GET / HTTP/1.0" 200 OK 2026-04-22 00:38:02,875 - lava_callback - INFO - Received callback for node 69e575612138313246289c04 INFO: 172.21.0.1:40220 - "POST /node/69e575612138313246289c04 HTTP/1.0" 202 Accepted 2026-04-22 00:38:02,880 - lava_callback - INFO - Starting async job submit for node 69e575612138313246289c04 2026-04-22 00:38:02,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:38:02,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e575612138313246289c04 HTTP/1.1" 200 None 2026-04-22 00:38:02,897 - lava_callback - DEBUG - Processing node 69e575612138313246289c04: baseline-arm-baylibre 2026-04-22 00:38:02,897 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e575612138313246289c04 2026-04-22 00:38:02,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:38:02,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e575612138313246289c04 HTTP/1.1" 200 None 2026-04-22 00:38:02,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:38:02,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-22 00:38:02,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:38:02,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e575612138313246289c04 HTTP/1.1" 200 None 2026-04-22 00:38:02,949 - lava_callback - ERROR - Error processing callback for node 69e575612138313246289c04: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45022 - "GET / HTTP/1.0" 200 OK 2026-04-22 00:38:16,675 - lava_callback - INFO - Received callback for node 69e81805afb86e738cacfe53 INFO: 172.21.0.1:45026 - "POST /node/69e81805afb86e738cacfe53 HTTP/1.0" 202 Accepted 2026-04-22 00:38:16,681 - lava_callback - INFO - Starting async job submit for node 69e81805afb86e738cacfe53 2026-04-22 00:38:16,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:38:16,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81805afb86e738cacfe53 HTTP/1.1" 200 None 2026-04-22 00:38:16,721 - lava_callback - DEBUG - Processing node 69e81805afb86e738cacfe53: baseline-arm-broonie 2026-04-22 00:38:16,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:38:17,221 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:38:17,223 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e81805afb86e738cacfe53/log.txt.gz 2026-04-22 00:38:17,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:38:17,544 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:38:17,546 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e81805afb86e738cacfe53/lava-logs.yaml 2026-04-22 00:38:17,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:38:17,672 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:38:17,674 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e81805afb86e738cacfe53/lava_callback.json.gz 2026-04-22 00:38:17,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:38:17,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81805afb86e738cacfe53 HTTP/1.1" 200 None 2026-04-22 00:38:17,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:38:17,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8139bafb86e738cacfb7c HTTP/1.1" 200 None 2026-04-22 00:38:17,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:38:17,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e81805afb86e738cacfe53 HTTP/1.1" 200 None 2026-04-22 00:38:17,759 - lava_callback - INFO - Completed processing callback for node 69e81805afb86e738cacfe53 2026-04-22 00:38:22,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:38:22,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-22 00:38:25,286 - lava_callback - INFO - Received callback for node 69e81812afb86e738cacfeb8 INFO: 172.21.0.1:49548 - "POST /node/69e81812afb86e738cacfeb8 HTTP/1.0" 202 Accepted 2026-04-22 00:38:25,292 - lava_callback - INFO - Starting async job submit for node 69e81812afb86e738cacfeb8 2026-04-22 00:38:25,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:38:25,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81812afb86e738cacfeb8 HTTP/1.1" 200 None 2026-04-22 00:38:25,330 - lava_callback - DEBUG - Processing node 69e81812afb86e738cacfeb8: baseline-arm-kontron 2026-04-22 00:38:25,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:38:25,607 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:38:25,609 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69e81812afb86e738cacfeb8/log.txt.gz 2026-04-22 00:38:25,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:38:25,841 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:38:25,842 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69e81812afb86e738cacfeb8/lava-logs.yaml 2026-04-22 00:38:25,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:38:25,970 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:38:25,972 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69e81812afb86e738cacfeb8/lava_callback.json.gz 2026-04-22 00:38:25,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:38:26,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81812afb86e738cacfeb8 HTTP/1.1" 200 None 2026-04-22 00:38:26,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:38:26,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8139bafb86e738cacfb7c HTTP/1.1" 200 None 2026-04-22 00:38:26,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:38:26,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e81812afb86e738cacfeb8 HTTP/1.1" 200 None 2026-04-22 00:38:26,048 - lava_callback - INFO - Completed processing callback for node 69e81812afb86e738cacfeb8 INFO: 172.21.0.1:49560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51270 - "GET / HTTP/1.0" 200 OK 2026-04-22 00:38:38,920 - lava_callback - INFO - Received callback for node 69e81804afb86e738cacfe4d INFO: 172.21.0.1:51276 - "POST /node/69e81804afb86e738cacfe4d HTTP/1.0" 202 Accepted 2026-04-22 00:38:38,926 - lava_callback - INFO - Starting async job submit for node 69e81804afb86e738cacfe4d 2026-04-22 00:38:38,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:38:38,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81804afb86e738cacfe4d HTTP/1.1" 200 None 2026-04-22 00:38:38,964 - lava_callback - DEBUG - Processing node 69e81804afb86e738cacfe4d: baseline-arm-broonie 2026-04-22 00:38:39,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:38:39,248 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:38:39,250 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e81804afb86e738cacfe4d/log.txt.gz 2026-04-22 00:38:39,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:38:39,500 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:38:39,502 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e81804afb86e738cacfe4d/lava-logs.yaml 2026-04-22 00:38:39,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:38:39,619 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:38:39,620 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e81804afb86e738cacfe4d/lava_callback.json.gz 2026-04-22 00:38:39,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:38:39,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81804afb86e738cacfe4d HTTP/1.1" 200 None 2026-04-22 00:38:39,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:38:39,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8139bafb86e738cacfb7c HTTP/1.1" 200 None 2026-04-22 00:38:39,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:38:39,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e81804afb86e738cacfe4d HTTP/1.1" 200 None 2026-04-22 00:38:39,696 - lava_callback - INFO - Completed processing callback for node 69e81804afb86e738cacfe4d INFO: 172.21.0.1:49956 - "GET / HTTP/1.0" 200 OK 2026-04-22 00:38:45,324 - lava_callback - INFO - Received callback for node 69e81811afb86e738cacfeb5 INFO: 172.21.0.1:49964 - "POST /node/69e81811afb86e738cacfeb5 HTTP/1.0" 202 Accepted 2026-04-22 00:38:45,330 - lava_callback - INFO - Starting async job submit for node 69e81811afb86e738cacfeb5 2026-04-22 00:38:45,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:38:45,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81811afb86e738cacfeb5 HTTP/1.1" 200 None 2026-04-22 00:38:45,371 - lava_callback - DEBUG - Processing node 69e81811afb86e738cacfeb5: baseline-arm-kontron 2026-04-22 00:38:45,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:38:45,671 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:38:45,673 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69e81811afb86e738cacfeb5/log.txt.gz 2026-04-22 00:38:45,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:38:45,963 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:38:45,965 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69e81811afb86e738cacfeb5/lava-logs.yaml 2026-04-22 00:38:45,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:38:46,097 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:38:46,098 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69e81811afb86e738cacfeb5/lava_callback.json.gz 2026-04-22 00:38:46,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:38:46,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81811afb86e738cacfeb5 HTTP/1.1" 200 None 2026-04-22 00:38:46,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:38:46,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8139bafb86e738cacfb7c HTTP/1.1" 200 None 2026-04-22 00:38:46,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:38:46,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e81811afb86e738cacfeb5 HTTP/1.1" 200 None 2026-04-22 00:38:46,175 - lava_callback - INFO - Completed processing callback for node 69e81811afb86e738cacfeb5 INFO: 172.21.0.1:49974 - "GET / HTTP/1.0" 200 OK 2026-04-22 00:38:48,221 - lava_callback - INFO - Received callback for node 69e8182fafb86e738cacfef0 INFO: 172.21.0.1:49984 - "POST /node/69e8182fafb86e738cacfef0 HTTP/1.0" 202 Accepted 2026-04-22 00:38:48,227 - lava_callback - INFO - Starting async job submit for node 69e8182fafb86e738cacfef0 2026-04-22 00:38:48,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:38:48,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8182fafb86e738cacfef0 HTTP/1.1" 200 None 2026-04-22 00:38:48,266 - lava_callback - DEBUG - Processing node 69e8182fafb86e738cacfef0: ltp-dio 2026-04-22 00:38:48,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:38:48,833 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:38:48,835 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-69e8182fafb86e738cacfef0/log.txt.gz 2026-04-22 00:38:49,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:38:49,193 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:38:49,195 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-69e8182fafb86e738cacfef0/lava-logs.yaml 2026-04-22 00:38:49,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:38:49,315 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:38:49,316 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-69e8182fafb86e738cacfef0/lava_callback.json.gz 2026-04-22 00:38:49,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:38:49,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8182fafb86e738cacfef0 HTTP/1.1" 200 None 2026-04-22 00:38:49,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:38:49,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8139bafb86e738cacfb7c HTTP/1.1" 200 None 2026-04-22 00:38:49,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:38:49,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e8182fafb86e738cacfef0 HTTP/1.1" 200 None 2026-04-22 00:38:49,397 - lava_callback - INFO - Completed processing callback for node 69e8182fafb86e738cacfef0 2026-04-22 00:38:52,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:38:52,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-22 00:38:54,169 - lava_callback - INFO - Received callback for node 69e5758e2138313246289c13 INFO: 172.21.0.1:59440 - "POST /node/69e5758e2138313246289c13 HTTP/1.0" 202 Accepted 2026-04-22 00:38:54,175 - lava_callback - INFO - Starting async job submit for node 69e5758e2138313246289c13 2026-04-22 00:38:54,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:38:54,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5758e2138313246289c13 HTTP/1.1" 200 None 2026-04-22 00:38:54,191 - lava_callback - DEBUG - Processing node 69e5758e2138313246289c13: baseline-arm-clabbe 2026-04-22 00:38:54,191 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5758e2138313246289c13 2026-04-22 00:38:54,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:38:54,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5758e2138313246289c13 HTTP/1.1" 200 None 2026-04-22 00:38:54,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:38:54,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-22 00:38:54,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:38:54,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5758e2138313246289c13 HTTP/1.1" 200 None 2026-04-22 00:38:54,252 - lava_callback - ERROR - Error processing callback for node 69e5758e2138313246289c13: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36212 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36220 - "GET / HTTP/1.0" 200 OK 2026-04-22 00:39:22,943 - lava_callback - INFO - Received callback for node 69e575b02138313246289c1e INFO: 172.21.0.1:60732 - "POST /node/69e575b02138313246289c1e HTTP/1.0" 202 Accepted 2026-04-22 00:39:22,951 - lava_callback - INFO - Starting async job submit for node 69e575b02138313246289c1e 2026-04-22 00:39:22,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:39:22,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e575b02138313246289c1e HTTP/1.1" 200 None 2026-04-22 00:39:22,968 - lava_callback - DEBUG - Processing node 69e575b02138313246289c1e: baseline-arm-baylibre 2026-04-22 00:39:22,968 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e575b02138313246289c1e 2026-04-22 00:39:22,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:39:22,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e575b02138313246289c1e HTTP/1.1" 200 None 2026-04-22 00:39:22,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:39:23,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-22 00:39:23,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:39:23,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e575b02138313246289c1e HTTP/1.1" 200 None 2026-04-22 00:39:23,035 - lava_callback - ERROR - Error processing callback for node 69e575b02138313246289c1e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51996 - "GET / HTTP/1.0" 200 OK 2026-04-22 00:40:14,132 - lava_callback - INFO - Received callback for node 69e575de2138313246289c2b INFO: 172.21.0.1:57240 - "POST /node/69e575de2138313246289c2b HTTP/1.0" 202 Accepted 2026-04-22 00:40:14,137 - lava_callback - INFO - Starting async job submit for node 69e575de2138313246289c2b 2026-04-22 00:40:14,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:40:14,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e575de2138313246289c2b HTTP/1.1" 200 None 2026-04-22 00:40:14,153 - lava_callback - DEBUG - Processing node 69e575de2138313246289c2b: baseline-arm-clabbe 2026-04-22 00:40:14,153 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e575de2138313246289c2b 2026-04-22 00:40:14,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:40:14,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e575de2138313246289c2b HTTP/1.1" 200 None 2026-04-22 00:40:14,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:40:14,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-22 00:40:14,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:40:14,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e575de2138313246289c2b HTTP/1.1" 200 None 2026-04-22 00:40:14,200 - lava_callback - ERROR - Error processing callback for node 69e575de2138313246289c2b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56440 - "GET / HTTP/1.0" 200 OK 2026-04-22 00:40:43,012 - lava_callback - INFO - Received callback for node 69e576012138313246289c3c INFO: 172.21.0.1:56452 - "POST /node/69e576012138313246289c3c HTTP/1.0" 202 Accepted 2026-04-22 00:40:43,017 - lava_callback - INFO - Starting async job submit for node 69e576012138313246289c3c 2026-04-22 00:40:43,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:40:43,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e576012138313246289c3c HTTP/1.1" 200 None 2026-04-22 00:40:43,033 - lava_callback - DEBUG - Processing node 69e576012138313246289c3c: baseline-arm-baylibre 2026-04-22 00:40:43,033 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e576012138313246289c3c 2026-04-22 00:40:43,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:40:43,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e576012138313246289c3c HTTP/1.1" 200 None 2026-04-22 00:40:43,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:40:43,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-22 00:40:43,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:40:43,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e576012138313246289c3c HTTP/1.1" 200 None 2026-04-22 00:40:43,096 - lava_callback - ERROR - Error processing callback for node 69e576012138313246289c3c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55922 - "GET / HTTP/1.0" 200 OK 2026-04-22 00:41:22,984 - lava_callback - INFO - Received callback for node 69e576292138313246289c47 INFO: 172.21.0.1:50606 - "POST /node/69e576292138313246289c47 HTTP/1.0" 202 Accepted 2026-04-22 00:41:22,990 - lava_callback - INFO - Starting async job submit for node 69e576292138313246289c47 2026-04-22 00:41:22,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:41:23,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e576292138313246289c47 HTTP/1.1" 200 None 2026-04-22 00:41:23,006 - lava_callback - DEBUG - Processing node 69e576292138313246289c47: baseline-arm-baylibre 2026-04-22 00:41:23,006 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e576292138313246289c47 2026-04-22 00:41:23,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:41:23,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e576292138313246289c47 HTTP/1.1" 200 None 2026-04-22 00:41:23,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:41:23,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-22 00:41:23,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:41:23,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e576292138313246289c47 HTTP/1.1" 200 None 2026-04-22 00:41:23,053 - lava_callback - ERROR - Error processing callback for node 69e576292138313246289c47: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38010 - "GET / HTTP/1.0" 200 OK 2026-04-22 00:42:03,044 - lava_callback - INFO - Received callback for node 69e5764e2138313246289c56 INFO: 172.21.0.1:36804 - "POST /node/69e5764e2138313246289c56 HTTP/1.0" 202 Accepted 2026-04-22 00:42:03,049 - lava_callback - INFO - Starting async job submit for node 69e5764e2138313246289c56 2026-04-22 00:42:03,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:42:03,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5764e2138313246289c56 HTTP/1.1" 200 None 2026-04-22 00:42:03,066 - lava_callback - DEBUG - Processing node 69e5764e2138313246289c56: baseline-arm-baylibre 2026-04-22 00:42:03,066 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5764e2138313246289c56 2026-04-22 00:42:03,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:42:03,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5764e2138313246289c56 HTTP/1.1" 200 None 2026-04-22 00:42:03,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:42:03,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-22 00:42:03,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:42:03,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5764e2138313246289c56 HTTP/1.1" 200 None 2026-04-22 00:42:03,114 - lava_callback - ERROR - Error processing callback for node 69e5764e2138313246289c56: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45766 - "GET / HTTP/1.0" 200 OK 2026-04-22 00:42:33,759 - lava_callback - INFO - Received callback for node 69e81807afb86e738cacfe58 INFO: 172.21.0.1:54584 - "POST /node/69e81807afb86e738cacfe58 HTTP/1.0" 202 Accepted 2026-04-22 00:42:33,765 - lava_callback - INFO - Starting async job submit for node 69e81807afb86e738cacfe58 2026-04-22 00:42:33,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:42:33,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81807afb86e738cacfe58 HTTP/1.1" 200 None 2026-04-22 00:42:33,802 - lava_callback - DEBUG - Processing node 69e81807afb86e738cacfe58: baseline-arm-broonie 2026-04-22 00:42:34,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:42:34,145 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:42:34,146 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e81807afb86e738cacfe58/log.txt.gz 2026-04-22 00:42:34,281 - lava_callback - INFO - Received callback for node 69e576752138313246289c65 2026-04-22 00:42:34,291 - lava_callback - INFO - Starting async job submit for node 69e576752138313246289c65 INFO: 172.21.0.1:54598 - "POST /node/69e576752138313246289c65 HTTP/1.0" 202 Accepted 2026-04-22 00:42:34,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:42:34,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:42:34,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e576752138313246289c65 HTTP/1.1" 200 None 2026-04-22 00:42:34,311 - lava_callback - DEBUG - Processing node 69e576752138313246289c65: baseline-arm-clabbe 2026-04-22 00:42:34,311 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e576752138313246289c65 2026-04-22 00:42:34,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:42:34,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e576752138313246289c65 HTTP/1.1" 200 None 2026-04-22 00:42:34,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:42:34,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-22 00:42:34,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:42:34,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e576752138313246289c65 HTTP/1.1" 200 None 2026-04-22 00:42:34,363 - lava_callback - ERROR - Error processing callback for node 69e576752138313246289c65: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-22 00:42:34,456 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:42:34,458 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e81807afb86e738cacfe58/lava-logs.yaml 2026-04-22 00:42:34,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:42:34,592 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:42:34,594 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e81807afb86e738cacfe58/lava_callback.json.gz 2026-04-22 00:42:34,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:42:34,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81807afb86e738cacfe58 HTTP/1.1" 200 None 2026-04-22 00:42:34,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:42:34,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8139bafb86e738cacfb7c HTTP/1.1" 200 None 2026-04-22 00:42:34,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:42:34,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e81807afb86e738cacfe58 HTTP/1.1" 200 None 2026-04-22 00:42:34,670 - lava_callback - INFO - Completed processing callback for node 69e81807afb86e738cacfe58 INFO: 172.21.0.1:54600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36276 - "GET / HTTP/1.0" 200 OK 2026-04-22 00:42:52,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:42:52,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33838 - "GET / HTTP/1.0" 200 OK 2026-04-22 00:43:14,259 - lava_callback - INFO - Received callback for node 69e5769b2138313246289c75 INFO: 172.21.0.1:44088 - "POST /node/69e5769b2138313246289c75 HTTP/1.0" 202 Accepted 2026-04-22 00:43:14,265 - lava_callback - INFO - Starting async job submit for node 69e5769b2138313246289c75 2026-04-22 00:43:14,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:43:14,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5769b2138313246289c75 HTTP/1.1" 200 None 2026-04-22 00:43:14,281 - lava_callback - DEBUG - Processing node 69e5769b2138313246289c75: baseline-arm-clabbe 2026-04-22 00:43:14,281 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5769b2138313246289c75 2026-04-22 00:43:14,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:43:14,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5769b2138313246289c75 HTTP/1.1" 200 None 2026-04-22 00:43:14,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:43:14,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-22 00:43:14,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:43:14,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5769b2138313246289c75 HTTP/1.1" 200 None 2026-04-22 00:43:14,334 - lava_callback - ERROR - Error processing callback for node 69e5769b2138313246289c75: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48430 - "GET / HTTP/1.0" 200 OK 2026-04-22 00:43:54,321 - lava_callback - INFO - Received callback for node 69e576c02138313246289c81 INFO: 172.21.0.1:59018 - "POST /node/69e576c02138313246289c81 HTTP/1.0" 202 Accepted 2026-04-22 00:43:54,327 - lava_callback - INFO - Starting async job submit for node 69e576c02138313246289c81 2026-04-22 00:43:54,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:43:54,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e576c02138313246289c81 HTTP/1.1" 200 None 2026-04-22 00:43:54,343 - lava_callback - DEBUG - Processing node 69e576c02138313246289c81: baseline-arm-clabbe 2026-04-22 00:43:54,344 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e576c02138313246289c81 2026-04-22 00:43:54,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:43:54,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e576c02138313246289c81 HTTP/1.1" 200 None 2026-04-22 00:43:54,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:43:54,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-22 00:43:54,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:43:54,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e576c02138313246289c81 HTTP/1.1" 200 None 2026-04-22 00:43:54,395 - lava_callback - ERROR - Error processing callback for node 69e576c02138313246289c81: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51678 - "GET / HTTP/1.0" 200 OK 2026-04-22 00:44:34,305 - lava_callback - INFO - Received callback for node 69e576e52138313246289c8e INFO: 172.21.0.1:53474 - "POST /node/69e576e52138313246289c8e HTTP/1.0" 202 Accepted 2026-04-22 00:44:34,311 - lava_callback - INFO - Starting async job submit for node 69e576e52138313246289c8e 2026-04-22 00:44:34,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:44:34,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e576e52138313246289c8e HTTP/1.1" 200 None 2026-04-22 00:44:34,327 - lava_callback - DEBUG - Processing node 69e576e52138313246289c8e: baseline-arm-clabbe 2026-04-22 00:44:34,327 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e576e52138313246289c8e 2026-04-22 00:44:34,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:44:34,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e576e52138313246289c8e HTTP/1.1" 200 None 2026-04-22 00:44:34,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:44:34,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-22 00:44:34,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:44:34,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e576e52138313246289c8e HTTP/1.1" 200 None 2026-04-22 00:44:34,378 - lava_callback - ERROR - Error processing callback for node 69e576e52138313246289c8e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52792 - "GET / HTTP/1.0" 200 OK 2026-04-22 00:45:14,373 - lava_callback - INFO - Received callback for node 69e5770a2138313246289c9b INFO: 172.21.0.1:49974 - "POST /node/69e5770a2138313246289c9b HTTP/1.0" 202 Accepted 2026-04-22 00:45:14,378 - lava_callback - INFO - Starting async job submit for node 69e5770a2138313246289c9b 2026-04-22 00:45:14,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:45:14,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5770a2138313246289c9b HTTP/1.1" 200 None 2026-04-22 00:45:14,394 - lava_callback - DEBUG - Processing node 69e5770a2138313246289c9b: baseline-arm-clabbe 2026-04-22 00:45:14,395 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5770a2138313246289c9b 2026-04-22 00:45:14,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:45:14,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5770a2138313246289c9b HTTP/1.1" 200 None 2026-04-22 00:45:14,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:45:14,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-22 00:45:14,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:45:14,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5770a2138313246289c9b HTTP/1.1" 200 None 2026-04-22 00:45:14,440 - lava_callback - ERROR - Error processing callback for node 69e5770a2138313246289c9b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58094 - "GET / HTTP/1.0" 200 OK 2026-04-22 00:45:53,736 - lava_callback - INFO - Received callback for node 69e8183bafb86e738cacff29 INFO: 172.21.0.1:59962 - "POST /node/69e8183bafb86e738cacff29 HTTP/1.0" 202 Accepted 2026-04-22 00:45:53,745 - lava_callback - INFO - Starting async job submit for node 69e8183bafb86e738cacff29 2026-04-22 00:45:53,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:45:53,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8183bafb86e738cacff29 HTTP/1.1" 200 None 2026-04-22 00:45:53,794 - lava_callback - DEBUG - Processing node 69e8183bafb86e738cacff29: ltp-syscalls 2026-04-22 00:45:54,344 - lava_callback - INFO - Received callback for node 69e577322138313246289caa INFO: 172.21.0.1:59976 - "POST /node/69e577322138313246289caa HTTP/1.0" 202 Accepted 2026-04-22 00:45:54,360 - lava_callback - INFO - Starting async job submit for node 69e577322138313246289caa 2026-04-22 00:45:54,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:45:54,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e577322138313246289caa HTTP/1.1" 200 None 2026-04-22 00:45:54,472 - lava_callback - DEBUG - Processing node 69e577322138313246289caa: baseline-arm-clabbe 2026-04-22 00:45:54,472 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e577322138313246289caa 2026-04-22 00:45:54,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:45:54,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e577322138313246289caa HTTP/1.1" 200 None 2026-04-22 00:45:54,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:45:54,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-22 00:45:54,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:45:54,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:45:54,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e577322138313246289caa HTTP/1.1" 200 None 2026-04-22 00:45:54,766 - lava_callback - ERROR - Error processing callback for node 69e577322138313246289caa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-22 00:45:54,971 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:45:54,973 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-69e8183bafb86e738cacff29/log.txt.gz 2026-04-22 00:45:55,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:45:55,746 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:45:55,749 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-69e8183bafb86e738cacff29/lava-logs.yaml 2026-04-22 00:45:55,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:45:55,889 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:45:55,891 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-69e8183bafb86e738cacff29/lava_callback.json.gz 2026-04-22 00:45:55,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:45:55,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8183bafb86e738cacff29 HTTP/1.1" 200 None 2026-04-22 00:45:55,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:45:55,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8139bafb86e738cacfb7c HTTP/1.1" 200 None 2026-04-22 00:45:55,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:45:56,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e8183bafb86e738cacff29 HTTP/1.1" 200 None 2026-04-22 00:45:56,016 - lava_callback - INFO - Completed processing callback for node 69e8183bafb86e738cacff29 INFO: 172.21.0.1:59992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60088 - "GET / HTTP/1.0" 200 OK 2026-04-22 00:46:22,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:46:22,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34724 - "GET / HTTP/1.0" 200 OK 2026-04-22 00:47:16,926 - lava_callback - INFO - Received callback for node 69e815f9afb86e738cacfcfa INFO: 172.21.0.1:34740 - "POST /node/69e815f9afb86e738cacfcfa HTTP/1.0" 202 Accepted 2026-04-22 00:47:16,933 - lava_callback - INFO - Starting async job submit for node 69e815f9afb86e738cacfcfa 2026-04-22 00:47:16,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:47:17,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e815f9afb86e738cacfcfa HTTP/1.1" 200 None 2026-04-22 00:47:17,013 - lava_callback - DEBUG - Processing node 69e815f9afb86e738cacfcfa: ltp-smoke 2026-04-22 00:47:17,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:47:17,606 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:47:17,608 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69e815f9afb86e738cacfcfa/log.txt.gz 2026-04-22 00:47:17,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:47:18,092 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:47:18,094 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69e815f9afb86e738cacfcfa/lava-logs.yaml 2026-04-22 00:47:18,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:47:18,210 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:47:18,211 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69e815f9afb86e738cacfcfa/lava_callback.json.gz 2026-04-22 00:47:18,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:47:18,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e815f9afb86e738cacfcfa HTTP/1.1" 200 None 2026-04-22 00:47:18,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:47:18,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813a3afb86e738cacfb99 HTTP/1.1" 200 None 2026-04-22 00:47:18,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:47:18,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e815f9afb86e738cacfcfa HTTP/1.1" 200 None 2026-04-22 00:47:18,510 - lava_callback - INFO - Completed processing callback for node 69e815f9afb86e738cacfcfa 2026-04-22 00:47:22,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:47:22,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39474 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33578 - "GET / HTTP/1.0" 200 OK 2026-04-22 00:49:33,612 - lava_callback - INFO - Received callback for node 69e81803afb86e738cacfe4a INFO: 172.21.0.1:47608 - "POST /node/69e81803afb86e738cacfe4a HTTP/1.0" 202 Accepted 2026-04-22 00:49:33,618 - lava_callback - INFO - Starting async job submit for node 69e81803afb86e738cacfe4a 2026-04-22 00:49:33,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:49:33,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81803afb86e738cacfe4a HTTP/1.1" 200 None 2026-04-22 00:49:33,674 - lava_callback - DEBUG - Processing node 69e81803afb86e738cacfe4a: baseline-arm-broonie 2026-04-22 00:49:33,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:49:34,088 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:49:34,090 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e81803afb86e738cacfe4a/log.txt.gz 2026-04-22 00:49:34,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:49:34,400 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:49:34,402 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e81803afb86e738cacfe4a/lava-logs.yaml 2026-04-22 00:49:34,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:49:34,496 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:49:34,498 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69e81803afb86e738cacfe4a/lava_callback.json.gz 2026-04-22 00:49:34,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:49:34,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81803afb86e738cacfe4a HTTP/1.1" 200 None 2026-04-22 00:49:34,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:49:34,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8139bafb86e738cacfb7c HTTP/1.1" 200 None 2026-04-22 00:49:34,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:49:34,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e81803afb86e738cacfe4a HTTP/1.1" 200 None 2026-04-22 00:49:34,577 - lava_callback - INFO - Completed processing callback for node 69e81803afb86e738cacfe4a INFO: 172.21.0.1:47624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46546 - "GET / HTTP/1.0" 200 OK 2026-04-22 00:49:52,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:49:52,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32842 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33370 - "GET / HTTP/1.0" 200 OK 2026-04-22 00:52:13,880 - lava_callback - INFO - Received callback for node 69e81829afb86e738cacfee3 INFO: 172.21.0.1:53272 - "POST /node/69e81829afb86e738cacfee3 HTTP/1.0" 202 Accepted 2026-04-22 00:52:13,886 - lava_callback - INFO - Starting async job submit for node 69e81829afb86e738cacfee3 2026-04-22 00:52:13,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:52:13,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81829afb86e738cacfee3 HTTP/1.1" 200 None 2026-04-22 00:52:13,926 - lava_callback - DEBUG - Processing node 69e81829afb86e738cacfee3: ltp-containers 2026-04-22 00:52:14,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:52:14,447 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:52:14,449 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-containers-69e81829afb86e738cacfee3/log.txt.gz 2026-04-22 00:52:14,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:52:14,831 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:52:14,833 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-containers-69e81829afb86e738cacfee3/lava-logs.yaml 2026-04-22 00:52:14,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:52:14,963 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:52:14,964 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-containers-69e81829afb86e738cacfee3/lava_callback.json.gz 2026-04-22 00:52:14,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:52:15,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81829afb86e738cacfee3 HTTP/1.1" 200 None 2026-04-22 00:52:15,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:52:15,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8139bafb86e738cacfb7c HTTP/1.1" 200 None 2026-04-22 00:52:15,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:52:15,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e81829afb86e738cacfee3 HTTP/1.1" 200 None 2026-04-22 00:52:15,043 - lava_callback - INFO - Completed processing callback for node 69e81829afb86e738cacfee3 INFO: 172.21.0.1:53284 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53294 - "GET / HTTP/1.0" 200 OK 2026-04-22 00:52:22,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:52:22,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47776 - "GET / HTTP/1.0" 200 OK 2026-04-22 00:52:35,232 - lava_callback - INFO - Received callback for node 69e81828afb86e738cacfee0 INFO: 172.21.0.1:48478 - "POST /node/69e81828afb86e738cacfee0 HTTP/1.0" 202 Accepted 2026-04-22 00:52:35,241 - lava_callback - INFO - Starting async job submit for node 69e81828afb86e738cacfee0 2026-04-22 00:52:35,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:52:35,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81828afb86e738cacfee0 HTTP/1.1" 200 None 2026-04-22 00:52:35,298 - lava_callback - DEBUG - Processing node 69e81828afb86e738cacfee0: ltp-cap_bounds 2026-04-22 00:52:35,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:52:35,774 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:52:35,776 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69e81828afb86e738cacfee0/log.txt.gz 2026-04-22 00:52:35,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:52:36,142 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:52:36,144 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69e81828afb86e738cacfee0/lava-logs.yaml 2026-04-22 00:52:36,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:52:36,273 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:52:36,274 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69e81828afb86e738cacfee0/lava_callback.json.gz 2026-04-22 00:52:36,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:52:36,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81828afb86e738cacfee0 HTTP/1.1" 200 None 2026-04-22 00:52:36,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:52:36,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8139bafb86e738cacfb7c HTTP/1.1" 200 None 2026-04-22 00:52:36,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:52:36,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e81828afb86e738cacfee0 HTTP/1.1" 200 None 2026-04-22 00:52:36,355 - lava_callback - INFO - Completed processing callback for node 69e81828afb86e738cacfee0 INFO: 172.21.0.1:48486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52596 - "GET / HTTP/1.0" 200 OK 2026-04-22 00:52:52,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:52:52,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37342 - "GET / HTTP/1.0" 200 OK 2026-04-22 00:53:09,197 - lava_callback - INFO - Received callback for node 69e817f9afb86e738cacfe37 INFO: 172.21.0.1:37354 - "POST /node/69e817f9afb86e738cacfe37 HTTP/1.0" 202 Accepted 2026-04-22 00:53:09,204 - lava_callback - INFO - Starting async job submit for node 69e817f9afb86e738cacfe37 2026-04-22 00:53:09,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:53:09,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e817f9afb86e738cacfe37 HTTP/1.1" 200 None 2026-04-22 00:53:09,272 - lava_callback - DEBUG - Processing node 69e817f9afb86e738cacfe37: baseline-arm 2026-04-22 00:53:10,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:53:10,120 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:53:10,122 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e817f9afb86e738cacfe37/log.txt.gz 2026-04-22 00:53:10,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:53:10,924 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:53:10,926 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e817f9afb86e738cacfe37/lava-logs.yaml 2026-04-22 00:53:10,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:53:11,051 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:53:11,052 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e817f9afb86e738cacfe37/lava_callback.json.gz DEBUG: Setup failed for 69e817f9afb86e738cacfe37. Transitting job node result: incomplete -> fail 2026-04-22 00:53:11,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:53:11,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e817f9afb86e738cacfe37 HTTP/1.1" 200 None 2026-04-22 00:53:11,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:53:11,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8139bafb86e738cacfb7c HTTP/1.1" 200 None 2026-04-22 00:53:11,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:53:11,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e817f9afb86e738cacfe37 HTTP/1.1" 200 None 2026-04-22 00:53:11,311 - lava_callback - INFO - Completed processing callback for node 69e817f9afb86e738cacfe37 INFO: 172.21.0.1:55380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55394 - "GET / HTTP/1.0" 200 OK 2026-04-22 00:53:22,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:53:22,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52408 - "GET / HTTP/1.0" 200 OK 2026-04-22 00:53:53,844 - lava_callback - INFO - Received callback for node 69e8182bafb86e738cacfee6 INFO: 172.21.0.1:51724 - "POST /node/69e8182bafb86e738cacfee6 HTTP/1.0" 202 Accepted 2026-04-22 00:53:53,851 - lava_callback - INFO - Starting async job submit for node 69e8182bafb86e738cacfee6 2026-04-22 00:53:53,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:53:53,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8182bafb86e738cacfee6 HTTP/1.1" 200 None 2026-04-22 00:53:53,918 - lava_callback - DEBUG - Processing node 69e8182bafb86e738cacfee6: ltp-controllers 2026-04-22 00:53:54,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:53:54,517 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:53:54,519 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-controllers-69e8182bafb86e738cacfee6/log.txt.gz 2026-04-22 00:53:54,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:53:54,965 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:53:54,967 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-controllers-69e8182bafb86e738cacfee6/lava-logs.yaml 2026-04-22 00:53:54,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:53:55,122 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:53:55,124 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-controllers-69e8182bafb86e738cacfee6/lava_callback.json.gz 2026-04-22 00:53:55,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:53:55,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8182bafb86e738cacfee6 HTTP/1.1" 200 None 2026-04-22 00:53:55,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:53:55,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8139bafb86e738cacfb7c HTTP/1.1" 200 None 2026-04-22 00:53:55,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:53:55,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e8182bafb86e738cacfee6 HTTP/1.1" 200 None 2026-04-22 00:53:55,214 - lava_callback - INFO - Completed processing callback for node 69e8182bafb86e738cacfee6 INFO: 172.21.0.1:51740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55806 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55822 - "GET / HTTP/1.0" 200 OK 2026-04-22 00:54:22,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:54:22,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49308 - "GET / HTTP/1.0" 200 OK 2026-04-22 00:54:31,433 - lava_callback - INFO - Received callback for node 69e81c3cafb86e738cad0213 INFO: 172.21.0.1:42412 - "POST /node/69e81c3cafb86e738cad0213 HTTP/1.0" 202 Accepted 2026-04-22 00:54:31,439 - lava_callback - INFO - Starting async job submit for node 69e81c3cafb86e738cad0213 2026-04-22 00:54:31,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:54:31,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81c3cafb86e738cad0213 HTTP/1.1" 200 None 2026-04-22 00:54:31,457 - lava_callback - DEBUG - Processing node 69e81c3cafb86e738cad0213: baseline-arm 2026-04-22 00:54:31,462 - lava_callback - WARNING - Failed to upload log 2026-04-22 00:54:31,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:54:31,557 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:54:31,558 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e81c3cafb86e738cad0213/lava-logs.yaml 2026-04-22 00:54:31,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:54:31,641 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:54:31,643 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e81c3cafb86e738cad0213/lava_callback.json.gz 2026-04-22 00:54:31,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:54:31,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81c3cafb86e738cad0213 HTTP/1.1" 200 None 2026-04-22 00:54:31,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:54:31,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8139bafb86e738cacfb7c HTTP/1.1" 200 None 2026-04-22 00:54:31,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:54:31,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e81c3cafb86e738cad0213 HTTP/1.1" 200 None 2026-04-22 00:54:31,705 - lava_callback - INFO - Completed processing callback for node 69e81c3cafb86e738cad0213 INFO: 172.21.0.1:42424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37986 - "GET / HTTP/1.0" 200 OK 2026-04-22 00:54:52,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:54:52,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47918 - "GET / HTTP/1.0" 200 OK 2026-04-22 00:56:14,123 - lava_callback - INFO - Received callback for node 69e8182dafb86e738cacfeed INFO: 172.21.0.1:52772 - "POST /node/69e8182dafb86e738cacfeed HTTP/1.0" 202 Accepted 2026-04-22 00:56:14,134 - lava_callback - INFO - Starting async job submit for node 69e8182dafb86e738cacfeed 2026-04-22 00:56:14,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:56:14,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8182dafb86e738cacfeed HTTP/1.1" 200 None 2026-04-22 00:56:14,215 - lava_callback - DEBUG - Processing node 69e8182dafb86e738cacfeed: ltp-cve 2026-04-22 00:56:14,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:56:15,001 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:56:15,003 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cve-69e8182dafb86e738cacfeed/log.txt.gz INFO: 172.21.0.1:52782 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-22 00:56:15,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:56:15,584 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:56:15,587 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cve-69e8182dafb86e738cacfeed/lava-logs.yaml 2026-04-22 00:56:15,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:56:15,765 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:56:15,767 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cve-69e8182dafb86e738cacfeed/lava_callback.json.gz 2026-04-22 00:56:15,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:56:15,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8182dafb86e738cacfeed HTTP/1.1" 200 None 2026-04-22 00:56:15,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:56:15,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8139bafb86e738cacfb7c HTTP/1.1" 200 None 2026-04-22 00:56:15,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:56:15,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e8182dafb86e738cacfeed HTTP/1.1" 200 None 2026-04-22 00:56:15,873 - lava_callback - INFO - Completed processing callback for node 69e8182dafb86e738cacfeed INFO: 172.21.0.1:52794 - "GET / HTTP/1.0" 200 OK 2026-04-22 00:56:22,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:56:22,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33400 - "GET / HTTP/1.0" 200 OK 2026-04-22 00:57:15,059 - lava_callback - INFO - Received callback for node 69e81831afb86e738cacfef3 INFO: 172.21.0.1:35626 - "POST /node/69e81831afb86e738cacfef3 HTTP/1.0" 202 Accepted 2026-04-22 00:57:15,067 - lava_callback - INFO - Starting async job submit for node 69e81831afb86e738cacfef3 2026-04-22 00:57:15,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:57:15,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81831afb86e738cacfef3 HTTP/1.1" 200 None 2026-04-22 00:57:15,145 - lava_callback - DEBUG - Processing node 69e81831afb86e738cacfef3: ltp-fs_bind INFO: 172.21.0.1:35634 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-22 00:57:15,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:57:15,712 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:57:15,713 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69e81831afb86e738cacfef3/log.txt.gz 2026-04-22 00:57:15,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:57:16,153 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:57:16,155 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69e81831afb86e738cacfef3/lava-logs.yaml 2026-04-22 00:57:16,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:57:16,282 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:57:16,283 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69e81831afb86e738cacfef3/lava_callback.json.gz 2026-04-22 00:57:16,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:57:16,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81831afb86e738cacfef3 HTTP/1.1" 200 None 2026-04-22 00:57:16,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:57:16,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8139bafb86e738cacfb7c HTTP/1.1" 200 None 2026-04-22 00:57:16,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:57:16,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e81831afb86e738cacfef3 HTTP/1.1" 200 None 2026-04-22 00:57:16,399 - lava_callback - INFO - Completed processing callback for node 69e81831afb86e738cacfef3 INFO: 172.21.0.1:35646 - "GET / HTTP/1.0" 200 OK 2026-04-22 00:57:22,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:57:22,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55364 - "GET / HTTP/1.0" 200 OK 2026-04-22 00:57:54,650 - lava_callback - INFO - Received callback for node 69e81832afb86e738cacff14 INFO: 172.21.0.1:53850 - "POST /node/69e81832afb86e738cacff14 HTTP/1.0" 202 Accepted 2026-04-22 00:57:54,657 - lava_callback - INFO - Starting async job submit for node 69e81832afb86e738cacff14 2026-04-22 00:57:54,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:57:54,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81832afb86e738cacff14 HTTP/1.1" 200 None 2026-04-22 00:57:54,700 - lava_callback - DEBUG - Processing node 69e81832afb86e738cacff14: ltp-fsx 2026-04-22 00:57:55,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:57:55,137 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:57:55,139 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fsx-69e81832afb86e738cacff14/log.txt.gz 2026-04-22 00:57:55,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:57:55,532 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:57:55,535 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fsx-69e81832afb86e738cacff14/lava-logs.yaml 2026-04-22 00:57:55,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 00:57:55,660 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 00:57:55,662 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fsx-69e81832afb86e738cacff14/lava_callback.json.gz 2026-04-22 00:57:55,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:57:55,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81832afb86e738cacff14 HTTP/1.1" 200 None 2026-04-22 00:57:55,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:57:55,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8139bafb86e738cacfb7c HTTP/1.1" 200 None 2026-04-22 00:57:55,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:57:55,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e81832afb86e738cacff14 HTTP/1.1" 200 None 2026-04-22 00:57:55,740 - lava_callback - INFO - Completed processing callback for node 69e81832afb86e738cacff14 INFO: 172.21.0.1:53854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60182 - "GET / HTTP/1.0" 200 OK 2026-04-22 00:58:22,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 00:58:22,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39266 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56042 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-22 01:00:16,452 - lava_callback - INFO - Received callback for node 69e81d99afb86e738cad031b INFO: 172.21.0.1:56052 - "POST /node/69e81d99afb86e738cad031b HTTP/1.0" 202 Accepted 2026-04-22 01:00:16,458 - lava_callback - INFO - Starting async job submit for node 69e81d99afb86e738cad031b 2026-04-22 01:00:16,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:00:16,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81d99afb86e738cad031b HTTP/1.1" 200 None 2026-04-22 01:00:16,479 - lava_callback - DEBUG - Processing node 69e81d99afb86e738cad031b: baseline-nfs-arm64 2026-04-22 01:00:16,480 - lava_callback - WARNING - Failed to upload log 2026-04-22 01:00:16,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:56068 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:00:16,581 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:00:16,583 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e81d99afb86e738cad031b/lava-logs.yaml 2026-04-22 01:00:16,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:00:16,714 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:00:16,716 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e81d99afb86e738cad031b/lava_callback.json.gz 2026-04-22 01:00:16,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:00:16,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81d99afb86e738cad031b HTTP/1.1" 200 None 2026-04-22 01:00:16,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:00:16,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 01:00:16,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:00:16,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e81d99afb86e738cad031b HTTP/1.1" 200 None 2026-04-22 01:00:16,786 - lava_callback - INFO - Completed processing callback for node 69e81d99afb86e738cad031b 2026-04-22 01:00:22,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:00:22,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59442 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:00:29,733 - lava_callback - INFO - Received callback for node 69e81d7dafb86e738cad02b3 INFO: 172.21.0.1:35750 - "POST /node/69e81d7dafb86e738cad02b3 HTTP/1.0" 202 Accepted 2026-04-22 01:00:29,740 - lava_callback - INFO - Starting async job submit for node 69e81d7dafb86e738cad02b3 2026-04-22 01:00:29,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:00:29,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81d7dafb86e738cad02b3 HTTP/1.1" 200 None 2026-04-22 01:00:29,785 - lava_callback - DEBUG - Processing node 69e81d7dafb86e738cad02b3: baseline-arm64 2026-04-22 01:00:29,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:00:30,105 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:00:30,107 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e81d7dafb86e738cad02b3/log.txt.gz 2026-04-22 01:00:30,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:00:30,406 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:00:30,407 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e81d7dafb86e738cad02b3/lava-logs.yaml 2026-04-22 01:00:30,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:00:30,504 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:00:30,505 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e81d7dafb86e738cad02b3/lava_callback.json.gz 2026-04-22 01:00:30,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:00:30,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81d7dafb86e738cad02b3 HTTP/1.1" 200 None 2026-04-22 01:00:30,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:00:30,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 01:00:30,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:00:30,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e81d7dafb86e738cad02b3 HTTP/1.1" 200 None 2026-04-22 01:00:30,580 - lava_callback - INFO - Completed processing callback for node 69e81d7dafb86e738cad02b3 INFO: 172.21.0.1:35758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53356 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:00:52,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:00:52,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60668 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:01:01,092 - lava_callback - INFO - Received callback for node 69e81d7eafb86e738cad02b9 INFO: 172.21.0.1:45808 - "POST /node/69e81d7eafb86e738cad02b9 HTTP/1.0" 202 Accepted 2026-04-22 01:01:01,099 - lava_callback - INFO - Starting async job submit for node 69e81d7eafb86e738cad02b9 2026-04-22 01:01:01,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:01:01,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81d7eafb86e738cad02b9 HTTP/1.1" 200 None 2026-04-22 01:01:01,138 - lava_callback - DEBUG - Processing node 69e81d7eafb86e738cad02b9: baseline-arm64 2026-04-22 01:01:01,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:01:01,571 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:01:01,573 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e81d7eafb86e738cad02b9/log.txt.gz 2026-04-22 01:01:01,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:01:01,912 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:01:01,914 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e81d7eafb86e738cad02b9/lava-logs.yaml 2026-04-22 01:01:01,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:01:02,027 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:01:02,028 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e81d7eafb86e738cad02b9/lava_callback.json.gz 2026-04-22 01:01:02,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:01:02,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81d7eafb86e738cad02b9 HTTP/1.1" 200 None 2026-04-22 01:01:02,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:01:02,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 01:01:02,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:01:02,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e81d7eafb86e738cad02b9 HTTP/1.1" 200 None 2026-04-22 01:01:02,108 - lava_callback - INFO - Completed processing callback for node 69e81d7eafb86e738cad02b9 2026-04-22 01:01:03,938 - lava_callback - INFO - Received callback for node 69e81d88afb86e738cad02d4 INFO: 172.21.0.1:45814 - "POST /node/69e81d88afb86e738cad02d4 HTTP/1.0" 202 Accepted 2026-04-22 01:01:03,945 - lava_callback - INFO - Starting async job submit for node 69e81d88afb86e738cad02d4 2026-04-22 01:01:03,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:01:03,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81d88afb86e738cad02d4 HTTP/1.1" 200 None 2026-04-22 01:01:03,980 - lava_callback - DEBUG - Processing node 69e81d88afb86e738cad02d4: baseline-arm64 2026-04-22 01:01:04,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:01:04,231 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:01:04,234 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e81d88afb86e738cad02d4/log.txt.gz 2026-04-22 01:01:04,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:01:04,473 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:01:04,475 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e81d88afb86e738cad02d4/lava-logs.yaml 2026-04-22 01:01:04,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:01:04,591 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:01:04,593 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e81d88afb86e738cad02d4/lava_callback.json.gz 2026-04-22 01:01:04,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:01:04,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81d88afb86e738cad02d4 HTTP/1.1" 200 None 2026-04-22 01:01:04,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:01:04,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 01:01:04,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:01:04,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e81d88afb86e738cad02d4 HTTP/1.1" 200 None 2026-04-22 01:01:04,681 - lava_callback - INFO - Completed processing callback for node 69e81d88afb86e738cad02d4 INFO: 172.21.0.1:45822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33426 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:01:17,441 - lava_callback - INFO - Received callback for node 69e81d7dafb86e738cad02b6 INFO: 172.21.0.1:33430 - "POST /node/69e81d7dafb86e738cad02b6 HTTP/1.0" 202 Accepted 2026-04-22 01:01:17,447 - lava_callback - INFO - Starting async job submit for node 69e81d7dafb86e738cad02b6 2026-04-22 01:01:17,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:01:17,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81d7dafb86e738cad02b6 HTTP/1.1" 200 None 2026-04-22 01:01:17,487 - lava_callback - DEBUG - Processing node 69e81d7dafb86e738cad02b6: baseline-arm64 2026-04-22 01:01:17,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:01:17,863 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:01:17,864 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e81d7dafb86e738cad02b6/log.txt.gz 2026-04-22 01:01:18,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:01:18,175 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:01:18,177 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e81d7dafb86e738cad02b6/lava-logs.yaml 2026-04-22 01:01:18,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:01:18,330 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:01:18,332 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e81d7dafb86e738cad02b6/lava_callback.json.gz 2026-04-22 01:01:18,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:01:18,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81d7dafb86e738cad02b6 HTTP/1.1" 200 None 2026-04-22 01:01:18,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:01:18,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 01:01:18,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:01:18,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e81d7dafb86e738cad02b6 HTTP/1.1" 200 None 2026-04-22 01:01:18,460 - lava_callback - INFO - Completed processing callback for node 69e81d7dafb86e738cad02b6 2026-04-22 01:01:22,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:01:22,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-22 01:01:22,989 - lava_callback - INFO - Received callback for node 69e81d86afb86e738cad02ce INFO: 172.21.0.1:36640 - "POST /node/69e81d86afb86e738cad02ce HTTP/1.0" 202 Accepted 2026-04-22 01:01:22,996 - lava_callback - INFO - Starting async job submit for node 69e81d86afb86e738cad02ce 2026-04-22 01:01:23,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:01:23,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81d86afb86e738cad02ce HTTP/1.1" 200 None 2026-04-22 01:01:23,066 - lava_callback - DEBUG - Processing node 69e81d86afb86e738cad02ce: baseline-arm64 2026-04-22 01:01:23,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:01:23,632 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:01:23,634 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e81d86afb86e738cad02ce/log.txt.gz 2026-04-22 01:01:23,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:01:24,045 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:01:24,047 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e81d86afb86e738cad02ce/lava-logs.yaml 2026-04-22 01:01:24,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:01:24,171 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:01:24,173 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e81d86afb86e738cad02ce/lava_callback.json.gz 2026-04-22 01:01:24,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:01:24,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81d86afb86e738cad02ce HTTP/1.1" 200 None 2026-04-22 01:01:24,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:01:24,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 01:01:24,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:01:24,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e81d86afb86e738cad02ce HTTP/1.1" 200 None 2026-04-22 01:01:24,264 - lava_callback - INFO - Completed processing callback for node 69e81d86afb86e738cad02ce INFO: 172.21.0.1:36650 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:01:27,374 - lava_callback - INFO - Received callback for node 69e81d80afb86e738cad02bf INFO: 172.21.0.1:36654 - "POST /node/69e81d80afb86e738cad02bf HTTP/1.0" 202 Accepted 2026-04-22 01:01:27,382 - lava_callback - INFO - Starting async job submit for node 69e81d80afb86e738cad02bf 2026-04-22 01:01:27,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:01:27,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81d80afb86e738cad02bf HTTP/1.1" 200 None 2026-04-22 01:01:27,428 - lava_callback - DEBUG - Processing node 69e81d80afb86e738cad02bf: baseline-arm64 2026-04-22 01:01:27,582 - lava_callback - WARNING - Failed to upload log 2026-04-22 01:01:27,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:01:27,774 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:01:27,775 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e81d80afb86e738cad02bf/lava-logs.yaml 2026-04-22 01:01:27,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:01:27,880 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:01:27,882 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e81d80afb86e738cad02bf/lava_callback.json.gz 2026-04-22 01:01:27,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:01:27,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81d80afb86e738cad02bf HTTP/1.1" 200 None 2026-04-22 01:01:27,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:01:27,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 01:01:27,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:01:27,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e81d80afb86e738cad02bf HTTP/1.1" 200 None 2026-04-22 01:01:28,019 - lava_callback - INFO - Completed processing callback for node 69e81d80afb86e738cad02bf 2026-04-22 01:01:34,621 - lava_callback - INFO - Received callback for node 69e81d84afb86e738cad02cb INFO: 172.21.0.1:32822 - "POST /node/69e81d84afb86e738cad02cb HTTP/1.0" 202 Accepted 2026-04-22 01:01:34,627 - lava_callback - INFO - Starting async job submit for node 69e81d84afb86e738cad02cb 2026-04-22 01:01:34,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:01:34,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81d84afb86e738cad02cb HTTP/1.1" 200 None 2026-04-22 01:01:34,666 - lava_callback - DEBUG - Processing node 69e81d84afb86e738cad02cb: baseline-arm64 2026-04-22 01:01:35,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:01:35,148 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:01:35,149 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e81d84afb86e738cad02cb/log.txt.gz 2026-04-22 01:01:35,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:01:35,531 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:01:35,532 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e81d84afb86e738cad02cb/lava-logs.yaml 2026-04-22 01:01:35,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:01:35,669 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:01:35,671 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e81d84afb86e738cad02cb/lava_callback.json.gz 2026-04-22 01:01:35,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:01:35,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81d84afb86e738cad02cb HTTP/1.1" 200 None 2026-04-22 01:01:35,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:01:35,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 01:01:35,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:01:35,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e81d84afb86e738cad02cb HTTP/1.1" 200 None 2026-04-22 01:01:35,765 - lava_callback - INFO - Completed processing callback for node 69e81d84afb86e738cad02cb INFO: 172.21.0.1:32828 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:01:38,282 - lava_callback - INFO - Received callback for node 69e81d8cafb86e738cad02e0 INFO: 172.21.0.1:32842 - "POST /node/69e81d8cafb86e738cad02e0 HTTP/1.0" 202 Accepted 2026-04-22 01:01:38,289 - lava_callback - INFO - Starting async job submit for node 69e81d8cafb86e738cad02e0 2026-04-22 01:01:38,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:01:38,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81d8cafb86e738cad02e0 HTTP/1.1" 200 None 2026-04-22 01:01:38,332 - lava_callback - DEBUG - Processing node 69e81d8cafb86e738cad02e0: baseline-arm64 2026-04-22 01:01:38,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:01:38,754 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:01:38,756 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e81d8cafb86e738cad02e0/log.txt.gz 2026-04-22 01:01:38,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:01:39,054 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:01:39,056 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e81d8cafb86e738cad02e0/lava-logs.yaml 2026-04-22 01:01:39,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:01:39,193 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:01:39,194 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e81d8cafb86e738cad02e0/lava_callback.json.gz 2026-04-22 01:01:39,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:01:39,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81d8cafb86e738cad02e0 HTTP/1.1" 200 None 2026-04-22 01:01:39,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:01:39,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 01:01:39,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:01:39,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e81d8cafb86e738cad02e0 HTTP/1.1" 200 None 2026-04-22 01:01:39,268 - lava_callback - INFO - Completed processing callback for node 69e81d8cafb86e738cad02e0 INFO: 172.21.0.1:48064 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:01:42,678 - lava_callback - INFO - Received callback for node 69e81d81afb86e738cad02c2 INFO: 172.21.0.1:48066 - "POST /node/69e81d81afb86e738cad02c2 HTTP/1.0" 202 Accepted 2026-04-22 01:01:42,685 - lava_callback - INFO - Starting async job submit for node 69e81d81afb86e738cad02c2 2026-04-22 01:01:42,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:01:42,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81d81afb86e738cad02c2 HTTP/1.1" 200 None 2026-04-22 01:01:42,730 - lava_callback - DEBUG - Processing node 69e81d81afb86e738cad02c2: baseline-arm64 2026-04-22 01:01:42,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:01:42,959 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:01:42,961 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e81d81afb86e738cad02c2/log.txt.gz 2026-04-22 01:01:43,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:01:43,176 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:01:43,178 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e81d81afb86e738cad02c2/lava-logs.yaml 2026-04-22 01:01:43,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:01:43,259 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:01:43,261 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e81d81afb86e738cad02c2/lava_callback.json.gz 2026-04-22 01:01:43,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:01:43,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81d81afb86e738cad02c2 HTTP/1.1" 200 None 2026-04-22 01:01:43,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:01:43,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 01:01:43,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:01:43,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e81d81afb86e738cad02c2 HTTP/1.1" 200 None 2026-04-22 01:01:43,392 - lava_callback - INFO - Completed processing callback for node 69e81d81afb86e738cad02c2 2026-04-22 01:01:43,885 - lava_callback - INFO - Received callback for node 69e81d8bafb86e738cad02dd INFO: 172.21.0.1:48068 - "POST /node/69e81d8bafb86e738cad02dd HTTP/1.0" 202 Accepted 2026-04-22 01:01:43,891 - lava_callback - INFO - Starting async job submit for node 69e81d8bafb86e738cad02dd 2026-04-22 01:01:43,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:01:43,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81d8bafb86e738cad02dd HTTP/1.1" 200 None 2026-04-22 01:01:43,928 - lava_callback - DEBUG - Processing node 69e81d8bafb86e738cad02dd: baseline-arm64 2026-04-22 01:01:44,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:01:44,370 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:01:44,372 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e81d8bafb86e738cad02dd/log.txt.gz 2026-04-22 01:01:44,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:01:44,706 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:01:44,708 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e81d8bafb86e738cad02dd/lava-logs.yaml 2026-04-22 01:01:44,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:01:44,810 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:01:44,811 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e81d8bafb86e738cad02dd/lava_callback.json.gz 2026-04-22 01:01:44,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:01:44,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81d8bafb86e738cad02dd HTTP/1.1" 200 None 2026-04-22 01:01:44,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:01:44,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 01:01:44,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:01:44,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e81d8bafb86e738cad02dd HTTP/1.1" 200 None 2026-04-22 01:01:44,888 - lava_callback - INFO - Completed processing callback for node 69e81d8bafb86e738cad02dd INFO: 172.21.0.1:48070 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:01:52,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:01:52,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-22 01:01:54,500 - lava_callback - INFO - Received callback for node 69e81834afb86e738cacff19 INFO: 172.21.0.1:56632 - "POST /node/69e81834afb86e738cacff19 HTTP/1.0" 202 Accepted 2026-04-22 01:01:54,506 - lava_callback - INFO - Starting async job submit for node 69e81834afb86e738cacff19 2026-04-22 01:01:54,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:01:54,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81834afb86e738cacff19 HTTP/1.1" 200 None 2026-04-22 01:01:54,553 - lava_callback - DEBUG - Processing node 69e81834afb86e738cacff19: ltp-input 2026-04-22 01:01:55,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:01:55,126 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:01:55,129 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-input-69e81834afb86e738cacff19/log.txt.gz 2026-04-22 01:01:55,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:01:55,571 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:01:55,573 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-input-69e81834afb86e738cacff19/lava-logs.yaml 2026-04-22 01:01:55,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:01:55,727 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:01:55,729 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-input-69e81834afb86e738cacff19/lava_callback.json.gz 2026-04-22 01:01:55,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:01:55,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81834afb86e738cacff19 HTTP/1.1" 200 None 2026-04-22 01:01:55,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:01:55,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8139bafb86e738cacfb7c HTTP/1.1" 200 None 2026-04-22 01:01:55,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:01:55,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e81834afb86e738cacff19 HTTP/1.1" 200 None 2026-04-22 01:01:55,830 - lava_callback - INFO - Completed processing callback for node 69e81834afb86e738cacff19 INFO: 172.21.0.1:56648 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:01:57,933 - lava_callback - INFO - Received callback for node 69e81d96afb86e738cad02f5 INFO: 172.21.0.1:56656 - "POST /node/69e81d96afb86e738cad02f5 HTTP/1.0" 202 Accepted 2026-04-22 01:01:57,943 - lava_callback - INFO - Starting async job submit for node 69e81d96afb86e738cad02f5 2026-04-22 01:01:57,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:01:57,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81d96afb86e738cad02f5 HTTP/1.1" 200 None 2026-04-22 01:01:57,994 - lava_callback - DEBUG - Processing node 69e81d96afb86e738cad02f5: baseline-nfs-arm64 2026-04-22 01:01:58,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:01:58,739 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:01:58,740 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e81d96afb86e738cad02f5/log.txt.gz 2026-04-22 01:01:58,852 - lava_callback - INFO - Received callback for node 69e81d98afb86e738cad0318 INFO: 172.21.0.1:56670 - "POST /node/69e81d98afb86e738cad0318 HTTP/1.0" 202 Accepted 2026-04-22 01:01:58,876 - lava_callback - INFO - Starting async job submit for node 69e81d98afb86e738cad0318 2026-04-22 01:01:58,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:01:59,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81d98afb86e738cad0318 HTTP/1.1" 200 None 2026-04-22 01:01:59,011 - lava_callback - DEBUG - Processing node 69e81d98afb86e738cad0318: baseline-nfs-arm64 2026-04-22 01:01:59,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:01:59,725 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:01:59,767 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e81d96afb86e738cad02f5/lava-logs.yaml 2026-04-22 01:01:59,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:01:59,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:01:59,886 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:01:59,888 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e81d98afb86e738cad0318/log.txt.gz 2026-04-22 01:01:59,945 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:01:59,979 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e81d96afb86e738cad02f5/lava_callback.json.gz 2026-04-22 01:02:00,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:00,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81d96afb86e738cad02f5 HTTP/1.1" 200 None 2026-04-22 01:02:00,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:00,220 - lava_callback - INFO - Received callback for node 69e81d87afb86e738cad02d1 2026-04-22 01:02:00,244 - lava_callback - INFO - Starting async job submit for node 69e81d87afb86e738cad02d1 INFO: 172.21.0.1:58446 - "POST /node/69e81d87afb86e738cad02d1 HTTP/1.0" 202 Accepted 2026-04-22 01:02:00,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:00,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 01:02:00,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:00,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81d87afb86e738cad02d1 HTTP/1.1" 200 None 2026-04-22 01:02:00,415 - lava_callback - DEBUG - Processing node 69e81d87afb86e738cad02d1: baseline-arm64 2026-04-22 01:02:00,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:02:00,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e81d96afb86e738cad02f5 HTTP/1.1" 200 None 2026-04-22 01:02:00,460 - lava_callback - INFO - Completed processing callback for node 69e81d96afb86e738cad02f5 2026-04-22 01:02:00,761 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:02:00,809 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e81d98afb86e738cad0318/lava-logs.yaml 2026-04-22 01:02:00,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:02:01,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:02:01,118 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:02:01,121 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e81d98afb86e738cad0318/lava_callback.json.gz 2026-04-22 01:02:01,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:01,165 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:02:01,167 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e81d87afb86e738cad02d1/log.txt.gz 2026-04-22 01:02:01,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81d98afb86e738cad0318 HTTP/1.1" 200 None 2026-04-22 01:02:01,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:01,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 01:02:01,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:01,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e81d98afb86e738cad0318 HTTP/1.1" 200 None 2026-04-22 01:02:01,406 - lava_callback - INFO - Completed processing callback for node 69e81d98afb86e738cad0318 2026-04-22 01:02:01,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:02:01,758 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:02:01,760 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e81d87afb86e738cad02d1/lava-logs.yaml 2026-04-22 01:02:01,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:02:01,917 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:02:01,920 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e81d87afb86e738cad02d1/lava_callback.json.gz 2026-04-22 01:02:01,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:02,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81d87afb86e738cad02d1 HTTP/1.1" 200 None 2026-04-22 01:02:02,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:02,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 01:02:02,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:02,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e81d87afb86e738cad02d1 HTTP/1.1" 200 None 2026-04-22 01:02:02,161 - lava_callback - INFO - Completed processing callback for node 69e81d87afb86e738cad02d1 2026-04-22 01:02:02,925 - lava_callback - INFO - Received callback for node 69e81d83afb86e738cad02c8 INFO: 172.21.0.1:58462 - "POST /node/69e81d83afb86e738cad02c8 HTTP/1.0" 202 Accepted 2026-04-22 01:02:02,932 - lava_callback - INFO - Starting async job submit for node 69e81d83afb86e738cad02c8 2026-04-22 01:02:02,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:02,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81d83afb86e738cad02c8 HTTP/1.1" 200 None 2026-04-22 01:02:02,968 - lava_callback - DEBUG - Processing node 69e81d83afb86e738cad02c8: baseline-arm64 2026-04-22 01:02:03,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:02:03,346 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:02:03,348 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e81d83afb86e738cad02c8/log.txt.gz 2026-04-22 01:02:03,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:02:03,691 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:02:03,693 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e81d83afb86e738cad02c8/lava-logs.yaml 2026-04-22 01:02:03,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:02:03,811 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:02:03,813 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e81d83afb86e738cad02c8/lava_callback.json.gz 2026-04-22 01:02:03,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:03,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81d83afb86e738cad02c8 HTTP/1.1" 200 None 2026-04-22 01:02:03,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:03,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 01:02:03,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:03,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e81d83afb86e738cad02c8 HTTP/1.1" 200 None 2026-04-22 01:02:03,886 - lava_callback - INFO - Completed processing callback for node 69e81d83afb86e738cad02c8 2026-04-22 01:02:06,086 - lava_callback - INFO - Received callback for node 69e81d89afb86e738cad02d7 INFO: 172.21.0.1:58476 - "POST /node/69e81d89afb86e738cad02d7 HTTP/1.0" 202 Accepted 2026-04-22 01:02:06,097 - lava_callback - INFO - Starting async job submit for node 69e81d89afb86e738cad02d7 2026-04-22 01:02:06,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:06,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81d89afb86e738cad02d7 HTTP/1.1" 200 None 2026-04-22 01:02:06,179 - lava_callback - DEBUG - Processing node 69e81d89afb86e738cad02d7: baseline-arm64 2026-04-22 01:02:06,313 - lava_callback - INFO - Received callback for node 69e81dc5afb86e738cad03aa INFO: 172.21.0.1:58486 - "POST /node/69e81dc5afb86e738cad03aa HTTP/1.0" 202 Accepted 2026-04-22 01:02:06,332 - lava_callback - INFO - Starting async job submit for node 69e81dc5afb86e738cad03aa 2026-04-22 01:02:06,375 - lava_callback - INFO - Received callback for node 69e81dc0afb86e738cad0398 2026-04-22 01:02:06,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:58488 - "POST /node/69e81dc0afb86e738cad0398 HTTP/1.0" 202 Accepted 2026-04-22 01:02:06,407 - lava_callback - INFO - Starting async job submit for node 69e81dc0afb86e738cad0398 2026-04-22 01:02:06,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:58498 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:02:06,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81dc5afb86e738cad03aa HTTP/1.1" 200 None 2026-04-22 01:02:06,563 - lava_callback - DEBUG - Processing node 69e81dc5afb86e738cad03aa: baseline-arm64-foundriesio 2026-04-22 01:02:06,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81dc0afb86e738cad0398 HTTP/1.1" 200 None 2026-04-22 01:02:06,600 - lava_callback - DEBUG - Processing node 69e81dc0afb86e738cad0398: baseline-arm64-kontron 2026-04-22 01:02:06,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:02:07,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:02:07,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:02:07,197 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:02:07,199 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e81d89afb86e738cad02d7/log.txt.gz 2026-04-22 01:02:07,281 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:02:07,304 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:02:07,318 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e81dc5afb86e738cad03aa/log.txt.gz 2026-04-22 01:02:07,373 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69e81dc0afb86e738cad0398/log.txt.gz 2026-04-22 01:02:07,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:02:07,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:02:07,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:02:07,804 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:02:07,806 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e81d89afb86e738cad02d7/lava-logs.yaml 2026-04-22 01:02:07,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:02:07,819 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:02:07,821 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e81dc5afb86e738cad03aa/lava-logs.yaml 2026-04-22 01:02:07,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:02:07,855 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:02:07,857 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69e81dc0afb86e738cad0398/lava-logs.yaml 2026-04-22 01:02:07,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:02:07,938 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:02:07,940 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e81d89afb86e738cad02d7/lava_callback.json.gz 2026-04-22 01:02:07,959 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:02:07,965 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:02:07,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:07,967 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e81dc5afb86e738cad03aa/lava_callback.json.gz 2026-04-22 01:02:07,972 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69e81dc0afb86e738cad0398/lava_callback.json.gz 2026-04-22 01:02:08,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:08,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:08,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81d89afb86e738cad02d7 HTTP/1.1" 200 None 2026-04-22 01:02:08,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:08,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81dc5afb86e738cad03aa HTTP/1.1" 200 None 2026-04-22 01:02:08,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:08,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81dc0afb86e738cad0398 HTTP/1.1" 200 None 2026-04-22 01:02:08,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:08,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 01:02:08,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 01:02:08,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:08,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:08,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 01:02:08,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:08,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e81d89afb86e738cad02d7 HTTP/1.1" 200 None 2026-04-22 01:02:08,089 - lava_callback - INFO - Completed processing callback for node 69e81d89afb86e738cad02d7 2026-04-22 01:02:08,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e81dc5afb86e738cad03aa HTTP/1.1" 200 None 2026-04-22 01:02:08,109 - lava_callback - INFO - Completed processing callback for node 69e81dc5afb86e738cad03aa 2026-04-22 01:02:08,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e81dc0afb86e738cad0398 HTTP/1.1" 200 None 2026-04-22 01:02:08,122 - lava_callback - INFO - Completed processing callback for node 69e81dc0afb86e738cad0398 2026-04-22 01:02:11,070 - lava_callback - INFO - Received callback for node 69e81dc2afb86e738cad03a1 INFO: 172.21.0.1:42080 - "POST /node/69e81dc2afb86e738cad03a1 HTTP/1.0" 202 Accepted 2026-04-22 01:02:11,077 - lava_callback - INFO - Starting async job submit for node 69e81dc2afb86e738cad03a1 2026-04-22 01:02:11,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:11,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81dc2afb86e738cad03a1 HTTP/1.1" 200 None 2026-04-22 01:02:11,113 - lava_callback - DEBUG - Processing node 69e81dc2afb86e738cad03a1: baseline-arm64-pengutronix 2026-04-22 01:02:11,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:02:11,395 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:02:11,397 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e81dc2afb86e738cad03a1/log.txt.gz 2026-04-22 01:02:11,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:02:11,657 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:02:11,659 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e81dc2afb86e738cad03a1/lava-logs.yaml 2026-04-22 01:02:11,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:02:11,757 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:02:11,759 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e81dc2afb86e738cad03a1/lava_callback.json.gz 2026-04-22 01:02:11,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:11,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81dc2afb86e738cad03a1 HTTP/1.1" 200 None 2026-04-22 01:02:11,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:11,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 01:02:11,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:11,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e81dc2afb86e738cad03a1 HTTP/1.1" 200 None 2026-04-22 01:02:11,830 - lava_callback - INFO - Completed processing callback for node 69e81dc2afb86e738cad03a1 2026-04-22 01:02:13,787 - lava_callback - INFO - Received callback for node 69e81d8dafb86e738cad02e3 INFO: 172.21.0.1:42084 - "POST /node/69e81d8dafb86e738cad02e3 HTTP/1.0" 202 Accepted 2026-04-22 01:02:13,794 - lava_callback - INFO - Starting async job submit for node 69e81d8dafb86e738cad02e3 2026-04-22 01:02:13,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:13,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81d8dafb86e738cad02e3 HTTP/1.1" 200 None 2026-04-22 01:02:13,837 - lava_callback - DEBUG - Processing node 69e81d8dafb86e738cad02e3: baseline-arm64 2026-04-22 01:02:14,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:02:14,321 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:02:14,323 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e81d8dafb86e738cad02e3/log.txt.gz 2026-04-22 01:02:14,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:02:14,700 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:02:14,702 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e81d8dafb86e738cad02e3/lava-logs.yaml 2026-04-22 01:02:14,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:02:14,812 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:02:14,814 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e81d8dafb86e738cad02e3/lava_callback.json.gz 2026-04-22 01:02:14,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:14,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81d8dafb86e738cad02e3 HTTP/1.1" 200 None 2026-04-22 01:02:14,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:14,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 01:02:14,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:14,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e81d8dafb86e738cad02e3 HTTP/1.1" 200 None 2026-04-22 01:02:14,917 - lava_callback - INFO - Completed processing callback for node 69e81d8dafb86e738cad02e3 INFO: 172.21.0.1:42090 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42104 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:02:18,487 - lava_callback - INFO - Received callback for node 69e81da0afb86e738cad032e INFO: 172.21.0.1:42120 - "POST /node/69e81da0afb86e738cad032e HTTP/1.0" 202 Accepted 2026-04-22 01:02:18,493 - lava_callback - INFO - Starting async job submit for node 69e81da0afb86e738cad032e 2026-04-22 01:02:18,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:18,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81da0afb86e738cad032e HTTP/1.1" 200 None 2026-04-22 01:02:18,536 - lava_callback - DEBUG - Processing node 69e81da0afb86e738cad032e: baseline-nfs-arm64 2026-04-22 01:02:18,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:02:19,088 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:02:19,090 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e81da0afb86e738cad032e/log.txt.gz 2026-04-22 01:02:19,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:02:19,501 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:02:19,503 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e81da0afb86e738cad032e/lava-logs.yaml 2026-04-22 01:02:19,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:02:19,622 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:02:19,624 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e81da0afb86e738cad032e/lava_callback.json.gz 2026-04-22 01:02:19,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:19,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81da0afb86e738cad032e HTTP/1.1" 200 None 2026-04-22 01:02:19,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:19,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 01:02:19,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:19,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e81da0afb86e738cad032e HTTP/1.1" 200 None 2026-04-22 01:02:19,698 - lava_callback - INFO - Completed processing callback for node 69e81da0afb86e738cad032e 2026-04-22 01:02:22,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:22,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-22 01:02:25,311 - lava_callback - INFO - Received callback for node 69e81d7fafb86e738cad02bc INFO: 172.21.0.1:43400 - "POST /node/69e81d7fafb86e738cad02bc HTTP/1.0" 202 Accepted 2026-04-22 01:02:25,317 - lava_callback - INFO - Starting async job submit for node 69e81d7fafb86e738cad02bc 2026-04-22 01:02:25,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:25,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81d7fafb86e738cad02bc HTTP/1.1" 200 None 2026-04-22 01:02:25,353 - lava_callback - DEBUG - Processing node 69e81d7fafb86e738cad02bc: baseline-arm64 2026-04-22 01:02:25,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:02:25,684 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:02:25,686 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e81d7fafb86e738cad02bc/log.txt.gz 2026-04-22 01:02:25,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:02:25,967 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:02:25,969 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e81d7fafb86e738cad02bc/lava-logs.yaml 2026-04-22 01:02:25,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:02:26,097 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:02:26,099 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e81d7fafb86e738cad02bc/lava_callback.json.gz 2026-04-22 01:02:26,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:26,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81d7fafb86e738cad02bc HTTP/1.1" 200 None 2026-04-22 01:02:26,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:26,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 01:02:26,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:26,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e81d7fafb86e738cad02bc HTTP/1.1" 200 None 2026-04-22 01:02:26,209 - lava_callback - INFO - Completed processing callback for node 69e81d7fafb86e738cad02bc INFO: 172.21.0.1:43404 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:02:27,277 - lava_callback - INFO - Received callback for node 69e81dc3afb86e738cad03a4 INFO: 172.21.0.1:43420 - "POST /node/69e81dc3afb86e738cad03a4 HTTP/1.0" 202 Accepted 2026-04-22 01:02:27,283 - lava_callback - INFO - Starting async job submit for node 69e81dc3afb86e738cad03a4 2026-04-22 01:02:27,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:27,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81dc3afb86e738cad03a4 HTTP/1.1" 200 None 2026-04-22 01:02:27,319 - lava_callback - DEBUG - Processing node 69e81dc3afb86e738cad03a4: baseline-arm64-pengutronix 2026-04-22 01:02:27,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:02:27,622 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:02:27,624 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e81dc3afb86e738cad03a4/log.txt.gz 2026-04-22 01:02:27,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:02:27,881 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:02:27,883 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e81dc3afb86e738cad03a4/lava-logs.yaml 2026-04-22 01:02:27,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:02:27,980 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:02:27,982 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e81dc3afb86e738cad03a4/lava_callback.json.gz 2026-04-22 01:02:28,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:28,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81dc3afb86e738cad03a4 HTTP/1.1" 200 None 2026-04-22 01:02:28,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:28,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 01:02:28,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:28,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e81dc3afb86e738cad03a4 HTTP/1.1" 200 None 2026-04-22 01:02:28,073 - lava_callback - INFO - Completed processing callback for node 69e81dc3afb86e738cad03a4 2026-04-22 01:02:33,693 - lava_callback - INFO - Received callback for node 69e81d9bafb86e738cad031e INFO: 172.21.0.1:40818 - "POST /node/69e81d9bafb86e738cad031e HTTP/1.0" 202 Accepted 2026-04-22 01:02:33,700 - lava_callback - INFO - Starting async job submit for node 69e81d9bafb86e738cad031e 2026-04-22 01:02:33,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:33,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81d9bafb86e738cad031e HTTP/1.1" 200 None 2026-04-22 01:02:33,738 - lava_callback - DEBUG - Processing node 69e81d9bafb86e738cad031e: baseline-nfs-arm64 2026-04-22 01:02:34,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:02:34,203 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:02:34,205 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e81d9bafb86e738cad031e/log.txt.gz 2026-04-22 01:02:34,212 - lava_callback - INFO - Received callback for node 69e81db0afb86e738cad034f INFO: 172.21.0.1:40826 - "POST /node/69e81db0afb86e738cad034f HTTP/1.0" 202 Accepted 2026-04-22 01:02:34,234 - lava_callback - INFO - Starting async job submit for node 69e81db0afb86e738cad034f 2026-04-22 01:02:34,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:34,314 - lava_callback - INFO - Received callback for node 69e81d93afb86e738cad02ef INFO: 172.21.0.1:40834 - "POST /node/69e81d93afb86e738cad02ef HTTP/1.0" 202 Accepted 2026-04-22 01:02:34,333 - lava_callback - INFO - Starting async job submit for node 69e81d93afb86e738cad02ef 2026-04-22 01:02:34,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:34,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81db0afb86e738cad034f HTTP/1.1" 200 None 2026-04-22 01:02:34,440 - lava_callback - DEBUG - Processing node 69e81db0afb86e738cad034f: baseline-arm64-broonie 2026-04-22 01:02:34,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81d93afb86e738cad02ef HTTP/1.1" 200 None 2026-04-22 01:02:34,567 - lava_callback - DEBUG - Processing node 69e81d93afb86e738cad02ef: baseline-nfs-arm64 2026-04-22 01:02:34,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:02:35,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:02:35,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:02:35,228 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:02:35,230 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e81d9bafb86e738cad031e/lava-logs.yaml 2026-04-22 01:02:35,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:02:35,303 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:02:35,305 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e81db0afb86e738cad034f/log.txt.gz 2026-04-22 01:02:35,338 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:02:35,373 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:02:35,385 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e81d93afb86e738cad02ef/log.txt.gz 2026-04-22 01:02:35,401 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e81d9bafb86e738cad031e/lava_callback.json.gz 2026-04-22 01:02:35,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:35,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81d9bafb86e738cad031e HTTP/1.1" 200 None 2026-04-22 01:02:35,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:02:35,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:35,698 - lava_callback - INFO - Received callback for node 69e81db6afb86e738cad037d 2026-04-22 01:02:35,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 01:02:35,726 - lava_callback - INFO - Starting async job submit for node 69e81db6afb86e738cad037d INFO: 172.21.0.1:40840 - "POST /node/69e81db6afb86e738cad037d HTTP/1.0" 202 Accepted 2026-04-22 01:02:35,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:35,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:35,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:02:35,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81db6afb86e738cad037d HTTP/1.1" 200 None 2026-04-22 01:02:35,793 - lava_callback - DEBUG - Processing node 69e81db6afb86e738cad037d: baseline-arm64-broonie 2026-04-22 01:02:35,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e81d9bafb86e738cad031e HTTP/1.1" 200 None 2026-04-22 01:02:35,813 - lava_callback - INFO - Completed processing callback for node 69e81d9bafb86e738cad031e 2026-04-22 01:02:35,953 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:02:35,961 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e81db0afb86e738cad034f/lava-logs.yaml 2026-04-22 01:02:35,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:02:36,025 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:02:36,068 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e81d93afb86e738cad02ef/lava-logs.yaml 2026-04-22 01:02:36,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:02:36,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:02:36,282 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:02:36,284 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e81db0afb86e738cad034f/lava_callback.json.gz 2026-04-22 01:02:36,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:36,343 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:02:36,345 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e81d93afb86e738cad02ef/lava_callback.json.gz 2026-04-22 01:02:36,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81db0afb86e738cad034f HTTP/1.1" 200 None 2026-04-22 01:02:36,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:36,374 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:02:36,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:36,376 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e81db6afb86e738cad037d/log.txt.gz 2026-04-22 01:02:36,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 01:02:36,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81d93afb86e738cad02ef HTTP/1.1" 200 None 2026-04-22 01:02:36,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:36,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:40850 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:02:36,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:02:36,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e81db0afb86e738cad034f HTTP/1.1" 200 None 2026-04-22 01:02:36,574 - lava_callback - INFO - Completed processing callback for node 69e81db0afb86e738cad034f 2026-04-22 01:02:36,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 01:02:36,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:36,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e81d93afb86e738cad02ef HTTP/1.1" 200 None 2026-04-22 01:02:36,644 - lava_callback - INFO - Completed processing callback for node 69e81d93afb86e738cad02ef 2026-04-22 01:02:36,791 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:02:36,794 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e81db6afb86e738cad037d/lava-logs.yaml 2026-04-22 01:02:36,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:02:36,919 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:02:36,921 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e81db6afb86e738cad037d/lava_callback.json.gz 2026-04-22 01:02:36,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:36,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81db6afb86e738cad037d HTTP/1.1" 200 None 2026-04-22 01:02:36,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:36,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 01:02:36,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:37,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e81db6afb86e738cad037d HTTP/1.1" 200 None 2026-04-22 01:02:37,004 - lava_callback - INFO - Completed processing callback for node 69e81db6afb86e738cad037d INFO: 172.21.0.1:42460 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:02:44,150 - lava_callback - INFO - Received callback for node 69e57b272138313246289cd6 INFO: 172.21.0.1:42464 - "POST /node/69e57b272138313246289cd6 HTTP/1.0" 202 Accepted 2026-04-22 01:02:44,155 - lava_callback - INFO - Starting async job submit for node 69e57b272138313246289cd6 2026-04-22 01:02:44,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:44,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e57b272138313246289cd6 HTTP/1.1" 200 None 2026-04-22 01:02:44,170 - lava_callback - DEBUG - Processing node 69e57b272138313246289cd6: baseline-arm-baylibre 2026-04-22 01:02:44,171 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e57b272138313246289cd6 2026-04-22 01:02:44,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:44,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e57b272138313246289cd6 HTTP/1.1" 200 None 2026-04-22 01:02:44,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:44,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-22 01:02:44,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:44,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e57b272138313246289cd6 HTTP/1.1" 200 None 2026-04-22 01:02:44,227 - lava_callback - ERROR - Error processing callback for node 69e57b272138313246289cd6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42466 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:02:52,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:52,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-22 01:02:55,309 - lava_callback - INFO - Received callback for node 69e81db7afb86e738cad0380 INFO: 172.21.0.1:57834 - "POST /node/69e81db7afb86e738cad0380 HTTP/1.0" 202 Accepted 2026-04-22 01:02:55,315 - lava_callback - INFO - Starting async job submit for node 69e81db7afb86e738cad0380 2026-04-22 01:02:55,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:55,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81db7afb86e738cad0380 HTTP/1.1" 200 None 2026-04-22 01:02:55,353 - lava_callback - DEBUG - Processing node 69e81db7afb86e738cad0380: baseline-arm64-broonie 2026-04-22 01:02:55,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:02:55,727 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:02:55,729 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e81db7afb86e738cad0380/log.txt.gz 2026-04-22 01:02:55,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:02:56,130 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:02:56,132 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e81db7afb86e738cad0380/lava-logs.yaml 2026-04-22 01:02:56,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:02:56,246 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:02:56,248 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e81db7afb86e738cad0380/lava_callback.json.gz 2026-04-22 01:02:56,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:56,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81db7afb86e738cad0380 HTTP/1.1" 200 None 2026-04-22 01:02:56,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:56,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 01:02:56,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:02:56,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e81db7afb86e738cad0380 HTTP/1.1" 200 None 2026-04-22 01:02:56,333 - lava_callback - INFO - Completed processing callback for node 69e81db7afb86e738cad0380 INFO: 172.21.0.1:57836 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:03:01,220 - lava_callback - INFO - Received callback for node 69e81d90afb86e738cad02e9 INFO: 172.21.0.1:39842 - "POST /node/69e81d90afb86e738cad02e9 HTTP/1.0" 202 Accepted 2026-04-22 01:03:01,227 - lava_callback - INFO - Starting async job submit for node 69e81d90afb86e738cad02e9 2026-04-22 01:03:01,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:03:01,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81d90afb86e738cad02e9 HTTP/1.1" 200 None 2026-04-22 01:03:01,268 - lava_callback - DEBUG - Processing node 69e81d90afb86e738cad02e9: baseline-nfs-arm64 2026-04-22 01:03:01,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:03:01,718 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:03:01,720 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e81d90afb86e738cad02e9/log.txt.gz 2026-04-22 01:03:01,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:03:02,275 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:03:02,277 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e81d90afb86e738cad02e9/lava-logs.yaml 2026-04-22 01:03:02,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:03:03,081 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:03:03,082 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e81d90afb86e738cad02e9/lava_callback.json.gz 2026-04-22 01:03:03,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:03:03,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81d90afb86e738cad02e9 HTTP/1.1" 200 None 2026-04-22 01:03:03,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:03:03,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 01:03:03,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:03:03,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e81d90afb86e738cad02e9 HTTP/1.1" 200 None 2026-04-22 01:03:03,172 - lava_callback - INFO - Completed processing callback for node 69e81d90afb86e738cad02e9 2026-04-22 01:03:03,488 - lava_callback - INFO - Received callback for node 69e81dc1afb86e738cad039e INFO: 172.21.0.1:39844 - "POST /node/69e81dc1afb86e738cad039e HTTP/1.0" 202 Accepted 2026-04-22 01:03:03,494 - lava_callback - INFO - Starting async job submit for node 69e81dc1afb86e738cad039e 2026-04-22 01:03:03,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:03:03,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81dc1afb86e738cad039e HTTP/1.1" 200 None 2026-04-22 01:03:03,530 - lava_callback - DEBUG - Processing node 69e81dc1afb86e738cad039e: baseline-arm64-pengutronix 2026-04-22 01:03:03,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:03:03,801 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:03:03,803 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e81dc1afb86e738cad039e/log.txt.gz 2026-04-22 01:03:03,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:03:04,080 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:03:04,082 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e81dc1afb86e738cad039e/lava-logs.yaml 2026-04-22 01:03:04,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:03:04,196 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:03:04,198 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e81dc1afb86e738cad039e/lava_callback.json.gz 2026-04-22 01:03:04,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:03:04,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81dc1afb86e738cad039e HTTP/1.1" 200 None 2026-04-22 01:03:04,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:03:04,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 01:03:04,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:03:04,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e81dc1afb86e738cad039e HTTP/1.1" 200 None 2026-04-22 01:03:04,335 - lava_callback - INFO - Completed processing callback for node 69e81dc1afb86e738cad039e INFO: 172.21.0.1:39852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49314 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:03:22,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:03:22,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-22 01:03:24,191 - lava_callback - INFO - Received callback for node 69e57b4f2138313246289ce3 INFO: 172.21.0.1:35466 - "POST /node/69e57b4f2138313246289ce3 HTTP/1.0" 202 Accepted 2026-04-22 01:03:24,197 - lava_callback - INFO - Starting async job submit for node 69e57b4f2138313246289ce3 2026-04-22 01:03:24,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:03:24,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e57b4f2138313246289ce3 HTTP/1.1" 200 None 2026-04-22 01:03:24,229 - lava_callback - DEBUG - Processing node 69e57b4f2138313246289ce3: baseline-arm-baylibre 2026-04-22 01:03:24,229 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e57b4f2138313246289ce3 2026-04-22 01:03:24,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:03:24,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e57b4f2138313246289ce3 HTTP/1.1" 200 None 2026-04-22 01:03:24,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:03:24,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-22 01:03:24,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:03:24,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e57b4f2138313246289ce3 HTTP/1.1" 200 None 2026-04-22 01:03:24,276 - lava_callback - ERROR - Error processing callback for node 69e57b4f2138313246289ce3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42924 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:04:04,299 - lava_callback - INFO - Received callback for node 69e57b772138313246289cf0 INFO: 172.21.0.1:38810 - "POST /node/69e57b772138313246289cf0 HTTP/1.0" 202 Accepted 2026-04-22 01:04:04,304 - lava_callback - INFO - Starting async job submit for node 69e57b772138313246289cf0 2026-04-22 01:04:04,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:04:04,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e57b772138313246289cf0 HTTP/1.1" 200 None 2026-04-22 01:04:04,320 - lava_callback - DEBUG - Processing node 69e57b772138313246289cf0: baseline-arm-baylibre 2026-04-22 01:04:04,320 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e57b772138313246289cf0 2026-04-22 01:04:04,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:04:04,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e57b772138313246289cf0 HTTP/1.1" 200 None 2026-04-22 01:04:04,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:04:04,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-22 01:04:04,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:04:04,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e57b772138313246289cf0 HTTP/1.1" 200 None 2026-04-22 01:04:04,388 - lava_callback - ERROR - Error processing callback for node 69e57b772138313246289cf0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38818 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:04:14,527 - lava_callback - INFO - Received callback for node 69e81835afb86e738cacff1c INFO: 172.21.0.1:46246 - "POST /node/69e81835afb86e738cacff1c HTTP/1.0" 202 Accepted 2026-04-22 01:04:14,536 - lava_callback - INFO - Starting async job submit for node 69e81835afb86e738cacff1c 2026-04-22 01:04:14,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:04:14,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81835afb86e738cacff1c HTTP/1.1" 200 None 2026-04-22 01:04:14,615 - lava_callback - DEBUG - Processing node 69e81835afb86e738cacff1c: ltp-ipc INFO: 172.21.0.1:46248 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-22 01:04:15,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:04:15,419 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:04:15,422 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-ipc-69e81835afb86e738cacff1c/log.txt.gz 2026-04-22 01:04:15,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:04:16,074 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:04:16,077 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-ipc-69e81835afb86e738cacff1c/lava-logs.yaml 2026-04-22 01:04:16,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:04:16,256 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:04:16,259 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-ipc-69e81835afb86e738cacff1c/lava_callback.json.gz 2026-04-22 01:04:16,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:04:16,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81835afb86e738cacff1c HTTP/1.1" 200 None 2026-04-22 01:04:16,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:04:16,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8139bafb86e738cacfb7c HTTP/1.1" 200 None 2026-04-22 01:04:16,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:04:16,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e81835afb86e738cacff1c HTTP/1.1" 200 None 2026-04-22 01:04:16,413 - lava_callback - INFO - Completed processing callback for node 69e81835afb86e738cacff1c INFO: 172.21.0.1:46260 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:04:16,851 - lava_callback - INFO - Received callback for node 69e81836afb86e738cacff1f INFO: 172.21.0.1:46264 - "POST /node/69e81836afb86e738cacff1f HTTP/1.0" 202 Accepted 2026-04-22 01:04:16,864 - lava_callback - INFO - Starting async job submit for node 69e81836afb86e738cacff1f 2026-04-22 01:04:16,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:04:16,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81836afb86e738cacff1f HTTP/1.1" 200 None 2026-04-22 01:04:16,937 - lava_callback - DEBUG - Processing node 69e81836afb86e738cacff1f: ltp-pty 2026-04-22 01:04:17,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:04:17,662 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:04:17,665 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-pty-69e81836afb86e738cacff1f/log.txt.gz 2026-04-22 01:04:18,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:04:18,388 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:04:18,391 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-pty-69e81836afb86e738cacff1f/lava-logs.yaml 2026-04-22 01:04:18,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:04:18,577 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:04:18,580 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-pty-69e81836afb86e738cacff1f/lava_callback.json.gz 2026-04-22 01:04:18,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:04:18,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81836afb86e738cacff1f HTTP/1.1" 200 None 2026-04-22 01:04:18,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:04:18,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8139bafb86e738cacfb7c HTTP/1.1" 200 None 2026-04-22 01:04:18,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:04:18,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e81836afb86e738cacff1f HTTP/1.1" 200 None 2026-04-22 01:04:18,736 - lava_callback - INFO - Completed processing callback for node 69e81836afb86e738cacff1f 2026-04-22 01:04:22,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:04:22,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44254 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:04:36,873 - lava_callback - INFO - Received callback for node 69e81db2afb86e738cad0352 INFO: 172.21.0.1:44260 - "POST /node/69e81db2afb86e738cad0352 HTTP/1.0" 202 Accepted 2026-04-22 01:04:36,883 - lava_callback - INFO - Starting async job submit for node 69e81db2afb86e738cad0352 2026-04-22 01:04:36,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:04:36,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81db2afb86e738cad0352 HTTP/1.1" 200 None 2026-04-22 01:04:36,948 - lava_callback - DEBUG - Processing node 69e81db2afb86e738cad0352: baseline-arm64-broonie 2026-04-22 01:04:37,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:04:37,655 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:04:37,658 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e81db2afb86e738cad0352/log.txt.gz 2026-04-22 01:04:37,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:04:38,246 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:04:38,249 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e81db2afb86e738cad0352/lava-logs.yaml 2026-04-22 01:04:38,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:04:38,464 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:04:38,467 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e81db2afb86e738cad0352/lava_callback.json.gz 2026-04-22 01:04:38,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:04:38,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81db2afb86e738cad0352 HTTP/1.1" 200 None 2026-04-22 01:04:38,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:04:38,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 01:04:38,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:04:38,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e81db2afb86e738cad0352 HTTP/1.1" 200 None 2026-04-22 01:04:38,629 - lava_callback - INFO - Completed processing callback for node 69e81db2afb86e738cad0352 INFO: 172.21.0.1:56554 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:04:44,249 - lava_callback - INFO - Received callback for node 69e57ba02138313246289cff INFO: 172.21.0.1:56558 - "POST /node/69e57ba02138313246289cff HTTP/1.0" 202 Accepted 2026-04-22 01:04:44,255 - lava_callback - INFO - Starting async job submit for node 69e57ba02138313246289cff 2026-04-22 01:04:44,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:04:44,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e57ba02138313246289cff HTTP/1.1" 200 None 2026-04-22 01:04:44,281 - lava_callback - DEBUG - Processing node 69e57ba02138313246289cff: baseline-arm-baylibre 2026-04-22 01:04:44,281 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e57ba02138313246289cff 2026-04-22 01:04:44,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:04:44,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e57ba02138313246289cff HTTP/1.1" 200 None 2026-04-22 01:04:44,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:04:44,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-22 01:04:44,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:04:44,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e57ba02138313246289cff HTTP/1.1" 200 None 2026-04-22 01:04:44,328 - lava_callback - ERROR - Error processing callback for node 69e57ba02138313246289cff: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56566 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:04:52,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:04:52,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53718 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:05:24,365 - lava_callback - INFO - Received callback for node 69e57bc92138313246289d0d INFO: 172.21.0.1:44288 - "POST /node/69e57bc92138313246289d0d HTTP/1.0" 202 Accepted 2026-04-22 01:05:24,371 - lava_callback - INFO - Starting async job submit for node 69e57bc92138313246289d0d 2026-04-22 01:05:24,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:05:24,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e57bc92138313246289d0d HTTP/1.1" 200 None 2026-04-22 01:05:24,386 - lava_callback - DEBUG - Processing node 69e57bc92138313246289d0d: baseline-arm-baylibre 2026-04-22 01:05:24,387 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e57bc92138313246289d0d 2026-04-22 01:05:24,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:05:24,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e57bc92138313246289d0d HTTP/1.1" 200 None 2026-04-22 01:05:24,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:05:24,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-22 01:05:24,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:05:24,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e57bc92138313246289d0d HTTP/1.1" 200 None 2026-04-22 01:05:24,434 - lava_callback - ERROR - Error processing callback for node 69e57bc92138313246289d0d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57634 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:05:54,401 - lava_callback - INFO - Received callback for node 69e81838afb86e738cacff23 INFO: 172.21.0.1:45422 - "POST /node/69e81838afb86e738cacff23 HTTP/1.0" 202 Accepted 2026-04-22 01:05:54,407 - lava_callback - INFO - Starting async job submit for node 69e81838afb86e738cacff23 2026-04-22 01:05:54,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:05:54,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81838afb86e738cacff23 HTTP/1.1" 200 None 2026-04-22 01:05:54,460 - lava_callback - DEBUG - Processing node 69e81838afb86e738cacff23: ltp-sched 2026-04-22 01:05:54,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:05:54,941 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:05:54,943 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-sched-69e81838afb86e738cacff23/log.txt.gz 2026-04-22 01:05:55,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:05:55,326 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:05:55,328 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-sched-69e81838afb86e738cacff23/lava-logs.yaml 2026-04-22 01:05:55,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:05:55,459 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:05:55,461 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-sched-69e81838afb86e738cacff23/lava_callback.json.gz 2026-04-22 01:05:55,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:05:55,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81838afb86e738cacff23 HTTP/1.1" 200 None 2026-04-22 01:05:55,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:05:55,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8139bafb86e738cacfb7c HTTP/1.1" 200 None 2026-04-22 01:05:55,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:05:55,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e81838afb86e738cacff23 HTTP/1.1" 200 None 2026-04-22 01:05:55,562 - lava_callback - INFO - Completed processing callback for node 69e81838afb86e738cacff23 INFO: 172.21.0.1:45432 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:06:04,340 - lava_callback - INFO - Received callback for node 69e57bee2138313246289d1b INFO: 172.21.0.1:44716 - "POST /node/69e57bee2138313246289d1b HTTP/1.0" 202 Accepted 2026-04-22 01:06:04,345 - lava_callback - INFO - Starting async job submit for node 69e57bee2138313246289d1b 2026-04-22 01:06:04,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:06:04,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e57bee2138313246289d1b HTTP/1.1" 200 None 2026-04-22 01:06:04,362 - lava_callback - DEBUG - Processing node 69e57bee2138313246289d1b: baseline-arm-baylibre 2026-04-22 01:06:04,362 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e57bee2138313246289d1b 2026-04-22 01:06:04,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:06:04,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e57bee2138313246289d1b HTTP/1.1" 200 None 2026-04-22 01:06:04,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:06:04,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-22 01:06:04,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:06:04,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e57bee2138313246289d1b HTTP/1.1" 200 None 2026-04-22 01:06:04,410 - lava_callback - ERROR - Error processing callback for node 69e57bee2138313246289d1b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44720 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:06:12,240 - lava_callback - INFO - Received callback for node 69e81dc5afb86e738cad03ad INFO: 172.21.0.1:60736 - "POST /node/69e81dc5afb86e738cad03ad HTTP/1.0" 202 Accepted 2026-04-22 01:06:12,251 - lava_callback - INFO - Starting async job submit for node 69e81dc5afb86e738cad03ad 2026-04-22 01:06:12,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:06:12,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81dc5afb86e738cad03ad HTTP/1.1" 200 None 2026-04-22 01:06:12,323 - lava_callback - DEBUG - Processing node 69e81dc5afb86e738cad03ad: baseline-arm64-foundriesio 2026-04-22 01:06:13,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:06:13,780 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:06:13,781 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e81dc5afb86e738cad03ad/log.txt.gz 2026-04-22 01:06:14,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:06:14,706 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:06:14,709 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e81dc5afb86e738cad03ad/lava-logs.yaml 2026-04-22 01:06:14,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:06:14,869 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:06:14,871 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e81dc5afb86e738cad03ad/lava_callback.json.gz DEBUG: 69e81dc5afb86e738cad03ad Transitting job node result: pass -> incomplete 2026-04-22 01:06:14,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:06:14,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81dc5afb86e738cad03ad HTTP/1.1" 200 None 2026-04-22 01:06:14,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:06:14,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 01:06:14,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:06:14,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e81dc5afb86e738cad03ad HTTP/1.1" 200 None 2026-04-22 01:06:14,993 - lava_callback - INFO - Completed processing callback for node 69e81dc5afb86e738cad03ad INFO: 172.21.0.1:60750 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60762 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:06:22,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:06:22,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54014 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:06:35,240 - lava_callback - INFO - Received callback for node 69e57c142138313246289d29 INFO: 172.21.0.1:59000 - "POST /node/69e57c142138313246289d29 HTTP/1.0" 202 Accepted 2026-04-22 01:06:35,246 - lava_callback - INFO - Starting async job submit for node 69e57c142138313246289d29 2026-04-22 01:06:35,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:06:35,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e57c142138313246289d29 HTTP/1.1" 200 None 2026-04-22 01:06:35,262 - lava_callback - DEBUG - Processing node 69e57c142138313246289d29: baseline-arm-clabbe 2026-04-22 01:06:35,263 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e57c142138313246289d29 2026-04-22 01:06:35,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:06:35,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e57c142138313246289d29 HTTP/1.1" 200 None 2026-04-22 01:06:35,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:06:35,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-22 01:06:35,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:06:35,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e57c142138313246289d29 HTTP/1.1" 200 None 2026-04-22 01:06:35,313 - lava_callback - ERROR - Error processing callback for node 69e57c142138313246289d29: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58308 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:07:14,369 - lava_callback - INFO - Received callback for node 69e8183aafb86e738cacff26 INFO: 172.21.0.1:37754 - "POST /node/69e8183aafb86e738cacff26 HTTP/1.0" 202 Accepted 2026-04-22 01:07:14,376 - lava_callback - INFO - Starting async job submit for node 69e8183aafb86e738cacff26 2026-04-22 01:07:14,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:07:14,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8183aafb86e738cacff26 HTTP/1.1" 200 None 2026-04-22 01:07:14,417 - lava_callback - DEBUG - Processing node 69e8183aafb86e738cacff26: ltp-smoke 2026-04-22 01:07:14,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:07:14,904 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:07:14,906 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69e8183aafb86e738cacff26/log.txt.gz 2026-04-22 01:07:15,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:37762 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-22 01:07:15,301 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:07:15,303 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69e8183aafb86e738cacff26/lava-logs.yaml 2026-04-22 01:07:15,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:07:15,418 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:07:15,419 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69e8183aafb86e738cacff26/lava_callback.json.gz 2026-04-22 01:07:15,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:07:15,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8183aafb86e738cacff26 HTTP/1.1" 200 None 2026-04-22 01:07:15,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:07:15,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8139bafb86e738cacfb7c HTTP/1.1" 200 None 2026-04-22 01:07:15,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:07:15,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e8183aafb86e738cacff26 HTTP/1.1" 200 None 2026-04-22 01:07:15,501 - lava_callback - INFO - Completed processing callback for node 69e8183aafb86e738cacff26 INFO: 172.21.0.1:37770 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:07:22,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:07:22,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54804 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:08:08,696 - lava_callback - INFO - Received callback for node 69e81d8fafb86e738cad02e6 INFO: 172.21.0.1:54808 - "POST /node/69e81d8fafb86e738cad02e6 HTTP/1.0" 202 Accepted 2026-04-22 01:08:08,703 - lava_callback - INFO - Starting async job submit for node 69e81d8fafb86e738cad02e6 2026-04-22 01:08:08,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:08:08,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81d8fafb86e738cad02e6 HTTP/1.1" 200 None 2026-04-22 01:08:08,762 - lava_callback - DEBUG - Processing node 69e81d8fafb86e738cad02e6: baseline-arm64 2026-04-22 01:08:09,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:08:09,266 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:08:09,267 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e81d8fafb86e738cad02e6/log.txt.gz 2026-04-22 01:08:09,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:08:09,656 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:08:09,658 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e81d8fafb86e738cad02e6/lava-logs.yaml 2026-04-22 01:08:09,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:08:09,800 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:08:09,801 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e81d8fafb86e738cad02e6/lava_callback.json.gz DEBUG: Setup failed for 69e81d8fafb86e738cad02e6. Transitting job node result: incomplete -> fail 2026-04-22 01:08:09,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:08:09,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81d8fafb86e738cad02e6 HTTP/1.1" 200 None 2026-04-22 01:08:09,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:08:09,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 01:08:09,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:08:09,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e81d8fafb86e738cad02e6 HTTP/1.1" 200 None 2026-04-22 01:08:10,063 - lava_callback - INFO - Completed processing callback for node 69e81d8fafb86e738cad02e6 INFO: 172.21.0.1:33610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33624 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:08:17,425 - lava_callback - INFO - Received callback for node 69e8183eafb86e738cacff2f INFO: 172.21.0.1:33630 - "POST /node/69e8183eafb86e738cacff2f HTTP/1.0" 202 Accepted 2026-04-22 01:08:17,432 - lava_callback - INFO - Starting async job submit for node 69e8183eafb86e738cacff2f 2026-04-22 01:08:17,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:08:17,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8183eafb86e738cacff2f HTTP/1.1" 200 None 2026-04-22 01:08:17,486 - lava_callback - DEBUG - Processing node 69e8183eafb86e738cacff2f: ltp-timers 2026-04-22 01:08:17,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:08:17,995 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:08:17,997 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-timers-69e8183eafb86e738cacff2f/log.txt.gz 2026-04-22 01:08:18,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:08:18,377 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:08:18,379 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-timers-69e8183eafb86e738cacff2f/lava-logs.yaml 2026-04-22 01:08:18,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:08:18,509 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:08:18,511 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-timers-69e8183eafb86e738cacff2f/lava_callback.json.gz 2026-04-22 01:08:18,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:08:18,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8183eafb86e738cacff2f HTTP/1.1" 200 None 2026-04-22 01:08:18,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:08:18,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8139bafb86e738cacfb7c HTTP/1.1" 200 None 2026-04-22 01:08:18,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:08:18,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e8183eafb86e738cacff2f HTTP/1.1" 200 None 2026-04-22 01:08:18,590 - lava_callback - INFO - Completed processing callback for node 69e8183eafb86e738cacff2f 2026-04-22 01:08:22,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:08:22,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46916 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:08:35,250 - lava_callback - INFO - Received callback for node 69e57c842138313246289d3a INFO: 172.21.0.1:40848 - "POST /node/69e57c842138313246289d3a HTTP/1.0" 202 Accepted 2026-04-22 01:08:35,267 - lava_callback - INFO - Starting async job submit for node 69e57c842138313246289d3a 2026-04-22 01:08:35,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:08:35,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e57c842138313246289d3a HTTP/1.1" 200 None 2026-04-22 01:08:35,297 - lava_callback - DEBUG - Processing node 69e57c842138313246289d3a: baseline-arm-clabbe 2026-04-22 01:08:35,298 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e57c842138313246289d3a 2026-04-22 01:08:35,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:08:35,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e57c842138313246289d3a HTTP/1.1" 200 None 2026-04-22 01:08:35,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:08:35,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-22 01:08:35,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:08:35,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e57c842138313246289d3a HTTP/1.1" 200 None 2026-04-22 01:08:35,381 - lava_callback - ERROR - Error processing callback for node 69e57c842138313246289d3a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40852 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:08:38,906 - lava_callback - INFO - Received callback for node 69e81f85afb86e738cad0598 INFO: 172.21.0.1:40868 - "POST /node/69e81f85afb86e738cad0598 HTTP/1.0" 202 Accepted 2026-04-22 01:08:38,912 - lava_callback - INFO - Starting async job submit for node 69e81f85afb86e738cad0598 2026-04-22 01:08:38,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:08:38,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81f85afb86e738cad0598 HTTP/1.1" 200 None 2026-04-22 01:08:38,931 - lava_callback - DEBUG - Processing node 69e81f85afb86e738cad0598: baseline-arm 2026-04-22 01:08:38,936 - lava_callback - WARNING - Failed to upload log 2026-04-22 01:08:38,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:08:39,026 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:08:39,029 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e81f85afb86e738cad0598/lava-logs.yaml 2026-04-22 01:08:39,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:08:39,115 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:08:39,117 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e81f85afb86e738cad0598/lava_callback.json.gz 2026-04-22 01:08:39,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:08:39,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81f85afb86e738cad0598 HTTP/1.1" 200 None 2026-04-22 01:08:39,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:08:39,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8139bafb86e738cacfb7c HTTP/1.1" 200 None 2026-04-22 01:08:39,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:08:39,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e81f85afb86e738cad0598 HTTP/1.1" 200 None 2026-04-22 01:08:39,179 - lava_callback - INFO - Completed processing callback for node 69e81f85afb86e738cad0598 INFO: 172.21.0.1:55270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55280 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:08:52,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:08:52,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-22 01:08:54,685 - lava_callback - INFO - Received callback for node 69e8183dafb86e738cacff2c INFO: 172.21.0.1:43374 - "POST /node/69e8183dafb86e738cacff2c HTTP/1.0" 202 Accepted 2026-04-22 01:08:54,691 - lava_callback - INFO - Starting async job submit for node 69e8183dafb86e738cacff2c 2026-04-22 01:08:54,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:08:54,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8183dafb86e738cacff2c HTTP/1.1" 200 None 2026-04-22 01:08:54,745 - lava_callback - DEBUG - Processing node 69e8183dafb86e738cacff2c: ltp-syscalls-ipc 2026-04-22 01:08:55,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:08:55,316 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:08:55,318 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69e8183dafb86e738cacff2c/log.txt.gz 2026-04-22 01:08:55,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:08:55,679 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:08:55,681 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69e8183dafb86e738cacff2c/lava-logs.yaml 2026-04-22 01:08:55,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:08:55,800 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:08:55,802 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69e8183dafb86e738cacff2c/lava_callback.json.gz 2026-04-22 01:08:55,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:08:55,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8183dafb86e738cacff2c HTTP/1.1" 200 None 2026-04-22 01:08:55,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:08:55,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8139bafb86e738cacfb7c HTTP/1.1" 200 None 2026-04-22 01:08:55,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:08:55,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e8183dafb86e738cacff2c HTTP/1.1" 200 None 2026-04-22 01:08:55,898 - lava_callback - INFO - Completed processing callback for node 69e8183dafb86e738cacff2c INFO: 172.21.0.1:43380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41642 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-22 01:09:15,247 - lava_callback - INFO - Received callback for node 69e57cab2138313246289d47 INFO: 172.21.0.1:41652 - "POST /node/69e57cab2138313246289d47 HTTP/1.0" 202 Accepted 2026-04-22 01:09:15,252 - lava_callback - INFO - Starting async job submit for node 69e57cab2138313246289d47 2026-04-22 01:09:15,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:09:15,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e57cab2138313246289d47 HTTP/1.1" 200 None 2026-04-22 01:09:15,268 - lava_callback - DEBUG - Processing node 69e57cab2138313246289d47: baseline-arm-clabbe 2026-04-22 01:09:15,269 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e57cab2138313246289d47 2026-04-22 01:09:15,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:09:15,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e57cab2138313246289d47 HTTP/1.1" 200 None 2026-04-22 01:09:15,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:09:15,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-22 01:09:15,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:09:15,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e57cab2138313246289d47 HTTP/1.1" 200 None 2026-04-22 01:09:15,320 - lava_callback - ERROR - Error processing callback for node 69e57cab2138313246289d47: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41664 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:09:22,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:09:22,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46294 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:09:54,746 - lava_callback - INFO - Received callback for node 69e8183fafb86e738cacff32 INFO: 172.21.0.1:56584 - "POST /node/69e8183fafb86e738cacff32 HTTP/1.0" 202 Accepted 2026-04-22 01:09:54,753 - lava_callback - INFO - Starting async job submit for node 69e8183fafb86e738cacff32 2026-04-22 01:09:54,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:09:54,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8183fafb86e738cacff32 HTTP/1.1" 200 None 2026-04-22 01:09:54,793 - lava_callback - DEBUG - Processing node 69e8183fafb86e738cacff32: ltp-watchqueue 2026-04-22 01:09:55,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:09:55,239 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:09:55,241 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69e8183fafb86e738cacff32/log.txt.gz 2026-04-22 01:09:55,312 - lava_callback - INFO - Received callback for node 69e57cd32138313246289d56 INFO: 172.21.0.1:56586 - "POST /node/69e57cd32138313246289d56 HTTP/1.0" 202 Accepted 2026-04-22 01:09:55,328 - lava_callback - INFO - Starting async job submit for node 69e57cd32138313246289d56 2026-04-22 01:09:55,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:09:55,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e57cd32138313246289d56 HTTP/1.1" 200 None 2026-04-22 01:09:55,429 - lava_callback - DEBUG - Processing node 69e57cd32138313246289d56: baseline-arm-clabbe 2026-04-22 01:09:55,429 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e57cd32138313246289d56 2026-04-22 01:09:55,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:09:55,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e57cd32138313246289d56 HTTP/1.1" 200 None 2026-04-22 01:09:55,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:09:55,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:09:55,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-22 01:09:55,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:09:55,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e57cd32138313246289d56 HTTP/1.1" 200 None 2026-04-22 01:09:55,572 - lava_callback - ERROR - Error processing callback for node 69e57cd32138313246289d56: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-22 01:09:55,714 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:09:55,717 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69e8183fafb86e738cacff32/lava-logs.yaml 2026-04-22 01:09:55,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:09:55,835 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:09:55,837 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69e8183fafb86e738cacff32/lava_callback.json.gz 2026-04-22 01:09:55,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:09:55,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8183fafb86e738cacff32 HTTP/1.1" 200 None 2026-04-22 01:09:55,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:09:55,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8139bafb86e738cacfb7c HTTP/1.1" 200 None 2026-04-22 01:09:55,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:09:55,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e8183fafb86e738cacff32 HTTP/1.1" 200 None 2026-04-22 01:09:55,924 - lava_callback - INFO - Completed processing callback for node 69e8183fafb86e738cacff32 INFO: 172.21.0.1:56594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48860 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:10:22,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:10:22,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43930 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:11:35,441 - lava_callback - INFO - Received callback for node 69e57d372138313246289d62 INFO: 172.21.0.1:47584 - "POST /node/69e57d372138313246289d62 HTTP/1.0" 202 Accepted 2026-04-22 01:11:35,452 - lava_callback - INFO - Starting async job submit for node 69e57d372138313246289d62 2026-04-22 01:11:35,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:11:35,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e57d372138313246289d62 HTTP/1.1" 200 None 2026-04-22 01:11:35,482 - lava_callback - DEBUG - Processing node 69e57d372138313246289d62: baseline-arm-clabbe 2026-04-22 01:11:35,482 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e57d372138313246289d62 2026-04-22 01:11:35,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:11:35,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e57d372138313246289d62 HTTP/1.1" 200 None 2026-04-22 01:11:35,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:11:35,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-22 01:11:35,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:11:35,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e57d372138313246289d62 HTTP/1.1" 200 None 2026-04-22 01:11:35,562 - lava_callback - ERROR - Error processing callback for node 69e57d372138313246289d62: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58552 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:11:57,110 - lava_callback - INFO - Received callback for node 69e82042afb86e738cad05f1 INFO: 172.21.0.1:58562 - "POST /node/69e82042afb86e738cad05f1 HTTP/1.0" 202 Accepted 2026-04-22 01:11:57,118 - lava_callback - INFO - Starting async job submit for node 69e82042afb86e738cad05f1 2026-04-22 01:11:57,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:11:57,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e82042afb86e738cad05f1 HTTP/1.1" 200 None 2026-04-22 01:11:57,139 - lava_callback - DEBUG - Processing node 69e82042afb86e738cad05f1: baseline-nfs-arm64 2026-04-22 01:11:57,140 - lava_callback - WARNING - Failed to upload log 2026-04-22 01:11:57,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:11:57,400 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:11:57,402 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e82042afb86e738cad05f1/lava-logs.yaml 2026-04-22 01:11:57,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:11:57,527 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:11:57,529 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e82042afb86e738cad05f1/lava_callback.json.gz 2026-04-22 01:11:57,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:11:57,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e82042afb86e738cad05f1 HTTP/1.1" 200 None 2026-04-22 01:11:57,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:11:57,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 01:11:57,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:11:57,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e82042afb86e738cad05f1 HTTP/1.1" 200 None 2026-04-22 01:11:57,604 - lava_callback - INFO - Completed processing callback for node 69e82042afb86e738cad05f1 INFO: 172.21.0.1:33922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35742 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-22 01:12:15,386 - lava_callback - INFO - Received callback for node 69e57d5f2138313246289d6f INFO: 172.21.0.1:35744 - "POST /node/69e57d5f2138313246289d6f HTTP/1.0" 202 Accepted 2026-04-22 01:12:15,396 - lava_callback - INFO - Starting async job submit for node 69e57d5f2138313246289d6f 2026-04-22 01:12:15,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:12:15,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e57d5f2138313246289d6f HTTP/1.1" 200 None 2026-04-22 01:12:15,423 - lava_callback - DEBUG - Processing node 69e57d5f2138313246289d6f: baseline-arm-clabbe 2026-04-22 01:12:15,423 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e57d5f2138313246289d6f 2026-04-22 01:12:15,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:12:15,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e57d5f2138313246289d6f HTTP/1.1" 200 None 2026-04-22 01:12:15,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:12:15,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-22 01:12:15,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:12:15,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e57d5f2138313246289d6f HTTP/1.1" 200 None 2026-04-22 01:12:15,492 - lava_callback - ERROR - Error processing callback for node 69e57d5f2138313246289d6f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35752 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:12:22,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:12:22,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42018 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:12:42,260 - lava_callback - INFO - Received callback for node 69e81d82afb86e738cad02c5 INFO: 172.21.0.1:38680 - "POST /node/69e81d82afb86e738cad02c5 HTTP/1.0" 202 Accepted 2026-04-22 01:12:42,266 - lava_callback - INFO - Starting async job submit for node 69e81d82afb86e738cad02c5 2026-04-22 01:12:42,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:12:42,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81d82afb86e738cad02c5 HTTP/1.1" 200 None 2026-04-22 01:12:42,306 - lava_callback - DEBUG - Processing node 69e81d82afb86e738cad02c5: baseline-arm64 INFO: 172.21.0.1:38684 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:12:42,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:12:42,885 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:12:42,887 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e81d82afb86e738cad02c5/log.txt.gz 2026-04-22 01:12:43,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:12:43,213 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:12:43,215 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e81d82afb86e738cad02c5/lava-logs.yaml 2026-04-22 01:12:43,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:12:43,332 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:12:43,334 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e81d82afb86e738cad02c5/lava_callback.json.gz 2026-04-22 01:12:43,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:12:43,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81d82afb86e738cad02c5 HTTP/1.1" 200 None 2026-04-22 01:12:43,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:12:43,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 01:12:43,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:12:43,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e81d82afb86e738cad02c5 HTTP/1.1" 200 None 2026-04-22 01:12:43,478 - lava_callback - INFO - Completed processing callback for node 69e81d82afb86e738cad02c5 INFO: 172.21.0.1:38700 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:12:52,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:12:52,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38822 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-22 01:14:15,489 - lava_callback - INFO - Received callback for node 69e57dd82138313246289d7d INFO: 172.21.0.1:38834 - "POST /node/69e57dd82138313246289d7d HTTP/1.0" 202 Accepted 2026-04-22 01:14:15,495 - lava_callback - INFO - Starting async job submit for node 69e57dd82138313246289d7d 2026-04-22 01:14:15,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:14:15,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e57dd82138313246289d7d HTTP/1.1" 200 None 2026-04-22 01:14:15,512 - lava_callback - DEBUG - Processing node 69e57dd82138313246289d7d: baseline-arm-clabbe 2026-04-22 01:14:15,512 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e57dd82138313246289d7d 2026-04-22 01:14:15,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:14:15,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e57dd82138313246289d7d HTTP/1.1" 200 None 2026-04-22 01:14:15,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:14:15,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-22 01:14:15,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:14:15,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e57dd82138313246289d7d HTTP/1.1" 200 None 2026-04-22 01:14:15,563 - lava_callback - ERROR - Error processing callback for node 69e57dd82138313246289d7d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46654 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:14:55,538 - lava_callback - INFO - Received callback for node 69e57dff2138313246289d8c INFO: 172.21.0.1:60522 - "POST /node/69e57dff2138313246289d8c HTTP/1.0" 202 Accepted 2026-04-22 01:14:55,544 - lava_callback - INFO - Starting async job submit for node 69e57dff2138313246289d8c 2026-04-22 01:14:55,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:14:55,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e57dff2138313246289d8c HTTP/1.1" 200 None 2026-04-22 01:14:55,559 - lava_callback - DEBUG - Processing node 69e57dff2138313246289d8c: baseline-arm-clabbe 2026-04-22 01:14:55,559 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e57dff2138313246289d8c 2026-04-22 01:14:55,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:14:55,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e57dff2138313246289d8c HTTP/1.1" 200 None 2026-04-22 01:14:55,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:14:55,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-22 01:14:55,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:14:55,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e57dff2138313246289d8c HTTP/1.1" 200 None 2026-04-22 01:14:55,613 - lava_callback - ERROR - Error processing callback for node 69e57dff2138313246289d8c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37052 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:16:35,609 - lava_callback - INFO - Received callback for node 69e57e642138313246289d99 INFO: 172.21.0.1:41240 - "POST /node/69e57e642138313246289d99 HTTP/1.0" 202 Accepted 2026-04-22 01:16:35,614 - lava_callback - INFO - Starting async job submit for node 69e57e642138313246289d99 2026-04-22 01:16:35,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:16:35,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e57e642138313246289d99 HTTP/1.1" 200 None 2026-04-22 01:16:35,631 - lava_callback - DEBUG - Processing node 69e57e642138313246289d99: baseline-arm-clabbe 2026-04-22 01:16:35,632 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e57e642138313246289d99 2026-04-22 01:16:35,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:16:35,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e57e642138313246289d99 HTTP/1.1" 200 None 2026-04-22 01:16:35,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:16:35,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd879cc2164e674d71ee38 HTTP/1.1" 200 None 2026-04-22 01:16:35,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:16:35,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e57e642138313246289d99 HTTP/1.1" 200 None 2026-04-22 01:16:35,697 - lava_callback - ERROR - Error processing callback for node 69e57e642138313246289d99: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50620 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:16:56,618 - lava_callback - INFO - Received callback for node 69e820deafb86e738cad065a INFO: 172.21.0.1:50624 - "POST /node/69e820deafb86e738cad065a HTTP/1.0" 202 Accepted 2026-04-22 01:16:56,630 - lava_callback - INFO - Starting async job submit for node 69e820deafb86e738cad065a 2026-04-22 01:16:56,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:16:56,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e820deafb86e738cad065a HTTP/1.1" 200 None 2026-04-22 01:16:56,688 - lava_callback - DEBUG - Processing node 69e820deafb86e738cad065a: baseline-arm64 2026-04-22 01:16:56,907 - lava_callback - WARNING - Failed to upload log 2026-04-22 01:16:57,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:16:57,178 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:16:57,180 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e820deafb86e738cad065a/lava-logs.yaml 2026-04-22 01:16:57,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:16:57,272 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:16:57,274 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e820deafb86e738cad065a/lava_callback.json.gz 2026-04-22 01:16:57,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:16:57,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e820deafb86e738cad065a HTTP/1.1" 200 None 2026-04-22 01:16:57,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:16:57,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 01:16:57,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:16:57,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e820deafb86e738cad065a HTTP/1.1" 200 None 2026-04-22 01:16:57,508 - lava_callback - INFO - Completed processing callback for node 69e820deafb86e738cad065a 2026-04-22 01:17:06,188 - lava_callback - INFO - Received callback for node 69e81d91afb86e738cad02ec INFO: 172.21.0.1:38782 - "POST /node/69e81d91afb86e738cad02ec HTTP/1.0" 202 Accepted 2026-04-22 01:17:06,195 - lava_callback - INFO - Starting async job submit for node 69e81d91afb86e738cad02ec 2026-04-22 01:17:06,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:17:06,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81d91afb86e738cad02ec HTTP/1.1" 200 None 2026-04-22 01:17:06,236 - lava_callback - DEBUG - Processing node 69e81d91afb86e738cad02ec: baseline-nfs-arm64 INFO: 172.21.0.1:38792 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:17:06,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:17:06,919 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:17:06,922 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e81d91afb86e738cad02ec/log.txt.gz 2026-04-22 01:17:07,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:17:07,461 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:17:07,464 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e81d91afb86e738cad02ec/lava-logs.yaml 2026-04-22 01:17:07,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:17:07,626 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:17:07,628 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e81d91afb86e738cad02ec/lava_callback.json.gz 2026-04-22 01:17:07,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:17:07,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81d91afb86e738cad02ec HTTP/1.1" 200 None 2026-04-22 01:17:07,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:17:07,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 01:17:07,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:17:07,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e81d91afb86e738cad02ec HTTP/1.1" 200 None 2026-04-22 01:17:07,760 - lava_callback - INFO - Completed processing callback for node 69e81d91afb86e738cad02ec INFO: 172.21.0.1:51450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51456 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:17:22,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:17:22,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:32890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36894 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:18:01,846 - lava_callback - INFO - Received callback for node 69e82186afb86e738cad06c1 INFO: 172.21.0.1:39548 - "POST /node/69e82186afb86e738cad06c1 HTTP/1.0" 202 Accepted 2026-04-22 01:18:01,855 - lava_callback - INFO - Starting async job submit for node 69e82186afb86e738cad06c1 2026-04-22 01:18:01,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:18:01,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e82186afb86e738cad06c1 HTTP/1.1" 200 None 2026-04-22 01:18:01,903 - lava_callback - DEBUG - Processing node 69e82186afb86e738cad06c1: baseline-arm64 2026-04-22 01:18:02,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:18:02,768 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:18:02,771 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e82186afb86e738cad06c1/log.txt.gz 2026-04-22 01:18:03,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:18:03,329 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:18:03,331 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e82186afb86e738cad06c1/lava-logs.yaml 2026-04-22 01:18:03,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:18:03,490 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:18:03,492 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e82186afb86e738cad06c1/lava_callback.json.gz 2026-04-22 01:18:03,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:18:03,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e82186afb86e738cad06c1 HTTP/1.1" 200 None 2026-04-22 01:18:03,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:18:03,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 01:18:03,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:18:03,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e82186afb86e738cad06c1 HTTP/1.1" 200 None 2026-04-22 01:18:03,590 - lava_callback - INFO - Completed processing callback for node 69e82186afb86e738cad06c1 INFO: 172.21.0.1:39556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36656 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:18:22,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:18:22,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59934 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:19:32,229 - lava_callback - INFO - Received callback for node 69e82131afb86e738cad068d INFO: 172.21.0.1:46136 - "POST /node/69e82131afb86e738cad068d HTTP/1.0" 202 Accepted 2026-04-22 01:19:32,236 - lava_callback - INFO - Starting async job submit for node 69e82131afb86e738cad068d 2026-04-22 01:19:32,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:19:32,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e82131afb86e738cad068d HTTP/1.1" 200 None 2026-04-22 01:19:32,292 - lava_callback - DEBUG - Processing node 69e82131afb86e738cad068d: baseline-arm64 2026-04-22 01:19:32,454 - lava_callback - WARNING - Failed to upload log 2026-04-22 01:19:32,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:19:32,679 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:19:32,680 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e82131afb86e738cad068d/lava-logs.yaml 2026-04-22 01:19:32,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:19:32,770 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:19:32,771 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e82131afb86e738cad068d/lava_callback.json.gz 2026-04-22 01:19:32,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:19:32,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e82131afb86e738cad068d HTTP/1.1" 200 None 2026-04-22 01:19:32,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:19:32,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 01:19:32,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:19:32,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e82131afb86e738cad068d HTTP/1.1" 200 None 2026-04-22 01:19:32,925 - lava_callback - INFO - Completed processing callback for node 69e82131afb86e738cad068d INFO: 172.21.0.1:46144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60244 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:19:48,939 - lava_callback - INFO - Received callback for node 69e821f1afb86e738cad0714 INFO: 172.21.0.1:60258 - "POST /node/69e821f1afb86e738cad0714 HTTP/1.0" 202 Accepted 2026-04-22 01:19:48,945 - lava_callback - INFO - Starting async job submit for node 69e821f1afb86e738cad0714 2026-04-22 01:19:48,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:19:48,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e821f1afb86e738cad0714 HTTP/1.1" 200 None 2026-04-22 01:19:48,981 - lava_callback - DEBUG - Processing node 69e821f1afb86e738cad0714: baseline-arm64-pengutronix 2026-04-22 01:19:49,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:19:49,273 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:19:49,274 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e821f1afb86e738cad0714/log.txt.gz 2026-04-22 01:19:49,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:19:49,548 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:19:49,550 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e821f1afb86e738cad0714/lava-logs.yaml 2026-04-22 01:19:49,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:19:49,656 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:19:49,658 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69e821f1afb86e738cad0714/lava_callback.json.gz 2026-04-22 01:19:49,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:19:49,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e821f1afb86e738cad0714 HTTP/1.1" 200 None 2026-04-22 01:19:49,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:19:49,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 01:19:49,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:19:49,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e821f1afb86e738cad0714 HTTP/1.1" 200 None 2026-04-22 01:19:49,750 - lava_callback - INFO - Completed processing callback for node 69e821f1afb86e738cad0714 2026-04-22 01:19:52,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:19:52,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60598 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58684 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:20:30,980 - lava_callback - INFO - Received callback for node 69e81d94afb86e738cad02f2 INFO: 172.21.0.1:34488 - "POST /node/69e81d94afb86e738cad02f2 HTTP/1.0" 202 Accepted 2026-04-22 01:20:30,989 - lava_callback - INFO - Starting async job submit for node 69e81d94afb86e738cad02f2 2026-04-22 01:20:31,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:20:31,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81d94afb86e738cad02f2 HTTP/1.1" 200 None 2026-04-22 01:20:31,057 - lava_callback - DEBUG - Processing node 69e81d94afb86e738cad02f2: baseline-nfs-arm64 2026-04-22 01:20:32,294 - lava_callback - INFO - Received callback for node 69e81d9fafb86e738cad032b INFO: 172.21.0.1:34496 - "POST /node/69e81d9fafb86e738cad032b HTTP/1.0" 202 Accepted 2026-04-22 01:20:32,302 - lava_callback - INFO - Starting async job submit for node 69e81d9fafb86e738cad032b 2026-04-22 01:20:32,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:20:32,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:20:32,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81d9fafb86e738cad032b HTTP/1.1" 200 None 2026-04-22 01:20:32,364 - lava_callback - DEBUG - Processing node 69e81d9fafb86e738cad032b: baseline-nfs-arm64 2026-04-22 01:20:32,570 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:20:32,627 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e81d94afb86e738cad02f2/log.txt.gz 2026-04-22 01:20:34,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:20:34,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:20:34,212 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:20:34,214 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e81d9fafb86e738cad032b/log.txt.gz 2026-04-22 01:20:34,310 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:20:34,340 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e81d94afb86e738cad02f2/lava-logs.yaml 2026-04-22 01:20:34,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:20:34,617 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:20:34,661 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e81d94afb86e738cad02f2/lava_callback.json.gz DEBUG: Setup failed for 69e81d94afb86e738cad02f2. Transitting job node result: incomplete -> fail 2026-04-22 01:20:34,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:20:34,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:20:34,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81d94afb86e738cad02f2 HTTP/1.1" 200 None 2026-04-22 01:20:34,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:20:34,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 01:20:34,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:20:34,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e81d94afb86e738cad02f2 HTTP/1.1" 200 None 2026-04-22 01:20:35,062 - lava_callback - INFO - Completed processing callback for node 69e81d94afb86e738cad02f2 2026-04-22 01:20:35,118 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:20:35,120 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e81d9fafb86e738cad032b/lava-logs.yaml 2026-04-22 01:20:35,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:20:35,275 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:20:35,276 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e81d9fafb86e738cad032b/lava_callback.json.gz DEBUG: Setup failed for 69e81d9fafb86e738cad032b. Transitting job node result: incomplete -> fail 2026-04-22 01:20:35,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:20:35,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81d9fafb86e738cad032b HTTP/1.1" 200 None 2026-04-22 01:20:35,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:20:35,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 01:20:35,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:20:35,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e81d9fafb86e738cad032b HTTP/1.1" 200 None 2026-04-22 01:20:35,505 - lava_callback - INFO - Completed processing callback for node 69e81d9fafb86e738cad032b INFO: 172.21.0.1:34512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49894 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:20:52,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:20:52,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48020 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52316 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:21:48,845 - lava_callback - INFO - Received callback for node 69e81d9dafb86e738cad0327 INFO: 172.21.0.1:52322 - "POST /node/69e81d9dafb86e738cad0327 HTTP/1.0" 202 Accepted 2026-04-22 01:21:48,857 - lava_callback - INFO - Starting async job submit for node 69e81d9dafb86e738cad0327 2026-04-22 01:21:48,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:21:48,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81d9dafb86e738cad0327 HTTP/1.1" 200 None 2026-04-22 01:21:48,930 - lava_callback - DEBUG - Processing node 69e81d9dafb86e738cad0327: baseline-nfs-arm64 2026-04-22 01:21:50,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:21:50,299 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:21:50,301 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e81d9dafb86e738cad0327/log.txt.gz 2026-04-22 01:21:50,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:21:51,267 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:21:51,271 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e81d9dafb86e738cad0327/lava-logs.yaml 2026-04-22 01:21:51,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:21:51,493 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:21:51,495 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e81d9dafb86e738cad0327/lava_callback.json.gz DEBUG: Setup failed for 69e81d9dafb86e738cad0327. Transitting job node result: incomplete -> fail 2026-04-22 01:21:51,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:21:51,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81d9dafb86e738cad0327 HTTP/1.1" 200 None 2026-04-22 01:21:51,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:21:51,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 01:21:51,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:21:51,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e81d9dafb86e738cad0327 HTTP/1.1" 200 None 2026-04-22 01:21:51,806 - lava_callback - INFO - Completed processing callback for node 69e81d9dafb86e738cad0327 2026-04-22 01:21:52,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:21:52,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48528 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58672 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59246 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:23:52,800 - lava_callback - INFO - Received callback for node 69e82320afb86e738cad07c8 INFO: 172.21.0.1:44690 - "POST /node/69e82320afb86e738cad07c8 HTTP/1.0" 202 Accepted 2026-04-22 01:23:52,806 - lava_callback - INFO - Starting async job submit for node 69e82320afb86e738cad07c8 2026-04-22 01:23:52,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:23:52,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e82320afb86e738cad07c8 HTTP/1.1" 200 None 2026-04-22 01:23:52,824 - lava_callback - DEBUG - Processing node 69e82320afb86e738cad07c8: baseline-arm 2026-04-22 01:23:52,829 - lava_callback - WARNING - Failed to upload log 2026-04-22 01:23:52,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:23:52,933 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:23:52,935 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e82320afb86e738cad07c8/lava-logs.yaml 2026-04-22 01:23:52,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:23:53,020 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:23:53,022 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e82320afb86e738cad07c8/lava_callback.json.gz 2026-04-22 01:23:53,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:23:53,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e82320afb86e738cad07c8 HTTP/1.1" 200 None 2026-04-22 01:23:53,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:23:53,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8139bafb86e738cacfb7c HTTP/1.1" 200 None 2026-04-22 01:23:53,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:23:53,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e82320afb86e738cad07c8 HTTP/1.1" 200 None 2026-04-22 01:23:53,085 - lava_callback - INFO - Completed processing callback for node 69e82320afb86e738cad07c8 INFO: 172.21.0.1:44704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40710 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40726 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:24:22,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:24:22,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38920 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:24:37,955 - lava_callback - INFO - Received callback for node 69e81f18afb86e738cad055c INFO: 172.21.0.1:38932 - "POST /node/69e81f18afb86e738cad055c HTTP/1.0" 202 Accepted 2026-04-22 01:24:37,962 - lava_callback - INFO - Starting async job submit for node 69e81f18afb86e738cad055c 2026-04-22 01:24:38,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:24:38,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81f18afb86e738cad055c HTTP/1.1" 200 None 2026-04-22 01:24:38,070 - lava_callback - DEBUG - Processing node 69e81f18afb86e738cad055c: ltp-smoke 2026-04-22 01:24:38,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:24:38,721 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:24:38,722 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69e81f18afb86e738cad055c/log.txt.gz 2026-04-22 01:24:38,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:24:39,150 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:24:39,153 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69e81f18afb86e738cad055c/lava-logs.yaml 2026-04-22 01:24:39,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:24:39,273 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:24:39,275 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69e81f18afb86e738cad055c/lava_callback.json.gz 2026-04-22 01:24:39,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:24:39,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81f18afb86e738cad055c HTTP/1.1" 200 None 2026-04-22 01:24:39,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:24:39,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813a3afb86e738cacfb99 HTTP/1.1" 200 None 2026-04-22 01:24:39,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:24:39,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e81f18afb86e738cad055c HTTP/1.1" 200 None 2026-04-22 01:24:39,555 - lava_callback - INFO - Completed processing callback for node 69e81f18afb86e738cad055c INFO: 172.21.0.1:44392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44402 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:24:52,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:24:52,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-22 01:24:53,910 - lava_callback - INFO - Received callback for node 69e81f3eafb86e738cad056e INFO: 172.21.0.1:34342 - "POST /node/69e81f3eafb86e738cad056e HTTP/1.0" 202 Accepted 2026-04-22 01:24:53,917 - lava_callback - INFO - Starting async job submit for node 69e81f3eafb86e738cad056e 2026-04-22 01:24:53,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:24:53,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81f3eafb86e738cad056e HTTP/1.1" 200 None 2026-04-22 01:24:53,998 - lava_callback - DEBUG - Processing node 69e81f3eafb86e738cad056e: baseline-arm 2026-04-22 01:24:54,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:24:54,688 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:24:54,689 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e81f3eafb86e738cad056e/log.txt.gz 2026-04-22 01:24:55,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:24:55,258 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:24:55,260 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e81f3eafb86e738cad056e/lava-logs.yaml 2026-04-22 01:24:55,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:24:55,382 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:24:55,384 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e81f3eafb86e738cad056e/lava_callback.json.gz DEBUG: Setup failed for 69e81f3eafb86e738cad056e. Transitting job node result: incomplete -> fail 2026-04-22 01:24:55,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:24:55,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81f3eafb86e738cad056e HTTP/1.1" 200 None 2026-04-22 01:24:55,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:24:55,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8139bafb86e738cacfb7c HTTP/1.1" 200 None 2026-04-22 01:24:55,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:24:55,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e81f3eafb86e738cad056e HTTP/1.1" 200 None 2026-04-22 01:24:55,675 - lava_callback - INFO - Completed processing callback for node 69e81f3eafb86e738cad056e INFO: 172.21.0.1:34344 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:25:05,917 - lava_callback - INFO - Received callback for node 69e5806f2138313246289dae INFO: 172.21.0.1:57362 - "POST /node/69e5806f2138313246289dae HTTP/1.0" 202 Accepted 2026-04-22 01:25:05,923 - lava_callback - INFO - Starting async job submit for node 69e5806f2138313246289dae 2026-04-22 01:25:05,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:25:05,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5806f2138313246289dae HTTP/1.1" 200 None 2026-04-22 01:25:05,944 - lava_callback - DEBUG - Processing node 69e5806f2138313246289dae: baseline-arm64-baylibre 2026-04-22 01:25:05,945 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5806f2138313246289dae 2026-04-22 01:25:05,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:25:05,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5806f2138313246289dae HTTP/1.1" 200 None 2026-04-22 01:25:05,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:25:05,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-22 01:25:05,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:25:06,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5806f2138313246289dae HTTP/1.1" 200 None 2026-04-22 01:25:06,007 - lava_callback - ERROR - Error processing callback for node 69e5806f2138313246289dae: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52516 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:25:22,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:25:22,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42266 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:26:25,557 - lava_callback - INFO - Received callback for node 69e580bf2138313246289dcd INFO: 172.21.0.1:41668 - "POST /node/69e580bf2138313246289dcd HTTP/1.0" 202 Accepted 2026-04-22 01:26:25,563 - lava_callback - INFO - Starting async job submit for node 69e580bf2138313246289dcd 2026-04-22 01:26:25,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:26:25,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e580bf2138313246289dcd HTTP/1.1" 200 None 2026-04-22 01:26:25,578 - lava_callback - DEBUG - Processing node 69e580bf2138313246289dcd: baseline-arm64-baylibre 2026-04-22 01:26:25,578 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e580bf2138313246289dcd 2026-04-22 01:26:25,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:26:25,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e580bf2138313246289dcd HTTP/1.1" 200 None 2026-04-22 01:26:25,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:26:25,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-22 01:26:25,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:26:25,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e580bf2138313246289dcd HTTP/1.1" 200 None 2026-04-22 01:26:25,643 - lava_callback - ERROR - Error processing callback for node 69e580bf2138313246289dcd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41676 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:26:33,438 - lava_callback - INFO - Received callback for node 69e82248afb86e738cad074f INFO: 172.21.0.1:42312 - "POST /node/69e82248afb86e738cad074f HTTP/1.0" 202 Accepted 2026-04-22 01:26:33,448 - lava_callback - INFO - Starting async job submit for node 69e82248afb86e738cad074f 2026-04-22 01:26:33,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:26:33,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e82248afb86e738cad074f HTTP/1.1" 200 None 2026-04-22 01:26:33,524 - lava_callback - DEBUG - Processing node 69e82248afb86e738cad074f: baseline-arm64-foundriesio 2026-04-22 01:26:34,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:26:35,022 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:26:35,024 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e82248afb86e738cad074f/log.txt.gz 2026-04-22 01:26:36,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:26:36,384 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:26:36,387 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e82248afb86e738cad074f/lava-logs.yaml 2026-04-22 01:26:36,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:42328 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:26:36,549 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:26:36,551 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e82248afb86e738cad074f/lava_callback.json.gz DEBUG: Setup failed for 69e82248afb86e738cad074f. Transitting job node result: incomplete -> fail 2026-04-22 01:26:36,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:26:36,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e82248afb86e738cad074f HTTP/1.1" 200 None 2026-04-22 01:26:36,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:26:36,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 01:26:36,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:26:36,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e82248afb86e738cad074f HTTP/1.1" 200 None 2026-04-22 01:26:36,819 - lava_callback - INFO - Completed processing callback for node 69e82248afb86e738cad074f INFO: 172.21.0.1:54648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54650 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:26:52,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:26:52,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58996 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59008 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:27:17,800 - lava_callback - INFO - Received callback for node 69e823daafb86e738cad081a INFO: 172.21.0.1:59016 - "POST /node/69e823daafb86e738cad081a HTTP/1.0" 202 Accepted 2026-04-22 01:27:17,806 - lava_callback - INFO - Starting async job submit for node 69e823daafb86e738cad081a 2026-04-22 01:27:17,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:27:17,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e823daafb86e738cad081a HTTP/1.1" 200 None 2026-04-22 01:27:17,822 - lava_callback - DEBUG - Processing node 69e823daafb86e738cad081a: baseline-nfs-arm64 2026-04-22 01:27:17,824 - lava_callback - WARNING - Failed to upload log 2026-04-22 01:27:17,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:27:17,915 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:27:17,917 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e823daafb86e738cad081a/lava-logs.yaml 2026-04-22 01:27:17,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:27:18,001 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:27:18,003 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e823daafb86e738cad081a/lava_callback.json.gz 2026-04-22 01:27:18,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:27:18,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e823daafb86e738cad081a HTTP/1.1" 200 None 2026-04-22 01:27:18,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:27:18,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 01:27:18,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:27:18,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e823daafb86e738cad081a HTTP/1.1" 200 None 2026-04-22 01:27:18,077 - lava_callback - INFO - Completed processing callback for node 69e823daafb86e738cad081a 2026-04-22 01:27:22,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:27:22,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33844 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:27:45,557 - lava_callback - INFO - Received callback for node 69e5810f2138313246289df0 INFO: 172.21.0.1:33856 - "POST /node/69e5810f2138313246289df0 HTTP/1.0" 202 Accepted 2026-04-22 01:27:45,565 - lava_callback - INFO - Starting async job submit for node 69e5810f2138313246289df0 2026-04-22 01:27:45,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:27:45,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5810f2138313246289df0 HTTP/1.1" 200 None 2026-04-22 01:27:45,588 - lava_callback - DEBUG - Processing node 69e5810f2138313246289df0: baseline-arm64-baylibre 2026-04-22 01:27:45,588 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5810f2138313246289df0 2026-04-22 01:27:45,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:27:45,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5810f2138313246289df0 HTTP/1.1" 200 None 2026-04-22 01:27:45,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:27:45,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-22 01:27:45,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:27:45,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5810f2138313246289df0 HTTP/1.1" 200 None 2026-04-22 01:27:45,640 - lava_callback - ERROR - Error processing callback for node 69e5810f2138313246289df0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33862 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:27:53,957 - lava_callback - INFO - Received callback for node 69e822cfafb86e738cad0796 INFO: 172.21.0.1:52970 - "POST /node/69e822cfafb86e738cad0796 HTTP/1.0" 202 Accepted 2026-04-22 01:27:53,966 - lava_callback - INFO - Starting async job submit for node 69e822cfafb86e738cad0796 2026-04-22 01:27:54,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:27:54,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e822cfafb86e738cad0796 HTTP/1.1" 200 None 2026-04-22 01:27:54,018 - lava_callback - DEBUG - Processing node 69e822cfafb86e738cad0796: baseline-arm64 2026-04-22 01:27:54,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:27:54,475 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:27:54,477 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e822cfafb86e738cad0796/log.txt.gz 2026-04-22 01:27:54,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:27:54,867 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:27:54,869 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e822cfafb86e738cad0796/lava-logs.yaml 2026-04-22 01:27:54,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:27:54,990 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:27:54,992 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e822cfafb86e738cad0796/lava_callback.json.gz DEBUG: Setup failed for 69e822cfafb86e738cad0796. Transitting job node result: incomplete -> fail 2026-04-22 01:27:55,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:27:55,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e822cfafb86e738cad0796 HTTP/1.1" 200 None 2026-04-22 01:27:55,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:27:55,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 01:27:55,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:27:55,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e822cfafb86e738cad0796 HTTP/1.1" 200 None 2026-04-22 01:27:55,183 - lava_callback - INFO - Completed processing callback for node 69e822cfafb86e738cad0796 INFO: 172.21.0.1:52978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33504 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:28:22,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:28:22,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33414 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33426 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:29:25,650 - lava_callback - INFO - Received callback for node 69e581602138313246289e11 INFO: 172.21.0.1:43536 - "POST /node/69e581602138313246289e11 HTTP/1.0" 202 Accepted 2026-04-22 01:29:25,656 - lava_callback - INFO - Starting async job submit for node 69e581602138313246289e11 2026-04-22 01:29:25,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:29:25,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e581602138313246289e11 HTTP/1.1" 200 None 2026-04-22 01:29:25,674 - lava_callback - DEBUG - Processing node 69e581602138313246289e11: baseline-arm64-baylibre 2026-04-22 01:29:25,674 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e581602138313246289e11 2026-04-22 01:29:25,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:29:25,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e581602138313246289e11 HTTP/1.1" 200 None 2026-04-22 01:29:25,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:29:25,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-22 01:29:25,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:29:25,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e581602138313246289e11 HTTP/1.1" 200 None 2026-04-22 01:29:25,742 - lava_callback - ERROR - Error processing callback for node 69e581602138313246289e11: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42598 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47752 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:30:45,706 - lava_callback - INFO - Received callback for node 69e581b32138313246289e2c INFO: 172.21.0.1:47766 - "POST /node/69e581b32138313246289e2c HTTP/1.0" 202 Accepted 2026-04-22 01:30:45,711 - lava_callback - INFO - Starting async job submit for node 69e581b32138313246289e2c 2026-04-22 01:30:45,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:30:45,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e581b32138313246289e2c HTTP/1.1" 200 None 2026-04-22 01:30:45,728 - lava_callback - DEBUG - Processing node 69e581b32138313246289e2c: baseline-arm64-baylibre 2026-04-22 01:30:45,728 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e581b32138313246289e2c 2026-04-22 01:30:45,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:30:45,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e581b32138313246289e2c HTTP/1.1" 200 None 2026-04-22 01:30:45,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:30:45,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-22 01:30:45,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:30:45,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e581b32138313246289e2c HTTP/1.1" 200 None 2026-04-22 01:30:45,776 - lava_callback - ERROR - Error processing callback for node 69e581b32138313246289e2c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51940 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:31:58,081 - lava_callback - INFO - Received callback for node 69e82427afb86e738cad084c INFO: 172.21.0.1:51952 - "POST /node/69e82427afb86e738cad084c HTTP/1.0" 202 Accepted 2026-04-22 01:31:58,087 - lava_callback - INFO - Starting async job submit for node 69e82427afb86e738cad084c 2026-04-22 01:31:58,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:31:58,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e82427afb86e738cad084c HTTP/1.1" 200 None 2026-04-22 01:31:58,140 - lava_callback - DEBUG - Processing node 69e82427afb86e738cad084c: baseline-arm64 2026-04-22 01:31:58,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:31:58,616 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:31:58,618 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e82427afb86e738cad084c/log.txt.gz 2026-04-22 01:31:58,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:31:58,966 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:31:58,968 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e82427afb86e738cad084c/lava-logs.yaml 2026-04-22 01:31:58,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:31:59,082 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:31:59,084 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e82427afb86e738cad084c/lava_callback.json.gz 2026-04-22 01:31:59,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:31:59,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e82427afb86e738cad084c HTTP/1.1" 200 None 2026-04-22 01:31:59,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:31:59,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 01:31:59,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:31:59,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e82427afb86e738cad084c HTTP/1.1" 200 None 2026-04-22 01:31:59,229 - lava_callback - INFO - Completed processing callback for node 69e82427afb86e738cad084c 2026-04-22 01:32:05,837 - lava_callback - INFO - Received callback for node 69e582052138313246289e4c INFO: 172.21.0.1:49284 - "POST /node/69e582052138313246289e4c HTTP/1.0" 202 Accepted 2026-04-22 01:32:05,842 - lava_callback - INFO - Starting async job submit for node 69e582052138313246289e4c 2026-04-22 01:32:05,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:32:05,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e582052138313246289e4c HTTP/1.1" 200 None 2026-04-22 01:32:05,858 - lava_callback - DEBUG - Processing node 69e582052138313246289e4c: baseline-arm64-baylibre 2026-04-22 01:32:05,858 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e582052138313246289e4c 2026-04-22 01:32:05,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:32:05,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e582052138313246289e4c HTTP/1.1" 200 None 2026-04-22 01:32:05,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:32:05,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-22 01:32:05,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:32:05,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e582052138313246289e4c HTTP/1.1" 200 None 2026-04-22 01:32:05,908 - lava_callback - ERROR - Error processing callback for node 69e582052138313246289e4c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54950 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:32:22,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:32:22,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-22 01:32:24,372 - lava_callback - INFO - Received callback for node 69e824cfafb86e738cad08ad INFO: 172.21.0.1:47772 - "POST /node/69e824cfafb86e738cad08ad HTTP/1.0" 202 Accepted 2026-04-22 01:32:24,379 - lava_callback - INFO - Starting async job submit for node 69e824cfafb86e738cad08ad 2026-04-22 01:32:24,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:32:24,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e824cfafb86e738cad08ad HTTP/1.1" 200 None 2026-04-22 01:32:24,424 - lava_callback - DEBUG - Processing node 69e824cfafb86e738cad08ad: baseline-arm64 2026-04-22 01:32:24,558 - lava_callback - WARNING - Failed to upload log 2026-04-22 01:32:24,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:32:24,742 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:32:24,744 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e824cfafb86e738cad08ad/lava-logs.yaml 2026-04-22 01:32:24,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:32:24,848 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:32:24,849 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e824cfafb86e738cad08ad/lava_callback.json.gz 2026-04-22 01:32:24,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:32:24,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e824cfafb86e738cad08ad HTTP/1.1" 200 None 2026-04-22 01:32:24,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:32:24,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 01:32:24,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:32:24,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e824cfafb86e738cad08ad HTTP/1.1" 200 None 2026-04-22 01:32:25,018 - lava_callback - INFO - Completed processing callback for node 69e824cfafb86e738cad08ad INFO: 172.21.0.1:47788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32800 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:32:52,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:32:52,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46290 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:33:36,496 - lava_callback - INFO - Received callback for node 69e5825b2138313246289e6d INFO: 172.21.0.1:42648 - "POST /node/69e5825b2138313246289e6d HTTP/1.0" 202 Accepted 2026-04-22 01:33:36,502 - lava_callback - INFO - Starting async job submit for node 69e5825b2138313246289e6d 2026-04-22 01:33:36,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:33:36,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5825b2138313246289e6d HTTP/1.1" 200 None 2026-04-22 01:33:36,518 - lava_callback - DEBUG - Processing node 69e5825b2138313246289e6d: baseline-arm64-clabbe 2026-04-22 01:33:36,518 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5825b2138313246289e6d 2026-04-22 01:33:36,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:42662 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:33:36,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5825b2138313246289e6d HTTP/1.1" 200 None 2026-04-22 01:33:36,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:33:36,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-22 01:33:36,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:33:36,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5825b2138313246289e6d HTTP/1.1" 200 None 2026-04-22 01:33:36,571 - lava_callback - ERROR - Error processing callback for node 69e5825b2138313246289e6d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40198 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:34:56,435 - lava_callback - INFO - Received callback for node 69e582ab2138313246289e97 INFO: 172.21.0.1:33932 - "POST /node/69e582ab2138313246289e97 HTTP/1.0" 202 Accepted 2026-04-22 01:34:56,440 - lava_callback - INFO - Starting async job submit for node 69e582ab2138313246289e97 2026-04-22 01:34:56,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:34:56,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e582ab2138313246289e97 HTTP/1.1" 200 None 2026-04-22 01:34:56,505 - lava_callback - DEBUG - Processing node 69e582ab2138313246289e97: baseline-arm64-clabbe 2026-04-22 01:34:56,505 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e582ab2138313246289e97 2026-04-22 01:34:56,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:33946 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:34:56,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e582ab2138313246289e97 HTTP/1.1" 200 None 2026-04-22 01:34:56,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:34:56,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-22 01:34:56,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:34:56,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e582ab2138313246289e97 HTTP/1.1" 200 None 2026-04-22 01:34:56,692 - lava_callback - ERROR - Error processing callback for node 69e582ab2138313246289e97: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60842 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36740 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:35:57,933 - lava_callback - INFO - Received callback for node 69e81db3afb86e738cad0355 INFO: 172.21.0.1:36752 - "POST /node/69e81db3afb86e738cad0355 HTTP/1.0" 202 Accepted 2026-04-22 01:35:57,939 - lava_callback - INFO - Starting async job submit for node 69e81db3afb86e738cad0355 2026-04-22 01:35:57,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:35:57,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81db3afb86e738cad0355 HTTP/1.1" 200 None 2026-04-22 01:35:58,000 - lava_callback - DEBUG - Processing node 69e81db3afb86e738cad0355: baseline-arm64-broonie 2026-04-22 01:35:58,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:35:58,358 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:35:58,360 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e81db3afb86e738cad0355/log.txt.gz 2026-04-22 01:35:58,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:35:58,659 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:35:58,660 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e81db3afb86e738cad0355/lava-logs.yaml 2026-04-22 01:35:58,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:35:58,784 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:35:58,786 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e81db3afb86e738cad0355/lava_callback.json.gz 2026-04-22 01:35:58,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:35:58,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81db3afb86e738cad0355 HTTP/1.1" 200 None 2026-04-22 01:35:58,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:35:58,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 01:35:58,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:35:58,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e81db3afb86e738cad0355 HTTP/1.1" 200 None 2026-04-22 01:35:58,873 - lava_callback - INFO - Completed processing callback for node 69e81db3afb86e738cad0355 INFO: 172.21.0.1:48648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41388 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41400 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:36:22,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:36:22,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50426 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:37:00,992 - lava_callback - INFO - Received callback for node 69e825d7afb86e738cad093d INFO: 172.21.0.1:34530 - "POST /node/69e825d7afb86e738cad093d HTTP/1.0" 202 Accepted 2026-04-22 01:37:00,999 - lava_callback - INFO - Starting async job submit for node 69e825d7afb86e738cad093d 2026-04-22 01:37:01,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:37:01,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e825d7afb86e738cad093d HTTP/1.1" 200 None 2026-04-22 01:37:01,039 - lava_callback - DEBUG - Processing node 69e825d7afb86e738cad093d: baseline-nfs-arm64 2026-04-22 01:37:01,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:37:01,495 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:37:01,496 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e825d7afb86e738cad093d/log.txt.gz 2026-04-22 01:37:01,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:37:01,895 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:37:01,897 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e825d7afb86e738cad093d/lava-logs.yaml 2026-04-22 01:37:01,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:37:02,090 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:37:02,091 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e825d7afb86e738cad093d/lava_callback.json.gz 2026-04-22 01:37:02,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:37:02,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e825d7afb86e738cad093d HTTP/1.1" 200 None 2026-04-22 01:37:02,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:37:02,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 01:37:02,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:37:02,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e825d7afb86e738cad093d HTTP/1.1" 200 None 2026-04-22 01:37:02,181 - lava_callback - INFO - Completed processing callback for node 69e825d7afb86e738cad093d INFO: 172.21.0.1:34540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37688 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:37:22,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:37:22,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34614 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:37:36,618 - lava_callback - INFO - Received callback for node 69e5834c2138313246289eba INFO: 172.21.0.1:34620 - "POST /node/69e5834c2138313246289eba HTTP/1.0" 202 Accepted 2026-04-22 01:37:36,624 - lava_callback - INFO - Starting async job submit for node 69e5834c2138313246289eba 2026-04-22 01:37:36,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:37:36,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5834c2138313246289eba HTTP/1.1" 200 None 2026-04-22 01:37:36,644 - lava_callback - DEBUG - Processing node 69e5834c2138313246289eba: baseline-arm64-clabbe 2026-04-22 01:37:36,644 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5834c2138313246289eba 2026-04-22 01:37:36,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:37:36,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5834c2138313246289eba HTTP/1.1" 200 None 2026-04-22 01:37:36,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:37:36,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-22 01:37:36,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:37:36,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5834c2138313246289eba HTTP/1.1" 200 None 2026-04-22 01:37:36,695 - lava_callback - ERROR - Error processing callback for node 69e5834c2138313246289eba: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51086 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39306 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:38:56,597 - lava_callback - INFO - Received callback for node 69e5839c2138313246289ee3 INFO: 172.21.0.1:39316 - "POST /node/69e5839c2138313246289ee3 HTTP/1.0" 202 Accepted 2026-04-22 01:38:56,602 - lava_callback - INFO - Starting async job submit for node 69e5839c2138313246289ee3 2026-04-22 01:38:56,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:38:56,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5839c2138313246289ee3 HTTP/1.1" 200 None 2026-04-22 01:38:56,618 - lava_callback - DEBUG - Processing node 69e5839c2138313246289ee3: baseline-arm64-clabbe 2026-04-22 01:38:56,618 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5839c2138313246289ee3 2026-04-22 01:38:56,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:38:56,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5839c2138313246289ee3 HTTP/1.1" 200 None 2026-04-22 01:38:56,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:38:56,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-22 01:38:56,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:38:56,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5839c2138313246289ee3 HTTP/1.1" 200 None 2026-04-22 01:38:56,665 - lava_callback - ERROR - Error processing callback for node 69e5839c2138313246289ee3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37792 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:40:16,690 - lava_callback - INFO - Received callback for node 69e583ed2138313246289f02 INFO: 172.21.0.1:37802 - "POST /node/69e583ed2138313246289f02 HTTP/1.0" 202 Accepted 2026-04-22 01:40:16,696 - lava_callback - INFO - Starting async job submit for node 69e583ed2138313246289f02 2026-04-22 01:40:16,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:40:16,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e583ed2138313246289f02 HTTP/1.1" 200 None 2026-04-22 01:40:16,712 - lava_callback - DEBUG - Processing node 69e583ed2138313246289f02: baseline-arm64-clabbe 2026-04-22 01:40:16,712 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e583ed2138313246289f02 2026-04-22 01:40:16,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:40:16,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e583ed2138313246289f02 HTTP/1.1" 200 None 2026-04-22 01:40:16,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:40:16,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-22 01:40:16,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:40:16,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e583ed2138313246289f02 HTTP/1.1" 200 None 2026-04-22 01:40:16,770 - lava_callback - ERROR - Error processing callback for node 69e583ed2138313246289f02: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49864 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:41:36,699 - lava_callback - INFO - Received callback for node 69e5843e2138313246289f28 INFO: 172.21.0.1:49876 - "POST /node/69e5843e2138313246289f28 HTTP/1.0" 202 Accepted 2026-04-22 01:41:36,705 - lava_callback - INFO - Starting async job submit for node 69e5843e2138313246289f28 2026-04-22 01:41:36,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:41:36,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5843e2138313246289f28 HTTP/1.1" 200 None 2026-04-22 01:41:36,720 - lava_callback - DEBUG - Processing node 69e5843e2138313246289f28: baseline-arm64-clabbe 2026-04-22 01:41:36,720 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5843e2138313246289f28 2026-04-22 01:41:36,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:41:36,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5843e2138313246289f28 HTTP/1.1" 200 None 2026-04-22 01:41:36,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:41:36,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-22 01:41:36,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:41:36,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5843e2138313246289f28 HTTP/1.1" 200 None 2026-04-22 01:41:36,793 - lava_callback - ERROR - Error processing callback for node 69e5843e2138313246289f28: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48528 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54064 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:42:56,762 - lava_callback - INFO - Received callback for node 69e5848e2138313246289f52 INFO: 172.21.0.1:54070 - "POST /node/69e5848e2138313246289f52 HTTP/1.0" 202 Accepted 2026-04-22 01:42:56,771 - lava_callback - INFO - Starting async job submit for node 69e5848e2138313246289f52 2026-04-22 01:42:56,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:42:56,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5848e2138313246289f52 HTTP/1.1" 200 None 2026-04-22 01:42:56,802 - lava_callback - DEBUG - Processing node 69e5848e2138313246289f52: baseline-arm64-clabbe 2026-04-22 01:42:56,802 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5848e2138313246289f52 2026-04-22 01:42:56,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:42:56,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5848e2138313246289f52 HTTP/1.1" 200 None 2026-04-22 01:42:56,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:42:56,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-22 01:42:56,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:42:56,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5848e2138313246289f52 HTTP/1.1" 200 None 2026-04-22 01:42:56,885 - lava_callback - ERROR - Error processing callback for node 69e5848e2138313246289f52: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52478 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:43:18,376 - lava_callback - INFO - Received callback for node 69e827aaafb86e738cad0a34 INFO: 172.21.0.1:52492 - "POST /node/69e827aaafb86e738cad0a34 HTTP/1.0" 202 Accepted 2026-04-22 01:43:18,382 - lava_callback - INFO - Starting async job submit for node 69e827aaafb86e738cad0a34 2026-04-22 01:43:18,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:43:18,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e827aaafb86e738cad0a34 HTTP/1.1" 200 None 2026-04-22 01:43:18,406 - lava_callback - DEBUG - Processing node 69e827aaafb86e738cad0a34: baseline-nfs-arm64 2026-04-22 01:43:18,408 - lava_callback - WARNING - Failed to upload log 2026-04-22 01:43:18,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:43:18,514 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:43:18,515 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e827aaafb86e738cad0a34/lava-logs.yaml 2026-04-22 01:43:18,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:43:18,607 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:43:18,609 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e827aaafb86e738cad0a34/lava_callback.json.gz 2026-04-22 01:43:18,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:43:18,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e827aaafb86e738cad0a34 HTTP/1.1" 200 None 2026-04-22 01:43:18,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:43:18,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 01:43:18,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:43:18,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e827aaafb86e738cad0a34 HTTP/1.1" 200 None 2026-04-22 01:43:18,671 - lava_callback - INFO - Completed processing callback for node 69e827aaafb86e738cad0a34 2026-04-22 01:43:22,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:43:23,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59442 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:45:12,922 - lava_callback - INFO - Received callback for node 69e82766afb86e738cad0a0b INFO: 172.21.0.1:51684 - "POST /node/69e82766afb86e738cad0a0b HTTP/1.0" 202 Accepted 2026-04-22 01:45:12,930 - lava_callback - INFO - Starting async job submit for node 69e82766afb86e738cad0a0b 2026-04-22 01:45:12,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:45:12,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e82766afb86e738cad0a0b HTTP/1.1" 200 None 2026-04-22 01:45:12,985 - lava_callback - DEBUG - Processing node 69e82766afb86e738cad0a0b: baseline-arm64-foundriesio 2026-04-22 01:45:13,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:45:13,950 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:45:13,952 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e82766afb86e738cad0a0b/log.txt.gz 2026-04-22 01:45:14,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:45:14,626 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:45:14,628 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e82766afb86e738cad0a0b/lava-logs.yaml 2026-04-22 01:45:14,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:45:14,841 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:45:14,843 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e82766afb86e738cad0a0b/lava_callback.json.gz DEBUG: 69e82766afb86e738cad0a0b Transitting job node result: pass -> incomplete 2026-04-22 01:45:14,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:45:14,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e82766afb86e738cad0a0b HTTP/1.1" 200 None 2026-04-22 01:45:14,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:45:14,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 01:45:14,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:45:14,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e82766afb86e738cad0a0b HTTP/1.1" 200 None 2026-04-22 01:45:14,942 - lava_callback - INFO - Completed processing callback for node 69e82766afb86e738cad0a0b INFO: 172.21.0.1:51690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51692 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:45:23,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:45:23,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57810 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56340 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:48:18,670 - lava_callback - INFO - Received callback for node 69e82526afb86e738cad08de INFO: 172.21.0.1:56356 - "POST /node/69e82526afb86e738cad08de HTTP/1.0" 202 Accepted 2026-04-22 01:48:18,677 - lava_callback - INFO - Starting async job submit for node 69e82526afb86e738cad08de 2026-04-22 01:48:18,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:48:18,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e82526afb86e738cad08de HTTP/1.1" 200 None 2026-04-22 01:48:18,721 - lava_callback - DEBUG - Processing node 69e82526afb86e738cad08de: baseline-arm64 2026-04-22 01:48:18,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:48:18,959 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:48:18,961 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e82526afb86e738cad08de/log.txt.gz 2026-04-22 01:48:19,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:48:19,200 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:48:19,202 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e82526afb86e738cad08de/lava-logs.yaml 2026-04-22 01:48:19,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:48:19,307 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:48:19,308 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e82526afb86e738cad08de/lava_callback.json.gz 2026-04-22 01:48:19,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:48:19,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e82526afb86e738cad08de HTTP/1.1" 200 None 2026-04-22 01:48:19,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:48:19,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 01:48:19,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:48:19,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e82526afb86e738cad08de HTTP/1.1" 200 None 2026-04-22 01:48:19,442 - lava_callback - INFO - Completed processing callback for node 69e82526afb86e738cad08de 2026-04-22 01:48:23,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:48:23,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53860 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:49:47,088 - lava_callback - INFO - Received callback for node 69e586392138313246289f79 INFO: 172.21.0.1:53866 - "POST /node/69e586392138313246289f79 HTTP/1.0" 202 Accepted 2026-04-22 01:49:47,093 - lava_callback - INFO - Starting async job submit for node 69e586392138313246289f79 2026-04-22 01:49:47,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:49:47,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e586392138313246289f79 HTTP/1.1" 200 None 2026-04-22 01:49:47,109 - lava_callback - DEBUG - Processing node 69e586392138313246289f79: baseline-arm64-baylibre 2026-04-22 01:49:47,109 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e586392138313246289f79 2026-04-22 01:49:47,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:49:47,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e586392138313246289f79 HTTP/1.1" 200 None 2026-04-22 01:49:47,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:49:47,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-22 01:49:47,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:49:47,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e586392138313246289f79 HTTP/1.1" 200 None 2026-04-22 01:49:47,156 - lava_callback - ERROR - Error processing callback for node 69e586392138313246289f79: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38498 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:51:26,847 - lava_callback - INFO - Received callback for node 69e586902138313246289fa0 INFO: 172.21.0.1:38508 - "POST /node/69e586902138313246289fa0 HTTP/1.0" 202 Accepted 2026-04-22 01:51:26,853 - lava_callback - INFO - Starting async job submit for node 69e586902138313246289fa0 2026-04-22 01:51:26,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:51:26,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e586902138313246289fa0 HTTP/1.1" 200 None 2026-04-22 01:51:26,869 - lava_callback - DEBUG - Processing node 69e586902138313246289fa0: baseline-arm64-baylibre 2026-04-22 01:51:26,869 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e586902138313246289fa0 2026-04-22 01:51:26,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:51:26,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e586902138313246289fa0 HTTP/1.1" 200 None 2026-04-22 01:51:26,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:51:26,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-22 01:51:26,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:51:26,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e586902138313246289fa0 HTTP/1.1" 200 None 2026-04-22 01:51:26,917 - lava_callback - ERROR - Error processing callback for node 69e586902138313246289fa0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45006 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40934 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:52:57,172 - lava_callback - INFO - Received callback for node 69e586e42138313246289fca INFO: 172.21.0.1:40950 - "POST /node/69e586e42138313246289fca HTTP/1.0" 202 Accepted 2026-04-22 01:52:57,178 - lava_callback - INFO - Starting async job submit for node 69e586e42138313246289fca 2026-04-22 01:52:57,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:52:57,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e586e42138313246289fca HTTP/1.1" 200 None 2026-04-22 01:52:57,194 - lava_callback - DEBUG - Processing node 69e586e42138313246289fca: baseline-arm64-clabbe 2026-04-22 01:52:57,194 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e586e42138313246289fca 2026-04-22 01:52:57,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:52:57,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e586e42138313246289fca HTTP/1.1" 200 None 2026-04-22 01:52:57,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:52:57,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-22 01:52:57,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:52:57,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e586e42138313246289fca HTTP/1.1" 200 None 2026-04-22 01:52:57,244 - lava_callback - ERROR - Error processing callback for node 69e586e42138313246289fca: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35006 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35022 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:54:17,231 - lava_callback - INFO - Received callback for node 69e587342138313246289fe9 INFO: 172.21.0.1:35026 - "POST /node/69e587342138313246289fe9 HTTP/1.0" 202 Accepted 2026-04-22 01:54:17,236 - lava_callback - INFO - Starting async job submit for node 69e587342138313246289fe9 2026-04-22 01:54:17,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:54:17,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e587342138313246289fe9 HTTP/1.1" 200 None 2026-04-22 01:54:17,255 - lava_callback - DEBUG - Processing node 69e587342138313246289fe9: baseline-arm64-clabbe 2026-04-22 01:54:17,256 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e587342138313246289fe9 2026-04-22 01:54:17,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:54:17,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e587342138313246289fe9 HTTP/1.1" 200 None 2026-04-22 01:54:17,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:54:17,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-22 01:54:17,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:54:17,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e587342138313246289fe9 HTTP/1.1" 200 None 2026-04-22 01:54:17,306 - lava_callback - ERROR - Error processing callback for node 69e587342138313246289fe9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-22 01:54:18,576 - lava_callback - INFO - Received callback for node 69e82582afb86e738cad0912 INFO: 172.21.0.1:35034 - "POST /node/69e82582afb86e738cad0912 HTTP/1.0" 202 Accepted 2026-04-22 01:54:18,585 - lava_callback - INFO - Starting async job submit for node 69e82582afb86e738cad0912 2026-04-22 01:54:18,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:54:18,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e82582afb86e738cad0912 HTTP/1.1" 200 None 2026-04-22 01:54:18,643 - lava_callback - DEBUG - Processing node 69e82582afb86e738cad0912: baseline-nfs-arm64 2026-04-22 01:54:19,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:54:20,029 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:54:20,031 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e82582afb86e738cad0912/log.txt.gz 2026-04-22 01:54:20,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:54:20,818 - lava_callback - INFO - Received callback for node 69e8267aafb86e738cad099f INFO: 172.21.0.1:38510 - "POST /node/69e8267aafb86e738cad099f HTTP/1.0" 202 Accepted 2026-04-22 01:54:20,830 - lava_callback - INFO - Starting async job submit for node 69e8267aafb86e738cad099f 2026-04-22 01:54:20,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:54:20,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8267aafb86e738cad099f HTTP/1.1" 200 None 2026-04-22 01:54:20,903 - lava_callback - DEBUG - Processing node 69e8267aafb86e738cad099f: baseline-arm 2026-04-22 01:54:20,999 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:54:21,053 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e82582afb86e738cad0912/lava-logs.yaml 2026-04-22 01:54:21,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:54:21,400 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:54:21,447 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e82582afb86e738cad0912/lava_callback.json.gz DEBUG: Setup failed for 69e82582afb86e738cad0912. Transitting job node result: incomplete -> fail 2026-04-22 01:54:21,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:54:21,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:54:21,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e82582afb86e738cad0912 HTTP/1.1" 200 None 2026-04-22 01:54:21,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:54:21,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 01:54:21,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:54:21,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e82582afb86e738cad0912 HTTP/1.1" 200 None 2026-04-22 01:54:21,778 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:54:21,787 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e8267aafb86e738cad099f/log.txt.gz 2026-04-22 01:54:21,806 - lava_callback - INFO - Completed processing callback for node 69e82582afb86e738cad0912 2026-04-22 01:54:22,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:54:22,456 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:54:22,459 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e8267aafb86e738cad099f/lava-logs.yaml 2026-04-22 01:54:22,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:54:22,578 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:54:22,580 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e8267aafb86e738cad099f/lava_callback.json.gz DEBUG: Setup failed for 69e8267aafb86e738cad099f. Transitting job node result: incomplete -> fail 2026-04-22 01:54:22,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:54:22,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8267aafb86e738cad099f HTTP/1.1" 200 None 2026-04-22 01:54:22,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:54:22,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8139bafb86e738cacfb7c HTTP/1.1" 200 None 2026-04-22 01:54:22,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:54:22,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e8267aafb86e738cad099f HTTP/1.1" 200 None 2026-04-22 01:54:22,832 - lava_callback - INFO - Completed processing callback for node 69e8267aafb86e738cad099f 2026-04-22 01:54:23,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:54:23,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60484 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:55:10,145 - lava_callback - INFO - Received callback for node 69e82a53afb86e738cad0bb7 INFO: 172.21.0.1:55520 - "POST /node/69e82a53afb86e738cad0bb7 HTTP/1.0" 202 Accepted 2026-04-22 01:55:10,152 - lava_callback - INFO - Starting async job submit for node 69e82a53afb86e738cad0bb7 2026-04-22 01:55:10,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:55:10,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e82a53afb86e738cad0bb7 HTTP/1.1" 200 None 2026-04-22 01:55:10,197 - lava_callback - DEBUG - Processing node 69e82a53afb86e738cad0bb7: baseline-arm64 2026-04-22 01:55:10,339 - lava_callback - WARNING - Failed to upload log 2026-04-22 01:55:10,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:55:10,554 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:55:10,556 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e82a53afb86e738cad0bb7/lava-logs.yaml 2026-04-22 01:55:10,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:55:10,649 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:55:10,650 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e82a53afb86e738cad0bb7/lava_callback.json.gz 2026-04-22 01:55:10,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:55:10,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e82a53afb86e738cad0bb7 HTTP/1.1" 200 None 2026-04-22 01:55:10,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:55:10,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 01:55:10,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:55:10,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e82a53afb86e738cad0bb7 HTTP/1.1" 200 None 2026-04-22 01:55:10,814 - lava_callback - INFO - Completed processing callback for node 69e82a53afb86e738cad0bb7 INFO: 172.21.0.1:55530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55534 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:55:23,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:55:23,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-22 01:55:23,448 - lava_callback - INFO - Received callback for node 69e82854afb86e738cad0a96 INFO: 172.21.0.1:33080 - "POST /node/69e82854afb86e738cad0a96 HTTP/1.0" 202 Accepted 2026-04-22 01:55:23,455 - lava_callback - INFO - Starting async job submit for node 69e82854afb86e738cad0a96 2026-04-22 01:55:23,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:55:23,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e82854afb86e738cad0a96 HTTP/1.1" 200 None 2026-04-22 01:55:23,508 - lava_callback - DEBUG - Processing node 69e82854afb86e738cad0a96: baseline-arm64 2026-04-22 01:55:23,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:55:23,984 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:55:23,985 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e82854afb86e738cad0a96/log.txt.gz 2026-04-22 01:55:24,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:55:24,371 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:55:24,373 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e82854afb86e738cad0a96/lava-logs.yaml 2026-04-22 01:55:24,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:55:24,489 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:55:24,491 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e82854afb86e738cad0a96/lava_callback.json.gz DEBUG: Setup failed for 69e82854afb86e738cad0a96. Transitting job node result: incomplete -> fail 2026-04-22 01:55:24,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:55:24,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e82854afb86e738cad0a96 HTTP/1.1" 200 None 2026-04-22 01:55:24,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:55:24,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 01:55:24,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:55:24,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e82854afb86e738cad0a96 HTTP/1.1" 200 None 2026-04-22 01:55:24,711 - lava_callback - INFO - Completed processing callback for node 69e82854afb86e738cad0a96 INFO: 172.21.0.1:33090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56120 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:55:37,338 - lava_callback - INFO - Received callback for node 69e58785213831324628a010 INFO: 172.21.0.1:56134 - "POST /node/69e58785213831324628a010 HTTP/1.0" 202 Accepted 2026-04-22 01:55:37,343 - lava_callback - INFO - Starting async job submit for node 69e58785213831324628a010 2026-04-22 01:55:37,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:55:37,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e58785213831324628a010 HTTP/1.1" 200 None 2026-04-22 01:55:37,359 - lava_callback - DEBUG - Processing node 69e58785213831324628a010: baseline-arm64-clabbe 2026-04-22 01:55:37,359 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e58785213831324628a010 2026-04-22 01:55:37,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:55:37,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e58785213831324628a010 HTTP/1.1" 200 None 2026-04-22 01:55:37,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:55:37,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-22 01:55:37,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:55:37,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e58785213831324628a010 HTTP/1.1" 200 None 2026-04-22 01:55:37,407 - lava_callback - ERROR - Error processing callback for node 69e58785213831324628a010: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-22 01:55:39,382 - lava_callback - INFO - Received callback for node 69e82678afb86e738cad099c INFO: 172.21.0.1:56150 - "POST /node/69e82678afb86e738cad099c HTTP/1.0" 202 Accepted 2026-04-22 01:55:39,389 - lava_callback - INFO - Starting async job submit for node 69e82678afb86e738cad099c 2026-04-22 01:55:39,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:55:39,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e82678afb86e738cad099c HTTP/1.1" 200 None 2026-04-22 01:55:39,464 - lava_callback - DEBUG - Processing node 69e82678afb86e738cad099c: ltp-smoke 2026-04-22 01:55:39,593 - lava_callback - INFO - Received callback for node 69e829abafb86e738cad0b47 INFO: 172.21.0.1:56154 - "POST /node/69e829abafb86e738cad0b47 HTTP/1.0" 202 Accepted 2026-04-22 01:55:39,615 - lava_callback - INFO - Starting async job submit for node 69e829abafb86e738cad0b47 2026-04-22 01:55:39,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:55:39,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e829abafb86e738cad0b47 HTTP/1.1" 200 None 2026-04-22 01:55:39,788 - lava_callback - DEBUG - Processing node 69e829abafb86e738cad0b47: baseline-arm64 2026-04-22 01:55:40,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:55:40,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:55:40,501 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:55:40,503 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69e82678afb86e738cad099c/log.txt.gz 2026-04-22 01:55:40,535 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:55:40,564 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e829abafb86e738cad0b47/log.txt.gz 2026-04-22 01:55:40,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:55:40,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:55:41,155 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:55:41,157 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69e82678afb86e738cad099c/lava-logs.yaml 2026-04-22 01:55:41,159 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:55:41,161 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e829abafb86e738cad0b47/lava-logs.yaml 2026-04-22 01:55:41,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:55:41,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:55:41,285 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:55:41,287 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69e82678afb86e738cad099c/lava_callback.json.gz 2026-04-22 01:55:41,304 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:55:41,352 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e829abafb86e738cad0b47/lava_callback.json.gz 2026-04-22 01:55:41,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:55:41,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:55:41,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e829abafb86e738cad0b47 HTTP/1.1" 200 None 2026-04-22 01:55:41,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:55:41,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 01:55:41,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:55:41,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e82678afb86e738cad099c HTTP/1.1" 200 None 2026-04-22 01:55:41,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:55:41,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813a3afb86e738cacfb99 HTTP/1.1" 200 None 2026-04-22 01:55:41,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e829abafb86e738cad0b47 HTTP/1.1" 200 None 2026-04-22 01:55:41,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:55:41,593 - lava_callback - INFO - Completed processing callback for node 69e829abafb86e738cad0b47 2026-04-22 01:55:41,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e82678afb86e738cad099c HTTP/1.1" 200 None 2026-04-22 01:55:41,739 - lava_callback - INFO - Completed processing callback for node 69e82678afb86e738cad099c INFO: 172.21.0.1:56738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56754 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:55:53,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:55:53,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41940 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:56:51,916 - lava_callback - INFO - Received callback for node 69e8262dafb86e738cad096f INFO: 172.21.0.1:40512 - "POST /node/69e8262dafb86e738cad096f HTTP/1.0" 202 Accepted 2026-04-22 01:56:51,924 - lava_callback - INFO - Starting async job submit for node 69e8262dafb86e738cad096f 2026-04-22 01:56:51,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:56:51,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8262dafb86e738cad096f HTTP/1.1" 200 None 2026-04-22 01:56:51,985 - lava_callback - DEBUG - Processing node 69e8262dafb86e738cad096f: baseline-nfs-arm64 2026-04-22 01:56:52,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:56:53,064 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:56:53,065 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e8262dafb86e738cad096f/log.txt.gz 2026-04-22 01:56:53,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:56:53,730 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:56:53,732 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e8262dafb86e738cad096f/lava-logs.yaml 2026-04-22 01:56:53,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 01:56:53,872 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 01:56:53,874 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e8262dafb86e738cad096f/lava_callback.json.gz DEBUG: Setup failed for 69e8262dafb86e738cad096f. Transitting job node result: incomplete -> fail 2026-04-22 01:56:53,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:56:53,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8262dafb86e738cad096f HTTP/1.1" 200 None 2026-04-22 01:56:53,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:56:53,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 01:56:53,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:56:54,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e8262dafb86e738cad096f HTTP/1.1" 200 None 2026-04-22 01:56:54,175 - lava_callback - INFO - Completed processing callback for node 69e8262dafb86e738cad096f INFO: 172.21.0.1:40526 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:56:57,393 - lava_callback - INFO - Received callback for node 69e587d3213831324628a03b INFO: 172.21.0.1:40528 - "POST /node/69e587d3213831324628a03b HTTP/1.0" 202 Accepted 2026-04-22 01:56:57,399 - lava_callback - INFO - Starting async job submit for node 69e587d3213831324628a03b 2026-04-22 01:56:57,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:56:57,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e587d3213831324628a03b HTTP/1.1" 200 None 2026-04-22 01:56:57,415 - lava_callback - DEBUG - Processing node 69e587d3213831324628a03b: baseline-arm64-clabbe 2026-04-22 01:56:57,415 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e587d3213831324628a03b 2026-04-22 01:56:57,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:56:57,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e587d3213831324628a03b HTTP/1.1" 200 None 2026-04-22 01:56:57,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:56:57,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-22 01:56:57,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:56:57,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e587d3213831324628a03b HTTP/1.1" 200 None 2026-04-22 01:56:57,484 - lava_callback - ERROR - Error processing callback for node 69e587d3213831324628a03b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52328 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:57:23,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:57:23,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43528 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:58:17,417 - lava_callback - INFO - Received callback for node 69e58823213831324628a058 INFO: 172.21.0.1:43542 - "POST /node/69e58823213831324628a058 HTTP/1.0" 202 Accepted 2026-04-22 01:58:17,423 - lava_callback - INFO - Starting async job submit for node 69e58823213831324628a058 2026-04-22 01:58:17,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:58:17,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e58823213831324628a058 HTTP/1.1" 200 None 2026-04-22 01:58:17,440 - lava_callback - DEBUG - Processing node 69e58823213831324628a058: baseline-arm64-clabbe 2026-04-22 01:58:17,440 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e58823213831324628a058 2026-04-22 01:58:17,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:58:17,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e58823213831324628a058 HTTP/1.1" 200 None 2026-04-22 01:58:17,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:58:17,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-22 01:58:17,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:58:17,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e58823213831324628a058 HTTP/1.1" 200 None 2026-04-22 01:58:17,502 - lava_callback - ERROR - Error processing callback for node 69e58823213831324628a058: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57768 - "GET / HTTP/1.0" 200 OK 2026-04-22 01:59:37,419 - lava_callback - INFO - Received callback for node 69e58874213831324628a082 INFO: 172.21.0.1:57772 - "POST /node/69e58874213831324628a082 HTTP/1.0" 202 Accepted 2026-04-22 01:59:37,425 - lava_callback - INFO - Starting async job submit for node 69e58874213831324628a082 2026-04-22 01:59:37,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:59:37,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e58874213831324628a082 HTTP/1.1" 200 None 2026-04-22 01:59:37,441 - lava_callback - DEBUG - Processing node 69e58874213831324628a082: baseline-arm64-clabbe 2026-04-22 01:59:37,441 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e58874213831324628a082 2026-04-22 01:59:37,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:59:37,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e58874213831324628a082 HTTP/1.1" 200 None 2026-04-22 01:59:37,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:59:37,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-22 01:59:37,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 01:59:37,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e58874213831324628a082 HTTP/1.1" 200 None 2026-04-22 01:59:37,488 - lava_callback - ERROR - Error processing callback for node 69e58874213831324628a082: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42524 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46788 - "GET / HTTP/1.0" 200 OK 2026-04-22 02:00:57,696 - lava_callback - INFO - Received callback for node 69e588c4213831324628a0ac INFO: 172.21.0.1:46798 - "POST /node/69e588c4213831324628a0ac HTTP/1.0" 202 Accepted 2026-04-22 02:00:57,702 - lava_callback - INFO - Starting async job submit for node 69e588c4213831324628a0ac 2026-04-22 02:00:57,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:00:57,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e588c4213831324628a0ac HTTP/1.1" 200 None 2026-04-22 02:00:57,734 - lava_callback - DEBUG - Processing node 69e588c4213831324628a0ac: baseline-arm64-clabbe 2026-04-22 02:00:57,734 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e588c4213831324628a0ac 2026-04-22 02:00:57,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:00:57,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e588c4213831324628a0ac HTTP/1.1" 200 None 2026-04-22 02:00:57,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:00:57,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69dd87b5c2164e674d71ee47 HTTP/1.1" 200 None 2026-04-22 02:00:57,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:00:57,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e588c4213831324628a0ac HTTP/1.1" 200 None 2026-04-22 02:00:57,790 - lava_callback - ERROR - Error processing callback for node 69e588c4213831324628a0ac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34528 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52482 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53224 - "GET / HTTP/1.0" 200 OK 2026-04-22 02:08:30,745 - lava_callback - INFO - Received callback for node 69e82d64afb86e738cad0d96 INFO: 172.21.0.1:57608 - "POST /node/69e82d64afb86e738cad0d96 HTTP/1.0" 202 Accepted 2026-04-22 02:08:30,751 - lava_callback - INFO - Starting async job submit for node 69e82d64afb86e738cad0d96 2026-04-22 02:08:30,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:08:30,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e82d64afb86e738cad0d96 HTTP/1.1" 200 None 2026-04-22 02:08:30,801 - lava_callback - DEBUG - Processing node 69e82d64afb86e738cad0d96: baseline-arm64 2026-04-22 02:08:30,934 - lava_callback - WARNING - Failed to upload log 2026-04-22 02:08:31,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 02:08:31,296 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 02:08:31,298 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e82d64afb86e738cad0d96/lava-logs.yaml 2026-04-22 02:08:31,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 02:08:31,396 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 02:08:31,398 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e82d64afb86e738cad0d96/lava_callback.json.gz 2026-04-22 02:08:31,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:08:31,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e82d64afb86e738cad0d96 HTTP/1.1" 200 None 2026-04-22 02:08:31,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:08:31,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 02:08:31,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:08:31,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e82d64afb86e738cad0d96 HTTP/1.1" 200 None 2026-04-22 02:08:31,579 - lava_callback - INFO - Completed processing callback for node 69e82d64afb86e738cad0d96 INFO: 172.21.0.1:57610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51346 - "GET / HTTP/1.0" 200 OK 2026-04-22 02:08:53,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:08:53,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44080 - "GET / HTTP/1.0" 200 OK 2026-04-22 02:09:37,223 - lava_callback - INFO - Received callback for node 69e82d1fafb86e738cad0d6b INFO: 172.21.0.1:44086 - "POST /node/69e82d1fafb86e738cad0d6b HTTP/1.0" 202 Accepted 2026-04-22 02:09:37,231 - lava_callback - INFO - Starting async job submit for node 69e82d1fafb86e738cad0d6b 2026-04-22 02:09:37,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:09:37,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e82d1fafb86e738cad0d6b HTTP/1.1" 200 None 2026-04-22 02:09:37,286 - lava_callback - DEBUG - Processing node 69e82d1fafb86e738cad0d6b: baseline-arm64-foundriesio 2026-04-22 02:09:38,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 02:09:38,249 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 02:09:38,251 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e82d1fafb86e738cad0d6b/log.txt.gz 2026-04-22 02:09:38,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 02:09:39,067 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 02:09:39,070 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e82d1fafb86e738cad0d6b/lava-logs.yaml 2026-04-22 02:09:39,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 02:09:39,269 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 02:09:39,270 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69e82d1fafb86e738cad0d6b/lava_callback.json.gz DEBUG: 69e82d1fafb86e738cad0d6b Transitting job node result: pass -> incomplete 2026-04-22 02:09:39,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:09:39,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e82d1fafb86e738cad0d6b HTTP/1.1" 200 None 2026-04-22 02:09:39,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:09:39,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 02:09:39,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:09:39,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e82d1fafb86e738cad0d6b HTTP/1.1" 200 None 2026-04-22 02:09:39,361 - lava_callback - INFO - Completed processing callback for node 69e82d1fafb86e738cad0d6b INFO: 172.21.0.1:46320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46332 - "GET / HTTP/1.0" 200 OK 2026-04-22 02:09:53,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:09:53,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55236 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55668 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47668 - "GET / HTTP/1.0" 200 OK 2026-04-22 02:18:19,536 - lava_callback - INFO - Received callback for node 69e82efdafb86e738cad0e52 INFO: 172.21.0.1:47672 - "POST /node/69e82efdafb86e738cad0e52 HTTP/1.0" 202 Accepted 2026-04-22 02:18:19,542 - lava_callback - INFO - Starting async job submit for node 69e82efdafb86e738cad0e52 2026-04-22 02:18:19,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:18:19,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e82efdafb86e738cad0e52 HTTP/1.1" 200 None 2026-04-22 02:18:19,576 - lava_callback - DEBUG - Processing node 69e82efdafb86e738cad0e52: baseline-arm64 2026-04-22 02:18:19,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 02:18:20,121 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 02:18:20,122 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e82efdafb86e738cad0e52/log.txt.gz 2026-04-22 02:18:20,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 02:18:20,515 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 02:18:20,517 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e82efdafb86e738cad0e52/lava-logs.yaml 2026-04-22 02:18:20,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 02:18:20,717 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 02:18:20,718 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e82efdafb86e738cad0e52/lava_callback.json.gz 2026-04-22 02:18:20,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:18:20,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e82efdafb86e738cad0e52 HTTP/1.1" 200 None 2026-04-22 02:18:20,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:18:20,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 02:18:20,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:18:20,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e82efdafb86e738cad0e52 HTTP/1.1" 200 None 2026-04-22 02:18:20,856 - lava_callback - INFO - Completed processing callback for node 69e82efdafb86e738cad0e52 2026-04-22 02:18:23,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:18:23,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49708 - "GET / HTTP/1.0" 200 OK 2026-04-22 02:20:36,669 - lava_callback - INFO - Received callback for node 69e82eabafb86e738cad0e26 INFO: 172.21.0.1:49722 - "POST /node/69e82eabafb86e738cad0e26 HTTP/1.0" 202 Accepted 2026-04-22 02:20:36,676 - lava_callback - INFO - Starting async job submit for node 69e82eabafb86e738cad0e26 2026-04-22 02:20:36,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:20:36,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e82eabafb86e738cad0e26 HTTP/1.1" 200 None 2026-04-22 02:20:36,728 - lava_callback - DEBUG - Processing node 69e82eabafb86e738cad0e26: baseline-arm64 2026-04-22 02:20:37,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 02:20:37,178 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 02:20:37,180 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e82eabafb86e738cad0e26/log.txt.gz 2026-04-22 02:20:37,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 02:20:37,570 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 02:20:37,573 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e82eabafb86e738cad0e26/lava-logs.yaml 2026-04-22 02:20:37,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 02:20:37,695 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 02:20:37,697 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e82eabafb86e738cad0e26/lava_callback.json.gz DEBUG: Setup failed for 69e82eabafb86e738cad0e26. Transitting job node result: incomplete -> fail 2026-04-22 02:20:37,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:20:37,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e82eabafb86e738cad0e26 HTTP/1.1" 200 None 2026-04-22 02:20:37,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:20:37,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 02:20:37,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:20:37,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e82eabafb86e738cad0e26 HTTP/1.1" 200 None 2026-04-22 02:20:37,898 - lava_callback - INFO - Completed processing callback for node 69e82eabafb86e738cad0e26 INFO: 172.21.0.1:46122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46132 - "GET / HTTP/1.0" 200 OK 2026-04-22 02:20:53,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:20:53,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34532 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39396 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47748 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43440 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-22 02:29:16,305 - lava_callback - INFO - Received callback for node 69e82e55afb86e738cad0e0d INFO: 172.21.0.1:43448 - "POST /node/69e82e55afb86e738cad0e0d HTTP/1.0" 202 Accepted 2026-04-22 02:29:16,312 - lava_callback - INFO - Starting async job submit for node 69e82e55afb86e738cad0e0d 2026-04-22 02:29:16,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:29:16,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e82e55afb86e738cad0e0d HTTP/1.1" 200 None 2026-04-22 02:29:16,396 - lava_callback - DEBUG - Processing node 69e82e55afb86e738cad0e0d: baseline-arm INFO: 172.21.0.1:43460 - "GET / HTTP/1.0" 200 OK 2026-04-22 02:29:16,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 02:29:17,135 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 02:29:17,137 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69e82e55afb86e738cad0e0d/log.txt.gz 2026-04-22 02:29:17,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 02:29:17,850 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 02:29:17,853 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69e82e55afb86e738cad0e0d/lava-logs.yaml 2026-04-22 02:29:17,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 02:29:18,016 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 02:29:18,018 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69e82e55afb86e738cad0e0d/lava_callback.json.gz DEBUG: Setup failed for 69e82e55afb86e738cad0e0d. Transitting job node result: incomplete -> fail 2026-04-22 02:29:18,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:29:18,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e82e55afb86e738cad0e0d HTTP/1.1" 200 None 2026-04-22 02:29:18,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:29:18,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8139bafb86e738cacfb7c HTTP/1.1" 200 None 2026-04-22 02:29:18,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:29:18,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e82e55afb86e738cad0e0d HTTP/1.1" 200 None 2026-04-22 02:29:18,306 - lava_callback - INFO - Completed processing callback for node 69e82e55afb86e738cad0e0d 2026-04-22 02:29:23,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:29:23,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47806 - "GET / HTTP/1.0" 200 OK 2026-04-22 02:30:32,223 - lava_callback - INFO - Received callback for node 69e82e09afb86e738cad0de5 INFO: 172.21.0.1:56444 - "POST /node/69e82e09afb86e738cad0de5 HTTP/1.0" 202 Accepted 2026-04-22 02:30:32,232 - lava_callback - INFO - Starting async job submit for node 69e82e09afb86e738cad0de5 2026-04-22 02:30:32,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:30:32,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e82e09afb86e738cad0de5 HTTP/1.1" 200 None 2026-04-22 02:30:32,310 - lava_callback - DEBUG - Processing node 69e82e09afb86e738cad0de5: baseline-nfs-arm64 2026-04-22 02:30:33,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 02:30:33,664 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 02:30:33,666 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e82e09afb86e738cad0de5/log.txt.gz 2026-04-22 02:30:34,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 02:30:34,613 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 02:30:34,616 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e82e09afb86e738cad0de5/lava-logs.yaml 2026-04-22 02:30:34,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 02:30:34,793 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 02:30:34,794 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e82e09afb86e738cad0de5/lava_callback.json.gz DEBUG: Setup failed for 69e82e09afb86e738cad0de5. Transitting job node result: incomplete -> fail 2026-04-22 02:30:34,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:30:34,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e82e09afb86e738cad0de5 HTTP/1.1" 200 None 2026-04-22 02:30:34,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:30:34,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 02:30:34,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:30:34,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e82e09afb86e738cad0de5 HTTP/1.1" 200 None 2026-04-22 02:30:35,087 - lava_callback - INFO - Completed processing callback for node 69e82e09afb86e738cad0de5 INFO: 172.21.0.1:56456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52776 - "GET / HTTP/1.0" 200 OK 2026-04-22 02:30:53,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:30:53,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56028 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40394 - "GET / HTTP/1.0" 200 OK 2026-04-22 02:33:40,691 - lava_callback - INFO - Received callback for node 69e82f54afb86e738cad0e7e INFO: 172.21.0.1:44454 - "POST /node/69e82f54afb86e738cad0e7e HTTP/1.0" 202 Accepted 2026-04-22 02:33:40,698 - lava_callback - INFO - Starting async job submit for node 69e82f54afb86e738cad0e7e 2026-04-22 02:33:40,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:33:40,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e82f54afb86e738cad0e7e HTTP/1.1" 200 None 2026-04-22 02:33:40,774 - lava_callback - DEBUG - Processing node 69e82f54afb86e738cad0e7e: ltp-smoke 2026-04-22 02:33:41,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 02:33:41,376 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 02:33:41,378 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69e82f54afb86e738cad0e7e/log.txt.gz 2026-04-22 02:33:41,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 02:33:41,841 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 02:33:41,843 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69e82f54afb86e738cad0e7e/lava-logs.yaml 2026-04-22 02:33:41,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 02:33:41,970 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 02:33:41,972 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69e82f54afb86e738cad0e7e/lava_callback.json.gz 2026-04-22 02:33:42,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:33:42,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e82f54afb86e738cad0e7e HTTP/1.1" 200 None 2026-04-22 02:33:42,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:33:42,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813a3afb86e738cacfb99 HTTP/1.1" 200 None 2026-04-22 02:33:42,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:33:42,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e82f54afb86e738cad0e7e HTTP/1.1" 200 None 2026-04-22 02:33:42,276 - lava_callback - INFO - Completed processing callback for node 69e82f54afb86e738cad0e7e INFO: 172.21.0.1:44468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44476 - "GET / HTTP/1.0" 200 OK 2026-04-22 02:33:53,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:33:53,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53938 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40468 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41182 - "GET / HTTP/1.0" 200 OK 2026-04-22 02:36:50,023 - lava_callback - INFO - Received callback for node 69e82f88afb86e738cad0e8e INFO: 172.21.0.1:32776 - "POST /node/69e82f88afb86e738cad0e8e HTTP/1.0" 202 Accepted 2026-04-22 02:36:50,031 - lava_callback - INFO - Starting async job submit for node 69e82f88afb86e738cad0e8e 2026-04-22 02:36:50,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:36:50,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e82f88afb86e738cad0e8e HTTP/1.1" 200 None 2026-04-22 02:36:50,094 - lava_callback - DEBUG - Processing node 69e82f88afb86e738cad0e8e: baseline-nfs-arm64 2026-04-22 02:36:50,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 02:36:51,282 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 02:36:51,284 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e82f88afb86e738cad0e8e/log.txt.gz 2026-04-22 02:36:51,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 02:36:52,008 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 02:36:52,011 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e82f88afb86e738cad0e8e/lava-logs.yaml 2026-04-22 02:36:52,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 02:36:52,184 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 02:36:52,185 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e82f88afb86e738cad0e8e/lava_callback.json.gz DEBUG: Setup failed for 69e82f88afb86e738cad0e8e. Transitting job node result: incomplete -> fail 2026-04-22 02:36:52,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:36:52,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e82f88afb86e738cad0e8e HTTP/1.1" 200 None 2026-04-22 02:36:52,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:36:52,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 02:36:52,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:36:52,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e82f88afb86e738cad0e8e HTTP/1.1" 200 None 2026-04-22 02:36:52,423 - lava_callback - INFO - Completed processing callback for node 69e82f88afb86e738cad0e8e 2026-04-22 02:36:53,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:36:53,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:32788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60218 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54020 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40524 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46078 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46090 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54812 - "GET / HTTP/1.0" 200 OK 2026-04-22 02:52:11,547 - lava_callback - INFO - Received callback for node 69e83339afb86e738cad102c INFO: 172.21.0.1:33662 - "POST /node/69e83339afb86e738cad102c HTTP/1.0" 202 Accepted 2026-04-22 02:52:11,556 - lava_callback - INFO - Starting async job submit for node 69e83339afb86e738cad102c 2026-04-22 02:52:11,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:52:11,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e83339afb86e738cad102c HTTP/1.1" 200 None 2026-04-22 02:52:11,615 - lava_callback - DEBUG - Processing node 69e83339afb86e738cad102c: baseline-nfs-arm64 2026-04-22 02:52:12,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 02:52:13,042 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 02:52:13,043 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e83339afb86e738cad102c/log.txt.gz 2026-04-22 02:52:13,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 02:52:13,976 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 02:52:13,978 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e83339afb86e738cad102c/lava-logs.yaml 2026-04-22 02:52:14,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 02:52:14,128 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 02:52:14,131 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e83339afb86e738cad102c/lava_callback.json.gz DEBUG: Setup failed for 69e83339afb86e738cad102c. Transitting job node result: incomplete -> fail 2026-04-22 02:52:14,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:52:14,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e83339afb86e738cad102c HTTP/1.1" 200 None 2026-04-22 02:52:14,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:52:14,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 02:52:14,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:52:14,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e83339afb86e738cad102c HTTP/1.1" 200 None 2026-04-22 02:52:14,389 - lava_callback - INFO - Completed processing callback for node 69e83339afb86e738cad102c INFO: 172.21.0.1:33664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33672 - "GET / HTTP/1.0" 200 OK 2026-04-22 02:52:23,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:52:23,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34012 - "GET / HTTP/1.0" 200 OK 2026-04-22 02:54:30,378 - lava_callback - INFO - Received callback for node 69e59556213831324628a101 INFO: 172.21.0.1:34046 - "POST /node/69e59556213831324628a101 HTTP/1.0" 202 Accepted 2026-04-22 02:54:30,383 - lava_callback - INFO - Starting async job submit for node 69e59556213831324628a101 2026-04-22 02:54:30,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:54:30,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e59556213831324628a101 HTTP/1.1" 200 None 2026-04-22 02:54:30,407 - lava_callback - DEBUG - Processing node 69e59556213831324628a101: baseline-arm-baylibre 2026-04-22 02:54:30,407 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e59556213831324628a101 2026-04-22 02:54:30,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:54:30,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e59556213831324628a101 HTTP/1.1" 200 None 2026-04-22 02:54:30,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:54:30,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f497ab9251d5f915e9f HTTP/1.1" 200 None 2026-04-22 02:54:30,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:54:30,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e59556213831324628a101 HTTP/1.1" 200 None 2026-04-22 02:54:30,481 - lava_callback - ERROR - Error processing callback for node 69e59556213831324628a101: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55056 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58862 - "GET / HTTP/1.0" 200 OK 2026-04-22 02:55:30,387 - lava_callback - INFO - Received callback for node 69e59595213831324628a10f INFO: 172.21.0.1:54418 - "POST /node/69e59595213831324628a10f HTTP/1.0" 202 Accepted 2026-04-22 02:55:30,393 - lava_callback - INFO - Starting async job submit for node 69e59595213831324628a10f 2026-04-22 02:55:30,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:55:30,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e59595213831324628a10f HTTP/1.1" 200 None 2026-04-22 02:55:30,409 - lava_callback - DEBUG - Processing node 69e59595213831324628a10f: baseline-arm-baylibre 2026-04-22 02:55:30,409 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e59595213831324628a10f 2026-04-22 02:55:30,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:55:30,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e59595213831324628a10f HTTP/1.1" 200 None 2026-04-22 02:55:30,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:55:30,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f497ab9251d5f915e9f HTTP/1.1" 200 None 2026-04-22 02:55:30,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:55:30,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e59595213831324628a10f HTTP/1.1" 200 None 2026-04-22 02:55:30,461 - lava_callback - ERROR - Error processing callback for node 69e59595213831324628a10f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51482 - "GET / HTTP/1.0" 200 OK 2026-04-22 02:56:30,454 - lava_callback - INFO - Received callback for node 69e595d0213831324628a11f INFO: 172.21.0.1:57548 - "POST /node/69e595d0213831324628a11f HTTP/1.0" 202 Accepted 2026-04-22 02:56:30,460 - lava_callback - INFO - Starting async job submit for node 69e595d0213831324628a11f 2026-04-22 02:56:30,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:56:30,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e595d0213831324628a11f HTTP/1.1" 200 None 2026-04-22 02:56:30,477 - lava_callback - DEBUG - Processing node 69e595d0213831324628a11f: baseline-arm-baylibre 2026-04-22 02:56:30,477 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e595d0213831324628a11f 2026-04-22 02:56:30,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:56:30,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e595d0213831324628a11f HTTP/1.1" 200 None 2026-04-22 02:56:30,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:56:30,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f497ab9251d5f915e9f HTTP/1.1" 200 None 2026-04-22 02:56:30,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:56:30,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e595d0213831324628a11f HTTP/1.1" 200 None 2026-04-22 02:56:30,525 - lava_callback - ERROR - Error processing callback for node 69e595d0213831324628a11f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42122 - "GET / HTTP/1.0" 200 OK 2026-04-22 02:57:10,425 - lava_callback - INFO - Received callback for node 69e595f4213831324628a12d INFO: 172.21.0.1:45962 - "POST /node/69e595f4213831324628a12d HTTP/1.0" 202 Accepted 2026-04-22 02:57:10,430 - lava_callback - INFO - Starting async job submit for node 69e595f4213831324628a12d 2026-04-22 02:57:10,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:57:10,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e595f4213831324628a12d HTTP/1.1" 200 None 2026-04-22 02:57:10,446 - lava_callback - DEBUG - Processing node 69e595f4213831324628a12d: baseline-arm-baylibre 2026-04-22 02:57:10,447 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e595f4213831324628a12d 2026-04-22 02:57:10,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:57:10,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e595f4213831324628a12d HTTP/1.1" 200 None 2026-04-22 02:57:10,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:57:10,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f497ab9251d5f915e9f HTTP/1.1" 200 None 2026-04-22 02:57:10,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:57:10,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e595f4213831324628a12d HTTP/1.1" 200 None 2026-04-22 02:57:10,497 - lava_callback - ERROR - Error processing callback for node 69e595f4213831324628a12d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43258 - "GET / HTTP/1.0" 200 OK 2026-04-22 02:57:50,521 - lava_callback - INFO - Received callback for node 69e59619213831324628a13b INFO: 172.21.0.1:50806 - "POST /node/69e59619213831324628a13b HTTP/1.0" 202 Accepted 2026-04-22 02:57:50,527 - lava_callback - INFO - Starting async job submit for node 69e59619213831324628a13b 2026-04-22 02:57:50,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:57:50,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e59619213831324628a13b HTTP/1.1" 200 None 2026-04-22 02:57:50,550 - lava_callback - DEBUG - Processing node 69e59619213831324628a13b: baseline-arm-baylibre 2026-04-22 02:57:50,550 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e59619213831324628a13b 2026-04-22 02:57:50,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:57:50,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e59619213831324628a13b HTTP/1.1" 200 None 2026-04-22 02:57:50,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:57:50,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f497ab9251d5f915e9f HTTP/1.1" 200 None 2026-04-22 02:57:50,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:57:50,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e59619213831324628a13b HTTP/1.1" 200 None 2026-04-22 02:57:50,604 - lava_callback - ERROR - Error processing callback for node 69e59619213831324628a13b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41736 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39676 - "GET / HTTP/1.0" 200 OK 2026-04-22 02:58:30,515 - lava_callback - INFO - Received callback for node 69e5964a213831324628a14a INFO: 172.21.0.1:50782 - "POST /node/69e5964a213831324628a14a HTTP/1.0" 202 Accepted 2026-04-22 02:58:30,521 - lava_callback - INFO - Starting async job submit for node 69e5964a213831324628a14a 2026-04-22 02:58:30,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:58:30,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5964a213831324628a14a HTTP/1.1" 200 None 2026-04-22 02:58:30,550 - lava_callback - DEBUG - Processing node 69e5964a213831324628a14a: baseline-arm-baylibre 2026-04-22 02:58:30,550 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5964a213831324628a14a 2026-04-22 02:58:30,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:58:30,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5964a213831324628a14a HTTP/1.1" 200 None 2026-04-22 02:58:30,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:58:30,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f497ab9251d5f915e9f HTTP/1.1" 200 None 2026-04-22 02:58:30,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:58:30,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5964a213831324628a14a HTTP/1.1" 200 None 2026-04-22 02:58:30,598 - lava_callback - ERROR - Error processing callback for node 69e5964a213831324628a14a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51860 - "GET / HTTP/1.0" 200 OK 2026-04-22 02:59:27,347 - lava_callback - INFO - Received callback for node 69e834ddafb86e738cad111b INFO: 172.21.0.1:51862 - "POST /node/69e834ddafb86e738cad111b HTTP/1.0" 202 Accepted 2026-04-22 02:59:27,356 - lava_callback - INFO - Starting async job submit for node 69e834ddafb86e738cad111b 2026-04-22 02:59:27,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:59:27,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e834ddafb86e738cad111b HTTP/1.1" 200 None 2026-04-22 02:59:27,417 - lava_callback - DEBUG - Processing node 69e834ddafb86e738cad111b: baseline-nfs-arm64 2026-04-22 02:59:28,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 02:59:28,437 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 02:59:28,438 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e834ddafb86e738cad111b/log.txt.gz 2026-04-22 02:59:28,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 02:59:29,137 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 02:59:29,140 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e834ddafb86e738cad111b/lava-logs.yaml 2026-04-22 02:59:29,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 02:59:29,282 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 02:59:29,284 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e834ddafb86e738cad111b/lava_callback.json.gz DEBUG: Setup failed for 69e834ddafb86e738cad111b. Transitting job node result: incomplete -> fail 2026-04-22 02:59:29,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:59:29,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e834ddafb86e738cad111b HTTP/1.1" 200 None 2026-04-22 02:59:29,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:59:29,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 02:59:29,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:59:29,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e834ddafb86e738cad111b HTTP/1.1" 200 None 2026-04-22 02:59:29,522 - lava_callback - INFO - Completed processing callback for node 69e834ddafb86e738cad111b INFO: 172.21.0.1:38406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50236 - "GET / HTTP/1.0" 200 OK 2026-04-22 02:59:53,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 02:59:53,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58938 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36388 - "GET / HTTP/1.0" 200 OK 2026-04-22 03:00:40,266 - lava_callback - INFO - Received callback for node 69e596ce213831324628a178 INFO: 172.21.0.1:38254 - "POST /node/69e596ce213831324628a178 HTTP/1.0" 202 Accepted 2026-04-22 03:00:40,272 - lava_callback - INFO - Starting async job submit for node 69e596ce213831324628a178 2026-04-22 03:00:40,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:00:40,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e596ce213831324628a178 HTTP/1.1" 200 None 2026-04-22 03:00:40,289 - lava_callback - DEBUG - Processing node 69e596ce213831324628a178: baseline-arm-clabbe 2026-04-22 03:00:40,289 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e596ce213831324628a178 2026-04-22 03:00:40,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:00:40,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e596ce213831324628a178 HTTP/1.1" 200 None 2026-04-22 03:00:40,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:00:40,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f497ab9251d5f915e9f HTTP/1.1" 200 None 2026-04-22 03:00:40,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:00:40,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e596ce213831324628a178 HTTP/1.1" 200 None 2026-04-22 03:00:40,350 - lava_callback - ERROR - Error processing callback for node 69e596ce213831324628a178: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55856 - "GET / HTTP/1.0" 200 OK 2026-04-22 03:01:40,294 - lava_callback - INFO - Received callback for node 69e59700213831324628a186 INFO: 172.21.0.1:42740 - "POST /node/69e59700213831324628a186 HTTP/1.0" 202 Accepted 2026-04-22 03:01:40,300 - lava_callback - INFO - Starting async job submit for node 69e59700213831324628a186 2026-04-22 03:01:40,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:01:40,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e59700213831324628a186 HTTP/1.1" 200 None 2026-04-22 03:01:40,316 - lava_callback - DEBUG - Processing node 69e59700213831324628a186: baseline-arm-clabbe 2026-04-22 03:01:40,316 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e59700213831324628a186 2026-04-22 03:01:40,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:01:40,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e59700213831324628a186 HTTP/1.1" 200 None 2026-04-22 03:01:40,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:01:40,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f497ab9251d5f915e9f HTTP/1.1" 200 None 2026-04-22 03:01:40,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:01:40,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e59700213831324628a186 HTTP/1.1" 200 None 2026-04-22 03:01:40,368 - lava_callback - ERROR - Error processing callback for node 69e59700213831324628a186: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60626 - "GET / HTTP/1.0" 200 OK 2026-04-22 03:02:40,305 - lava_callback - INFO - Received callback for node 69e5973c213831324628a196 INFO: 172.21.0.1:43474 - "POST /node/69e5973c213831324628a196 HTTP/1.0" 202 Accepted 2026-04-22 03:02:40,311 - lava_callback - INFO - Starting async job submit for node 69e5973c213831324628a196 2026-04-22 03:02:40,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:02:40,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5973c213831324628a196 HTTP/1.1" 200 None 2026-04-22 03:02:40,327 - lava_callback - DEBUG - Processing node 69e5973c213831324628a196: baseline-arm-clabbe 2026-04-22 03:02:40,327 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5973c213831324628a196 2026-04-22 03:02:40,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:02:40,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5973c213831324628a196 HTTP/1.1" 200 None 2026-04-22 03:02:40,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:02:40,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f497ab9251d5f915e9f HTTP/1.1" 200 None 2026-04-22 03:02:40,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:02:40,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5973c213831324628a196 HTTP/1.1" 200 None 2026-04-22 03:02:40,375 - lava_callback - ERROR - Error processing callback for node 69e5973c213831324628a196: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37212 - "GET / HTTP/1.0" 200 OK 2026-04-22 03:04:40,426 - lava_callback - INFO - Received callback for node 69e597b5213831324628a1ab INFO: 172.21.0.1:56442 - "POST /node/69e597b5213831324628a1ab HTTP/1.0" 202 Accepted 2026-04-22 03:04:40,431 - lava_callback - INFO - Starting async job submit for node 69e597b5213831324628a1ab 2026-04-22 03:04:40,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:04:40,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e597b5213831324628a1ab HTTP/1.1" 200 None 2026-04-22 03:04:40,452 - lava_callback - DEBUG - Processing node 69e597b5213831324628a1ab: baseline-arm-clabbe 2026-04-22 03:04:40,453 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e597b5213831324628a1ab 2026-04-22 03:04:40,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:04:40,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e597b5213831324628a1ab HTTP/1.1" 200 None 2026-04-22 03:04:40,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:04:40,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f497ab9251d5f915e9f HTTP/1.1" 200 None 2026-04-22 03:04:40,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:04:40,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e597b5213831324628a1ab HTTP/1.1" 200 None 2026-04-22 03:04:40,500 - lava_callback - ERROR - Error processing callback for node 69e597b5213831324628a1ab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48818 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52376 - "GET / HTTP/1.0" 200 OK 2026-04-22 03:05:40,458 - lava_callback - INFO - Received callback for node 69e597f1213831324628a1bb INFO: 172.21.0.1:48290 - "POST /node/69e597f1213831324628a1bb HTTP/1.0" 202 Accepted 2026-04-22 03:05:40,463 - lava_callback - INFO - Starting async job submit for node 69e597f1213831324628a1bb 2026-04-22 03:05:40,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:05:40,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e597f1213831324628a1bb HTTP/1.1" 200 None 2026-04-22 03:05:40,479 - lava_callback - DEBUG - Processing node 69e597f1213831324628a1bb: baseline-arm-clabbe 2026-04-22 03:05:40,479 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e597f1213831324628a1bb 2026-04-22 03:05:40,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:05:40,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e597f1213831324628a1bb HTTP/1.1" 200 None 2026-04-22 03:05:40,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:05:40,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f497ab9251d5f915e9f HTTP/1.1" 200 None 2026-04-22 03:05:40,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:05:40,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e597f1213831324628a1bb HTTP/1.1" 200 None 2026-04-22 03:05:40,528 - lava_callback - ERROR - Error processing callback for node 69e597f1213831324628a1bb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52358 - "GET / HTTP/1.0" 200 OK 2026-04-22 03:06:20,490 - lava_callback - INFO - Received callback for node 69e59816213831324628a1c9 INFO: 172.21.0.1:50488 - "POST /node/69e59816213831324628a1c9 HTTP/1.0" 202 Accepted 2026-04-22 03:06:20,498 - lava_callback - INFO - Starting async job submit for node 69e59816213831324628a1c9 2026-04-22 03:06:20,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:06:20,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e59816213831324628a1c9 HTTP/1.1" 200 None 2026-04-22 03:06:20,515 - lava_callback - DEBUG - Processing node 69e59816213831324628a1c9: baseline-arm-clabbe 2026-04-22 03:06:20,515 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e59816213831324628a1c9 2026-04-22 03:06:20,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:06:20,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e59816213831324628a1c9 HTTP/1.1" 200 None 2026-04-22 03:06:20,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:06:20,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f497ab9251d5f915e9f HTTP/1.1" 200 None 2026-04-22 03:06:20,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:06:20,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e59816213831324628a1c9 HTTP/1.1" 200 None 2026-04-22 03:06:20,588 - lava_callback - ERROR - Error processing callback for node 69e59816213831324628a1c9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54020 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49474 - "GET / HTTP/1.0" 200 OK 2026-04-22 03:07:40,545 - lava_callback - INFO - Received callback for node 69e59869213831324628a1db INFO: 172.21.0.1:38498 - "POST /node/69e59869213831324628a1db HTTP/1.0" 202 Accepted 2026-04-22 03:07:40,551 - lava_callback - INFO - Starting async job submit for node 69e59869213831324628a1db 2026-04-22 03:07:40,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:07:40,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e59869213831324628a1db HTTP/1.1" 200 None 2026-04-22 03:07:40,570 - lava_callback - DEBUG - Processing node 69e59869213831324628a1db: baseline-arm-clabbe 2026-04-22 03:07:40,571 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e59869213831324628a1db 2026-04-22 03:07:40,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:07:40,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e59869213831324628a1db HTTP/1.1" 200 None 2026-04-22 03:07:40,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:07:40,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f497ab9251d5f915e9f HTTP/1.1" 200 None 2026-04-22 03:07:40,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:07:40,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e59869213831324628a1db HTTP/1.1" 200 None 2026-04-22 03:07:40,635 - lava_callback - ERROR - Error processing callback for node 69e59869213831324628a1db: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32800 - "GET / HTTP/1.0" 200 OK 2026-04-22 03:08:20,544 - lava_callback - INFO - Received callback for node 69e5988f213831324628a1e8 INFO: 172.21.0.1:35320 - "POST /node/69e5988f213831324628a1e8 HTTP/1.0" 202 Accepted 2026-04-22 03:08:20,549 - lava_callback - INFO - Starting async job submit for node 69e5988f213831324628a1e8 2026-04-22 03:08:20,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:08:20,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5988f213831324628a1e8 HTTP/1.1" 200 None 2026-04-22 03:08:20,565 - lava_callback - DEBUG - Processing node 69e5988f213831324628a1e8: baseline-arm-clabbe 2026-04-22 03:08:20,565 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5988f213831324628a1e8 2026-04-22 03:08:20,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:08:20,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5988f213831324628a1e8 HTTP/1.1" 200 None 2026-04-22 03:08:20,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:08:20,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f497ab9251d5f915e9f HTTP/1.1" 200 None 2026-04-22 03:08:20,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:08:20,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5988f213831324628a1e8 HTTP/1.1" 200 None 2026-04-22 03:08:20,621 - lava_callback - ERROR - Error processing callback for node 69e5988f213831324628a1e8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38982 - "GET / HTTP/1.0" 200 OK 2026-04-22 03:08:40,616 - lava_callback - INFO - Received callback for node 69e598b4213831324628a1fa INFO: 172.21.0.1:33368 - "POST /node/69e598b4213831324628a1fa HTTP/1.0" 202 Accepted 2026-04-22 03:08:40,622 - lava_callback - INFO - Starting async job submit for node 69e598b4213831324628a1fa 2026-04-22 03:08:40,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:08:40,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e598b4213831324628a1fa HTTP/1.1" 200 None 2026-04-22 03:08:40,638 - lava_callback - DEBUG - Processing node 69e598b4213831324628a1fa: baseline-arm-clabbe 2026-04-22 03:08:40,638 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e598b4213831324628a1fa 2026-04-22 03:08:40,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:08:40,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e598b4213831324628a1fa HTTP/1.1" 200 None 2026-04-22 03:08:40,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:08:40,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f497ab9251d5f915e9f HTTP/1.1" 200 None 2026-04-22 03:08:40,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:08:40,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e598b4213831324628a1fa HTTP/1.1" 200 None 2026-04-22 03:08:40,695 - lava_callback - ERROR - Error processing callback for node 69e598b4213831324628a1fa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48970 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36828 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45244 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41288 - "GET / HTTP/1.0" 200 OK 2026-04-22 03:28:52,289 - lava_callback - INFO - Received callback for node 69e59d6b213831324628a2d5 INFO: 172.21.0.1:46016 - "POST /node/69e59d6b213831324628a2d5 HTTP/1.0" 202 Accepted 2026-04-22 03:28:52,295 - lava_callback - INFO - Starting async job submit for node 69e59d6b213831324628a2d5 2026-04-22 03:28:52,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:28:52,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e59d6b213831324628a2d5 HTTP/1.1" 200 None 2026-04-22 03:28:52,329 - lava_callback - DEBUG - Processing node 69e59d6b213831324628a2d5: baseline-arm64-baylibre 2026-04-22 03:28:52,329 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e59d6b213831324628a2d5 2026-04-22 03:28:52,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:28:52,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e59d6b213831324628a2d5 HTTP/1.1" 200 None 2026-04-22 03:28:52,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:28:52,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-22 03:28:52,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:28:52,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e59d6b213831324628a2d5 HTTP/1.1" 200 None 2026-04-22 03:28:52,384 - lava_callback - ERROR - Error processing callback for node 69e59d6b213831324628a2d5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53218 - "GET / HTTP/1.0" 200 OK 2026-04-22 03:30:12,344 - lava_callback - INFO - Received callback for node 69e59db5213831324628a2f9 INFO: 172.21.0.1:46996 - "POST /node/69e59db5213831324628a2f9 HTTP/1.0" 202 Accepted 2026-04-22 03:30:12,350 - lava_callback - INFO - Starting async job submit for node 69e59db5213831324628a2f9 2026-04-22 03:30:12,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:30:12,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e59db5213831324628a2f9 HTTP/1.1" 200 None 2026-04-22 03:30:12,365 - lava_callback - DEBUG - Processing node 69e59db5213831324628a2f9: baseline-arm64-baylibre 2026-04-22 03:30:12,366 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e59db5213831324628a2f9 2026-04-22 03:30:12,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:30:12,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e59db5213831324628a2f9 HTTP/1.1" 200 None 2026-04-22 03:30:12,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:30:12,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-22 03:30:12,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:30:12,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e59db5213831324628a2f9 HTTP/1.1" 200 None 2026-04-22 03:30:12,421 - lava_callback - ERROR - Error processing callback for node 69e59db5213831324628a2f9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53928 - "GET / HTTP/1.0" 200 OK 2026-04-22 03:31:32,395 - lava_callback - INFO - Received callback for node 69e59e12213831324628a31f INFO: 172.21.0.1:55980 - "POST /node/69e59e12213831324628a31f HTTP/1.0" 202 Accepted 2026-04-22 03:31:32,401 - lava_callback - INFO - Starting async job submit for node 69e59e12213831324628a31f 2026-04-22 03:31:32,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:31:32,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e59e12213831324628a31f HTTP/1.1" 200 None 2026-04-22 03:31:32,419 - lava_callback - DEBUG - Processing node 69e59e12213831324628a31f: baseline-arm64-baylibre 2026-04-22 03:31:32,419 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e59e12213831324628a31f 2026-04-22 03:31:32,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:31:32,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e59e12213831324628a31f HTTP/1.1" 200 None 2026-04-22 03:31:32,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:31:32,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-22 03:31:32,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:31:32,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e59e12213831324628a31f HTTP/1.1" 200 None 2026-04-22 03:31:32,466 - lava_callback - ERROR - Error processing callback for node 69e59e12213831324628a31f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38546 - "GET / HTTP/1.0" 200 OK 2026-04-22 03:32:52,456 - lava_callback - INFO - Received callback for node 69e59e5e213831324628a346 INFO: 172.21.0.1:35416 - "POST /node/69e59e5e213831324628a346 HTTP/1.0" 202 Accepted 2026-04-22 03:32:52,462 - lava_callback - INFO - Starting async job submit for node 69e59e5e213831324628a346 2026-04-22 03:32:52,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:32:52,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e59e5e213831324628a346 HTTP/1.1" 200 None 2026-04-22 03:32:52,478 - lava_callback - DEBUG - Processing node 69e59e5e213831324628a346: baseline-arm64-baylibre 2026-04-22 03:32:52,478 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e59e5e213831324628a346 2026-04-22 03:32:52,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:32:52,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e59e5e213831324628a346 HTTP/1.1" 200 None 2026-04-22 03:32:52,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:32:52,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-22 03:32:52,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:32:52,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e59e5e213831324628a346 HTTP/1.1" 200 None 2026-04-22 03:32:52,531 - lava_callback - ERROR - Error processing callback for node 69e59e5e213831324628a346: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50574 - "GET / HTTP/1.0" 200 OK 2026-04-22 03:34:12,545 - lava_callback - INFO - Received callback for node 69e59eab213831324628a363 INFO: 172.21.0.1:50298 - "POST /node/69e59eab213831324628a363 HTTP/1.0" 202 Accepted 2026-04-22 03:34:12,550 - lava_callback - INFO - Starting async job submit for node 69e59eab213831324628a363 2026-04-22 03:34:12,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:34:12,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e59eab213831324628a363 HTTP/1.1" 200 None 2026-04-22 03:34:12,567 - lava_callback - DEBUG - Processing node 69e59eab213831324628a363: baseline-arm64-baylibre 2026-04-22 03:34:12,567 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e59eab213831324628a363 2026-04-22 03:34:12,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:34:12,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e59eab213831324628a363 HTTP/1.1" 200 None 2026-04-22 03:34:12,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:34:12,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-22 03:34:12,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:34:12,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e59eab213831324628a363 HTTP/1.1" 200 None 2026-04-22 03:34:12,622 - lava_callback - ERROR - Error processing callback for node 69e59eab213831324628a363: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52008 - "GET / HTTP/1.0" 200 OK 2026-04-22 03:35:32,597 - lava_callback - INFO - Received callback for node 69e59ef9213831324628a385 INFO: 172.21.0.1:34704 - "POST /node/69e59ef9213831324628a385 HTTP/1.0" 202 Accepted 2026-04-22 03:35:32,603 - lava_callback - INFO - Starting async job submit for node 69e59ef9213831324628a385 2026-04-22 03:35:32,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:35:32,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e59ef9213831324628a385 HTTP/1.1" 200 None 2026-04-22 03:35:32,618 - lava_callback - DEBUG - Processing node 69e59ef9213831324628a385: baseline-arm64-baylibre 2026-04-22 03:35:32,619 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e59ef9213831324628a385 2026-04-22 03:35:32,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:35:32,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e59ef9213831324628a385 HTTP/1.1" 200 None 2026-04-22 03:35:32,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:35:32,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-22 03:35:32,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:35:32,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e59ef9213831324628a385 HTTP/1.1" 200 None 2026-04-22 03:35:32,670 - lava_callback - ERROR - Error processing callback for node 69e59ef9213831324628a385: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51220 - "GET / HTTP/1.0" 200 OK 2026-04-22 03:37:01,724 - lava_callback - INFO - Received callback for node 69e59f4c213831324628a3a8 INFO: 172.21.0.1:48248 - "POST /node/69e59f4c213831324628a3a8 HTTP/1.0" 202 Accepted 2026-04-22 03:37:01,729 - lava_callback - INFO - Starting async job submit for node 69e59f4c213831324628a3a8 2026-04-22 03:37:01,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:37:01,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e59f4c213831324628a3a8 HTTP/1.1" 200 None 2026-04-22 03:37:01,745 - lava_callback - DEBUG - Processing node 69e59f4c213831324628a3a8: baseline-arm64-clabbe 2026-04-22 03:37:01,745 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e59f4c213831324628a3a8 2026-04-22 03:37:01,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:37:01,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e59f4c213831324628a3a8 HTTP/1.1" 200 None 2026-04-22 03:37:01,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:37:01,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-22 03:37:01,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:37:01,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e59f4c213831324628a3a8 HTTP/1.1" 200 None 2026-04-22 03:37:01,794 - lava_callback - ERROR - Error processing callback for node 69e59f4c213831324628a3a8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44530 - "GET / HTTP/1.0" 200 OK 2026-04-22 03:38:21,821 - lava_callback - INFO - Received callback for node 69e59f9c213831324628a3c4 INFO: 172.21.0.1:47162 - "POST /node/69e59f9c213831324628a3c4 HTTP/1.0" 202 Accepted 2026-04-22 03:38:21,827 - lava_callback - INFO - Starting async job submit for node 69e59f9c213831324628a3c4 2026-04-22 03:38:21,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:38:21,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e59f9c213831324628a3c4 HTTP/1.1" 200 None 2026-04-22 03:38:21,846 - lava_callback - DEBUG - Processing node 69e59f9c213831324628a3c4: baseline-arm64-clabbe 2026-04-22 03:38:21,847 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e59f9c213831324628a3c4 2026-04-22 03:38:21,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:38:21,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e59f9c213831324628a3c4 HTTP/1.1" 200 None 2026-04-22 03:38:21,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:38:21,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-22 03:38:21,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:38:21,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e59f9c213831324628a3c4 HTTP/1.1" 200 None 2026-04-22 03:38:21,894 - lava_callback - ERROR - Error processing callback for node 69e59f9c213831324628a3c4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33492 - "GET / HTTP/1.0" 200 OK 2026-04-22 03:39:41,797 - lava_callback - INFO - Received callback for node 69e59fea213831324628a3e7 INFO: 172.21.0.1:35250 - "POST /node/69e59fea213831324628a3e7 HTTP/1.0" 202 Accepted 2026-04-22 03:39:41,803 - lava_callback - INFO - Starting async job submit for node 69e59fea213831324628a3e7 2026-04-22 03:39:41,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:39:41,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e59fea213831324628a3e7 HTTP/1.1" 200 None 2026-04-22 03:39:41,819 - lava_callback - DEBUG - Processing node 69e59fea213831324628a3e7: baseline-arm64-clabbe 2026-04-22 03:39:41,819 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e59fea213831324628a3e7 2026-04-22 03:39:41,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:39:41,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e59fea213831324628a3e7 HTTP/1.1" 200 None 2026-04-22 03:39:41,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:39:41,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-22 03:39:41,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:39:41,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e59fea213831324628a3e7 HTTP/1.1" 200 None 2026-04-22 03:39:41,887 - lava_callback - ERROR - Error processing callback for node 69e59fea213831324628a3e7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55044 - "GET / HTTP/1.0" 200 OK 2026-04-22 03:41:01,874 - lava_callback - INFO - Received callback for node 69e5a03a213831324628a40b INFO: 172.21.0.1:59628 - "POST /node/69e5a03a213831324628a40b HTTP/1.0" 202 Accepted 2026-04-22 03:41:01,879 - lava_callback - INFO - Starting async job submit for node 69e5a03a213831324628a40b 2026-04-22 03:41:01,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:41:01,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5a03a213831324628a40b HTTP/1.1" 200 None 2026-04-22 03:41:01,897 - lava_callback - DEBUG - Processing node 69e5a03a213831324628a40b: baseline-arm64-clabbe 2026-04-22 03:41:01,897 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5a03a213831324628a40b 2026-04-22 03:41:01,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:41:01,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5a03a213831324628a40b HTTP/1.1" 200 None 2026-04-22 03:41:01,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:41:01,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-22 03:41:01,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:41:01,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5a03a213831324628a40b HTTP/1.1" 200 None 2026-04-22 03:41:01,944 - lava_callback - ERROR - Error processing callback for node 69e5a03a213831324628a40b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35388 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39322 - "GET / HTTP/1.0" 200 OK 2026-04-22 03:42:21,948 - lava_callback - INFO - Received callback for node 69e5a088213831324628a425 INFO: 172.21.0.1:45918 - "POST /node/69e5a088213831324628a425 HTTP/1.0" 202 Accepted 2026-04-22 03:42:21,953 - lava_callback - INFO - Starting async job submit for node 69e5a088213831324628a425 2026-04-22 03:42:21,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:42:21,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5a088213831324628a425 HTTP/1.1" 200 None 2026-04-22 03:42:21,971 - lava_callback - DEBUG - Processing node 69e5a088213831324628a425: baseline-arm64-clabbe 2026-04-22 03:42:21,972 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5a088213831324628a425 2026-04-22 03:42:21,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:42:21,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5a088213831324628a425 HTTP/1.1" 200 None 2026-04-22 03:42:21,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:42:22,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-22 03:42:22,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:42:22,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5a088213831324628a425 HTTP/1.1" 200 None 2026-04-22 03:42:22,022 - lava_callback - ERROR - Error processing callback for node 69e5a088213831324628a425: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55056 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36894 - "GET / HTTP/1.0" 200 OK 2026-04-22 03:43:42,019 - lava_callback - INFO - Received callback for node 69e5a0d9213831324628a449 INFO: 172.21.0.1:37622 - "POST /node/69e5a0d9213831324628a449 HTTP/1.0" 202 Accepted 2026-04-22 03:43:42,025 - lava_callback - INFO - Starting async job submit for node 69e5a0d9213831324628a449 2026-04-22 03:43:42,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:43:42,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5a0d9213831324628a449 HTTP/1.1" 200 None 2026-04-22 03:43:42,040 - lava_callback - DEBUG - Processing node 69e5a0d9213831324628a449: baseline-arm64-clabbe 2026-04-22 03:43:42,040 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5a0d9213831324628a449 2026-04-22 03:43:42,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:43:42,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5a0d9213831324628a449 HTTP/1.1" 200 None 2026-04-22 03:43:42,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:43:42,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-22 03:43:42,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:43:42,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5a0d9213831324628a449 HTTP/1.1" 200 None 2026-04-22 03:43:42,140 - lava_callback - ERROR - Error processing callback for node 69e5a0d9213831324628a449: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37414 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36150 - "GET / HTTP/1.0" 200 OK 2026-04-22 03:44:42,050 - lava_callback - INFO - Received callback for node 69e5a127213831324628a46e INFO: 172.21.0.1:49702 - "POST /node/69e5a127213831324628a46e HTTP/1.0" 202 Accepted 2026-04-22 03:44:42,058 - lava_callback - INFO - Starting async job submit for node 69e5a127213831324628a46e 2026-04-22 03:44:42,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:44:42,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5a127213831324628a46e HTTP/1.1" 200 None 2026-04-22 03:44:42,093 - lava_callback - DEBUG - Processing node 69e5a127213831324628a46e: baseline-arm64-clabbe 2026-04-22 03:44:42,093 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5a127213831324628a46e 2026-04-22 03:44:42,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:44:42,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5a127213831324628a46e HTTP/1.1" 200 None 2026-04-22 03:44:42,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:44:42,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e48f557ab9251d5f915eae HTTP/1.1" 200 None 2026-04-22 03:44:42,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 03:44:42,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5a127213831324628a46e HTTP/1.1" 200 None 2026-04-22 03:44:42,205 - lava_callback - ERROR - Error processing callback for node 69e5a127213831324628a46e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50942 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40842 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41882 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35318 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40040 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39086 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60020 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58296 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46606 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37984 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59336 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33448 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42396 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37392 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52188 - "GET / HTTP/1.0" 200 OK 2026-04-22 04:41:36,307 - lava_callback - INFO - Received callback for node 69e5ae74213831324628a4ca INFO: 172.21.0.1:34268 - "POST /node/69e5ae74213831324628a4ca HTTP/1.0" 202 Accepted 2026-04-22 04:41:36,313 - lava_callback - INFO - Starting async job submit for node 69e5ae74213831324628a4ca 2026-04-22 04:41:36,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:41:36,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5ae74213831324628a4ca HTTP/1.1" 200 None 2026-04-22 04:41:36,330 - lava_callback - DEBUG - Processing node 69e5ae74213831324628a4ca: baseline-arm-baylibre 2026-04-22 04:41:36,330 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5ae74213831324628a4ca 2026-04-22 04:41:36,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:41:36,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5ae74213831324628a4ca HTTP/1.1" 200 None 2026-04-22 04:41:36,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:41:36,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25cc01863655daa998ba7 HTTP/1.1" 200 None 2026-04-22 04:41:36,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:41:36,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5ae74213831324628a4ca HTTP/1.1" 200 None 2026-04-22 04:41:36,382 - lava_callback - ERROR - Error processing callback for node 69e5ae74213831324628a4ca: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49320 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43652 - "GET / HTTP/1.0" 200 OK 2026-04-22 04:42:36,256 - lava_callback - INFO - Received callback for node 69e5aeb0213831324628a4d8 INFO: 172.21.0.1:47568 - "POST /node/69e5aeb0213831324628a4d8 HTTP/1.0" 202 Accepted 2026-04-22 04:42:36,262 - lava_callback - INFO - Starting async job submit for node 69e5aeb0213831324628a4d8 2026-04-22 04:42:36,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:42:36,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5aeb0213831324628a4d8 HTTP/1.1" 200 None 2026-04-22 04:42:36,277 - lava_callback - DEBUG - Processing node 69e5aeb0213831324628a4d8: baseline-arm-baylibre 2026-04-22 04:42:36,278 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5aeb0213831324628a4d8 2026-04-22 04:42:36,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:42:36,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5aeb0213831324628a4d8 HTTP/1.1" 200 None 2026-04-22 04:42:36,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:42:36,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25cc01863655daa998ba7 HTTP/1.1" 200 None 2026-04-22 04:42:36,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:42:36,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5aeb0213831324628a4d8 HTTP/1.1" 200 None 2026-04-22 04:42:36,323 - lava_callback - ERROR - Error processing callback for node 69e5aeb0213831324628a4d8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60518 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-22 04:43:16,375 - lava_callback - INFO - Received callback for node 69e5aed6213831324628a4e6 INFO: 172.21.0.1:60520 - "POST /node/69e5aed6213831324628a4e6 HTTP/1.0" 202 Accepted 2026-04-22 04:43:16,380 - lava_callback - INFO - Starting async job submit for node 69e5aed6213831324628a4e6 2026-04-22 04:43:16,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:43:16,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5aed6213831324628a4e6 HTTP/1.1" 200 None 2026-04-22 04:43:16,400 - lava_callback - DEBUG - Processing node 69e5aed6213831324628a4e6: baseline-arm-baylibre 2026-04-22 04:43:16,401 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5aed6213831324628a4e6 2026-04-22 04:43:16,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:43:16,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5aed6213831324628a4e6 HTTP/1.1" 200 None 2026-04-22 04:43:16,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:43:16,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25cc01863655daa998ba7 HTTP/1.1" 200 None 2026-04-22 04:43:16,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:43:16,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5aed6213831324628a4e6 HTTP/1.1" 200 None 2026-04-22 04:43:16,462 - lava_callback - ERROR - Error processing callback for node 69e5aed6213831324628a4e6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37844 - "GET / HTTP/1.0" 200 OK 2026-04-22 04:43:56,321 - lava_callback - INFO - Received callback for node 69e5aefb213831324628a4f9 INFO: 172.21.0.1:59118 - "POST /node/69e5aefb213831324628a4f9 HTTP/1.0" 202 Accepted 2026-04-22 04:43:56,352 - lava_callback - INFO - Starting async job submit for node 69e5aefb213831324628a4f9 2026-04-22 04:43:56,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:43:56,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5aefb213831324628a4f9 HTTP/1.1" 200 None 2026-04-22 04:43:56,390 - lava_callback - DEBUG - Processing node 69e5aefb213831324628a4f9: baseline-arm-baylibre 2026-04-22 04:43:56,390 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5aefb213831324628a4f9 2026-04-22 04:43:56,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:43:56,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5aefb213831324628a4f9 HTTP/1.1" 200 None 2026-04-22 04:43:56,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:43:56,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25cc01863655daa998ba7 HTTP/1.1" 200 None 2026-04-22 04:43:56,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:43:56,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5aefb213831324628a4f9 HTTP/1.1" 200 None 2026-04-22 04:43:56,446 - lava_callback - ERROR - Error processing callback for node 69e5aefb213831324628a4f9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59722 - "GET / HTTP/1.0" 200 OK 2026-04-22 04:44:56,444 - lava_callback - INFO - Received callback for node 69e5af42213831324628a517 INFO: 172.21.0.1:49612 - "POST /node/69e5af42213831324628a517 HTTP/1.0" 202 Accepted 2026-04-22 04:44:56,450 - lava_callback - INFO - Starting async job submit for node 69e5af42213831324628a517 2026-04-22 04:44:56,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:44:56,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5af42213831324628a517 HTTP/1.1" 200 None 2026-04-22 04:44:56,465 - lava_callback - DEBUG - Processing node 69e5af42213831324628a517: baseline-arm-baylibre 2026-04-22 04:44:56,466 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5af42213831324628a517 2026-04-22 04:44:56,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:44:56,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5af42213831324628a517 HTTP/1.1" 200 None 2026-04-22 04:44:56,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:44:56,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25cc01863655daa998ba7 HTTP/1.1" 200 None 2026-04-22 04:44:56,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:44:56,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5af42213831324628a517 HTTP/1.1" 200 None 2026-04-22 04:44:56,517 - lava_callback - ERROR - Error processing callback for node 69e5af42213831324628a517: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59582 - "GET / HTTP/1.0" 200 OK 2026-04-22 04:45:36,416 - lava_callback - INFO - Received callback for node 69e5af66213831324628a526 INFO: 172.21.0.1:38394 - "POST /node/69e5af66213831324628a526 HTTP/1.0" 202 Accepted 2026-04-22 04:45:36,422 - lava_callback - INFO - Starting async job submit for node 69e5af66213831324628a526 2026-04-22 04:45:36,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:45:36,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5af66213831324628a526 HTTP/1.1" 200 None 2026-04-22 04:45:36,440 - lava_callback - DEBUG - Processing node 69e5af66213831324628a526: baseline-arm-baylibre 2026-04-22 04:45:36,440 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5af66213831324628a526 2026-04-22 04:45:36,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:45:36,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5af66213831324628a526 HTTP/1.1" 200 None 2026-04-22 04:45:36,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:45:36,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25cc01863655daa998ba7 HTTP/1.1" 200 None 2026-04-22 04:45:36,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:45:36,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5af66213831324628a526 HTTP/1.1" 200 None 2026-04-22 04:45:36,489 - lava_callback - ERROR - Error processing callback for node 69e5af66213831324628a526: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47192 - "GET / HTTP/1.0" 200 OK 2026-04-22 04:46:56,542 - lava_callback - INFO - Received callback for node 69e5afad213831324628a54a INFO: 172.21.0.1:47198 - "POST /node/69e5afad213831324628a54a HTTP/1.0" 202 Accepted 2026-04-22 04:46:56,548 - lava_callback - INFO - Starting async job submit for node 69e5afad213831324628a54a 2026-04-22 04:46:56,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:46:56,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5afad213831324628a54a HTTP/1.1" 200 None 2026-04-22 04:46:56,563 - lava_callback - DEBUG - Processing node 69e5afad213831324628a54a: baseline-arm-baylibre 2026-04-22 04:46:56,563 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5afad213831324628a54a 2026-04-22 04:46:56,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:46:56,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5afad213831324628a54a HTTP/1.1" 200 None 2026-04-22 04:46:56,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:46:56,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25cc01863655daa998ba7 HTTP/1.1" 200 None 2026-04-22 04:46:56,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:46:56,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5afad213831324628a54a HTTP/1.1" 200 None 2026-04-22 04:46:56,637 - lava_callback - ERROR - Error processing callback for node 69e5afad213831324628a54a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54266 - "GET / HTTP/1.0" 200 OK 2026-04-22 04:47:36,530 - lava_callback - INFO - Received callback for node 69e5afd3213831324628a554 INFO: 172.21.0.1:54282 - "POST /node/69e5afd3213831324628a554 HTTP/1.0" 202 Accepted 2026-04-22 04:47:36,538 - lava_callback - INFO - Starting async job submit for node 69e5afd3213831324628a554 2026-04-22 04:47:36,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:47:36,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5afd3213831324628a554 HTTP/1.1" 200 None 2026-04-22 04:47:36,560 - lava_callback - DEBUG - Processing node 69e5afd3213831324628a554: baseline-arm-baylibre 2026-04-22 04:47:36,561 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5afd3213831324628a554 2026-04-22 04:47:36,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:47:36,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5afd3213831324628a554 HTTP/1.1" 200 None 2026-04-22 04:47:36,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:47:36,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25cc01863655daa998ba7 HTTP/1.1" 200 None 2026-04-22 04:47:36,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:47:36,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5afd3213831324628a554 HTTP/1.1" 200 None 2026-04-22 04:47:36,615 - lava_callback - ERROR - Error processing callback for node 69e5afd3213831324628a554: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48390 - "GET / HTTP/1.0" 200 OK 2026-04-22 04:47:56,574 - lava_callback - INFO - Received callback for node 69e5aff6213831324628a567 INFO: 172.21.0.1:48394 - "POST /node/69e5aff6213831324628a567 HTTP/1.0" 202 Accepted 2026-04-22 04:47:56,580 - lava_callback - INFO - Starting async job submit for node 69e5aff6213831324628a567 2026-04-22 04:47:56,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:47:56,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5aff6213831324628a567 HTTP/1.1" 200 None 2026-04-22 04:47:56,596 - lava_callback - DEBUG - Processing node 69e5aff6213831324628a567: baseline-arm-baylibre 2026-04-22 04:47:56,596 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5aff6213831324628a567 2026-04-22 04:47:56,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:47:56,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5aff6213831324628a567 HTTP/1.1" 200 None 2026-04-22 04:47:56,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:47:56,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25cc01863655daa998ba7 HTTP/1.1" 200 None 2026-04-22 04:47:56,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:47:56,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5aff6213831324628a567 HTTP/1.1" 200 None 2026-04-22 04:47:56,648 - lava_callback - ERROR - Error processing callback for node 69e5aff6213831324628a567: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51718 - "GET / HTTP/1.0" 200 OK 2026-04-22 04:48:36,624 - lava_callback - INFO - Received callback for node 69e5b01c213831324628a578 INFO: 172.21.0.1:51734 - "POST /node/69e5b01c213831324628a578 HTTP/1.0" 202 Accepted 2026-04-22 04:48:36,631 - lava_callback - INFO - Starting async job submit for node 69e5b01c213831324628a578 2026-04-22 04:48:36,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:48:36,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b01c213831324628a578 HTTP/1.1" 200 None 2026-04-22 04:48:36,652 - lava_callback - DEBUG - Processing node 69e5b01c213831324628a578: baseline-arm-baylibre 2026-04-22 04:48:36,652 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5b01c213831324628a578 2026-04-22 04:48:36,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:48:36,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b01c213831324628a578 HTTP/1.1" 200 None 2026-04-22 04:48:36,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:48:36,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25cc01863655daa998ba7 HTTP/1.1" 200 None 2026-04-22 04:48:36,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:48:36,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5b01c213831324628a578 HTTP/1.1" 200 None 2026-04-22 04:48:36,740 - lava_callback - ERROR - Error processing callback for node 69e5b01c213831324628a578: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39044 - "GET / HTTP/1.0" 200 OK 2026-04-22 04:49:16,627 - lava_callback - INFO - Received callback for node 69e5b042213831324628a588 INFO: 172.21.0.1:39046 - "POST /node/69e5b042213831324628a588 HTTP/1.0" 202 Accepted 2026-04-22 04:49:16,633 - lava_callback - INFO - Starting async job submit for node 69e5b042213831324628a588 2026-04-22 04:49:16,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:49:16,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b042213831324628a588 HTTP/1.1" 200 None 2026-04-22 04:49:16,649 - lava_callback - DEBUG - Processing node 69e5b042213831324628a588: baseline-arm-baylibre 2026-04-22 04:49:16,649 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5b042213831324628a588 2026-04-22 04:49:16,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:49:16,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b042213831324628a588 HTTP/1.1" 200 None 2026-04-22 04:49:16,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:49:16,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25cc01863655daa998ba7 HTTP/1.1" 200 None 2026-04-22 04:49:16,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:49:16,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5b042213831324628a588 HTTP/1.1" 200 None 2026-04-22 04:49:16,724 - lava_callback - ERROR - Error processing callback for node 69e5b042213831324628a588: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39886 - "GET / HTTP/1.0" 200 OK 2026-04-22 04:49:56,747 - lava_callback - INFO - Received callback for node 69e5b064213831324628a59d INFO: 172.21.0.1:39900 - "POST /node/69e5b064213831324628a59d HTTP/1.0" 202 Accepted 2026-04-22 04:49:56,752 - lava_callback - INFO - Starting async job submit for node 69e5b064213831324628a59d 2026-04-22 04:49:56,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:49:56,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b064213831324628a59d HTTP/1.1" 200 None 2026-04-22 04:49:56,767 - lava_callback - DEBUG - Processing node 69e5b064213831324628a59d: baseline-arm-baylibre 2026-04-22 04:49:56,768 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5b064213831324628a59d 2026-04-22 04:49:56,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:49:56,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b064213831324628a59d HTTP/1.1" 200 None 2026-04-22 04:49:56,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:49:56,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25cc01863655daa998ba7 HTTP/1.1" 200 None 2026-04-22 04:49:56,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:49:56,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5b064213831324628a59d HTTP/1.1" 200 None 2026-04-22 04:49:56,818 - lava_callback - ERROR - Error processing callback for node 69e5b064213831324628a59d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51222 - "GET / HTTP/1.0" 200 OK 2026-04-22 04:50:56,683 - lava_callback - INFO - Received callback for node 69e5b0ab213831324628a5bd INFO: 172.21.0.1:51232 - "POST /node/69e5b0ab213831324628a5bd HTTP/1.0" 202 Accepted 2026-04-22 04:50:56,689 - lava_callback - INFO - Starting async job submit for node 69e5b0ab213831324628a5bd 2026-04-22 04:50:56,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:50:56,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b0ab213831324628a5bd HTTP/1.1" 200 None 2026-04-22 04:50:56,722 - lava_callback - DEBUG - Processing node 69e5b0ab213831324628a5bd: baseline-arm-baylibre 2026-04-22 04:50:56,722 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5b0ab213831324628a5bd 2026-04-22 04:50:56,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:50:56,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b0ab213831324628a5bd HTTP/1.1" 200 None 2026-04-22 04:50:56,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:50:56,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e500559a34686dd62e8a03 HTTP/1.1" 200 None 2026-04-22 04:50:56,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:50:56,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5b0ab213831324628a5bd HTTP/1.1" 200 None 2026-04-22 04:50:56,770 - lava_callback - ERROR - Error processing callback for node 69e5b0ab213831324628a5bd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34606 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41548 - "GET / HTTP/1.0" 200 OK 2026-04-22 04:52:25,045 - lava_callback - INFO - Received callback for node 69e5b0f8213831324628a5de INFO: 172.21.0.1:46996 - "POST /node/69e5b0f8213831324628a5de HTTP/1.0" 202 Accepted 2026-04-22 04:52:25,050 - lava_callback - INFO - Starting async job submit for node 69e5b0f8213831324628a5de 2026-04-22 04:52:25,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:52:25,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b0f8213831324628a5de HTTP/1.1" 200 None 2026-04-22 04:52:25,091 - lava_callback - DEBUG - Processing node 69e5b0f8213831324628a5de: baseline-arm-clabbe 2026-04-22 04:52:25,091 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5b0f8213831324628a5de 2026-04-22 04:52:25,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:52:25,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b0f8213831324628a5de HTTP/1.1" 200 None 2026-04-22 04:52:25,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:52:25,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25cc01863655daa998ba7 HTTP/1.1" 200 None 2026-04-22 04:52:25,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:52:25,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5b0f8213831324628a5de HTTP/1.1" 200 None 2026-04-22 04:52:25,191 - lava_callback - ERROR - Error processing callback for node 69e5b0f8213831324628a5de: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58116 - "GET / HTTP/1.0" 200 OK 2026-04-22 04:52:56,816 - lava_callback - INFO - Received callback for node 69e5b11a213831324628a5ef INFO: 172.21.0.1:58126 - "POST /node/69e5b11a213831324628a5ef HTTP/1.0" 202 Accepted 2026-04-22 04:52:56,822 - lava_callback - INFO - Starting async job submit for node 69e5b11a213831324628a5ef 2026-04-22 04:52:56,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:52:56,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b11a213831324628a5ef HTTP/1.1" 200 None 2026-04-22 04:52:56,843 - lava_callback - DEBUG - Processing node 69e5b11a213831324628a5ef: baseline-arm-baylibre 2026-04-22 04:52:56,843 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5b11a213831324628a5ef 2026-04-22 04:52:56,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:52:56,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b11a213831324628a5ef HTTP/1.1" 200 None 2026-04-22 04:52:56,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:52:56,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e500559a34686dd62e8a03 HTTP/1.1" 200 None 2026-04-22 04:52:56,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:52:56,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5b11a213831324628a5ef HTTP/1.1" 200 None 2026-04-22 04:52:56,924 - lava_callback - ERROR - Error processing callback for node 69e5b11a213831324628a5ef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53660 - "GET / HTTP/1.0" 200 OK 2026-04-22 04:53:25,046 - lava_callback - INFO - Received callback for node 69e5b142213831324628a600 INFO: 172.21.0.1:32874 - "POST /node/69e5b142213831324628a600 HTTP/1.0" 202 Accepted 2026-04-22 04:53:25,051 - lava_callback - INFO - Starting async job submit for node 69e5b142213831324628a600 2026-04-22 04:53:25,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:53:25,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b142213831324628a600 HTTP/1.1" 200 None 2026-04-22 04:53:25,067 - lava_callback - DEBUG - Processing node 69e5b142213831324628a600: baseline-arm-clabbe 2026-04-22 04:53:25,067 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5b142213831324628a600 2026-04-22 04:53:25,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:53:25,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b142213831324628a600 HTTP/1.1" 200 None 2026-04-22 04:53:25,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:53:25,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25cc01863655daa998ba7 HTTP/1.1" 200 None 2026-04-22 04:53:25,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:53:25,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5b142213831324628a600 HTTP/1.1" 200 None 2026-04-22 04:53:25,121 - lava_callback - ERROR - Error processing callback for node 69e5b142213831324628a600: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59994 - "GET / HTTP/1.0" 200 OK 2026-04-22 04:54:05,042 - lava_callback - INFO - Received callback for node 69e5b168213831324628a60e INFO: 172.21.0.1:40888 - "POST /node/69e5b168213831324628a60e HTTP/1.0" 202 Accepted 2026-04-22 04:54:05,048 - lava_callback - INFO - Starting async job submit for node 69e5b168213831324628a60e 2026-04-22 04:54:05,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:54:05,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b168213831324628a60e HTTP/1.1" 200 None 2026-04-22 04:54:05,078 - lava_callback - DEBUG - Processing node 69e5b168213831324628a60e: baseline-arm-clabbe 2026-04-22 04:54:05,078 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5b168213831324628a60e 2026-04-22 04:54:05,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:54:05,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b168213831324628a60e HTTP/1.1" 200 None 2026-04-22 04:54:05,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:54:05,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25cc01863655daa998ba7 HTTP/1.1" 200 None 2026-04-22 04:54:05,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:54:05,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5b168213831324628a60e HTTP/1.1" 200 None 2026-04-22 04:54:05,125 - lava_callback - ERROR - Error processing callback for node 69e5b168213831324628a60e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32994 - "GET / HTTP/1.0" 200 OK 2026-04-22 04:54:36,872 - lava_callback - INFO - Received callback for node 69e5b18b213831324628a621 INFO: 172.21.0.1:33008 - "POST /node/69e5b18b213831324628a621 HTTP/1.0" 202 Accepted 2026-04-22 04:54:36,878 - lava_callback - INFO - Starting async job submit for node 69e5b18b213831324628a621 2026-04-22 04:54:36,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:54:36,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b18b213831324628a621 HTTP/1.1" 200 None 2026-04-22 04:54:36,893 - lava_callback - DEBUG - Processing node 69e5b18b213831324628a621: baseline-arm-baylibre 2026-04-22 04:54:36,894 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5b18b213831324628a621 2026-04-22 04:54:36,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:54:36,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b18b213831324628a621 HTTP/1.1" 200 None 2026-04-22 04:54:36,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:54:36,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e500559a34686dd62e8a03 HTTP/1.1" 200 None 2026-04-22 04:54:36,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:54:36,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5b18b213831324628a621 HTTP/1.1" 200 None 2026-04-22 04:54:36,939 - lava_callback - ERROR - Error processing callback for node 69e5b18b213831324628a621: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34818 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34834 - "GET / HTTP/1.0" 200 OK 2026-04-22 04:55:16,908 - lava_callback - INFO - Received callback for node 69e5b1b0213831324628a62e INFO: 172.21.0.1:34844 - "POST /node/69e5b1b0213831324628a62e HTTP/1.0" 202 Accepted 2026-04-22 04:55:16,914 - lava_callback - INFO - Starting async job submit for node 69e5b1b0213831324628a62e 2026-04-22 04:55:16,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:55:16,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b1b0213831324628a62e HTTP/1.1" 200 None 2026-04-22 04:55:16,930 - lava_callback - DEBUG - Processing node 69e5b1b0213831324628a62e: baseline-arm-baylibre 2026-04-22 04:55:16,930 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5b1b0213831324628a62e 2026-04-22 04:55:16,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:55:16,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b1b0213831324628a62e HTTP/1.1" 200 None 2026-04-22 04:55:16,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:55:16,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e500559a34686dd62e8a03 HTTP/1.1" 200 None 2026-04-22 04:55:16,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:55:16,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5b1b0213831324628a62e HTTP/1.1" 200 None 2026-04-22 04:55:16,977 - lava_callback - ERROR - Error processing callback for node 69e5b1b0213831324628a62e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45772 - "GET / HTTP/1.0" 200 OK 2026-04-22 04:55:57,159 - lava_callback - INFO - Received callback for node 69e81d8aafb86e738cad02da INFO: 172.21.0.1:45786 - "POST /node/69e81d8aafb86e738cad02da HTTP/1.0" 202 Accepted 2026-04-22 04:55:57,165 - lava_callback - INFO - Starting async job submit for node 69e81d8aafb86e738cad02da 2026-04-22 04:55:57,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:55:57,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81d8aafb86e738cad02da HTTP/1.1" 200 None 2026-04-22 04:55:57,207 - lava_callback - DEBUG - Processing node 69e81d8aafb86e738cad02da: baseline-arm64 2026-04-22 04:55:57,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 04:55:57,891 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 04:55:57,893 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e81d8aafb86e738cad02da/log.txt.gz 2026-04-22 04:55:58,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 04:55:58,328 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 04:55:58,330 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e81d8aafb86e738cad02da/lava-logs.yaml 2026-04-22 04:55:58,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 04:55:58,463 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 04:55:58,464 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e81d8aafb86e738cad02da/lava_callback.json.gz 2026-04-22 04:55:58,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:55:58,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81d8aafb86e738cad02da HTTP/1.1" 200 None 2026-04-22 04:55:58,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:55:58,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 04:55:58,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:55:58,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e81d8aafb86e738cad02da HTTP/1.1" 200 None 2026-04-22 04:55:58,601 - lava_callback - INFO - Completed processing callback for node 69e81d8aafb86e738cad02da 2026-04-22 04:56:05,147 - lava_callback - INFO - Received callback for node 69e5b1d6213831324628a641 INFO: 172.21.0.1:45960 - "POST /node/69e5b1d6213831324628a641 HTTP/1.0" 202 Accepted 2026-04-22 04:56:05,153 - lava_callback - INFO - Starting async job submit for node 69e5b1d6213831324628a641 2026-04-22 04:56:05,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:56:05,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b1d6213831324628a641 HTTP/1.1" 200 None 2026-04-22 04:56:05,169 - lava_callback - DEBUG - Processing node 69e5b1d6213831324628a641: baseline-arm-clabbe 2026-04-22 04:56:05,169 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5b1d6213831324628a641 2026-04-22 04:56:05,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:56:05,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b1d6213831324628a641 HTTP/1.1" 200 None 2026-04-22 04:56:05,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:56:05,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25cc01863655daa998ba7 HTTP/1.1" 200 None 2026-04-22 04:56:05,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:56:05,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5b1d6213831324628a641 HTTP/1.1" 200 None 2026-04-22 04:56:05,226 - lava_callback - ERROR - Error processing callback for node 69e5b1d6213831324628a641: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40218 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40228 - "GET / HTTP/1.0" 200 OK 2026-04-22 04:56:23,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:56:23,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38430 - "GET / HTTP/1.0" 200 OK 2026-04-22 04:56:32,486 - lava_callback - INFO - Received callback for node 69e81d9cafb86e738cad0321 INFO: 172.21.0.1:38578 - "POST /node/69e81d9cafb86e738cad0321 HTTP/1.0" 202 Accepted 2026-04-22 04:56:32,493 - lava_callback - INFO - Starting async job submit for node 69e81d9cafb86e738cad0321 2026-04-22 04:56:32,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:56:32,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81d9cafb86e738cad0321 HTTP/1.1" 200 None 2026-04-22 04:56:32,533 - lava_callback - DEBUG - Processing node 69e81d9cafb86e738cad0321: baseline-nfs-arm64 2026-04-22 04:56:33,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 04:56:33,184 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 04:56:33,186 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e81d9cafb86e738cad0321/log.txt.gz 2026-04-22 04:56:33,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 04:56:33,638 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 04:56:33,640 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e81d9cafb86e738cad0321/lava-logs.yaml 2026-04-22 04:56:33,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 04:56:33,755 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 04:56:33,757 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69e81d9cafb86e738cad0321/lava_callback.json.gz 2026-04-22 04:56:33,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:56:33,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81d9cafb86e738cad0321 HTTP/1.1" 200 None 2026-04-22 04:56:33,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:56:33,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 04:56:33,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:56:33,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e81d9cafb86e738cad0321 HTTP/1.1" 200 None 2026-04-22 04:56:33,901 - lava_callback - INFO - Completed processing callback for node 69e81d9cafb86e738cad0321 INFO: 172.21.0.1:38590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33576 - "GET / HTTP/1.0" 200 OK 2026-04-22 04:56:53,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:56:53,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49106 - "GET / HTTP/1.0" 200 OK 2026-04-22 04:57:45,255 - lava_callback - INFO - Received callback for node 69e5b244213831324628a675 INFO: 172.21.0.1:44772 - "POST /node/69e5b244213831324628a675 HTTP/1.0" 202 Accepted 2026-04-22 04:57:45,261 - lava_callback - INFO - Starting async job submit for node 69e5b244213831324628a675 2026-04-22 04:57:45,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:57:45,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b244213831324628a675 HTTP/1.1" 200 None 2026-04-22 04:57:45,300 - lava_callback - DEBUG - Processing node 69e5b244213831324628a675: baseline-arm-clabbe 2026-04-22 04:57:45,300 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5b244213831324628a675 2026-04-22 04:57:45,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:57:45,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b244213831324628a675 HTTP/1.1" 200 None 2026-04-22 04:57:45,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:57:45,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25cc01863655daa998ba7 HTTP/1.1" 200 None 2026-04-22 04:57:45,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:57:45,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5b244213831324628a675 HTTP/1.1" 200 None 2026-04-22 04:57:45,403 - lava_callback - ERROR - Error processing callback for node 69e5b244213831324628a675: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38474 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38478 - "GET / HTTP/1.0" 200 OK 2026-04-22 04:58:25,194 - lava_callback - INFO - Received callback for node 69e5b26a213831324628a67e INFO: 172.21.0.1:38434 - "POST /node/69e5b26a213831324628a67e HTTP/1.0" 202 Accepted 2026-04-22 04:58:25,203 - lava_callback - INFO - Starting async job submit for node 69e5b26a213831324628a67e 2026-04-22 04:58:25,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:58:25,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b26a213831324628a67e HTTP/1.1" 200 None 2026-04-22 04:58:25,218 - lava_callback - DEBUG - Processing node 69e5b26a213831324628a67e: baseline-arm-clabbe 2026-04-22 04:58:25,219 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5b26a213831324628a67e 2026-04-22 04:58:25,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:58:25,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b26a213831324628a67e HTTP/1.1" 200 None 2026-04-22 04:58:25,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:58:25,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25cc01863655daa998ba7 HTTP/1.1" 200 None 2026-04-22 04:58:25,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:58:25,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5b26a213831324628a67e HTTP/1.1" 200 None 2026-04-22 04:58:25,281 - lava_callback - ERROR - Error processing callback for node 69e5b26a213831324628a67e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47628 - "GET / HTTP/1.0" 200 OK 2026-04-22 04:59:05,272 - lava_callback - INFO - Received callback for node 69e5b28f213831324628a691 INFO: 172.21.0.1:42112 - "POST /node/69e5b28f213831324628a691 HTTP/1.0" 202 Accepted 2026-04-22 04:59:05,278 - lava_callback - INFO - Starting async job submit for node 69e5b28f213831324628a691 2026-04-22 04:59:05,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:59:05,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b28f213831324628a691 HTTP/1.1" 200 None 2026-04-22 04:59:05,294 - lava_callback - DEBUG - Processing node 69e5b28f213831324628a691: baseline-arm-clabbe 2026-04-22 04:59:05,295 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5b28f213831324628a691 2026-04-22 04:59:05,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:59:05,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b28f213831324628a691 HTTP/1.1" 200 None 2026-04-22 04:59:05,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:59:05,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e500559a34686dd62e8a03 HTTP/1.1" 200 None 2026-04-22 04:59:05,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:59:05,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5b28f213831324628a691 HTTP/1.1" 200 None 2026-04-22 04:59:05,342 - lava_callback - ERROR - Error processing callback for node 69e5b28f213831324628a691: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36316 - "GET / HTTP/1.0" 200 OK 2026-04-22 04:59:45,275 - lava_callback - INFO - Received callback for node 69e5b2b4213831324628a6a1 INFO: 172.21.0.1:51560 - "POST /node/69e5b2b4213831324628a6a1 HTTP/1.0" 202 Accepted 2026-04-22 04:59:45,283 - lava_callback - INFO - Starting async job submit for node 69e5b2b4213831324628a6a1 2026-04-22 04:59:45,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:59:45,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b2b4213831324628a6a1 HTTP/1.1" 200 None 2026-04-22 04:59:45,299 - lava_callback - DEBUG - Processing node 69e5b2b4213831324628a6a1: baseline-arm-clabbe 2026-04-22 04:59:45,299 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5b2b4213831324628a6a1 2026-04-22 04:59:45,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:59:45,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b2b4213831324628a6a1 HTTP/1.1" 200 None 2026-04-22 04:59:45,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:59:45,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25cc01863655daa998ba7 HTTP/1.1" 200 None 2026-04-22 04:59:45,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 04:59:45,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5b2b4213831324628a6a1 HTTP/1.1" 200 None 2026-04-22 04:59:45,368 - lava_callback - ERROR - Error processing callback for node 69e5b2b4213831324628a6a1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46822 - "GET / HTTP/1.0" 200 OK 2026-04-22 05:00:25,328 - lava_callback - INFO - Received callback for node 69e5b2da213831324628a6b2 INFO: 172.21.0.1:45834 - "POST /node/69e5b2da213831324628a6b2 HTTP/1.0" 202 Accepted 2026-04-22 05:00:25,334 - lava_callback - INFO - Starting async job submit for node 69e5b2da213831324628a6b2 2026-04-22 05:00:25,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:00:25,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b2da213831324628a6b2 HTTP/1.1" 200 None 2026-04-22 05:00:25,353 - lava_callback - DEBUG - Processing node 69e5b2da213831324628a6b2: baseline-arm-clabbe 2026-04-22 05:00:25,353 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5b2da213831324628a6b2 2026-04-22 05:00:25,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:00:25,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b2da213831324628a6b2 HTTP/1.1" 200 None 2026-04-22 05:00:25,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:00:25,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e500559a34686dd62e8a03 HTTP/1.1" 200 None 2026-04-22 05:00:25,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:00:25,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5b2da213831324628a6b2 HTTP/1.1" 200 None 2026-04-22 05:00:25,439 - lava_callback - ERROR - Error processing callback for node 69e5b2da213831324628a6b2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38742 - "GET / HTTP/1.0" 200 OK 2026-04-22 05:01:05,367 - lava_callback - INFO - Received callback for node 69e5b2ff213831324628a6c1 INFO: 172.21.0.1:45772 - "POST /node/69e5b2ff213831324628a6c1 HTTP/1.0" 202 Accepted 2026-04-22 05:01:05,373 - lava_callback - INFO - Starting async job submit for node 69e5b2ff213831324628a6c1 2026-04-22 05:01:05,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:01:05,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b2ff213831324628a6c1 HTTP/1.1" 200 None 2026-04-22 05:01:05,388 - lava_callback - DEBUG - Processing node 69e5b2ff213831324628a6c1: baseline-arm-clabbe 2026-04-22 05:01:05,388 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5b2ff213831324628a6c1 2026-04-22 05:01:05,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:01:05,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b2ff213831324628a6c1 HTTP/1.1" 200 None 2026-04-22 05:01:05,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:01:05,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e500559a34686dd62e8a03 HTTP/1.1" 200 None 2026-04-22 05:01:05,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:01:05,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5b2ff213831324628a6c1 HTTP/1.1" 200 None 2026-04-22 05:01:05,449 - lava_callback - ERROR - Error processing callback for node 69e5b2ff213831324628a6c1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38076 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54722 - "GET / HTTP/1.0" 200 OK 2026-04-22 05:01:45,579 - lava_callback - INFO - Received callback for node 69e5b325213831324628a6d2 INFO: 172.21.0.1:60954 - "POST /node/69e5b325213831324628a6d2 HTTP/1.0" 202 Accepted 2026-04-22 05:01:45,584 - lava_callback - INFO - Starting async job submit for node 69e5b325213831324628a6d2 2026-04-22 05:01:45,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:01:45,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b325213831324628a6d2 HTTP/1.1" 200 None 2026-04-22 05:01:45,600 - lava_callback - DEBUG - Processing node 69e5b325213831324628a6d2: baseline-arm-clabbe 2026-04-22 05:01:45,600 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5b325213831324628a6d2 2026-04-22 05:01:45,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:01:45,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b325213831324628a6d2 HTTP/1.1" 200 None 2026-04-22 05:01:45,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:01:45,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25cc01863655daa998ba7 HTTP/1.1" 200 None 2026-04-22 05:01:45,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:01:45,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5b325213831324628a6d2 HTTP/1.1" 200 None 2026-04-22 05:01:45,656 - lava_callback - ERROR - Error processing callback for node 69e5b325213831324628a6d2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51590 - "GET / HTTP/1.0" 200 OK 2026-04-22 05:02:05,401 - lava_callback - INFO - Received callback for node 69e5b34a213831324628a6e1 INFO: 172.21.0.1:35190 - "POST /node/69e5b34a213831324628a6e1 HTTP/1.0" 202 Accepted 2026-04-22 05:02:05,406 - lava_callback - INFO - Starting async job submit for node 69e5b34a213831324628a6e1 2026-04-22 05:02:05,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:02:05,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b34a213831324628a6e1 HTTP/1.1" 200 None 2026-04-22 05:02:05,424 - lava_callback - DEBUG - Processing node 69e5b34a213831324628a6e1: baseline-arm-clabbe 2026-04-22 05:02:05,424 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5b34a213831324628a6e1 2026-04-22 05:02:05,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:02:05,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b34a213831324628a6e1 HTTP/1.1" 200 None 2026-04-22 05:02:05,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:02:05,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25cc01863655daa998ba7 HTTP/1.1" 200 None 2026-04-22 05:02:05,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:02:05,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5b34a213831324628a6e1 HTTP/1.1" 200 None 2026-04-22 05:02:05,486 - lava_callback - ERROR - Error processing callback for node 69e5b34a213831324628a6e1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49572 - "GET / HTTP/1.0" 200 OK 2026-04-22 05:02:45,418 - lava_callback - INFO - Received callback for node 69e5b36f213831324628a6f5 INFO: 172.21.0.1:45774 - "POST /node/69e5b36f213831324628a6f5 HTTP/1.0" 202 Accepted 2026-04-22 05:02:45,424 - lava_callback - INFO - Starting async job submit for node 69e5b36f213831324628a6f5 2026-04-22 05:02:45,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:02:45,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b36f213831324628a6f5 HTTP/1.1" 200 None 2026-04-22 05:02:45,441 - lava_callback - DEBUG - Processing node 69e5b36f213831324628a6f5: baseline-arm-clabbe 2026-04-22 05:02:45,441 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5b36f213831324628a6f5 2026-04-22 05:02:45,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:02:45,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b36f213831324628a6f5 HTTP/1.1" 200 None 2026-04-22 05:02:45,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:02:45,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e500559a34686dd62e8a03 HTTP/1.1" 200 None 2026-04-22 05:02:45,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:02:45,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5b36f213831324628a6f5 HTTP/1.1" 200 None 2026-04-22 05:02:45,497 - lava_callback - ERROR - Error processing callback for node 69e5b36f213831324628a6f5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43370 - "GET / HTTP/1.0" 200 OK 2026-04-22 05:03:25,440 - lava_callback - INFO - Received callback for node 69e5b395213831324628a6fe INFO: 172.21.0.1:46568 - "POST /node/69e5b395213831324628a6fe HTTP/1.0" 202 Accepted 2026-04-22 05:03:25,446 - lava_callback - INFO - Starting async job submit for node 69e5b395213831324628a6fe 2026-04-22 05:03:25,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:03:25,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b395213831324628a6fe HTTP/1.1" 200 None 2026-04-22 05:03:25,462 - lava_callback - DEBUG - Processing node 69e5b395213831324628a6fe: baseline-arm-clabbe 2026-04-22 05:03:25,462 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5b395213831324628a6fe 2026-04-22 05:03:25,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:03:25,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b395213831324628a6fe HTTP/1.1" 200 None 2026-04-22 05:03:25,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:03:25,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e500559a34686dd62e8a03 HTTP/1.1" 200 None 2026-04-22 05:03:25,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:03:25,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5b395213831324628a6fe HTTP/1.1" 200 None 2026-04-22 05:03:25,511 - lava_callback - ERROR - Error processing callback for node 69e5b395213831324628a6fe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36240 - "GET / HTTP/1.0" 200 OK 2026-04-22 05:04:05,505 - lava_callback - INFO - Received callback for node 69e5b3ba213831324628a711 INFO: 172.21.0.1:40598 - "POST /node/69e5b3ba213831324628a711 HTTP/1.0" 202 Accepted 2026-04-22 05:04:05,511 - lava_callback - INFO - Starting async job submit for node 69e5b3ba213831324628a711 2026-04-22 05:04:05,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:04:05,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b3ba213831324628a711 HTTP/1.1" 200 None 2026-04-22 05:04:05,530 - lava_callback - DEBUG - Processing node 69e5b3ba213831324628a711: baseline-arm-clabbe 2026-04-22 05:04:05,531 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5b3ba213831324628a711 2026-04-22 05:04:05,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:04:05,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b3ba213831324628a711 HTTP/1.1" 200 None 2026-04-22 05:04:05,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:04:05,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e500559a34686dd62e8a03 HTTP/1.1" 200 None 2026-04-22 05:04:05,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:04:05,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5b3ba213831324628a711 HTTP/1.1" 200 None 2026-04-22 05:04:05,578 - lava_callback - ERROR - Error processing callback for node 69e5b3ba213831324628a711: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55536 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57366 - "GET / HTTP/1.0" 200 OK 2026-04-22 05:04:45,517 - lava_callback - INFO - Received callback for node 69e5b3de213831324628a722 INFO: 172.21.0.1:45018 - "POST /node/69e5b3de213831324628a722 HTTP/1.0" 202 Accepted 2026-04-22 05:04:45,523 - lava_callback - INFO - Starting async job submit for node 69e5b3de213831324628a722 2026-04-22 05:04:45,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:04:45,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b3de213831324628a722 HTTP/1.1" 200 None 2026-04-22 05:04:45,543 - lava_callback - DEBUG - Processing node 69e5b3de213831324628a722: baseline-arm-clabbe 2026-04-22 05:04:45,544 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5b3de213831324628a722 2026-04-22 05:04:45,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:04:45,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b3de213831324628a722 HTTP/1.1" 200 None 2026-04-22 05:04:45,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:04:45,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e500559a34686dd62e8a03 HTTP/1.1" 200 None 2026-04-22 05:04:45,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:04:45,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5b3de213831324628a722 HTTP/1.1" 200 None 2026-04-22 05:04:45,592 - lava_callback - ERROR - Error processing callback for node 69e5b3de213831324628a722: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60398 - "GET / HTTP/1.0" 200 OK 2026-04-22 05:05:25,596 - lava_callback - INFO - Received callback for node 69e5b403213831324628a735 INFO: 172.21.0.1:40914 - "POST /node/69e5b403213831324628a735 HTTP/1.0" 202 Accepted 2026-04-22 05:05:25,601 - lava_callback - INFO - Starting async job submit for node 69e5b403213831324628a735 2026-04-22 05:05:25,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:05:25,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b403213831324628a735 HTTP/1.1" 200 None 2026-04-22 05:05:25,617 - lava_callback - DEBUG - Processing node 69e5b403213831324628a735: baseline-arm-clabbe 2026-04-22 05:05:25,617 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5b403213831324628a735 2026-04-22 05:05:25,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:05:25,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b403213831324628a735 HTTP/1.1" 200 None 2026-04-22 05:05:25,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:05:25,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e500559a34686dd62e8a03 HTTP/1.1" 200 None 2026-04-22 05:05:25,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:05:25,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5b403213831324628a735 HTTP/1.1" 200 None 2026-04-22 05:05:25,668 - lava_callback - ERROR - Error processing callback for node 69e5b403213831324628a735: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47906 - "GET / HTTP/1.0" 200 OK 2026-04-22 05:06:05,716 - lava_callback - INFO - Received callback for node 69e5b428213831324628a742 INFO: 172.21.0.1:34434 - "POST /node/69e5b428213831324628a742 HTTP/1.0" 202 Accepted 2026-04-22 05:06:05,721 - lava_callback - INFO - Starting async job submit for node 69e5b428213831324628a742 2026-04-22 05:06:05,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:06:05,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b428213831324628a742 HTTP/1.1" 200 None 2026-04-22 05:06:05,737 - lava_callback - DEBUG - Processing node 69e5b428213831324628a742: baseline-arm-clabbe 2026-04-22 05:06:05,737 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5b428213831324628a742 2026-04-22 05:06:05,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:06:05,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b428213831324628a742 HTTP/1.1" 200 None 2026-04-22 05:06:05,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:06:05,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e500559a34686dd62e8a03 HTTP/1.1" 200 None 2026-04-22 05:06:05,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:06:05,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5b428213831324628a742 HTTP/1.1" 200 None 2026-04-22 05:06:05,791 - lava_callback - ERROR - Error processing callback for node 69e5b428213831324628a742: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50616 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41834 - "GET / HTTP/1.0" 200 OK 2026-04-22 05:06:37,507 - lava_callback - INFO - Received callback for node 69e5b44b213831324628a74e INFO: 172.21.0.1:41838 - "POST /node/69e5b44b213831324628a74e HTTP/1.0" 202 Accepted 2026-04-22 05:06:37,515 - lava_callback - INFO - Starting async job submit for node 69e5b44b213831324628a74e 2026-04-22 05:06:37,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:06:37,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b44b213831324628a74e HTTP/1.1" 200 None 2026-04-22 05:06:37,532 - lava_callback - DEBUG - Processing node 69e5b44b213831324628a74e: baseline-arm-baylibre 2026-04-22 05:06:37,532 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5b44b213831324628a74e 2026-04-22 05:06:37,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:06:37,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b44b213831324628a74e HTTP/1.1" 200 None 2026-04-22 05:06:37,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:06:37,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25cc01863655daa998ba7 HTTP/1.1" 200 None 2026-04-22 05:06:37,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:06:37,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5b44b213831324628a74e HTTP/1.1" 200 None 2026-04-22 05:06:37,662 - lava_callback - ERROR - Error processing callback for node 69e5b44b213831324628a74e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53914 - "GET / HTTP/1.0" 200 OK 2026-04-22 05:07:37,510 - lava_callback - INFO - Received callback for node 69e5b492213831324628a76e INFO: 172.21.0.1:53918 - "POST /node/69e5b492213831324628a76e HTTP/1.0" 202 Accepted 2026-04-22 05:07:37,515 - lava_callback - INFO - Starting async job submit for node 69e5b492213831324628a76e 2026-04-22 05:07:37,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:07:37,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b492213831324628a76e HTTP/1.1" 200 None 2026-04-22 05:07:37,531 - lava_callback - DEBUG - Processing node 69e5b492213831324628a76e: baseline-arm-baylibre 2026-04-22 05:07:37,531 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5b492213831324628a76e 2026-04-22 05:07:37,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:07:37,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b492213831324628a76e HTTP/1.1" 200 None 2026-04-22 05:07:37,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:07:37,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25cc01863655daa998ba7 HTTP/1.1" 200 None 2026-04-22 05:07:37,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:07:37,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5b492213831324628a76e HTTP/1.1" 200 None 2026-04-22 05:07:37,585 - lava_callback - ERROR - Error processing callback for node 69e5b492213831324628a76e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44372 - "GET / HTTP/1.0" 200 OK 2026-04-22 05:08:17,590 - lava_callback - INFO - Received callback for node 69e5b4b8213831324628a781 INFO: 172.21.0.1:44376 - "POST /node/69e5b4b8213831324628a781 HTTP/1.0" 202 Accepted 2026-04-22 05:08:17,595 - lava_callback - INFO - Starting async job submit for node 69e5b4b8213831324628a781 2026-04-22 05:08:17,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:08:17,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b4b8213831324628a781 HTTP/1.1" 200 None 2026-04-22 05:08:17,616 - lava_callback - DEBUG - Processing node 69e5b4b8213831324628a781: baseline-arm-baylibre 2026-04-22 05:08:17,616 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5b4b8213831324628a781 2026-04-22 05:08:17,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:08:17,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b4b8213831324628a781 HTTP/1.1" 200 None 2026-04-22 05:08:17,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:08:17,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25cc01863655daa998ba7 HTTP/1.1" 200 None 2026-04-22 05:08:17,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:08:17,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5b4b8213831324628a781 HTTP/1.1" 200 None 2026-04-22 05:08:17,662 - lava_callback - ERROR - Error processing callback for node 69e5b4b8213831324628a781: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52890 - "GET / HTTP/1.0" 200 OK 2026-04-22 05:09:05,796 - lava_callback - INFO - Received callback for node 69e5b4de213831324628a78d INFO: 172.21.0.1:36378 - "POST /node/69e5b4de213831324628a78d HTTP/1.0" 202 Accepted 2026-04-22 05:09:05,802 - lava_callback - INFO - Starting async job submit for node 69e5b4de213831324628a78d 2026-04-22 05:09:05,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:09:05,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b4de213831324628a78d HTTP/1.1" 200 None 2026-04-22 05:09:05,816 - lava_callback - DEBUG - Processing node 69e5b4de213831324628a78d: baseline-arm-clabbe 2026-04-22 05:09:05,817 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5b4de213831324628a78d 2026-04-22 05:09:05,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:09:05,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b4de213831324628a78d HTTP/1.1" 200 None 2026-04-22 05:09:05,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:09:05,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25cc01863655daa998ba7 HTTP/1.1" 200 None 2026-04-22 05:09:05,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:09:05,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5b4de213831324628a78d HTTP/1.1" 200 None 2026-04-22 05:09:05,863 - lava_callback - ERROR - Error processing callback for node 69e5b4de213831324628a78d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33998 - "GET / HTTP/1.0" 200 OK 2026-04-22 05:09:37,687 - lava_callback - INFO - Received callback for node 69e5b501213831324628a79a INFO: 172.21.0.1:34008 - "POST /node/69e5b501213831324628a79a HTTP/1.0" 202 Accepted 2026-04-22 05:09:37,693 - lava_callback - INFO - Starting async job submit for node 69e5b501213831324628a79a 2026-04-22 05:09:37,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:09:37,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b501213831324628a79a HTTP/1.1" 200 None 2026-04-22 05:09:37,710 - lava_callback - DEBUG - Processing node 69e5b501213831324628a79a: baseline-arm-baylibre 2026-04-22 05:09:37,710 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5b501213831324628a79a 2026-04-22 05:09:37,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:09:37,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b501213831324628a79a HTTP/1.1" 200 None 2026-04-22 05:09:37,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:09:37,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25cc01863655daa998ba7 HTTP/1.1" 200 None 2026-04-22 05:09:37,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:09:37,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5b501213831324628a79a HTTP/1.1" 200 None 2026-04-22 05:09:37,772 - lava_callback - ERROR - Error processing callback for node 69e5b501213831324628a79a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60982 - "GET / HTTP/1.0" 200 OK 2026-04-22 05:10:05,780 - lava_callback - INFO - Received callback for node 69e5b528213831324628a7ad INFO: 172.21.0.1:59554 - "POST /node/69e5b528213831324628a7ad HTTP/1.0" 202 Accepted 2026-04-22 05:10:05,785 - lava_callback - INFO - Starting async job submit for node 69e5b528213831324628a7ad 2026-04-22 05:10:05,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:10:05,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b528213831324628a7ad HTTP/1.1" 200 None 2026-04-22 05:10:05,801 - lava_callback - DEBUG - Processing node 69e5b528213831324628a7ad: baseline-arm-clabbe 2026-04-22 05:10:05,802 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5b528213831324628a7ad 2026-04-22 05:10:05,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:10:05,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b528213831324628a7ad HTTP/1.1" 200 None 2026-04-22 05:10:05,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:10:05,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25cc01863655daa998ba7 HTTP/1.1" 200 None 2026-04-22 05:10:05,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:10:05,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5b528213831324628a7ad HTTP/1.1" 200 None 2026-04-22 05:10:05,848 - lava_callback - ERROR - Error processing callback for node 69e5b528213831324628a7ad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38350 - "GET / HTTP/1.0" 200 OK 2026-04-22 05:10:37,633 - lava_callback - INFO - Received callback for node 69e5b54b213831324628a7bd INFO: 172.21.0.1:38354 - "POST /node/69e5b54b213831324628a7bd HTTP/1.0" 202 Accepted 2026-04-22 05:10:37,639 - lava_callback - INFO - Starting async job submit for node 69e5b54b213831324628a7bd 2026-04-22 05:10:37,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:10:37,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b54b213831324628a7bd HTTP/1.1" 200 None 2026-04-22 05:10:37,654 - lava_callback - DEBUG - Processing node 69e5b54b213831324628a7bd: baseline-arm-baylibre 2026-04-22 05:10:37,655 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5b54b213831324628a7bd 2026-04-22 05:10:37,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:10:37,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b54b213831324628a7bd HTTP/1.1" 200 None 2026-04-22 05:10:37,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:10:37,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25cc01863655daa998ba7 HTTP/1.1" 200 None 2026-04-22 05:10:37,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:10:37,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5b54b213831324628a7bd HTTP/1.1" 200 None 2026-04-22 05:10:37,711 - lava_callback - ERROR - Error processing callback for node 69e5b54b213831324628a7bd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48992 - "GET / HTTP/1.0" 200 OK 2026-04-22 05:11:25,815 - lava_callback - INFO - Received callback for node 69e5b572213831324628a7cb INFO: 172.21.0.1:41390 - "POST /node/69e5b572213831324628a7cb HTTP/1.0" 202 Accepted 2026-04-22 05:11:25,821 - lava_callback - INFO - Starting async job submit for node 69e5b572213831324628a7cb 2026-04-22 05:11:25,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:11:25,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b572213831324628a7cb HTTP/1.1" 200 None 2026-04-22 05:11:25,840 - lava_callback - DEBUG - Processing node 69e5b572213831324628a7cb: baseline-arm-clabbe 2026-04-22 05:11:25,840 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5b572213831324628a7cb 2026-04-22 05:11:25,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:11:25,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b572213831324628a7cb HTTP/1.1" 200 None 2026-04-22 05:11:25,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:11:25,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25cc01863655daa998ba7 HTTP/1.1" 200 None 2026-04-22 05:11:25,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:11:25,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5b572213831324628a7cb HTTP/1.1" 200 None 2026-04-22 05:11:25,888 - lava_callback - ERROR - Error processing callback for node 69e5b572213831324628a7cb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60314 - "GET / HTTP/1.0" 200 OK 2026-04-22 05:12:05,824 - lava_callback - INFO - Received callback for node 69e5b598213831324628a7dd INFO: 172.21.0.1:42320 - "POST /node/69e5b598213831324628a7dd HTTP/1.0" 202 Accepted 2026-04-22 05:12:05,829 - lava_callback - INFO - Starting async job submit for node 69e5b598213831324628a7dd 2026-04-22 05:12:05,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:12:05,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b598213831324628a7dd HTTP/1.1" 200 None 2026-04-22 05:12:05,845 - lava_callback - DEBUG - Processing node 69e5b598213831324628a7dd: baseline-arm-clabbe 2026-04-22 05:12:05,845 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5b598213831324628a7dd 2026-04-22 05:12:05,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:12:05,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b598213831324628a7dd HTTP/1.1" 200 None 2026-04-22 05:12:05,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:12:05,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25cc01863655daa998ba7 HTTP/1.1" 200 None 2026-04-22 05:12:05,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:12:05,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5b598213831324628a7dd HTTP/1.1" 200 None 2026-04-22 05:12:05,894 - lava_callback - ERROR - Error processing callback for node 69e5b598213831324628a7dd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40816 - "GET / HTTP/1.0" 200 OK 2026-04-22 05:12:45,903 - lava_callback - INFO - Received callback for node 69e5b5bf213831324628a7ea INFO: 172.21.0.1:53834 - "POST /node/69e5b5bf213831324628a7ea HTTP/1.0" 202 Accepted 2026-04-22 05:12:45,909 - lava_callback - INFO - Starting async job submit for node 69e5b5bf213831324628a7ea 2026-04-22 05:12:45,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:12:45,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b5bf213831324628a7ea HTTP/1.1" 200 None 2026-04-22 05:12:45,923 - lava_callback - DEBUG - Processing node 69e5b5bf213831324628a7ea: baseline-arm-clabbe 2026-04-22 05:12:45,924 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5b5bf213831324628a7ea 2026-04-22 05:12:45,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:12:45,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b5bf213831324628a7ea HTTP/1.1" 200 None 2026-04-22 05:12:45,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:12:45,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25cc01863655daa998ba7 HTTP/1.1" 200 None 2026-04-22 05:12:45,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:12:45,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5b5bf213831324628a7ea HTTP/1.1" 200 None 2026-04-22 05:12:45,970 - lava_callback - ERROR - Error processing callback for node 69e5b5bf213831324628a7ea: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48164 - "GET / HTTP/1.0" 200 OK 2026-04-22 05:13:25,900 - lava_callback - INFO - Received callback for node 69e5b5e4213831324628a7fb INFO: 172.21.0.1:53422 - "POST /node/69e5b5e4213831324628a7fb HTTP/1.0" 202 Accepted 2026-04-22 05:13:25,906 - lava_callback - INFO - Starting async job submit for node 69e5b5e4213831324628a7fb 2026-04-22 05:13:25,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:13:25,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b5e4213831324628a7fb HTTP/1.1" 200 None 2026-04-22 05:13:25,921 - lava_callback - DEBUG - Processing node 69e5b5e4213831324628a7fb: baseline-arm-clabbe 2026-04-22 05:13:25,922 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5b5e4213831324628a7fb 2026-04-22 05:13:25,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:13:25,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b5e4213831324628a7fb HTTP/1.1" 200 None 2026-04-22 05:13:25,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:13:25,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25cc01863655daa998ba7 HTTP/1.1" 200 None 2026-04-22 05:13:25,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:13:25,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5b5e4213831324628a7fb HTTP/1.1" 200 None 2026-04-22 05:13:25,968 - lava_callback - ERROR - Error processing callback for node 69e5b5e4213831324628a7fb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55534 - "GET / HTTP/1.0" 200 OK 2026-04-22 05:14:05,939 - lava_callback - INFO - Received callback for node 69e5b609213831324628a807 INFO: 172.21.0.1:35384 - "POST /node/69e5b609213831324628a807 HTTP/1.0" 202 Accepted 2026-04-22 05:14:05,945 - lava_callback - INFO - Starting async job submit for node 69e5b609213831324628a807 2026-04-22 05:14:05,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:14:05,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b609213831324628a807 HTTP/1.1" 200 None 2026-04-22 05:14:05,962 - lava_callback - DEBUG - Processing node 69e5b609213831324628a807: baseline-arm-clabbe 2026-04-22 05:14:05,962 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5b609213831324628a807 2026-04-22 05:14:05,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:14:05,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b609213831324628a807 HTTP/1.1" 200 None 2026-04-22 05:14:05,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:14:05,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25cc01863655daa998ba7 HTTP/1.1" 200 None 2026-04-22 05:14:05,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:14:06,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5b609213831324628a807 HTTP/1.1" 200 None 2026-04-22 05:14:06,018 - lava_callback - ERROR - Error processing callback for node 69e5b609213831324628a807: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41656 - "GET / HTTP/1.0" 200 OK 2026-04-22 05:14:45,902 - lava_callback - INFO - Received callback for node 69e5b62f213831324628a814 INFO: 172.21.0.1:48146 - "POST /node/69e5b62f213831324628a814 HTTP/1.0" 202 Accepted 2026-04-22 05:14:45,907 - lava_callback - INFO - Starting async job submit for node 69e5b62f213831324628a814 2026-04-22 05:14:45,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:14:45,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b62f213831324628a814 HTTP/1.1" 200 None 2026-04-22 05:14:45,923 - lava_callback - DEBUG - Processing node 69e5b62f213831324628a814: baseline-arm-clabbe 2026-04-22 05:14:45,923 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5b62f213831324628a814 2026-04-22 05:14:45,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:14:45,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b62f213831324628a814 HTTP/1.1" 200 None 2026-04-22 05:14:45,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:14:45,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25cc01863655daa998ba7 HTTP/1.1" 200 None 2026-04-22 05:14:45,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:14:45,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5b62f213831324628a814 HTTP/1.1" 200 None 2026-04-22 05:14:45,971 - lava_callback - ERROR - Error processing callback for node 69e5b62f213831324628a814: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37840 - "GET / HTTP/1.0" 200 OK 2026-04-22 05:15:05,996 - lava_callback - INFO - Received callback for node 69e5b655213831324628a824 INFO: 172.21.0.1:54040 - "POST /node/69e5b655213831324628a824 HTTP/1.0" 202 Accepted 2026-04-22 05:15:06,002 - lava_callback - INFO - Starting async job submit for node 69e5b655213831324628a824 2026-04-22 05:15:06,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:15:06,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b655213831324628a824 HTTP/1.1" 200 None 2026-04-22 05:15:06,021 - lava_callback - DEBUG - Processing node 69e5b655213831324628a824: baseline-arm-clabbe 2026-04-22 05:15:06,022 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5b655213831324628a824 2026-04-22 05:15:06,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:15:06,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b655213831324628a824 HTTP/1.1" 200 None 2026-04-22 05:15:06,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:15:06,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25cc01863655daa998ba7 HTTP/1.1" 200 None 2026-04-22 05:15:06,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:15:06,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5b655213831324628a824 HTTP/1.1" 200 None 2026-04-22 05:15:06,116 - lava_callback - ERROR - Error processing callback for node 69e5b655213831324628a824: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58906 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46096 - "GET / HTTP/1.0" 200 OK 2026-04-22 05:15:45,975 - lava_callback - INFO - Received callback for node 69e5b67a213831324628a835 INFO: 172.21.0.1:54116 - "POST /node/69e5b67a213831324628a835 HTTP/1.0" 202 Accepted 2026-04-22 05:15:45,980 - lava_callback - INFO - Starting async job submit for node 69e5b67a213831324628a835 2026-04-22 05:15:45,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:15:45,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b67a213831324628a835 HTTP/1.1" 200 None 2026-04-22 05:15:45,996 - lava_callback - DEBUG - Processing node 69e5b67a213831324628a835: baseline-arm-clabbe 2026-04-22 05:15:45,997 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5b67a213831324628a835 2026-04-22 05:15:45,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:15:46,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b67a213831324628a835 HTTP/1.1" 200 None 2026-04-22 05:15:46,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:15:46,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25cc01863655daa998ba7 HTTP/1.1" 200 None 2026-04-22 05:15:46,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:15:46,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5b67a213831324628a835 HTTP/1.1" 200 None 2026-04-22 05:15:46,057 - lava_callback - ERROR - Error processing callback for node 69e5b67a213831324628a835: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47544 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47556 - "GET / HTTP/1.0" 200 OK 2026-04-22 05:16:26,042 - lava_callback - INFO - Received callback for node 69e5b6a0213831324628a83e INFO: 172.21.0.1:59046 - "POST /node/69e5b6a0213831324628a83e HTTP/1.0" 202 Accepted 2026-04-22 05:16:26,048 - lava_callback - INFO - Starting async job submit for node 69e5b6a0213831324628a83e 2026-04-22 05:16:26,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:16:26,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b6a0213831324628a83e HTTP/1.1" 200 None 2026-04-22 05:16:26,064 - lava_callback - DEBUG - Processing node 69e5b6a0213831324628a83e: baseline-arm-clabbe 2026-04-22 05:16:26,065 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5b6a0213831324628a83e 2026-04-22 05:16:26,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:16:26,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b6a0213831324628a83e HTTP/1.1" 200 None 2026-04-22 05:16:26,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:16:26,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25cc01863655daa998ba7 HTTP/1.1" 200 None 2026-04-22 05:16:26,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:16:26,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5b6a0213831324628a83e HTTP/1.1" 200 None 2026-04-22 05:16:26,120 - lava_callback - ERROR - Error processing callback for node 69e5b6a0213831324628a83e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38940 - "GET / HTTP/1.0" 200 OK 2026-04-22 05:17:06,030 - lava_callback - INFO - Received callback for node 69e5b6c5213831324628a84e INFO: 172.21.0.1:51422 - "POST /node/69e5b6c5213831324628a84e HTTP/1.0" 202 Accepted 2026-04-22 05:17:06,035 - lava_callback - INFO - Starting async job submit for node 69e5b6c5213831324628a84e 2026-04-22 05:17:06,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:17:06,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b6c5213831324628a84e HTTP/1.1" 200 None 2026-04-22 05:17:06,052 - lava_callback - DEBUG - Processing node 69e5b6c5213831324628a84e: baseline-arm-clabbe 2026-04-22 05:17:06,052 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5b6c5213831324628a84e 2026-04-22 05:17:06,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:17:06,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b6c5213831324628a84e HTTP/1.1" 200 None 2026-04-22 05:17:06,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:17:06,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25cc01863655daa998ba7 HTTP/1.1" 200 None 2026-04-22 05:17:06,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:17:06,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5b6c5213831324628a84e HTTP/1.1" 200 None 2026-04-22 05:17:06,109 - lava_callback - ERROR - Error processing callback for node 69e5b6c5213831324628a84e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42848 - "GET / HTTP/1.0" 200 OK 2026-04-22 05:17:46,090 - lava_callback - INFO - Received callback for node 69e5b6ea213831324628a85d INFO: 172.21.0.1:37126 - "POST /node/69e5b6ea213831324628a85d HTTP/1.0" 202 Accepted 2026-04-22 05:17:46,096 - lava_callback - INFO - Starting async job submit for node 69e5b6ea213831324628a85d 2026-04-22 05:17:46,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:17:46,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b6ea213831324628a85d HTTP/1.1" 200 None 2026-04-22 05:17:46,119 - lava_callback - DEBUG - Processing node 69e5b6ea213831324628a85d: baseline-arm-clabbe 2026-04-22 05:17:46,119 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5b6ea213831324628a85d 2026-04-22 05:17:46,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:17:46,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b6ea213831324628a85d HTTP/1.1" 200 None 2026-04-22 05:17:46,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:17:46,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25cc01863655daa998ba7 HTTP/1.1" 200 None 2026-04-22 05:17:46,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:17:46,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5b6ea213831324628a85d HTTP/1.1" 200 None 2026-04-22 05:17:46,170 - lava_callback - ERROR - Error processing callback for node 69e5b6ea213831324628a85d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57298 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57312 - "GET / HTTP/1.0" 200 OK 2026-04-22 05:18:26,090 - lava_callback - INFO - Received callback for node 69e5b70f213831324628a86b INFO: 172.21.0.1:41220 - "POST /node/69e5b70f213831324628a86b HTTP/1.0" 202 Accepted 2026-04-22 05:18:26,095 - lava_callback - INFO - Starting async job submit for node 69e5b70f213831324628a86b 2026-04-22 05:18:26,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:18:26,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b70f213831324628a86b HTTP/1.1" 200 None 2026-04-22 05:18:26,111 - lava_callback - DEBUG - Processing node 69e5b70f213831324628a86b: baseline-arm-clabbe 2026-04-22 05:18:26,111 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5b70f213831324628a86b 2026-04-22 05:18:26,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:18:26,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b70f213831324628a86b HTTP/1.1" 200 None 2026-04-22 05:18:26,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:18:26,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25cc01863655daa998ba7 HTTP/1.1" 200 None 2026-04-22 05:18:26,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:18:26,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5b70f213831324628a86b HTTP/1.1" 200 None 2026-04-22 05:18:26,159 - lava_callback - ERROR - Error processing callback for node 69e5b70f213831324628a86b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45966 - "GET / HTTP/1.0" 200 OK 2026-04-22 05:19:06,130 - lava_callback - INFO - Received callback for node 69e5b734213831324628a87d INFO: 172.21.0.1:45504 - "POST /node/69e5b734213831324628a87d HTTP/1.0" 202 Accepted 2026-04-22 05:19:06,135 - lava_callback - INFO - Starting async job submit for node 69e5b734213831324628a87d 2026-04-22 05:19:06,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:19:06,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b734213831324628a87d HTTP/1.1" 200 None 2026-04-22 05:19:06,151 - lava_callback - DEBUG - Processing node 69e5b734213831324628a87d: baseline-arm-clabbe 2026-04-22 05:19:06,151 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5b734213831324628a87d 2026-04-22 05:19:06,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:19:06,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b734213831324628a87d HTTP/1.1" 200 None 2026-04-22 05:19:06,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:19:06,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25cc01863655daa998ba7 HTTP/1.1" 200 None 2026-04-22 05:19:06,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:19:06,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5b734213831324628a87d HTTP/1.1" 200 None 2026-04-22 05:19:06,200 - lava_callback - ERROR - Error processing callback for node 69e5b734213831324628a87d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40824 - "GET / HTTP/1.0" 200 OK 2026-04-22 05:19:26,136 - lava_callback - INFO - Received callback for node 69e5b75a213831324628a888 INFO: 172.21.0.1:54596 - "POST /node/69e5b75a213831324628a888 HTTP/1.0" 202 Accepted 2026-04-22 05:19:26,142 - lava_callback - INFO - Starting async job submit for node 69e5b75a213831324628a888 2026-04-22 05:19:26,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:19:26,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b75a213831324628a888 HTTP/1.1" 200 None 2026-04-22 05:19:26,157 - lava_callback - DEBUG - Processing node 69e5b75a213831324628a888: baseline-arm-clabbe 2026-04-22 05:19:26,157 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5b75a213831324628a888 2026-04-22 05:19:26,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:19:26,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b75a213831324628a888 HTTP/1.1" 200 None 2026-04-22 05:19:26,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:19:26,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25cc01863655daa998ba7 HTTP/1.1" 200 None 2026-04-22 05:19:26,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:19:26,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5b75a213831324628a888 HTTP/1.1" 200 None 2026-04-22 05:19:26,205 - lava_callback - ERROR - Error processing callback for node 69e5b75a213831324628a888: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52358 - "GET / HTTP/1.0" 200 OK 2026-04-22 05:20:06,283 - lava_callback - INFO - Received callback for node 69e5b77f213831324628a898 INFO: 172.21.0.1:58842 - "POST /node/69e5b77f213831324628a898 HTTP/1.0" 202 Accepted 2026-04-22 05:20:06,288 - lava_callback - INFO - Starting async job submit for node 69e5b77f213831324628a898 2026-04-22 05:20:06,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:20:06,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b77f213831324628a898 HTTP/1.1" 200 None 2026-04-22 05:20:06,304 - lava_callback - DEBUG - Processing node 69e5b77f213831324628a898: baseline-arm-clabbe 2026-04-22 05:20:06,304 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5b77f213831324628a898 2026-04-22 05:20:06,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:20:06,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b77f213831324628a898 HTTP/1.1" 200 None 2026-04-22 05:20:06,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:20:06,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25cc01863655daa998ba7 HTTP/1.1" 200 None 2026-04-22 05:20:06,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:20:06,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5b77f213831324628a898 HTTP/1.1" 200 None 2026-04-22 05:20:06,356 - lava_callback - ERROR - Error processing callback for node 69e5b77f213831324628a898: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33420 - "GET / HTTP/1.0" 200 OK 2026-04-22 05:20:46,186 - lava_callback - INFO - Received callback for node 69e5b7a5213831324628a8a5 INFO: 172.21.0.1:37872 - "POST /node/69e5b7a5213831324628a8a5 HTTP/1.0" 202 Accepted 2026-04-22 05:20:46,191 - lava_callback - INFO - Starting async job submit for node 69e5b7a5213831324628a8a5 2026-04-22 05:20:46,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:20:46,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b7a5213831324628a8a5 HTTP/1.1" 200 None 2026-04-22 05:20:46,207 - lava_callback - DEBUG - Processing node 69e5b7a5213831324628a8a5: baseline-arm-clabbe 2026-04-22 05:20:46,207 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5b7a5213831324628a8a5 2026-04-22 05:20:46,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:20:46,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b7a5213831324628a8a5 HTTP/1.1" 200 None 2026-04-22 05:20:46,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:20:46,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25cc01863655daa998ba7 HTTP/1.1" 200 None 2026-04-22 05:20:46,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:20:46,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5b7a5213831324628a8a5 HTTP/1.1" 200 None 2026-04-22 05:20:46,255 - lava_callback - ERROR - Error processing callback for node 69e5b7a5213831324628a8a5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56990 - "GET / HTTP/1.0" 200 OK 2026-04-22 05:21:49,041 - lava_callback - INFO - Received callback for node 69e854e4afb86e738cad1543 INFO: 172.21.0.1:57004 - "POST /node/69e854e4afb86e738cad1543 HTTP/1.0" 202 Accepted 2026-04-22 05:21:49,048 - lava_callback - INFO - Starting async job submit for node 69e854e4afb86e738cad1543 2026-04-22 05:21:49,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:21:49,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e854e4afb86e738cad1543 HTTP/1.1" 200 None 2026-04-22 05:21:49,088 - lava_callback - DEBUG - Processing node 69e854e4afb86e738cad1543: baseline-arm64 2026-04-22 05:21:49,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 05:21:49,776 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 05:21:49,778 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e854e4afb86e738cad1543/log.txt.gz 2026-04-22 05:21:50,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 05:21:50,200 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 05:21:50,203 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e854e4afb86e738cad1543/lava-logs.yaml 2026-04-22 05:21:50,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 05:21:50,327 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 05:21:50,329 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e854e4afb86e738cad1543/lava_callback.json.gz 2026-04-22 05:21:50,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:21:50,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e854e4afb86e738cad1543 HTTP/1.1" 200 None 2026-04-22 05:21:50,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:21:50,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 05:21:50,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:21:50,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e854e4afb86e738cad1543 HTTP/1.1" 200 None 2026-04-22 05:21:50,450 - lava_callback - INFO - Completed processing callback for node 69e854e4afb86e738cad1543 2026-04-22 05:21:53,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:21:53,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40076 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41806 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48302 - "GET / HTTP/1.0" 200 OK 2026-04-22 05:27:38,744 - lava_callback - INFO - Received callback for node 69e5b942213831324628a940 INFO: 172.21.0.1:48318 - "POST /node/69e5b942213831324628a940 HTTP/1.0" 202 Accepted 2026-04-22 05:27:38,750 - lava_callback - INFO - Starting async job submit for node 69e5b942213831324628a940 2026-04-22 05:27:38,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:27:38,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b942213831324628a940 HTTP/1.1" 200 None 2026-04-22 05:27:38,766 - lava_callback - DEBUG - Processing node 69e5b942213831324628a940: baseline-arm64-baylibre 2026-04-22 05:27:38,766 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5b942213831324628a940 2026-04-22 05:27:38,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:27:38,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b942213831324628a940 HTTP/1.1" 200 None 2026-04-22 05:27:38,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:27:38,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e500629a34686dd62e8a12 HTTP/1.1" 200 None 2026-04-22 05:27:38,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:27:38,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5b942213831324628a940 HTTP/1.1" 200 None 2026-04-22 05:27:38,813 - lava_callback - ERROR - Error processing callback for node 69e5b942213831324628a940: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35524 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60262 - "GET / HTTP/1.0" 200 OK 2026-04-22 05:28:58,746 - lava_callback - INFO - Received callback for node 69e5b98f213831324628a963 INFO: 172.21.0.1:60270 - "POST /node/69e5b98f213831324628a963 HTTP/1.0" 202 Accepted 2026-04-22 05:28:58,753 - lava_callback - INFO - Starting async job submit for node 69e5b98f213831324628a963 2026-04-22 05:28:58,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:28:58,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b98f213831324628a963 HTTP/1.1" 200 None 2026-04-22 05:28:58,779 - lava_callback - DEBUG - Processing node 69e5b98f213831324628a963: baseline-arm64-baylibre 2026-04-22 05:28:58,779 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5b98f213831324628a963 2026-04-22 05:28:58,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:28:58,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b98f213831324628a963 HTTP/1.1" 200 None 2026-04-22 05:28:58,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:28:58,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e500629a34686dd62e8a12 HTTP/1.1" 200 None 2026-04-22 05:28:58,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:28:58,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5b98f213831324628a963 HTTP/1.1" 200 None 2026-04-22 05:28:58,857 - lava_callback - ERROR - Error processing callback for node 69e5b98f213831324628a963: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60834 - "GET / HTTP/1.0" 200 OK 2026-04-22 05:30:18,808 - lava_callback - INFO - Received callback for node 69e5b9db213831324628a97d INFO: 172.21.0.1:60836 - "POST /node/69e5b9db213831324628a97d HTTP/1.0" 202 Accepted 2026-04-22 05:30:18,814 - lava_callback - INFO - Starting async job submit for node 69e5b9db213831324628a97d 2026-04-22 05:30:18,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:30:18,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b9db213831324628a97d HTTP/1.1" 200 None 2026-04-22 05:30:18,832 - lava_callback - DEBUG - Processing node 69e5b9db213831324628a97d: baseline-arm64-baylibre 2026-04-22 05:30:18,833 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5b9db213831324628a97d 2026-04-22 05:30:18,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:30:18,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5b9db213831324628a97d HTTP/1.1" 200 None 2026-04-22 05:30:18,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:30:18,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e500629a34686dd62e8a12 HTTP/1.1" 200 None 2026-04-22 05:30:18,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:30:18,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5b9db213831324628a97d HTTP/1.1" 200 None 2026-04-22 05:30:18,879 - lava_callback - ERROR - Error processing callback for node 69e5b9db213831324628a97d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55672 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44320 - "GET / HTTP/1.0" 200 OK 2026-04-22 05:31:39,263 - lava_callback - INFO - Received callback for node 69e5ba28213831324628a99f INFO: 172.21.0.1:44332 - "POST /node/69e5ba28213831324628a99f HTTP/1.0" 202 Accepted 2026-04-22 05:31:39,270 - lava_callback - INFO - Starting async job submit for node 69e5ba28213831324628a99f 2026-04-22 05:31:39,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:31:39,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5ba28213831324628a99f HTTP/1.1" 200 None 2026-04-22 05:31:39,286 - lava_callback - DEBUG - Processing node 69e5ba28213831324628a99f: baseline-arm64-baylibre 2026-04-22 05:31:39,286 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5ba28213831324628a99f 2026-04-22 05:31:39,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:31:39,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5ba28213831324628a99f HTTP/1.1" 200 None 2026-04-22 05:31:39,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:31:39,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e500629a34686dd62e8a12 HTTP/1.1" 200 None 2026-04-22 05:31:39,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:31:39,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5ba28213831324628a99f HTTP/1.1" 200 None 2026-04-22 05:31:39,342 - lava_callback - ERROR - Error processing callback for node 69e5ba28213831324628a99f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44724 - "GET / HTTP/1.0" 200 OK 2026-04-22 05:32:38,925 - lava_callback - INFO - Received callback for node 69e5ba74213831324628a9c0 INFO: 172.21.0.1:44732 - "POST /node/69e5ba74213831324628a9c0 HTTP/1.0" 202 Accepted 2026-04-22 05:32:38,931 - lava_callback - INFO - Starting async job submit for node 69e5ba74213831324628a9c0 2026-04-22 05:32:38,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:32:38,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5ba74213831324628a9c0 HTTP/1.1" 200 None 2026-04-22 05:32:38,948 - lava_callback - DEBUG - Processing node 69e5ba74213831324628a9c0: baseline-arm64-baylibre 2026-04-22 05:32:38,948 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5ba74213831324628a9c0 2026-04-22 05:32:38,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:32:38,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5ba74213831324628a9c0 HTTP/1.1" 200 None 2026-04-22 05:32:38,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:32:38,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e500629a34686dd62e8a12 HTTP/1.1" 200 None 2026-04-22 05:32:38,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:32:38,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5ba74213831324628a9c0 HTTP/1.1" 200 None 2026-04-22 05:32:39,001 - lava_callback - ERROR - Error processing callback for node 69e5ba74213831324628a9c0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54364 - "GET / HTTP/1.0" 200 OK 2026-04-22 05:33:59,030 - lava_callback - INFO - Received callback for node 69e5bac1213831324628a9e2 INFO: 172.21.0.1:54368 - "POST /node/69e5bac1213831324628a9e2 HTTP/1.0" 202 Accepted 2026-04-22 05:33:59,036 - lava_callback - INFO - Starting async job submit for node 69e5bac1213831324628a9e2 2026-04-22 05:33:59,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:33:59,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5bac1213831324628a9e2 HTTP/1.1" 200 None 2026-04-22 05:33:59,051 - lava_callback - DEBUG - Processing node 69e5bac1213831324628a9e2: baseline-arm64-baylibre 2026-04-22 05:33:59,051 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5bac1213831324628a9e2 2026-04-22 05:33:59,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:33:59,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5bac1213831324628a9e2 HTTP/1.1" 200 None 2026-04-22 05:33:59,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:33:59,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e500629a34686dd62e8a12 HTTP/1.1" 200 None 2026-04-22 05:33:59,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:33:59,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5bac1213831324628a9e2 HTTP/1.1" 200 None 2026-04-22 05:33:59,126 - lava_callback - ERROR - Error processing callback for node 69e5bac1213831324628a9e2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53392 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44488 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35272 - "GET / HTTP/1.0" 200 OK 2026-04-22 05:35:26,912 - lava_callback - INFO - Received callback for node 69e5bb13213831324628aa08 INFO: 172.21.0.1:35286 - "POST /node/69e5bb13213831324628aa08 HTTP/1.0" 202 Accepted 2026-04-22 05:35:26,917 - lava_callback - INFO - Starting async job submit for node 69e5bb13213831324628aa08 2026-04-22 05:35:26,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:35:26,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5bb13213831324628aa08 HTTP/1.1" 200 None 2026-04-22 05:35:26,933 - lava_callback - DEBUG - Processing node 69e5bb13213831324628aa08: baseline-arm64-clabbe 2026-04-22 05:35:26,933 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5bb13213831324628aa08 2026-04-22 05:35:26,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:35:26,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5bb13213831324628aa08 HTTP/1.1" 200 None 2026-04-22 05:35:26,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:35:26,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e500629a34686dd62e8a12 HTTP/1.1" 200 None 2026-04-22 05:35:26,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:35:26,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5bb13213831324628aa08 HTTP/1.1" 200 None 2026-04-22 05:35:26,980 - lava_callback - ERROR - Error processing callback for node 69e5bb13213831324628aa08: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38882 - "GET / HTTP/1.0" 200 OK 2026-04-22 05:36:27,313 - lava_callback - INFO - Received callback for node 69e85bd8afb86e738cad18ae INFO: 172.21.0.1:38896 - "POST /node/69e85bd8afb86e738cad18ae HTTP/1.0" 202 Accepted 2026-04-22 05:36:27,320 - lava_callback - INFO - Starting async job submit for node 69e85bd8afb86e738cad18ae 2026-04-22 05:36:27,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:36:27,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e85bd8afb86e738cad18ae HTTP/1.1" 200 None 2026-04-22 05:36:27,360 - lava_callback - DEBUG - Processing node 69e85bd8afb86e738cad18ae: baseline-arm64 2026-04-22 05:36:27,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 05:36:28,029 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 05:36:28,030 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e85bd8afb86e738cad18ae/log.txt.gz 2026-04-22 05:36:28,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 05:36:28,480 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 05:36:28,482 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e85bd8afb86e738cad18ae/lava-logs.yaml 2026-04-22 05:36:28,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 05:36:28,626 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 05:36:28,627 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e85bd8afb86e738cad18ae/lava_callback.json.gz 2026-04-22 05:36:28,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:36:28,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e85bd8afb86e738cad18ae HTTP/1.1" 200 None 2026-04-22 05:36:28,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:36:28,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 05:36:28,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:36:28,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e85bd8afb86e738cad18ae HTTP/1.1" 200 None 2026-04-22 05:36:28,756 - lava_callback - INFO - Completed processing callback for node 69e85bd8afb86e738cad18ae INFO: 172.21.0.1:54814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57948 - "GET / HTTP/1.0" 200 OK 2026-04-22 05:36:46,937 - lava_callback - INFO - Received callback for node 69e5bb61213831324628aa20 INFO: 172.21.0.1:57962 - "POST /node/69e5bb61213831324628aa20 HTTP/1.0" 202 Accepted 2026-04-22 05:36:46,942 - lava_callback - INFO - Starting async job submit for node 69e5bb61213831324628aa20 2026-04-22 05:36:46,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:36:46,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5bb61213831324628aa20 HTTP/1.1" 200 None 2026-04-22 05:36:46,958 - lava_callback - DEBUG - Processing node 69e5bb61213831324628aa20: baseline-arm64-clabbe 2026-04-22 05:36:46,958 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5bb61213831324628aa20 2026-04-22 05:36:46,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:36:46,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5bb61213831324628aa20 HTTP/1.1" 200 None 2026-04-22 05:36:46,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:36:46,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e500629a34686dd62e8a12 HTTP/1.1" 200 None 2026-04-22 05:36:46,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:36:47,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5bb61213831324628aa20 HTTP/1.1" 200 None 2026-04-22 05:36:47,006 - lava_callback - ERROR - Error processing callback for node 69e5bb61213831324628aa20: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-22 05:36:53,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:36:53,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48014 - "GET / HTTP/1.0" 200 OK 2026-04-22 05:38:06,987 - lava_callback - INFO - Received callback for node 69e5bbaf213831324628aa40 INFO: 172.21.0.1:48018 - "POST /node/69e5bbaf213831324628aa40 HTTP/1.0" 202 Accepted 2026-04-22 05:38:06,992 - lava_callback - INFO - Starting async job submit for node 69e5bbaf213831324628aa40 2026-04-22 05:38:06,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:38:07,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5bbaf213831324628aa40 HTTP/1.1" 200 None 2026-04-22 05:38:07,010 - lava_callback - DEBUG - Processing node 69e5bbaf213831324628aa40: baseline-arm64-clabbe 2026-04-22 05:38:07,010 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5bbaf213831324628aa40 2026-04-22 05:38:07,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:38:07,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5bbaf213831324628aa40 HTTP/1.1" 200 None 2026-04-22 05:38:07,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:38:07,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e500629a34686dd62e8a12 HTTP/1.1" 200 None 2026-04-22 05:38:07,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:38:07,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5bbaf213831324628aa40 HTTP/1.1" 200 None 2026-04-22 05:38:07,056 - lava_callback - ERROR - Error processing callback for node 69e5bbaf213831324628aa40: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53136 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46078 - "GET / HTTP/1.0" 200 OK 2026-04-22 05:39:27,070 - lava_callback - INFO - Received callback for node 69e5bbfc213831324628aa5a INFO: 172.21.0.1:46086 - "POST /node/69e5bbfc213831324628aa5a HTTP/1.0" 202 Accepted 2026-04-22 05:39:27,076 - lava_callback - INFO - Starting async job submit for node 69e5bbfc213831324628aa5a 2026-04-22 05:39:27,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:39:27,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5bbfc213831324628aa5a HTTP/1.1" 200 None 2026-04-22 05:39:27,093 - lava_callback - DEBUG - Processing node 69e5bbfc213831324628aa5a: baseline-arm64-clabbe 2026-04-22 05:39:27,093 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5bbfc213831324628aa5a 2026-04-22 05:39:27,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:39:27,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5bbfc213831324628aa5a HTTP/1.1" 200 None 2026-04-22 05:39:27,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:39:27,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e500629a34686dd62e8a12 HTTP/1.1" 200 None 2026-04-22 05:39:27,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:39:27,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5bbfc213831324628aa5a HTTP/1.1" 200 None 2026-04-22 05:39:27,141 - lava_callback - ERROR - Error processing callback for node 69e5bbfc213831324628aa5a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35660 - "GET / HTTP/1.0" 200 OK 2026-04-22 05:40:47,093 - lava_callback - INFO - Received callback for node 69e5bc4a213831324628aa79 INFO: 172.21.0.1:35666 - "POST /node/69e5bc4a213831324628aa79 HTTP/1.0" 202 Accepted 2026-04-22 05:40:47,102 - lava_callback - INFO - Starting async job submit for node 69e5bc4a213831324628aa79 2026-04-22 05:40:47,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:40:47,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5bc4a213831324628aa79 HTTP/1.1" 200 None 2026-04-22 05:40:47,119 - lava_callback - DEBUG - Processing node 69e5bc4a213831324628aa79: baseline-arm64-clabbe 2026-04-22 05:40:47,119 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5bc4a213831324628aa79 2026-04-22 05:40:47,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:40:47,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5bc4a213831324628aa79 HTTP/1.1" 200 None 2026-04-22 05:40:47,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:40:47,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e500629a34686dd62e8a12 HTTP/1.1" 200 None 2026-04-22 05:40:47,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:40:47,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5bc4a213831324628aa79 HTTP/1.1" 200 None 2026-04-22 05:40:47,186 - lava_callback - ERROR - Error processing callback for node 69e5bc4a213831324628aa79: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51264 - "GET / HTTP/1.0" 200 OK 2026-04-22 05:41:47,150 - lava_callback - INFO - Received callback for node 69e5bc97213831324628aa9c INFO: 172.21.0.1:51278 - "POST /node/69e5bc97213831324628aa9c HTTP/1.0" 202 Accepted 2026-04-22 05:41:47,155 - lava_callback - INFO - Starting async job submit for node 69e5bc97213831324628aa9c 2026-04-22 05:41:47,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:41:47,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5bc97213831324628aa9c HTTP/1.1" 200 None 2026-04-22 05:41:47,171 - lava_callback - DEBUG - Processing node 69e5bc97213831324628aa9c: baseline-arm64-clabbe 2026-04-22 05:41:47,171 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5bc97213831324628aa9c 2026-04-22 05:41:47,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:41:47,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5bc97213831324628aa9c HTTP/1.1" 200 None 2026-04-22 05:41:47,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:41:47,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e500629a34686dd62e8a12 HTTP/1.1" 200 None 2026-04-22 05:41:47,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:41:47,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5bc97213831324628aa9c HTTP/1.1" 200 None 2026-04-22 05:41:47,218 - lava_callback - ERROR - Error processing callback for node 69e5bc97213831324628aa9c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40872 - "GET / HTTP/1.0" 200 OK 2026-04-22 05:43:07,208 - lava_callback - INFO - Received callback for node 69e5bce8213831324628aab2 INFO: 172.21.0.1:40888 - "POST /node/69e5bce8213831324628aab2 HTTP/1.0" 202 Accepted 2026-04-22 05:43:07,214 - lava_callback - INFO - Starting async job submit for node 69e5bce8213831324628aab2 2026-04-22 05:43:07,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:43:07,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5bce8213831324628aab2 HTTP/1.1" 200 None 2026-04-22 05:43:07,231 - lava_callback - DEBUG - Processing node 69e5bce8213831324628aab2: baseline-arm64-clabbe 2026-04-22 05:43:07,231 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5bce8213831324628aab2 2026-04-22 05:43:07,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:43:07,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5bce8213831324628aab2 HTTP/1.1" 200 None 2026-04-22 05:43:07,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:43:07,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e500629a34686dd62e8a12 HTTP/1.1" 200 None 2026-04-22 05:43:07,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 05:43:07,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5bce8213831324628aab2 HTTP/1.1" 200 None 2026-04-22 05:43:07,288 - lava_callback - ERROR - Error processing callback for node 69e5bce8213831324628aab2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46536 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48116 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51646 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56086 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56250 - "GET / HTTP/1.0" 200 OK 2026-04-22 06:00:47,643 - lava_callback - INFO - Received callback for node 69e86195afb86e738cad1c8a INFO: 172.21.0.1:56264 - "POST /node/69e86195afb86e738cad1c8a HTTP/1.0" 202 Accepted 2026-04-22 06:00:47,650 - lava_callback - INFO - Starting async job submit for node 69e86195afb86e738cad1c8a 2026-04-22 06:00:47,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:00:47,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e86195afb86e738cad1c8a HTTP/1.1" 200 None 2026-04-22 06:00:47,692 - lava_callback - DEBUG - Processing node 69e86195afb86e738cad1c8a: baseline-arm64 2026-04-22 06:00:48,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 06:00:48,354 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 06:00:48,356 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69e86195afb86e738cad1c8a/log.txt.gz 2026-04-22 06:00:48,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 06:00:48,819 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 06:00:48,822 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69e86195afb86e738cad1c8a/lava-logs.yaml 2026-04-22 06:00:48,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 06:00:48,987 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 06:00:48,989 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69e86195afb86e738cad1c8a/lava_callback.json.gz 2026-04-22 06:00:49,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:00:49,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e86195afb86e738cad1c8a HTTP/1.1" 200 None 2026-04-22 06:00:49,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:00:49,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 06:00:49,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:00:49,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e86195afb86e738cad1c8a HTTP/1.1" 200 None 2026-04-22 06:00:49,126 - lava_callback - INFO - Completed processing callback for node 69e86195afb86e738cad1c8a 2026-04-22 06:00:53,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:00:53,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41524 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49020 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54360 - "GET / HTTP/1.0" 200 OK 2026-04-22 06:16:01,263 - lava_callback - INFO - Received callback for node 69e5c48d213831324628aad9 INFO: 172.21.0.1:58100 - "POST /node/69e5c48d213831324628aad9 HTTP/1.0" 202 Accepted 2026-04-22 06:16:01,269 - lava_callback - INFO - Starting async job submit for node 69e5c48d213831324628aad9 2026-04-22 06:16:01,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:16:01,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5c48d213831324628aad9 HTTP/1.1" 200 None 2026-04-22 06:16:01,285 - lava_callback - DEBUG - Processing node 69e5c48d213831324628aad9: baseline-arm64-baylibre 2026-04-22 06:16:01,285 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5c48d213831324628aad9 2026-04-22 06:16:01,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:16:01,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5c48d213831324628aad9 HTTP/1.1" 200 None 2026-04-22 06:16:01,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:16:01,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25ccc1863655daa998bbc HTTP/1.1" 200 None 2026-04-22 06:16:01,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:16:01,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5c48d213831324628aad9 HTTP/1.1" 200 None 2026-04-22 06:16:01,332 - lava_callback - ERROR - Error processing callback for node 69e5c48d213831324628aad9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51244 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38614 - "GET / HTTP/1.0" 200 OK 2026-04-22 06:18:01,554 - lava_callback - INFO - Received callback for node 69e5c506213831324628aaf9 INFO: 172.21.0.1:51612 - "POST /node/69e5c506213831324628aaf9 HTTP/1.0" 202 Accepted 2026-04-22 06:18:01,562 - lava_callback - INFO - Starting async job submit for node 69e5c506213831324628aaf9 2026-04-22 06:18:01,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:18:01,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5c506213831324628aaf9 HTTP/1.1" 200 None 2026-04-22 06:18:01,580 - lava_callback - DEBUG - Processing node 69e5c506213831324628aaf9: baseline-arm64-baylibre 2026-04-22 06:18:01,580 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5c506213831324628aaf9 2026-04-22 06:18:01,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:18:01,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5c506213831324628aaf9 HTTP/1.1" 200 None 2026-04-22 06:18:01,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:18:01,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25ccc1863655daa998bbc HTTP/1.1" 200 None 2026-04-22 06:18:01,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:18:01,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5c506213831324628aaf9 HTTP/1.1" 200 None 2026-04-22 06:18:01,628 - lava_callback - ERROR - Error processing callback for node 69e5c506213831324628aaf9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42908 - "GET / HTTP/1.0" 200 OK 2026-04-22 06:19:01,460 - lava_callback - INFO - Received callback for node 69e5c553213831324628ab1d INFO: 172.21.0.1:47018 - "POST /node/69e5c553213831324628ab1d HTTP/1.0" 202 Accepted 2026-04-22 06:19:01,466 - lava_callback - INFO - Starting async job submit for node 69e5c553213831324628ab1d 2026-04-22 06:19:01,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:19:01,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5c553213831324628ab1d HTTP/1.1" 200 None 2026-04-22 06:19:01,488 - lava_callback - DEBUG - Processing node 69e5c553213831324628ab1d: baseline-arm64-baylibre 2026-04-22 06:19:01,488 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5c553213831324628ab1d 2026-04-22 06:19:01,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:19:01,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5c553213831324628ab1d HTTP/1.1" 200 None 2026-04-22 06:19:01,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:19:01,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25ccc1863655daa998bbc HTTP/1.1" 200 None 2026-04-22 06:19:01,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:19:01,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5c553213831324628ab1d HTTP/1.1" 200 None 2026-04-22 06:19:01,562 - lava_callback - ERROR - Error processing callback for node 69e5c553213831324628ab1d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34318 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34322 - "GET / HTTP/1.0" 200 OK 2026-04-22 06:20:21,584 - lava_callback - INFO - Received callback for node 69e5c5a2213831324628ab3f INFO: 172.21.0.1:33934 - "POST /node/69e5c5a2213831324628ab3f HTTP/1.0" 202 Accepted 2026-04-22 06:20:21,590 - lava_callback - INFO - Starting async job submit for node 69e5c5a2213831324628ab3f 2026-04-22 06:20:21,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:20:21,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5c5a2213831324628ab3f HTTP/1.1" 200 None 2026-04-22 06:20:21,605 - lava_callback - DEBUG - Processing node 69e5c5a2213831324628ab3f: baseline-arm64-baylibre 2026-04-22 06:20:21,605 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5c5a2213831324628ab3f 2026-04-22 06:20:21,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:20:21,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5c5a2213831324628ab3f HTTP/1.1" 200 None 2026-04-22 06:20:21,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:20:21,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25ccc1863655daa998bbc HTTP/1.1" 200 None 2026-04-22 06:20:21,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:20:21,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5c5a2213831324628ab3f HTTP/1.1" 200 None 2026-04-22 06:20:21,704 - lava_callback - ERROR - Error processing callback for node 69e5c5a2213831324628ab3f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33780 - "GET / HTTP/1.0" 200 OK 2026-04-22 06:22:01,843 - lava_callback - INFO - Received callback for node 69e5c5f8213831324628ab60 INFO: 172.21.0.1:51324 - "POST /node/69e5c5f8213831324628ab60 HTTP/1.0" 202 Accepted 2026-04-22 06:22:01,848 - lava_callback - INFO - Starting async job submit for node 69e5c5f8213831324628ab60 2026-04-22 06:22:01,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:22:01,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5c5f8213831324628ab60 HTTP/1.1" 200 None 2026-04-22 06:22:01,865 - lava_callback - DEBUG - Processing node 69e5c5f8213831324628ab60: baseline-arm64-baylibre 2026-04-22 06:22:01,865 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5c5f8213831324628ab60 2026-04-22 06:22:01,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:22:01,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5c5f8213831324628ab60 HTTP/1.1" 200 None 2026-04-22 06:22:01,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:22:01,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25ccc1863655daa998bbc HTTP/1.1" 200 None 2026-04-22 06:22:01,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:22:01,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5c5f8213831324628ab60 HTTP/1.1" 200 None 2026-04-22 06:22:01,930 - lava_callback - ERROR - Error processing callback for node 69e5c5f8213831324628ab60: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35006 - "GET / HTTP/1.0" 200 OK 2026-04-22 06:23:21,707 - lava_callback - INFO - Received callback for node 69e5c645213831324628ab7d INFO: 172.21.0.1:37258 - "POST /node/69e5c645213831324628ab7d HTTP/1.0" 202 Accepted 2026-04-22 06:23:21,713 - lava_callback - INFO - Starting async job submit for node 69e5c645213831324628ab7d 2026-04-22 06:23:21,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:23:21,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5c645213831324628ab7d HTTP/1.1" 200 None 2026-04-22 06:23:21,729 - lava_callback - DEBUG - Processing node 69e5c645213831324628ab7d: baseline-arm64-baylibre 2026-04-22 06:23:21,729 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5c645213831324628ab7d 2026-04-22 06:23:21,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:23:21,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5c645213831324628ab7d HTTP/1.1" 200 None 2026-04-22 06:23:21,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:23:21,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25ccc1863655daa998bbc HTTP/1.1" 200 None 2026-04-22 06:23:21,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:23:21,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5c645213831324628ab7d HTTP/1.1" 200 None 2026-04-22 06:23:21,785 - lava_callback - ERROR - Error processing callback for node 69e5c645213831324628ab7d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44800 - "GET / HTTP/1.0" 200 OK 2026-04-22 06:24:29,078 - lava_callback - INFO - Received callback for node 69e5c696213831324628ab9f INFO: 172.21.0.1:44814 - "POST /node/69e5c696213831324628ab9f HTTP/1.0" 202 Accepted 2026-04-22 06:24:29,084 - lava_callback - INFO - Starting async job submit for node 69e5c696213831324628ab9f 2026-04-22 06:24:29,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:24:29,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5c696213831324628ab9f HTTP/1.1" 200 None 2026-04-22 06:24:29,101 - lava_callback - DEBUG - Processing node 69e5c696213831324628ab9f: baseline-arm64-clabbe 2026-04-22 06:24:29,101 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5c696213831324628ab9f 2026-04-22 06:24:29,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:24:29,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5c696213831324628ab9f HTTP/1.1" 200 None 2026-04-22 06:24:29,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:24:29,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25ccc1863655daa998bbc HTTP/1.1" 200 None 2026-04-22 06:24:29,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:24:29,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5c696213831324628ab9f HTTP/1.1" 200 None 2026-04-22 06:24:29,162 - lava_callback - ERROR - Error processing callback for node 69e5c696213831324628ab9f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46924 - "GET / HTTP/1.0" 200 OK 2026-04-22 06:26:09,139 - lava_callback - INFO - Received callback for node 69e5c6ee213831324628abc0 INFO: 172.21.0.1:46934 - "POST /node/69e5c6ee213831324628abc0 HTTP/1.0" 202 Accepted 2026-04-22 06:26:09,145 - lava_callback - INFO - Starting async job submit for node 69e5c6ee213831324628abc0 2026-04-22 06:26:09,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:26:09,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5c6ee213831324628abc0 HTTP/1.1" 200 None 2026-04-22 06:26:09,162 - lava_callback - DEBUG - Processing node 69e5c6ee213831324628abc0: baseline-arm64-clabbe 2026-04-22 06:26:09,163 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5c6ee213831324628abc0 2026-04-22 06:26:09,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:26:09,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5c6ee213831324628abc0 HTTP/1.1" 200 None 2026-04-22 06:26:09,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:26:09,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25ccc1863655daa998bbc HTTP/1.1" 200 None 2026-04-22 06:26:09,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:26:09,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5c6ee213831324628abc0 HTTP/1.1" 200 None 2026-04-22 06:26:09,211 - lava_callback - ERROR - Error processing callback for node 69e5c6ee213831324628abc0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51692 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55126 - "GET / HTTP/1.0" 200 OK 2026-04-22 06:27:29,166 - lava_callback - INFO - Received callback for node 69e5c73c213831324628abdd INFO: 172.21.0.1:55134 - "POST /node/69e5c73c213831324628abdd HTTP/1.0" 202 Accepted 2026-04-22 06:27:29,172 - lava_callback - INFO - Starting async job submit for node 69e5c73c213831324628abdd 2026-04-22 06:27:29,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:27:29,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5c73c213831324628abdd HTTP/1.1" 200 None 2026-04-22 06:27:29,210 - lava_callback - DEBUG - Processing node 69e5c73c213831324628abdd: baseline-arm64-clabbe 2026-04-22 06:27:29,210 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5c73c213831324628abdd 2026-04-22 06:27:29,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:27:29,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5c73c213831324628abdd HTTP/1.1" 200 None 2026-04-22 06:27:29,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:27:29,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25ccc1863655daa998bbc HTTP/1.1" 200 None 2026-04-22 06:27:29,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:27:29,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5c73c213831324628abdd HTTP/1.1" 200 None 2026-04-22 06:27:29,288 - lava_callback - ERROR - Error processing callback for node 69e5c73c213831324628abdd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50160 - "GET / HTTP/1.0" 200 OK 2026-04-22 06:28:49,252 - lava_callback - INFO - Received callback for node 69e5c78a213831324628abff INFO: 172.21.0.1:50168 - "POST /node/69e5c78a213831324628abff HTTP/1.0" 202 Accepted 2026-04-22 06:28:49,258 - lava_callback - INFO - Starting async job submit for node 69e5c78a213831324628abff 2026-04-22 06:28:49,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:28:49,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5c78a213831324628abff HTTP/1.1" 200 None 2026-04-22 06:28:49,274 - lava_callback - DEBUG - Processing node 69e5c78a213831324628abff: baseline-arm64-clabbe 2026-04-22 06:28:49,274 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5c78a213831324628abff 2026-04-22 06:28:49,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:28:49,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5c78a213831324628abff HTTP/1.1" 200 None 2026-04-22 06:28:49,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:28:49,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25ccc1863655daa998bbc HTTP/1.1" 200 None 2026-04-22 06:28:49,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:28:49,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5c78a213831324628abff HTTP/1.1" 200 None 2026-04-22 06:28:49,327 - lava_callback - ERROR - Error processing callback for node 69e5c78a213831324628abff: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53134 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49970 - "GET / HTTP/1.0" 200 OK 2026-04-22 06:29:49,344 - lava_callback - INFO - Received callback for node 69e5c7d8213831324628ac24 INFO: 172.21.0.1:49976 - "POST /node/69e5c7d8213831324628ac24 HTTP/1.0" 202 Accepted 2026-04-22 06:29:49,349 - lava_callback - INFO - Starting async job submit for node 69e5c7d8213831324628ac24 2026-04-22 06:29:49,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:29:49,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5c7d8213831324628ac24 HTTP/1.1" 200 None 2026-04-22 06:29:49,365 - lava_callback - DEBUG - Processing node 69e5c7d8213831324628ac24: baseline-arm64-clabbe 2026-04-22 06:29:49,365 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5c7d8213831324628ac24 2026-04-22 06:29:49,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:29:49,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5c7d8213831324628ac24 HTTP/1.1" 200 None 2026-04-22 06:29:49,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:29:49,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25ccc1863655daa998bbc HTTP/1.1" 200 None 2026-04-22 06:29:49,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:29:49,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5c7d8213831324628ac24 HTTP/1.1" 200 None 2026-04-22 06:29:49,412 - lava_callback - ERROR - Error processing callback for node 69e5c7d8213831324628ac24: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39248 - "GET / HTTP/1.0" 200 OK 2026-04-22 06:31:09,305 - lava_callback - INFO - Received callback for node 69e5c825213831324628ac3d INFO: 172.21.0.1:39260 - "POST /node/69e5c825213831324628ac3d HTTP/1.0" 202 Accepted 2026-04-22 06:31:09,310 - lava_callback - INFO - Starting async job submit for node 69e5c825213831324628ac3d 2026-04-22 06:31:09,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:31:09,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5c825213831324628ac3d HTTP/1.1" 200 None 2026-04-22 06:31:09,328 - lava_callback - DEBUG - Processing node 69e5c825213831324628ac3d: baseline-arm64-clabbe 2026-04-22 06:31:09,328 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5c825213831324628ac3d 2026-04-22 06:31:09,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:31:09,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5c825213831324628ac3d HTTP/1.1" 200 None 2026-04-22 06:31:09,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:31:09,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25ccc1863655daa998bbc HTTP/1.1" 200 None 2026-04-22 06:31:09,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:31:09,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5c825213831324628ac3d HTTP/1.1" 200 None 2026-04-22 06:31:09,379 - lava_callback - ERROR - Error processing callback for node 69e5c825213831324628ac3d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33634 - "GET / HTTP/1.0" 200 OK 2026-04-22 06:32:30,634 - lava_callback - INFO - Received callback for node 69e5c872213831324628ac61 INFO: 172.21.0.1:49666 - "POST /node/69e5c872213831324628ac61 HTTP/1.0" 202 Accepted 2026-04-22 06:32:30,640 - lava_callback - INFO - Starting async job submit for node 69e5c872213831324628ac61 2026-04-22 06:32:30,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:32:30,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5c872213831324628ac61 HTTP/1.1" 200 None 2026-04-22 06:32:30,655 - lava_callback - DEBUG - Processing node 69e5c872213831324628ac61: baseline-arm64-clabbe 2026-04-22 06:32:30,656 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5c872213831324628ac61 2026-04-22 06:32:30,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:32:30,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5c872213831324628ac61 HTTP/1.1" 200 None 2026-04-22 06:32:30,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:32:30,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e25ccc1863655daa998bbc HTTP/1.1" 200 None 2026-04-22 06:32:30,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:32:30,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5c872213831324628ac61 HTTP/1.1" 200 None 2026-04-22 06:32:30,721 - lava_callback - ERROR - Error processing callback for node 69e5c872213831324628ac61: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49422 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45444 - "GET / HTTP/1.0" 200 OK 2026-04-22 06:37:49,640 - lava_callback - INFO - Received callback for node 69e5c9b2213831324628ac7f INFO: 172.21.0.1:45454 - "POST /node/69e5c9b2213831324628ac7f HTTP/1.0" 202 Accepted 2026-04-22 06:37:49,646 - lava_callback - INFO - Starting async job submit for node 69e5c9b2213831324628ac7f 2026-04-22 06:37:49,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:37:49,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5c9b2213831324628ac7f HTTP/1.1" 200 None 2026-04-22 06:37:49,680 - lava_callback - DEBUG - Processing node 69e5c9b2213831324628ac7f: baseline-arm-clabbe 2026-04-22 06:37:49,680 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5c9b2213831324628ac7f 2026-04-22 06:37:49,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:37:49,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5c9b2213831324628ac7f HTTP/1.1" 200 None 2026-04-22 06:37:49,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:37:49,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-22 06:37:49,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:37:49,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5c9b2213831324628ac7f HTTP/1.1" 200 None 2026-04-22 06:37:49,803 - lava_callback - ERROR - Error processing callback for node 69e5c9b2213831324628ac7f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44684 - "GET / HTTP/1.0" 200 OK 2026-04-22 06:38:29,610 - lava_callback - INFO - Received callback for node 69e5c9d8213831324628ac8f INFO: 172.21.0.1:44700 - "POST /node/69e5c9d8213831324628ac8f HTTP/1.0" 202 Accepted 2026-04-22 06:38:29,615 - lava_callback - INFO - Starting async job submit for node 69e5c9d8213831324628ac8f 2026-04-22 06:38:29,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:38:29,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5c9d8213831324628ac8f HTTP/1.1" 200 None 2026-04-22 06:38:29,631 - lava_callback - DEBUG - Processing node 69e5c9d8213831324628ac8f: baseline-arm-clabbe 2026-04-22 06:38:29,631 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5c9d8213831324628ac8f 2026-04-22 06:38:29,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:38:29,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5c9d8213831324628ac8f HTTP/1.1" 200 None 2026-04-22 06:38:29,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:38:29,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-22 06:38:29,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:38:29,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5c9d8213831324628ac8f HTTP/1.1" 200 None 2026-04-22 06:38:29,725 - lava_callback - ERROR - Error processing callback for node 69e5c9d8213831324628ac8f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45966 - "GET / HTTP/1.0" 200 OK 2026-04-22 06:39:02,571 - lava_callback - INFO - Received callback for node 69e5c9f8213831324628aca0 INFO: 172.21.0.1:50418 - "POST /node/69e5c9f8213831324628aca0 HTTP/1.0" 202 Accepted 2026-04-22 06:39:02,577 - lava_callback - INFO - Starting async job submit for node 69e5c9f8213831324628aca0 2026-04-22 06:39:02,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:39:02,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5c9f8213831324628aca0 HTTP/1.1" 200 None 2026-04-22 06:39:02,614 - lava_callback - DEBUG - Processing node 69e5c9f8213831324628aca0: baseline-arm-baylibre 2026-04-22 06:39:02,615 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5c9f8213831324628aca0 2026-04-22 06:39:02,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:39:02,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5c9f8213831324628aca0 HTTP/1.1" 200 None 2026-04-22 06:39:02,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:39:02,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-22 06:39:02,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:39:02,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5c9f8213831324628aca0 HTTP/1.1" 200 None 2026-04-22 06:39:02,667 - lava_callback - ERROR - Error processing callback for node 69e5c9f8213831324628aca0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35092 - "GET / HTTP/1.0" 200 OK 2026-04-22 06:40:09,917 - lava_callback - INFO - Received callback for node 69e5ca45213831324628acbd INFO: 172.21.0.1:37854 - "POST /node/69e5ca45213831324628acbd HTTP/1.0" 202 Accepted 2026-04-22 06:40:09,923 - lava_callback - INFO - Starting async job submit for node 69e5ca45213831324628acbd 2026-04-22 06:40:09,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:40:09,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5ca45213831324628acbd HTTP/1.1" 200 None 2026-04-22 06:40:09,945 - lava_callback - DEBUG - Processing node 69e5ca45213831324628acbd: baseline-arm-clabbe 2026-04-22 06:40:09,945 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5ca45213831324628acbd 2026-04-22 06:40:09,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:40:09,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5ca45213831324628acbd HTTP/1.1" 200 None 2026-04-22 06:40:09,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:40:09,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-22 06:40:09,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:40:09,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5ca45213831324628acbd HTTP/1.1" 200 None 2026-04-22 06:40:09,993 - lava_callback - ERROR - Error processing callback for node 69e5ca45213831324628acbd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37154 - "GET / HTTP/1.0" 200 OK 2026-04-22 06:40:49,786 - lava_callback - INFO - Received callback for node 69e5ca6a213831324628acd3 INFO: 172.21.0.1:58738 - "POST /node/69e5ca6a213831324628acd3 HTTP/1.0" 202 Accepted 2026-04-22 06:40:49,792 - lava_callback - INFO - Starting async job submit for node 69e5ca6a213831324628acd3 2026-04-22 06:40:49,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:40:49,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5ca6a213831324628acd3 HTTP/1.1" 200 None 2026-04-22 06:40:49,808 - lava_callback - DEBUG - Processing node 69e5ca6a213831324628acd3: baseline-arm-clabbe 2026-04-22 06:40:49,808 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5ca6a213831324628acd3 2026-04-22 06:40:49,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:40:49,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5ca6a213831324628acd3 HTTP/1.1" 200 None 2026-04-22 06:40:49,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:40:49,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-22 06:40:49,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:40:49,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5ca6a213831324628acd3 HTTP/1.1" 200 None 2026-04-22 06:40:49,854 - lava_callback - ERROR - Error processing callback for node 69e5ca6a213831324628acd3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59108 - "GET / HTTP/1.0" 200 OK 2026-04-22 06:41:22,660 - lava_callback - INFO - Received callback for node 69e5ca8a213831324628acde INFO: 172.21.0.1:35842 - "POST /node/69e5ca8a213831324628acde HTTP/1.0" 202 Accepted 2026-04-22 06:41:22,667 - lava_callback - INFO - Starting async job submit for node 69e5ca8a213831324628acde 2026-04-22 06:41:22,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:41:22,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5ca8a213831324628acde HTTP/1.1" 200 None 2026-04-22 06:41:22,694 - lava_callback - DEBUG - Processing node 69e5ca8a213831324628acde: baseline-arm-baylibre 2026-04-22 06:41:22,694 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5ca8a213831324628acde 2026-04-22 06:41:22,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:41:22,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5ca8a213831324628acde HTTP/1.1" 200 None 2026-04-22 06:41:22,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:41:22,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-22 06:41:22,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:41:22,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5ca8a213831324628acde HTTP/1.1" 200 None 2026-04-22 06:41:22,750 - lava_callback - ERROR - Error processing callback for node 69e5ca8a213831324628acde: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39796 - "GET / HTTP/1.0" 200 OK 2026-04-22 06:42:02,621 - lava_callback - INFO - Received callback for node 69e5caae213831324628acf5 INFO: 172.21.0.1:38834 - "POST /node/69e5caae213831324628acf5 HTTP/1.0" 202 Accepted 2026-04-22 06:42:02,626 - lava_callback - INFO - Starting async job submit for node 69e5caae213831324628acf5 2026-04-22 06:42:02,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:42:02,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5caae213831324628acf5 HTTP/1.1" 200 None 2026-04-22 06:42:02,645 - lava_callback - DEBUG - Processing node 69e5caae213831324628acf5: baseline-arm-baylibre 2026-04-22 06:42:02,646 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5caae213831324628acf5 2026-04-22 06:42:02,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:42:02,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5caae213831324628acf5 HTTP/1.1" 200 None 2026-04-22 06:42:02,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:42:02,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-22 06:42:02,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:42:02,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5caae213831324628acf5 HTTP/1.1" 200 None 2026-04-22 06:42:02,699 - lava_callback - ERROR - Error processing callback for node 69e5caae213831324628acf5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35136 - "GET / HTTP/1.0" 200 OK 2026-04-22 06:42:50,256 - lava_callback - INFO - Received callback for node 69e5cad7213831324628ad07 INFO: 172.21.0.1:59260 - "POST /node/69e5cad7213831324628ad07 HTTP/1.0" 202 Accepted 2026-04-22 06:42:50,262 - lava_callback - INFO - Starting async job submit for node 69e5cad7213831324628ad07 2026-04-22 06:42:50,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:42:50,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5cad7213831324628ad07 HTTP/1.1" 200 None 2026-04-22 06:42:50,278 - lava_callback - DEBUG - Processing node 69e5cad7213831324628ad07: baseline-arm-clabbe 2026-04-22 06:42:50,278 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5cad7213831324628ad07 2026-04-22 06:42:50,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:42:50,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5cad7213831324628ad07 HTTP/1.1" 200 None 2026-04-22 06:42:50,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:42:50,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-22 06:42:50,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:42:50,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5cad7213831324628ad07 HTTP/1.1" 200 None 2026-04-22 06:42:50,331 - lava_callback - ERROR - Error processing callback for node 69e5cad7213831324628ad07: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57706 - "GET / HTTP/1.0" 200 OK 2026-04-22 06:43:29,882 - lava_callback - INFO - Received callback for node 69e5cafb213831324628ad16 INFO: 172.21.0.1:43268 - "POST /node/69e5cafb213831324628ad16 HTTP/1.0" 202 Accepted 2026-04-22 06:43:29,888 - lava_callback - INFO - Starting async job submit for node 69e5cafb213831324628ad16 2026-04-22 06:43:29,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:43:29,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5cafb213831324628ad16 HTTP/1.1" 200 None 2026-04-22 06:43:29,904 - lava_callback - DEBUG - Processing node 69e5cafb213831324628ad16: baseline-arm-clabbe 2026-04-22 06:43:29,904 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5cafb213831324628ad16 2026-04-22 06:43:29,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:43:29,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5cafb213831324628ad16 HTTP/1.1" 200 None 2026-04-22 06:43:29,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:43:29,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-22 06:43:29,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:43:29,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5cafb213831324628ad16 HTTP/1.1" 200 None 2026-04-22 06:43:29,956 - lava_callback - ERROR - Error processing callback for node 69e5cafb213831324628ad16: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43272 - "GET / HTTP/1.0" 200 OK 2026-04-22 06:43:42,785 - lava_callback - INFO - Received callback for node 69e5cb1b213831324628ad21 INFO: 172.21.0.1:44664 - "POST /node/69e5cb1b213831324628ad21 HTTP/1.0" 202 Accepted 2026-04-22 06:43:42,790 - lava_callback - INFO - Starting async job submit for node 69e5cb1b213831324628ad21 2026-04-22 06:43:42,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:43:42,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5cb1b213831324628ad21 HTTP/1.1" 200 None 2026-04-22 06:43:42,807 - lava_callback - DEBUG - Processing node 69e5cb1b213831324628ad21: baseline-arm-baylibre 2026-04-22 06:43:42,807 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5cb1b213831324628ad21 2026-04-22 06:43:42,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:43:42,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5cb1b213831324628ad21 HTTP/1.1" 200 None 2026-04-22 06:43:42,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:43:42,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-22 06:43:42,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:43:42,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5cb1b213831324628ad21 HTTP/1.1" 200 None 2026-04-22 06:43:42,888 - lava_callback - ERROR - Error processing callback for node 69e5cb1b213831324628ad21: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57568 - "GET / HTTP/1.0" 200 OK 2026-04-22 06:44:22,819 - lava_callback - INFO - Received callback for node 69e5cb40213831324628ad31 INFO: 172.21.0.1:46490 - "POST /node/69e5cb40213831324628ad31 HTTP/1.0" 202 Accepted 2026-04-22 06:44:22,825 - lava_callback - INFO - Starting async job submit for node 69e5cb40213831324628ad31 2026-04-22 06:44:22,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:44:22,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5cb40213831324628ad31 HTTP/1.1" 200 None 2026-04-22 06:44:22,851 - lava_callback - DEBUG - Processing node 69e5cb40213831324628ad31: baseline-arm-baylibre 2026-04-22 06:44:22,851 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5cb40213831324628ad31 2026-04-22 06:44:22,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:44:22,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5cb40213831324628ad31 HTTP/1.1" 200 None 2026-04-22 06:44:22,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:44:22,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-22 06:44:22,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:44:22,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5cb40213831324628ad31 HTTP/1.1" 200 None 2026-04-22 06:44:22,901 - lava_callback - ERROR - Error processing callback for node 69e5cb40213831324628ad31: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53680 - "GET / HTTP/1.0" 200 OK 2026-04-22 06:45:02,825 - lava_callback - INFO - Received callback for node 69e5cb65213831324628ad47 INFO: 172.21.0.1:48348 - "POST /node/69e5cb65213831324628ad47 HTTP/1.0" 202 Accepted 2026-04-22 06:45:02,830 - lava_callback - INFO - Starting async job submit for node 69e5cb65213831324628ad47 2026-04-22 06:45:02,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:45:02,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5cb65213831324628ad47 HTTP/1.1" 200 None 2026-04-22 06:45:02,848 - lava_callback - DEBUG - Processing node 69e5cb65213831324628ad47: baseline-arm-baylibre 2026-04-22 06:45:02,848 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5cb65213831324628ad47 2026-04-22 06:45:02,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:45:02,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5cb65213831324628ad47 HTTP/1.1" 200 None 2026-04-22 06:45:02,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:45:02,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-22 06:45:02,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:45:02,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5cb65213831324628ad47 HTTP/1.1" 200 None 2026-04-22 06:45:02,905 - lava_callback - ERROR - Error processing callback for node 69e5cb65213831324628ad47: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48364 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:48370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42362 - "GET / HTTP/1.0" 200 OK 2026-04-22 06:45:42,811 - lava_callback - INFO - Received callback for node 69e5cb86213831324628ad55 INFO: 172.21.0.1:50876 - "POST /node/69e5cb86213831324628ad55 HTTP/1.0" 202 Accepted 2026-04-22 06:45:42,817 - lava_callback - INFO - Starting async job submit for node 69e5cb86213831324628ad55 2026-04-22 06:45:42,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:45:42,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5cb86213831324628ad55 HTTP/1.1" 200 None 2026-04-22 06:45:42,843 - lava_callback - DEBUG - Processing node 69e5cb86213831324628ad55: baseline-arm-baylibre 2026-04-22 06:45:42,843 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5cb86213831324628ad55 2026-04-22 06:45:42,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:45:42,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5cb86213831324628ad55 HTTP/1.1" 200 None 2026-04-22 06:45:42,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:45:42,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-22 06:45:42,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:45:42,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5cb86213831324628ad55 HTTP/1.1" 200 None 2026-04-22 06:45:42,898 - lava_callback - ERROR - Error processing callback for node 69e5cb86213831324628ad55: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52498 - "GET / HTTP/1.0" 200 OK 2026-04-22 06:46:22,866 - lava_callback - INFO - Received callback for node 69e5cbaa213831324628ad64 INFO: 172.21.0.1:35998 - "POST /node/69e5cbaa213831324628ad64 HTTP/1.0" 202 Accepted 2026-04-22 06:46:22,872 - lava_callback - INFO - Starting async job submit for node 69e5cbaa213831324628ad64 2026-04-22 06:46:22,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:46:22,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5cbaa213831324628ad64 HTTP/1.1" 200 None 2026-04-22 06:46:22,925 - lava_callback - DEBUG - Processing node 69e5cbaa213831324628ad64: baseline-arm-baylibre 2026-04-22 06:46:22,925 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5cbaa213831324628ad64 2026-04-22 06:46:22,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:46:22,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5cbaa213831324628ad64 HTTP/1.1" 200 None 2026-04-22 06:46:22,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:46:22,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-22 06:46:22,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:46:22,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5cbaa213831324628ad64 HTTP/1.1" 200 None 2026-04-22 06:46:22,975 - lava_callback - ERROR - Error processing callback for node 69e5cbaa213831324628ad64: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37382 - "GET / HTTP/1.0" 200 OK 2026-04-22 06:46:42,860 - lava_callback - INFO - Received callback for node 69e5cbd0213831324628ad7b INFO: 172.21.0.1:50702 - "POST /node/69e5cbd0213831324628ad7b HTTP/1.0" 202 Accepted 2026-04-22 06:46:42,869 - lava_callback - INFO - Starting async job submit for node 69e5cbd0213831324628ad7b 2026-04-22 06:46:42,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:46:42,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5cbd0213831324628ad7b HTTP/1.1" 200 None 2026-04-22 06:46:42,886 - lava_callback - DEBUG - Processing node 69e5cbd0213831324628ad7b: baseline-arm-baylibre 2026-04-22 06:46:42,886 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5cbd0213831324628ad7b 2026-04-22 06:46:42,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:46:42,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5cbd0213831324628ad7b HTTP/1.1" 200 None 2026-04-22 06:46:42,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:46:42,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-22 06:46:42,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:46:42,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5cbd0213831324628ad7b HTTP/1.1" 200 None 2026-04-22 06:46:42,937 - lava_callback - ERROR - Error processing callback for node 69e5cbd0213831324628ad7b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58562 - "GET / HTTP/1.0" 200 OK 2026-04-22 06:47:30,081 - lava_callback - INFO - Received callback for node 69e5cbf6213831324628ad86 INFO: 172.21.0.1:57920 - "POST /node/69e5cbf6213831324628ad86 HTTP/1.0" 202 Accepted 2026-04-22 06:47:30,087 - lava_callback - INFO - Starting async job submit for node 69e5cbf6213831324628ad86 2026-04-22 06:47:30,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:47:30,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5cbf6213831324628ad86 HTTP/1.1" 200 None 2026-04-22 06:47:30,106 - lava_callback - DEBUG - Processing node 69e5cbf6213831324628ad86: baseline-arm-clabbe 2026-04-22 06:47:30,106 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5cbf6213831324628ad86 2026-04-22 06:47:30,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:47:30,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5cbf6213831324628ad86 HTTP/1.1" 200 None 2026-04-22 06:47:30,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:47:30,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-22 06:47:30,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:47:30,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5cbf6213831324628ad86 HTTP/1.1" 200 None 2026-04-22 06:47:30,163 - lava_callback - ERROR - Error processing callback for node 69e5cbf6213831324628ad86: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36470 - "GET / HTTP/1.0" 200 OK 2026-04-22 06:48:02,995 - lava_callback - INFO - Received callback for node 69e5cc19213831324628ad96 INFO: 172.21.0.1:44742 - "POST /node/69e5cc19213831324628ad96 HTTP/1.0" 202 Accepted 2026-04-22 06:48:03,001 - lava_callback - INFO - Starting async job submit for node 69e5cc19213831324628ad96 2026-04-22 06:48:03,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:48:03,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5cc19213831324628ad96 HTTP/1.1" 200 None 2026-04-22 06:48:03,022 - lava_callback - DEBUG - Processing node 69e5cc19213831324628ad96: baseline-arm-baylibre 2026-04-22 06:48:03,022 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5cc19213831324628ad96 2026-04-22 06:48:03,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:48:03,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5cc19213831324628ad96 HTTP/1.1" 200 None 2026-04-22 06:48:03,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:48:03,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-22 06:48:03,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:48:03,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5cc19213831324628ad96 HTTP/1.1" 200 None 2026-04-22 06:48:03,076 - lava_callback - ERROR - Error processing callback for node 69e5cc19213831324628ad96: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53126 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36240 - "GET / HTTP/1.0" 200 OK 2026-04-22 06:48:50,260 - lava_callback - INFO - Received callback for node 69e5cc3f213831324628ada6 INFO: 172.21.0.1:58912 - "POST /node/69e5cc3f213831324628ada6 HTTP/1.0" 202 Accepted 2026-04-22 06:48:50,266 - lava_callback - INFO - Starting async job submit for node 69e5cc3f213831324628ada6 2026-04-22 06:48:50,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:48:50,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5cc3f213831324628ada6 HTTP/1.1" 200 None 2026-04-22 06:48:50,282 - lava_callback - DEBUG - Processing node 69e5cc3f213831324628ada6: baseline-arm-clabbe 2026-04-22 06:48:50,282 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5cc3f213831324628ada6 2026-04-22 06:48:50,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:48:50,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5cc3f213831324628ada6 HTTP/1.1" 200 None 2026-04-22 06:48:50,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:48:50,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-22 06:48:50,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:48:50,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5cc3f213831324628ada6 HTTP/1.1" 200 None 2026-04-22 06:48:50,351 - lava_callback - ERROR - Error processing callback for node 69e5cc3f213831324628ada6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43430 - "GET / HTTP/1.0" 200 OK 2026-04-22 06:50:03,485 - lava_callback - INFO - Received callback for node 69e5cc86213831324628adc7 INFO: 172.21.0.1:35414 - "POST /node/69e5cc86213831324628adc7 HTTP/1.0" 202 Accepted 2026-04-22 06:50:03,491 - lava_callback - INFO - Starting async job submit for node 69e5cc86213831324628adc7 2026-04-22 06:50:03,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:50:03,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5cc86213831324628adc7 HTTP/1.1" 200 None 2026-04-22 06:50:03,508 - lava_callback - DEBUG - Processing node 69e5cc86213831324628adc7: baseline-arm-baylibre 2026-04-22 06:50:03,508 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5cc86213831324628adc7 2026-04-22 06:50:03,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:50:03,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5cc86213831324628adc7 HTTP/1.1" 200 None 2026-04-22 06:50:03,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:50:03,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-22 06:50:03,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:50:03,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5cc86213831324628adc7 HTTP/1.1" 200 None 2026-04-22 06:50:03,557 - lava_callback - ERROR - Error processing callback for node 69e5cc86213831324628adc7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43930 - "GET / HTTP/1.0" 200 OK 2026-04-22 06:50:30,390 - lava_callback - INFO - Received callback for node 69e5ccab213831324628add2 INFO: 172.21.0.1:39698 - "POST /node/69e5ccab213831324628add2 HTTP/1.0" 202 Accepted 2026-04-22 06:50:30,396 - lava_callback - INFO - Starting async job submit for node 69e5ccab213831324628add2 2026-04-22 06:50:30,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:50:30,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5ccab213831324628add2 HTTP/1.1" 200 None 2026-04-22 06:50:30,413 - lava_callback - DEBUG - Processing node 69e5ccab213831324628add2: baseline-arm-clabbe 2026-04-22 06:50:30,413 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5ccab213831324628add2 2026-04-22 06:50:30,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:50:30,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5ccab213831324628add2 HTTP/1.1" 200 None 2026-04-22 06:50:30,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:50:30,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-22 06:50:30,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:50:30,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5ccab213831324628add2 HTTP/1.1" 200 None 2026-04-22 06:50:30,468 - lava_callback - ERROR - Error processing callback for node 69e5ccab213831324628add2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44448 - "GET / HTTP/1.0" 200 OK 2026-04-22 06:51:10,321 - lava_callback - INFO - Received callback for node 69e5ccd0213831324628ade2 INFO: 172.21.0.1:43896 - "POST /node/69e5ccd0213831324628ade2 HTTP/1.0" 202 Accepted 2026-04-22 06:51:10,326 - lava_callback - INFO - Starting async job submit for node 69e5ccd0213831324628ade2 2026-04-22 06:51:10,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:51:10,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5ccd0213831324628ade2 HTTP/1.1" 200 None 2026-04-22 06:51:10,342 - lava_callback - DEBUG - Processing node 69e5ccd0213831324628ade2: baseline-arm-clabbe 2026-04-22 06:51:10,343 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5ccd0213831324628ade2 2026-04-22 06:51:10,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:51:10,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5ccd0213831324628ade2 HTTP/1.1" 200 None 2026-04-22 06:51:10,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:51:10,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-22 06:51:10,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:51:10,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5ccd0213831324628ade2 HTTP/1.1" 200 None 2026-04-22 06:51:10,391 - lava_callback - ERROR - Error processing callback for node 69e5ccd0213831324628ade2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43904 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46432 - "GET / HTTP/1.0" 200 OK 2026-04-22 06:51:43,184 - lava_callback - INFO - Received callback for node 69e5ccf3213831324628adf2 INFO: 172.21.0.1:47228 - "POST /node/69e5ccf3213831324628adf2 HTTP/1.0" 202 Accepted 2026-04-22 06:51:43,189 - lava_callback - INFO - Starting async job submit for node 69e5ccf3213831324628adf2 2026-04-22 06:51:43,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:51:43,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5ccf3213831324628adf2 HTTP/1.1" 200 None 2026-04-22 06:51:43,214 - lava_callback - DEBUG - Processing node 69e5ccf3213831324628adf2: baseline-arm-baylibre 2026-04-22 06:51:43,214 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5ccf3213831324628adf2 2026-04-22 06:51:43,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:51:43,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5ccf3213831324628adf2 HTTP/1.1" 200 None 2026-04-22 06:51:43,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:51:43,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-22 06:51:43,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:51:43,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5ccf3213831324628adf2 HTTP/1.1" 200 None 2026-04-22 06:51:43,280 - lava_callback - ERROR - Error processing callback for node 69e5ccf3213831324628adf2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49374 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49380 - "GET / HTTP/1.0" 200 OK 2026-04-22 06:52:30,495 - lava_callback - INFO - Received callback for node 69e5cd19213831324628ae02 INFO: 172.21.0.1:42430 - "POST /node/69e5cd19213831324628ae02 HTTP/1.0" 202 Accepted 2026-04-22 06:52:30,501 - lava_callback - INFO - Starting async job submit for node 69e5cd19213831324628ae02 2026-04-22 06:52:30,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:52:30,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5cd19213831324628ae02 HTTP/1.1" 200 None 2026-04-22 06:52:30,518 - lava_callback - DEBUG - Processing node 69e5cd19213831324628ae02: baseline-arm-clabbe 2026-04-22 06:52:30,518 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5cd19213831324628ae02 2026-04-22 06:52:30,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:52:30,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5cd19213831324628ae02 HTTP/1.1" 200 None 2026-04-22 06:52:30,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:52:30,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-22 06:52:30,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:52:30,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5cd19213831324628ae02 HTTP/1.1" 200 None 2026-04-22 06:52:30,576 - lava_callback - ERROR - Error processing callback for node 69e5cd19213831324628ae02: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60674 - "GET / HTTP/1.0" 200 OK 2026-04-22 06:52:50,502 - lava_callback - INFO - Received callback for node 69e5cd3f213831324628ae14 INFO: 172.21.0.1:34818 - "POST /node/69e5cd3f213831324628ae14 HTTP/1.0" 202 Accepted 2026-04-22 06:52:50,507 - lava_callback - INFO - Starting async job submit for node 69e5cd3f213831324628ae14 2026-04-22 06:52:50,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:52:50,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5cd3f213831324628ae14 HTTP/1.1" 200 None 2026-04-22 06:52:50,524 - lava_callback - DEBUG - Processing node 69e5cd3f213831324628ae14: baseline-arm-clabbe 2026-04-22 06:52:50,524 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5cd3f213831324628ae14 2026-04-22 06:52:50,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:52:50,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5cd3f213831324628ae14 HTTP/1.1" 200 None 2026-04-22 06:52:50,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:52:50,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-22 06:52:50,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:52:50,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5cd3f213831324628ae14 HTTP/1.1" 200 None 2026-04-22 06:52:50,573 - lava_callback - ERROR - Error processing callback for node 69e5cd3f213831324628ae14: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58678 - "GET / HTTP/1.0" 200 OK 2026-04-22 06:53:30,521 - lava_callback - INFO - Received callback for node 69e5cd64213831324628ae24 INFO: 172.21.0.1:35348 - "POST /node/69e5cd64213831324628ae24 HTTP/1.0" 202 Accepted 2026-04-22 06:53:30,531 - lava_callback - INFO - Starting async job submit for node 69e5cd64213831324628ae24 2026-04-22 06:53:30,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:53:30,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5cd64213831324628ae24 HTTP/1.1" 200 None 2026-04-22 06:53:30,549 - lava_callback - DEBUG - Processing node 69e5cd64213831324628ae24: baseline-arm-clabbe 2026-04-22 06:53:30,549 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5cd64213831324628ae24 2026-04-22 06:53:30,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:53:30,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5cd64213831324628ae24 HTTP/1.1" 200 None 2026-04-22 06:53:30,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:53:30,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-22 06:53:30,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:53:30,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5cd64213831324628ae24 HTTP/1.1" 200 None 2026-04-22 06:53:30,597 - lava_callback - ERROR - Error processing callback for node 69e5cd64213831324628ae24: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38948 - "GET / HTTP/1.0" 200 OK 2026-04-22 06:54:10,453 - lava_callback - INFO - Received callback for node 69e5cd89213831324628ae35 INFO: 172.21.0.1:60758 - "POST /node/69e5cd89213831324628ae35 HTTP/1.0" 202 Accepted 2026-04-22 06:54:10,458 - lava_callback - INFO - Starting async job submit for node 69e5cd89213831324628ae35 2026-04-22 06:54:10,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:54:10,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5cd89213831324628ae35 HTTP/1.1" 200 None 2026-04-22 06:54:10,474 - lava_callback - DEBUG - Processing node 69e5cd89213831324628ae35: baseline-arm-clabbe 2026-04-22 06:54:10,475 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5cd89213831324628ae35 2026-04-22 06:54:10,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:54:10,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5cd89213831324628ae35 HTTP/1.1" 200 None 2026-04-22 06:54:10,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:54:10,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-22 06:54:10,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:54:10,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5cd89213831324628ae35 HTTP/1.1" 200 None 2026-04-22 06:54:10,525 - lava_callback - ERROR - Error processing callback for node 69e5cd89213831324628ae35: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60772 - "GET / HTTP/1.0" 200 OK 2026-04-22 06:54:50,564 - lava_callback - INFO - Received callback for node 69e5cdad213831324628ae46 INFO: 172.21.0.1:58976 - "POST /node/69e5cdad213831324628ae46 HTTP/1.0" 202 Accepted 2026-04-22 06:54:50,569 - lava_callback - INFO - Starting async job submit for node 69e5cdad213831324628ae46 2026-04-22 06:54:50,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:54:50,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5cdad213831324628ae46 HTTP/1.1" 200 None 2026-04-22 06:54:50,589 - lava_callback - DEBUG - Processing node 69e5cdad213831324628ae46: baseline-arm-clabbe 2026-04-22 06:54:50,589 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5cdad213831324628ae46 2026-04-22 06:54:50,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:54:50,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5cdad213831324628ae46 HTTP/1.1" 200 None 2026-04-22 06:54:50,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:54:50,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-22 06:54:50,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:54:50,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5cdad213831324628ae46 HTTP/1.1" 200 None 2026-04-22 06:54:50,676 - lava_callback - ERROR - Error processing callback for node 69e5cdad213831324628ae46: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47856 - "GET / HTTP/1.0" 200 OK 2026-04-22 06:55:30,516 - lava_callback - INFO - Received callback for node 69e5cdd2213831324628ae59 INFO: 172.21.0.1:39286 - "POST /node/69e5cdd2213831324628ae59 HTTP/1.0" 202 Accepted 2026-04-22 06:55:30,521 - lava_callback - INFO - Starting async job submit for node 69e5cdd2213831324628ae59 2026-04-22 06:55:30,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:55:30,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5cdd2213831324628ae59 HTTP/1.1" 200 None 2026-04-22 06:55:30,537 - lava_callback - DEBUG - Processing node 69e5cdd2213831324628ae59: baseline-arm-clabbe 2026-04-22 06:55:30,538 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5cdd2213831324628ae59 2026-04-22 06:55:30,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:55:30,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5cdd2213831324628ae59 HTTP/1.1" 200 None 2026-04-22 06:55:30,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:55:30,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-22 06:55:30,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:55:30,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5cdd2213831324628ae59 HTTP/1.1" 200 None 2026-04-22 06:55:30,596 - lava_callback - ERROR - Error processing callback for node 69e5cdd2213831324628ae59: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54658 - "GET / HTTP/1.0" 200 OK 2026-04-22 06:56:10,668 - lava_callback - INFO - Received callback for node 69e5cdf7213831324628ae64 INFO: 172.21.0.1:34866 - "POST /node/69e5cdf7213831324628ae64 HTTP/1.0" 202 Accepted 2026-04-22 06:56:10,674 - lava_callback - INFO - Starting async job submit for node 69e5cdf7213831324628ae64 2026-04-22 06:56:10,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:56:10,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5cdf7213831324628ae64 HTTP/1.1" 200 None 2026-04-22 06:56:10,702 - lava_callback - DEBUG - Processing node 69e5cdf7213831324628ae64: baseline-arm-clabbe 2026-04-22 06:56:10,703 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5cdf7213831324628ae64 2026-04-22 06:56:10,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:56:10,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5cdf7213831324628ae64 HTTP/1.1" 200 None 2026-04-22 06:56:10,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:56:10,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-22 06:56:10,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:56:10,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5cdf7213831324628ae64 HTTP/1.1" 200 None 2026-04-22 06:56:10,772 - lava_callback - ERROR - Error processing callback for node 69e5cdf7213831324628ae64: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34882 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34026 - "GET / HTTP/1.0" 200 OK 2026-04-22 06:56:50,657 - lava_callback - INFO - Received callback for node 69e5ce1c213831324628ae74 INFO: 172.21.0.1:51246 - "POST /node/69e5ce1c213831324628ae74 HTTP/1.0" 202 Accepted 2026-04-22 06:56:50,663 - lava_callback - INFO - Starting async job submit for node 69e5ce1c213831324628ae74 2026-04-22 06:56:50,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:56:50,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5ce1c213831324628ae74 HTTP/1.1" 200 None 2026-04-22 06:56:50,678 - lava_callback - DEBUG - Processing node 69e5ce1c213831324628ae74: baseline-arm-clabbe 2026-04-22 06:56:50,678 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5ce1c213831324628ae74 2026-04-22 06:56:50,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:56:50,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5ce1c213831324628ae74 HTTP/1.1" 200 None 2026-04-22 06:56:50,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:56:50,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-22 06:56:50,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:56:50,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5ce1c213831324628ae74 HTTP/1.1" 200 None 2026-04-22 06:56:50,736 - lava_callback - ERROR - Error processing callback for node 69e5ce1c213831324628ae74: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43704 - "GET / HTTP/1.0" 200 OK 2026-04-22 06:57:10,689 - lava_callback - INFO - Received callback for node 69e5ce41213831324628ae83 INFO: 172.21.0.1:57396 - "POST /node/69e5ce41213831324628ae83 HTTP/1.0" 202 Accepted 2026-04-22 06:57:10,695 - lava_callback - INFO - Starting async job submit for node 69e5ce41213831324628ae83 2026-04-22 06:57:10,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:57:10,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5ce41213831324628ae83 HTTP/1.1" 200 None 2026-04-22 06:57:10,711 - lava_callback - DEBUG - Processing node 69e5ce41213831324628ae83: baseline-arm-clabbe 2026-04-22 06:57:10,711 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5ce41213831324628ae83 2026-04-22 06:57:10,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:57:10,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5ce41213831324628ae83 HTTP/1.1" 200 None 2026-04-22 06:57:10,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:57:10,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-22 06:57:10,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:57:10,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5ce41213831324628ae83 HTTP/1.1" 200 None 2026-04-22 06:57:10,779 - lava_callback - ERROR - Error processing callback for node 69e5ce41213831324628ae83: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57400 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44768 - "GET / HTTP/1.0" 200 OK 2026-04-22 06:57:50,708 - lava_callback - INFO - Received callback for node 69e5ce65213831324628ae97 INFO: 172.21.0.1:51892 - "POST /node/69e5ce65213831324628ae97 HTTP/1.0" 202 Accepted 2026-04-22 06:57:50,713 - lava_callback - INFO - Starting async job submit for node 69e5ce65213831324628ae97 2026-04-22 06:57:50,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:57:50,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5ce65213831324628ae97 HTTP/1.1" 200 None 2026-04-22 06:57:50,729 - lava_callback - DEBUG - Processing node 69e5ce65213831324628ae97: baseline-arm-clabbe 2026-04-22 06:57:50,729 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5ce65213831324628ae97 2026-04-22 06:57:50,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:57:50,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5ce65213831324628ae97 HTTP/1.1" 200 None 2026-04-22 06:57:50,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:57:50,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-22 06:57:50,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:57:50,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5ce65213831324628ae97 HTTP/1.1" 200 None 2026-04-22 06:57:50,785 - lava_callback - ERROR - Error processing callback for node 69e5ce65213831324628ae97: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38484 - "GET / HTTP/1.0" 200 OK 2026-04-22 06:58:30,773 - lava_callback - INFO - Received callback for node 69e5ce8a213831324628aea2 INFO: 172.21.0.1:49114 - "POST /node/69e5ce8a213831324628aea2 HTTP/1.0" 202 Accepted 2026-04-22 06:58:30,779 - lava_callback - INFO - Starting async job submit for node 69e5ce8a213831324628aea2 2026-04-22 06:58:30,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:58:30,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5ce8a213831324628aea2 HTTP/1.1" 200 None 2026-04-22 06:58:30,801 - lava_callback - DEBUG - Processing node 69e5ce8a213831324628aea2: baseline-arm-clabbe 2026-04-22 06:58:30,801 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5ce8a213831324628aea2 2026-04-22 06:58:30,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:58:30,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5ce8a213831324628aea2 HTTP/1.1" 200 None 2026-04-22 06:58:30,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:58:30,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-22 06:58:30,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:58:30,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5ce8a213831324628aea2 HTTP/1.1" 200 None 2026-04-22 06:58:30,855 - lava_callback - ERROR - Error processing callback for node 69e5ce8a213831324628aea2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44252 - "GET / HTTP/1.0" 200 OK 2026-04-22 06:59:10,775 - lava_callback - INFO - Received callback for node 69e5ceae213831324628aeaf INFO: 172.21.0.1:60206 - "POST /node/69e5ceae213831324628aeaf HTTP/1.0" 202 Accepted 2026-04-22 06:59:10,781 - lava_callback - INFO - Starting async job submit for node 69e5ceae213831324628aeaf 2026-04-22 06:59:10,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:59:10,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5ceae213831324628aeaf HTTP/1.1" 200 None 2026-04-22 06:59:10,796 - lava_callback - DEBUG - Processing node 69e5ceae213831324628aeaf: baseline-arm-clabbe 2026-04-22 06:59:10,796 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5ceae213831324628aeaf 2026-04-22 06:59:10,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:59:10,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5ceae213831324628aeaf HTTP/1.1" 200 None 2026-04-22 06:59:10,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:59:10,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-22 06:59:10,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:59:10,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5ceae213831324628aeaf HTTP/1.1" 200 None 2026-04-22 06:59:10,845 - lava_callback - ERROR - Error processing callback for node 69e5ceae213831324628aeaf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49308 - "GET / HTTP/1.0" 200 OK 2026-04-22 06:59:50,734 - lava_callback - INFO - Received callback for node 69e5ced5213831324628aebd INFO: 172.21.0.1:54444 - "POST /node/69e5ced5213831324628aebd HTTP/1.0" 202 Accepted 2026-04-22 06:59:50,740 - lava_callback - INFO - Starting async job submit for node 69e5ced5213831324628aebd 2026-04-22 06:59:50,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:59:50,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5ced5213831324628aebd HTTP/1.1" 200 None 2026-04-22 06:59:50,756 - lava_callback - DEBUG - Processing node 69e5ced5213831324628aebd: baseline-arm-clabbe 2026-04-22 06:59:50,756 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5ced5213831324628aebd 2026-04-22 06:59:50,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:59:50,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5ced5213831324628aebd HTTP/1.1" 200 None 2026-04-22 06:59:50,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:59:50,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-22 06:59:50,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 06:59:50,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5ced5213831324628aebd HTTP/1.1" 200 None 2026-04-22 06:59:50,806 - lava_callback - ERROR - Error processing callback for node 69e5ced5213831324628aebd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35380 - "GET / HTTP/1.0" 200 OK 2026-04-22 07:00:30,780 - lava_callback - INFO - Received callback for node 69e5cefb213831324628aed1 INFO: 172.21.0.1:56818 - "POST /node/69e5cefb213831324628aed1 HTTP/1.0" 202 Accepted 2026-04-22 07:00:30,788 - lava_callback - INFO - Starting async job submit for node 69e5cefb213831324628aed1 2026-04-22 07:00:30,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:00:30,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5cefb213831324628aed1 HTTP/1.1" 200 None 2026-04-22 07:00:30,808 - lava_callback - DEBUG - Processing node 69e5cefb213831324628aed1: baseline-arm-clabbe 2026-04-22 07:00:30,808 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5cefb213831324628aed1 2026-04-22 07:00:30,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:00:30,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5cefb213831324628aed1 HTTP/1.1" 200 None 2026-04-22 07:00:30,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:00:30,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-22 07:00:30,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:00:30,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5cefb213831324628aed1 HTTP/1.1" 200 None 2026-04-22 07:00:30,861 - lava_callback - ERROR - Error processing callback for node 69e5cefb213831324628aed1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51156 - "GET / HTTP/1.0" 200 OK 2026-04-22 07:01:10,873 - lava_callback - INFO - Received callback for node 69e5cf20213831324628aedb INFO: 172.21.0.1:54554 - "POST /node/69e5cf20213831324628aedb HTTP/1.0" 202 Accepted 2026-04-22 07:01:10,878 - lava_callback - INFO - Starting async job submit for node 69e5cf20213831324628aedb 2026-04-22 07:01:10,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:01:10,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5cf20213831324628aedb HTTP/1.1" 200 None 2026-04-22 07:01:10,895 - lava_callback - DEBUG - Processing node 69e5cf20213831324628aedb: baseline-arm-clabbe 2026-04-22 07:01:10,895 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5cf20213831324628aedb 2026-04-22 07:01:10,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:01:10,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5cf20213831324628aedb HTTP/1.1" 200 None 2026-04-22 07:01:10,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:01:10,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-22 07:01:10,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:01:10,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5cf20213831324628aedb HTTP/1.1" 200 None 2026-04-22 07:01:10,945 - lava_callback - ERROR - Error processing callback for node 69e5cf20213831324628aedb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41912 - "GET / HTTP/1.0" 200 OK 2026-04-22 07:01:30,897 - lava_callback - INFO - Received callback for node 69e5cf45213831324628aee9 INFO: 172.21.0.1:58988 - "POST /node/69e5cf45213831324628aee9 HTTP/1.0" 202 Accepted 2026-04-22 07:01:30,903 - lava_callback - INFO - Starting async job submit for node 69e5cf45213831324628aee9 2026-04-22 07:01:30,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:01:30,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5cf45213831324628aee9 HTTP/1.1" 200 None 2026-04-22 07:01:30,924 - lava_callback - DEBUG - Processing node 69e5cf45213831324628aee9: baseline-arm-clabbe 2026-04-22 07:01:30,924 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5cf45213831324628aee9 2026-04-22 07:01:30,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:01:30,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5cf45213831324628aee9 HTTP/1.1" 200 None 2026-04-22 07:01:30,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:01:30,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-22 07:01:30,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:01:30,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5cf45213831324628aee9 HTTP/1.1" 200 None 2026-04-22 07:01:30,989 - lava_callback - ERROR - Error processing callback for node 69e5cf45213831324628aee9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38840 - "GET / HTTP/1.0" 200 OK 2026-04-22 07:02:10,941 - lava_callback - INFO - Received callback for node 69e5cf6b213831324628aef7 INFO: 172.21.0.1:54846 - "POST /node/69e5cf6b213831324628aef7 HTTP/1.0" 202 Accepted 2026-04-22 07:02:10,947 - lava_callback - INFO - Starting async job submit for node 69e5cf6b213831324628aef7 2026-04-22 07:02:10,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:02:10,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5cf6b213831324628aef7 HTTP/1.1" 200 None 2026-04-22 07:02:10,963 - lava_callback - DEBUG - Processing node 69e5cf6b213831324628aef7: baseline-arm-clabbe 2026-04-22 07:02:10,963 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5cf6b213831324628aef7 2026-04-22 07:02:10,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:02:10,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5cf6b213831324628aef7 HTTP/1.1" 200 None 2026-04-22 07:02:10,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:02:11,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a251fb14b744a548895 HTTP/1.1" 200 None 2026-04-22 07:02:11,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:02:11,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5cf6b213831324628aef7 HTTP/1.1" 200 None 2026-04-22 07:02:11,069 - lava_callback - ERROR - Error processing callback for node 69e5cf6b213831324628aef7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57084 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35602 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59218 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37842 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52254 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47532 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49264 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58768 - "GET / HTTP/1.0" 200 OK 2026-04-22 07:25:11,414 - lava_callback - INFO - Received callback for node 69e7ac315a8961569669509e INFO: 172.21.0.1:33606 - "POST /node/69e7ac315a8961569669509e HTTP/1.0" 202 Accepted 2026-04-22 07:25:11,420 - lava_callback - INFO - Starting async job submit for node 69e7ac315a8961569669509e 2026-04-22 07:25:11,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:25:11,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7ac315a8961569669509e HTTP/1.1" 200 None 2026-04-22 07:25:11,469 - lava_callback - DEBUG - Processing node 69e7ac315a8961569669509e: baseline-arm64-broonie 2026-04-22 07:25:11,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 07:25:11,914 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 07:25:11,915 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e7ac315a8961569669509e/log.txt.gz 2026-04-22 07:25:12,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 07:25:12,252 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 07:25:12,254 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e7ac315a8961569669509e/lava-logs.yaml 2026-04-22 07:25:12,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 07:25:12,363 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 07:25:12,364 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e7ac315a8961569669509e/lava_callback.json.gz 2026-04-22 07:25:12,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:25:12,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7ac315a8961569669509e HTTP/1.1" 200 None 2026-04-22 07:25:12,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:25:12,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7a3655a89615696692344 HTTP/1.1" 200 None 2026-04-22 07:25:12,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:25:12,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e7ac315a8961569669509e HTTP/1.1" 200 None 2026-04-22 07:25:12,452 - lava_callback - INFO - Completed processing callback for node 69e7ac315a8961569669509e INFO: 172.21.0.1:33622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33638 - "GET / HTTP/1.0" 200 OK 2026-04-22 07:25:23,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:25:23,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58002 - "GET / HTTP/1.0" 200 OK 2026-04-22 07:25:45,105 - lava_callback - INFO - Received callback for node 69e5d4f6213831324628af4e INFO: 172.21.0.1:48538 - "POST /node/69e5d4f6213831324628af4e HTTP/1.0" 202 Accepted 2026-04-22 07:25:45,111 - lava_callback - INFO - Starting async job submit for node 69e5d4f6213831324628af4e 2026-04-22 07:25:45,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:25:45,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5d4f6213831324628af4e HTTP/1.1" 200 None 2026-04-22 07:25:45,126 - lava_callback - DEBUG - Processing node 69e5d4f6213831324628af4e: baseline-arm64-baylibre 2026-04-22 07:25:45,127 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5d4f6213831324628af4e 2026-04-22 07:25:45,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:25:45,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5d4f6213831324628af4e HTTP/1.1" 200 None 2026-04-22 07:25:45,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:25:45,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-22 07:25:45,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:25:45,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5d4f6213831324628af4e HTTP/1.1" 200 None 2026-04-22 07:25:45,182 - lava_callback - ERROR - Error processing callback for node 69e5d4f6213831324628af4e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48566 - "GET / HTTP/1.0" 200 OK 2026-04-22 07:25:52,519 - lava_callback - INFO - Received callback for node 69e8088c5a89615696697050 INFO: 172.21.0.1:43598 - "POST /node/69e8088c5a89615696697050 HTTP/1.0" 202 Accepted 2026-04-22 07:25:52,525 - lava_callback - INFO - Starting async job submit for node 69e8088c5a89615696697050 2026-04-22 07:25:52,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:25:52,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8088c5a89615696697050 HTTP/1.1" 200 None 2026-04-22 07:25:52,575 - lava_callback - DEBUG - Processing node 69e8088c5a89615696697050: baseline-arm64-broonie 2026-04-22 07:25:52,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 07:25:52,922 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 07:25:52,924 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e8088c5a89615696697050/log.txt.gz 2026-04-22 07:25:53,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 07:25:53,219 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 07:25:53,221 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e8088c5a89615696697050/lava-logs.yaml 2026-04-22 07:25:53,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 07:25:53,356 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 07:25:53,358 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e8088c5a89615696697050/lava_callback.json.gz 2026-04-22 07:25:53,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:25:53,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e8088c5a89615696697050 HTTP/1.1" 200 None 2026-04-22 07:25:53,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:25:53,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7a3655a89615696692344 HTTP/1.1" 200 None 2026-04-22 07:25:53,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:25:53,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e8088c5a89615696697050 HTTP/1.1" 200 None 2026-04-22 07:25:53,465 - lava_callback - INFO - Completed processing callback for node 69e8088c5a89615696697050 2026-04-22 07:25:53,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:25:53,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41890 - "GET / HTTP/1.0" 200 OK 2026-04-22 07:26:51,479 - lava_callback - INFO - Received callback for node 69e81daaafb86e738cad0341 INFO: 172.21.0.1:46336 - "POST /node/69e81daaafb86e738cad0341 HTTP/1.0" 202 Accepted 2026-04-22 07:26:51,485 - lava_callback - INFO - Starting async job submit for node 69e81daaafb86e738cad0341 2026-04-22 07:26:51,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:26:51,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81daaafb86e738cad0341 HTTP/1.1" 200 None 2026-04-22 07:26:51,523 - lava_callback - DEBUG - Processing node 69e81daaafb86e738cad0341: baseline-arm64-broonie 2026-04-22 07:26:51,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 07:26:51,870 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 07:26:51,872 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e81daaafb86e738cad0341/log.txt.gz 2026-04-22 07:26:52,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 07:26:52,247 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 07:26:52,249 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e81daaafb86e738cad0341/lava-logs.yaml 2026-04-22 07:26:52,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 07:26:52,390 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 07:26:52,392 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e81daaafb86e738cad0341/lava_callback.json.gz 2026-04-22 07:26:52,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:26:52,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e81daaafb86e738cad0341 HTTP/1.1" 200 None 2026-04-22 07:26:52,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:26:52,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 07:26:52,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:26:52,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e81daaafb86e738cad0341 HTTP/1.1" 200 None 2026-04-22 07:26:52,489 - lava_callback - INFO - Completed processing callback for node 69e81daaafb86e738cad0341 2026-04-22 07:26:53,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:26:53,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46342 - "GET / HTTP/1.0" 200 OK 2026-04-22 07:27:05,106 - lava_callback - INFO - Received callback for node 69e5d541213831324628af6d INFO: 172.21.0.1:48170 - "POST /node/69e5d541213831324628af6d HTTP/1.0" 202 Accepted 2026-04-22 07:27:05,112 - lava_callback - INFO - Starting async job submit for node 69e5d541213831324628af6d 2026-04-22 07:27:05,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:27:05,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5d541213831324628af6d HTTP/1.1" 200 None 2026-04-22 07:27:05,131 - lava_callback - DEBUG - Processing node 69e5d541213831324628af6d: baseline-arm64-baylibre 2026-04-22 07:27:05,132 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5d541213831324628af6d 2026-04-22 07:27:05,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:27:05,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5d541213831324628af6d HTTP/1.1" 200 None 2026-04-22 07:27:05,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:27:05,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-22 07:27:05,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:27:05,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5d541213831324628af6d HTTP/1.1" 200 None 2026-04-22 07:27:05,186 - lava_callback - ERROR - Error processing callback for node 69e5d541213831324628af6d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48174 - "GET / HTTP/1.0" 200 OK 2026-04-22 07:27:11,990 - lava_callback - INFO - Received callback for node 69e85efdafb86e738cad1aae INFO: 172.21.0.1:43248 - "POST /node/69e85efdafb86e738cad1aae HTTP/1.0" 202 Accepted 2026-04-22 07:27:12,000 - lava_callback - INFO - Starting async job submit for node 69e85efdafb86e738cad1aae 2026-04-22 07:27:12,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:27:12,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e85efdafb86e738cad1aae HTTP/1.1" 200 None 2026-04-22 07:27:12,046 - lava_callback - DEBUG - Processing node 69e85efdafb86e738cad1aae: baseline-arm64-broonie 2026-04-22 07:27:12,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 07:27:12,393 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 07:27:12,395 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e85efdafb86e738cad1aae/log.txt.gz 2026-04-22 07:27:12,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 07:27:12,669 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 07:27:12,670 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e85efdafb86e738cad1aae/lava-logs.yaml 2026-04-22 07:27:12,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 07:27:12,777 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 07:27:12,779 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e85efdafb86e738cad1aae/lava_callback.json.gz 2026-04-22 07:27:12,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:27:12,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e85efdafb86e738cad1aae HTTP/1.1" 200 None 2026-04-22 07:27:12,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:27:12,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e7a3655a89615696692344 HTTP/1.1" 200 None 2026-04-22 07:27:12,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:27:12,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e85efdafb86e738cad1aae HTTP/1.1" 200 None 2026-04-22 07:27:12,861 - lava_callback - INFO - Completed processing callback for node 69e85efdafb86e738cad1aae INFO: 172.21.0.1:43264 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43272 - "GET / HTTP/1.0" 200 OK 2026-04-22 07:27:23,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:27:23,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:32798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57676 - "GET / HTTP/1.0" 200 OK 2026-04-22 07:28:25,226 - lava_callback - INFO - Received callback for node 69e5d58e213831324628af8e INFO: 172.21.0.1:47392 - "POST /node/69e5d58e213831324628af8e HTTP/1.0" 202 Accepted 2026-04-22 07:28:25,235 - lava_callback - INFO - Starting async job submit for node 69e5d58e213831324628af8e 2026-04-22 07:28:25,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:28:25,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5d58e213831324628af8e HTTP/1.1" 200 None 2026-04-22 07:28:25,253 - lava_callback - DEBUG - Processing node 69e5d58e213831324628af8e: baseline-arm64-baylibre 2026-04-22 07:28:25,253 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5d58e213831324628af8e 2026-04-22 07:28:25,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:28:25,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5d58e213831324628af8e HTTP/1.1" 200 None 2026-04-22 07:28:25,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:28:25,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-22 07:28:25,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:28:25,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5d58e213831324628af8e HTTP/1.1" 200 None 2026-04-22 07:28:25,317 - lava_callback - ERROR - Error processing callback for node 69e5d58e213831324628af8e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47398 - "GET / HTTP/1.0" 200 OK 2026-04-22 07:28:31,732 - lava_callback - INFO - Received callback for node 69e87450afb86e738cad2212 INFO: 172.21.0.1:38580 - "POST /node/69e87450afb86e738cad2212 HTTP/1.0" 202 Accepted 2026-04-22 07:28:31,740 - lava_callback - INFO - Starting async job submit for node 69e87450afb86e738cad2212 2026-04-22 07:28:31,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:28:31,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e87450afb86e738cad2212 HTTP/1.1" 200 None 2026-04-22 07:28:31,781 - lava_callback - DEBUG - Processing node 69e87450afb86e738cad2212: baseline-arm64-broonie 2026-04-22 07:28:32,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 07:28:32,102 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 07:28:32,103 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e87450afb86e738cad2212/log.txt.gz 2026-04-22 07:28:32,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 07:28:32,374 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 07:28:32,376 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e87450afb86e738cad2212/lava-logs.yaml 2026-04-22 07:28:32,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-22 07:28:32,487 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-22 07:28:32,488 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69e87450afb86e738cad2212/lava_callback.json.gz 2026-04-22 07:28:32,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:28:32,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e87450afb86e738cad2212 HTTP/1.1" 200 None 2026-04-22 07:28:32,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:28:32,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e813b0afb86e738cacfba2 HTTP/1.1" 200 None 2026-04-22 07:28:32,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:28:32,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e87450afb86e738cad2212 HTTP/1.1" 200 None 2026-04-22 07:28:32,567 - lava_callback - INFO - Completed processing callback for node 69e87450afb86e738cad2212 INFO: 172.21.0.1:38582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58296 - "GET / HTTP/1.0" 200 OK 2026-04-22 07:28:53,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:28:53,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33604 - "GET / HTTP/1.0" 200 OK 2026-04-22 07:29:45,266 - lava_callback - INFO - Received callback for node 69e5d5d8213831324628afad INFO: 172.21.0.1:59468 - "POST /node/69e5d5d8213831324628afad HTTP/1.0" 202 Accepted 2026-04-22 07:29:45,271 - lava_callback - INFO - Starting async job submit for node 69e5d5d8213831324628afad 2026-04-22 07:29:45,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:29:45,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5d5d8213831324628afad HTTP/1.1" 200 None 2026-04-22 07:29:45,292 - lava_callback - DEBUG - Processing node 69e5d5d8213831324628afad: baseline-arm64-baylibre 2026-04-22 07:29:45,293 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5d5d8213831324628afad 2026-04-22 07:29:45,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:29:45,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5d5d8213831324628afad HTTP/1.1" 200 None 2026-04-22 07:29:45,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:29:45,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-22 07:29:45,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:29:45,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5d5d8213831324628afad HTTP/1.1" 200 None 2026-04-22 07:29:45,343 - lava_callback - ERROR - Error processing callback for node 69e5d5d8213831324628afad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34940 - "GET / HTTP/1.0" 200 OK 2026-04-22 07:31:05,310 - lava_callback - INFO - Received callback for node 69e5d624213831324628afd4 INFO: 172.21.0.1:49796 - "POST /node/69e5d624213831324628afd4 HTTP/1.0" 202 Accepted 2026-04-22 07:31:05,316 - lava_callback - INFO - Starting async job submit for node 69e5d624213831324628afd4 2026-04-22 07:31:05,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:31:05,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5d624213831324628afd4 HTTP/1.1" 200 None 2026-04-22 07:31:05,333 - lava_callback - DEBUG - Processing node 69e5d624213831324628afd4: baseline-arm64-baylibre 2026-04-22 07:31:05,333 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5d624213831324628afd4 2026-04-22 07:31:05,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:31:05,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5d624213831324628afd4 HTTP/1.1" 200 None 2026-04-22 07:31:05,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:31:05,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-22 07:31:05,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:31:05,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5d624213831324628afd4 HTTP/1.1" 200 None 2026-04-22 07:31:05,391 - lava_callback - ERROR - Error processing callback for node 69e5d624213831324628afd4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34900 - "GET / HTTP/1.0" 200 OK 2026-04-22 07:32:05,320 - lava_callback - INFO - Received callback for node 69e5d66e213831324628aff1 INFO: 172.21.0.1:34682 - "POST /node/69e5d66e213831324628aff1 HTTP/1.0" 202 Accepted 2026-04-22 07:32:05,326 - lava_callback - INFO - Starting async job submit for node 69e5d66e213831324628aff1 2026-04-22 07:32:05,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:32:05,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5d66e213831324628aff1 HTTP/1.1" 200 None 2026-04-22 07:32:05,343 - lava_callback - DEBUG - Processing node 69e5d66e213831324628aff1: baseline-arm64-baylibre 2026-04-22 07:32:05,344 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5d66e213831324628aff1 2026-04-22 07:32:05,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:32:05,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5d66e213831324628aff1 HTTP/1.1" 200 None 2026-04-22 07:32:05,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:32:05,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-22 07:32:05,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:32:05,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5d66e213831324628aff1 HTTP/1.1" 200 None 2026-04-22 07:32:05,406 - lava_callback - ERROR - Error processing callback for node 69e5d66e213831324628aff1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55702 - "GET / HTTP/1.0" 200 OK 2026-04-22 07:33:25,472 - lava_callback - INFO - Received callback for node 69e5d6bb213831324628b016 INFO: 172.21.0.1:40608 - "POST /node/69e5d6bb213831324628b016 HTTP/1.0" 202 Accepted 2026-04-22 07:33:25,478 - lava_callback - INFO - Starting async job submit for node 69e5d6bb213831324628b016 2026-04-22 07:33:25,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:33:25,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5d6bb213831324628b016 HTTP/1.1" 200 None 2026-04-22 07:33:25,494 - lava_callback - DEBUG - Processing node 69e5d6bb213831324628b016: baseline-arm64-baylibre 2026-04-22 07:33:25,494 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5d6bb213831324628b016 2026-04-22 07:33:25,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:33:25,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5d6bb213831324628b016 HTTP/1.1" 200 None 2026-04-22 07:33:25,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:33:25,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-22 07:33:25,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:33:25,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5d6bb213831324628b016 HTTP/1.1" 200 None 2026-04-22 07:33:25,550 - lava_callback - ERROR - Error processing callback for node 69e5d6bb213831324628b016: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58628 - "GET / HTTP/1.0" 200 OK 2026-04-22 07:34:45,528 - lava_callback - INFO - Received callback for node 69e5d705213831324628b035 INFO: 172.21.0.1:39258 - "POST /node/69e5d705213831324628b035 HTTP/1.0" 202 Accepted 2026-04-22 07:34:45,534 - lava_callback - INFO - Starting async job submit for node 69e5d705213831324628b035 2026-04-22 07:34:45,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:34:45,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5d705213831324628b035 HTTP/1.1" 200 None 2026-04-22 07:34:45,550 - lava_callback - DEBUG - Processing node 69e5d705213831324628b035: baseline-arm64-baylibre 2026-04-22 07:34:45,550 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5d705213831324628b035 2026-04-22 07:34:45,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:34:45,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5d705213831324628b035 HTTP/1.1" 200 None 2026-04-22 07:34:45,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:34:45,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-22 07:34:45,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:34:45,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5d705213831324628b035 HTTP/1.1" 200 None 2026-04-22 07:34:45,606 - lava_callback - ERROR - Error processing callback for node 69e5d705213831324628b035: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34552 - "GET / HTTP/1.0" 200 OK 2026-04-22 07:36:05,615 - lava_callback - INFO - Received callback for node 69e5d750213831324628b05a INFO: 172.21.0.1:34444 - "POST /node/69e5d750213831324628b05a HTTP/1.0" 202 Accepted 2026-04-22 07:36:05,621 - lava_callback - INFO - Starting async job submit for node 69e5d750213831324628b05a 2026-04-22 07:36:05,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:36:05,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5d750213831324628b05a HTTP/1.1" 200 None 2026-04-22 07:36:05,638 - lava_callback - DEBUG - Processing node 69e5d750213831324628b05a: baseline-arm64-baylibre 2026-04-22 07:36:05,638 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5d750213831324628b05a 2026-04-22 07:36:05,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:36:05,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5d750213831324628b05a HTTP/1.1" 200 None 2026-04-22 07:36:05,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:36:05,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-22 07:36:05,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:36:05,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5d750213831324628b05a HTTP/1.1" 200 None 2026-04-22 07:36:05,689 - lava_callback - ERROR - Error processing callback for node 69e5d750213831324628b05a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44196 - "GET / HTTP/1.0" 200 OK 2026-04-22 07:37:05,667 - lava_callback - INFO - Received callback for node 69e5d79a213831324628b074 INFO: 172.21.0.1:49038 - "POST /node/69e5d79a213831324628b074 HTTP/1.0" 202 Accepted 2026-04-22 07:37:05,673 - lava_callback - INFO - Starting async job submit for node 69e5d79a213831324628b074 2026-04-22 07:37:05,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:37:05,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5d79a213831324628b074 HTTP/1.1" 200 None 2026-04-22 07:37:05,689 - lava_callback - DEBUG - Processing node 69e5d79a213831324628b074: baseline-arm64-baylibre 2026-04-22 07:37:05,689 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5d79a213831324628b074 2026-04-22 07:37:05,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:37:05,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5d79a213831324628b074 HTTP/1.1" 200 None 2026-04-22 07:37:05,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:37:05,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-22 07:37:05,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:37:05,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5d79a213831324628b074 HTTP/1.1" 200 None 2026-04-22 07:37:05,736 - lava_callback - ERROR - Error processing callback for node 69e5d79a213831324628b074: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34424 - "GET / HTTP/1.0" 200 OK 2026-04-22 07:38:25,654 - lava_callback - INFO - Received callback for node 69e5d7e4213831324628b09a INFO: 172.21.0.1:47340 - "POST /node/69e5d7e4213831324628b09a HTTP/1.0" 202 Accepted 2026-04-22 07:38:25,659 - lava_callback - INFO - Starting async job submit for node 69e5d7e4213831324628b09a 2026-04-22 07:38:25,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:38:25,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5d7e4213831324628b09a HTTP/1.1" 200 None 2026-04-22 07:38:25,676 - lava_callback - DEBUG - Processing node 69e5d7e4213831324628b09a: baseline-arm64-baylibre 2026-04-22 07:38:25,676 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5d7e4213831324628b09a 2026-04-22 07:38:25,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:38:25,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5d7e4213831324628b09a HTTP/1.1" 200 None 2026-04-22 07:38:25,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:38:25,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-22 07:38:25,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:38:25,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5d7e4213831324628b09a HTTP/1.1" 200 None 2026-04-22 07:38:25,730 - lava_callback - ERROR - Error processing callback for node 69e5d7e4213831324628b09a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37844 - "GET / HTTP/1.0" 200 OK 2026-04-22 07:39:45,796 - lava_callback - INFO - Received callback for node 69e5d82f213831324628b0b4 INFO: 172.21.0.1:48224 - "POST /node/69e5d82f213831324628b0b4 HTTP/1.0" 202 Accepted 2026-04-22 07:39:45,802 - lava_callback - INFO - Starting async job submit for node 69e5d82f213831324628b0b4 2026-04-22 07:39:45,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:39:45,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5d82f213831324628b0b4 HTTP/1.1" 200 None 2026-04-22 07:39:45,817 - lava_callback - DEBUG - Processing node 69e5d82f213831324628b0b4: baseline-arm64-baylibre 2026-04-22 07:39:45,818 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5d82f213831324628b0b4 2026-04-22 07:39:45,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:39:45,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5d82f213831324628b0b4 HTTP/1.1" 200 None 2026-04-22 07:39:45,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:39:45,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-22 07:39:45,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:39:45,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5d82f213831324628b0b4 HTTP/1.1" 200 None 2026-04-22 07:39:45,867 - lava_callback - ERROR - Error processing callback for node 69e5d82f213831324628b0b4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59140 - "GET / HTTP/1.0" 200 OK 2026-04-22 07:40:52,619 - lava_callback - INFO - Received callback for node 69e5d87f213831324628b0dd INFO: 172.21.0.1:59916 - "POST /node/69e5d87f213831324628b0dd HTTP/1.0" 202 Accepted 2026-04-22 07:40:52,629 - lava_callback - INFO - Starting async job submit for node 69e5d87f213831324628b0dd 2026-04-22 07:40:52,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:40:52,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5d87f213831324628b0dd HTTP/1.1" 200 None 2026-04-22 07:40:52,646 - lava_callback - DEBUG - Processing node 69e5d87f213831324628b0dd: baseline-arm64-clabbe 2026-04-22 07:40:52,646 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5d87f213831324628b0dd 2026-04-22 07:40:52,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:40:52,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5d87f213831324628b0dd HTTP/1.1" 200 None 2026-04-22 07:40:52,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:40:52,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-22 07:40:52,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:40:52,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5d87f213831324628b0dd HTTP/1.1" 200 None 2026-04-22 07:40:52,699 - lava_callback - ERROR - Error processing callback for node 69e5d87f213831324628b0dd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46780 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42510 - "GET / HTTP/1.0" 200 OK 2026-04-22 07:42:12,652 - lava_callback - INFO - Received callback for node 69e5d8c9213831324628b0fa INFO: 172.21.0.1:33562 - "POST /node/69e5d8c9213831324628b0fa HTTP/1.0" 202 Accepted 2026-04-22 07:42:12,658 - lava_callback - INFO - Starting async job submit for node 69e5d8c9213831324628b0fa 2026-04-22 07:42:12,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:42:12,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5d8c9213831324628b0fa HTTP/1.1" 200 None 2026-04-22 07:42:12,674 - lava_callback - DEBUG - Processing node 69e5d8c9213831324628b0fa: baseline-arm64-clabbe 2026-04-22 07:42:12,674 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5d8c9213831324628b0fa 2026-04-22 07:42:12,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:42:12,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5d8c9213831324628b0fa HTTP/1.1" 200 None 2026-04-22 07:42:12,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:42:12,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-22 07:42:12,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:42:12,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5d8c9213831324628b0fa HTTP/1.1" 200 None 2026-04-22 07:42:12,730 - lava_callback - ERROR - Error processing callback for node 69e5d8c9213831324628b0fa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33564 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49860 - "GET / HTTP/1.0" 200 OK 2026-04-22 07:43:32,729 - lava_callback - INFO - Received callback for node 69e5d914213831324628b120 INFO: 172.21.0.1:53098 - "POST /node/69e5d914213831324628b120 HTTP/1.0" 202 Accepted 2026-04-22 07:43:32,735 - lava_callback - INFO - Starting async job submit for node 69e5d914213831324628b120 2026-04-22 07:43:32,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:43:32,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5d914213831324628b120 HTTP/1.1" 200 None 2026-04-22 07:43:32,751 - lava_callback - DEBUG - Processing node 69e5d914213831324628b120: baseline-arm64-clabbe 2026-04-22 07:43:32,751 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5d914213831324628b120 2026-04-22 07:43:32,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:43:32,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5d914213831324628b120 HTTP/1.1" 200 None 2026-04-22 07:43:32,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:43:32,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-22 07:43:32,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:43:32,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5d914213831324628b120 HTTP/1.1" 200 None 2026-04-22 07:43:32,798 - lava_callback - ERROR - Error processing callback for node 69e5d914213831324628b120: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40630 - "GET / HTTP/1.0" 200 OK 2026-04-22 07:44:52,812 - lava_callback - INFO - Received callback for node 69e5d960213831324628b13c INFO: 172.21.0.1:36696 - "POST /node/69e5d960213831324628b13c HTTP/1.0" 202 Accepted 2026-04-22 07:44:52,818 - lava_callback - INFO - Starting async job submit for node 69e5d960213831324628b13c 2026-04-22 07:44:52,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:44:52,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5d960213831324628b13c HTTP/1.1" 200 None 2026-04-22 07:44:52,845 - lava_callback - DEBUG - Processing node 69e5d960213831324628b13c: baseline-arm64-clabbe 2026-04-22 07:44:52,845 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5d960213831324628b13c 2026-04-22 07:44:52,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:44:52,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5d960213831324628b13c HTTP/1.1" 200 None 2026-04-22 07:44:52,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:44:52,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-22 07:44:52,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:44:52,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5d960213831324628b13c HTTP/1.1" 200 None 2026-04-22 07:44:52,905 - lava_callback - ERROR - Error processing callback for node 69e5d960213831324628b13c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38494 - "GET / HTTP/1.0" 200 OK 2026-04-22 07:46:12,890 - lava_callback - INFO - Received callback for node 69e5d9b1213831324628b15f INFO: 172.21.0.1:35324 - "POST /node/69e5d9b1213831324628b15f HTTP/1.0" 202 Accepted 2026-04-22 07:46:12,895 - lava_callback - INFO - Starting async job submit for node 69e5d9b1213831324628b15f 2026-04-22 07:46:12,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:46:12,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5d9b1213831324628b15f HTTP/1.1" 200 None 2026-04-22 07:46:12,918 - lava_callback - DEBUG - Processing node 69e5d9b1213831324628b15f: baseline-arm64-clabbe 2026-04-22 07:46:12,918 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5d9b1213831324628b15f 2026-04-22 07:46:12,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:46:12,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5d9b1213831324628b15f HTTP/1.1" 200 None 2026-04-22 07:46:12,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:46:12,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-22 07:46:12,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:46:12,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5d9b1213831324628b15f HTTP/1.1" 200 None 2026-04-22 07:46:12,970 - lava_callback - ERROR - Error processing callback for node 69e5d9b1213831324628b15f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56280 - "GET / HTTP/1.0" 200 OK 2026-04-22 07:47:12,922 - lava_callback - INFO - Received callback for node 69e5d9fd213831324628b179 INFO: 172.21.0.1:43256 - "POST /node/69e5d9fd213831324628b179 HTTP/1.0" 202 Accepted 2026-04-22 07:47:12,930 - lava_callback - INFO - Starting async job submit for node 69e5d9fd213831324628b179 2026-04-22 07:47:12,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:47:12,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5d9fd213831324628b179 HTTP/1.1" 200 None 2026-04-22 07:47:12,950 - lava_callback - DEBUG - Processing node 69e5d9fd213831324628b179: baseline-arm64-clabbe 2026-04-22 07:47:12,950 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5d9fd213831324628b179 2026-04-22 07:47:12,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:47:12,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5d9fd213831324628b179 HTTP/1.1" 200 None 2026-04-22 07:47:12,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:47:12,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-22 07:47:12,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:47:13,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5d9fd213831324628b179 HTTP/1.1" 200 None 2026-04-22 07:47:13,005 - lava_callback - ERROR - Error processing callback for node 69e5d9fd213831324628b179: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43266 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33546 - "GET / HTTP/1.0" 200 OK 2026-04-22 07:48:33,036 - lava_callback - INFO - Received callback for node 69e5da4b213831324628b19a INFO: 172.21.0.1:47676 - "POST /node/69e5da4b213831324628b19a HTTP/1.0" 202 Accepted 2026-04-22 07:48:33,042 - lava_callback - INFO - Starting async job submit for node 69e5da4b213831324628b19a 2026-04-22 07:48:33,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:48:33,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5da4b213831324628b19a HTTP/1.1" 200 None 2026-04-22 07:48:33,058 - lava_callback - DEBUG - Processing node 69e5da4b213831324628b19a: baseline-arm64-clabbe 2026-04-22 07:48:33,058 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5da4b213831324628b19a 2026-04-22 07:48:33,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:48:33,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5da4b213831324628b19a HTTP/1.1" 200 None 2026-04-22 07:48:33,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:48:33,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-22 07:48:33,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:48:33,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5da4b213831324628b19a HTTP/1.1" 200 None 2026-04-22 07:48:33,115 - lava_callback - ERROR - Error processing callback for node 69e5da4b213831324628b19a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46296 - "GET / HTTP/1.0" 200 OK 2026-04-22 07:49:53,018 - lava_callback - INFO - Received callback for node 69e5da99213831324628b1be INFO: 172.21.0.1:60118 - "POST /node/69e5da99213831324628b1be HTTP/1.0" 202 Accepted 2026-04-22 07:49:53,028 - lava_callback - INFO - Starting async job submit for node 69e5da99213831324628b1be 2026-04-22 07:49:53,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:49:53,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5da99213831324628b1be HTTP/1.1" 200 None 2026-04-22 07:49:53,046 - lava_callback - DEBUG - Processing node 69e5da99213831324628b1be: baseline-arm64-clabbe 2026-04-22 07:49:53,047 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5da99213831324628b1be 2026-04-22 07:49:53,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:49:53,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5da99213831324628b1be HTTP/1.1" 200 None 2026-04-22 07:49:53,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:49:53,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-22 07:49:53,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:49:53,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5da99213831324628b1be HTTP/1.1" 200 None 2026-04-22 07:49:53,099 - lava_callback - ERROR - Error processing callback for node 69e5da99213831324628b1be: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43680 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42880 - "GET / HTTP/1.0" 200 OK 2026-04-22 07:51:13,060 - lava_callback - INFO - Received callback for node 69e5daea213831324628b1d8 INFO: 172.21.0.1:51504 - "POST /node/69e5daea213831324628b1d8 HTTP/1.0" 202 Accepted 2026-04-22 07:51:13,065 - lava_callback - INFO - Starting async job submit for node 69e5daea213831324628b1d8 2026-04-22 07:51:13,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:51:13,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5daea213831324628b1d8 HTTP/1.1" 200 None 2026-04-22 07:51:13,082 - lava_callback - DEBUG - Processing node 69e5daea213831324628b1d8: baseline-arm64-clabbe 2026-04-22 07:51:13,082 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5daea213831324628b1d8 2026-04-22 07:51:13,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:51:13,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5daea213831324628b1d8 HTTP/1.1" 200 None 2026-04-22 07:51:13,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:51:13,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-22 07:51:13,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:51:13,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5daea213831324628b1d8 HTTP/1.1" 200 None 2026-04-22 07:51:13,176 - lava_callback - ERROR - Error processing callback for node 69e5daea213831324628b1d8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46532 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52426 - "GET / HTTP/1.0" 200 OK 2026-04-22 07:52:33,176 - lava_callback - INFO - Received callback for node 69e5db38213831324628b1fd INFO: 172.21.0.1:43696 - "POST /node/69e5db38213831324628b1fd HTTP/1.0" 202 Accepted 2026-04-22 07:52:33,182 - lava_callback - INFO - Starting async job submit for node 69e5db38213831324628b1fd 2026-04-22 07:52:33,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:52:33,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5db38213831324628b1fd HTTP/1.1" 200 None 2026-04-22 07:52:33,197 - lava_callback - DEBUG - Processing node 69e5db38213831324628b1fd: baseline-arm64-clabbe 2026-04-22 07:52:33,197 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5db38213831324628b1fd 2026-04-22 07:52:33,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:52:33,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5db38213831324628b1fd HTTP/1.1" 200 None 2026-04-22 07:52:33,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:52:33,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-22 07:52:33,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:52:33,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5db38213831324628b1fd HTTP/1.1" 200 None 2026-04-22 07:52:33,252 - lava_callback - ERROR - Error processing callback for node 69e5db38213831324628b1fd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37680 - "GET / HTTP/1.0" 200 OK 2026-04-22 07:53:53,194 - lava_callback - INFO - Received callback for node 69e5db87213831324628b221 INFO: 172.21.0.1:46912 - "POST /node/69e5db87213831324628b221 HTTP/1.0" 202 Accepted 2026-04-22 07:53:53,201 - lava_callback - INFO - Starting async job submit for node 69e5db87213831324628b221 2026-04-22 07:53:53,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:53:53,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5db87213831324628b221 HTTP/1.1" 200 None 2026-04-22 07:53:53,218 - lava_callback - DEBUG - Processing node 69e5db87213831324628b221: baseline-arm64-clabbe 2026-04-22 07:53:53,218 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5db87213831324628b221 2026-04-22 07:53:53,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:53:53,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5db87213831324628b221 HTTP/1.1" 200 None 2026-04-22 07:53:53,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:53:53,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-22 07:53:53,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:53:53,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5db87213831324628b221 HTTP/1.1" 200 None 2026-04-22 07:53:53,272 - lava_callback - ERROR - Error processing callback for node 69e5db87213831324628b221: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48120 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42976 - "GET / HTTP/1.0" 200 OK 2026-04-22 07:55:13,216 - lava_callback - INFO - Received callback for node 69e5dbd5213831324628b239 INFO: 172.21.0.1:48588 - "POST /node/69e5dbd5213831324628b239 HTTP/1.0" 202 Accepted 2026-04-22 07:55:13,221 - lava_callback - INFO - Starting async job submit for node 69e5dbd5213831324628b239 2026-04-22 07:55:13,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:55:13,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5dbd5213831324628b239 HTTP/1.1" 200 None 2026-04-22 07:55:13,237 - lava_callback - DEBUG - Processing node 69e5dbd5213831324628b239: baseline-arm64-clabbe 2026-04-22 07:55:13,238 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5dbd5213831324628b239 2026-04-22 07:55:13,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:55:13,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5dbd5213831324628b239 HTTP/1.1" 200 None 2026-04-22 07:55:13,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:55:13,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-22 07:55:13,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:55:13,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5dbd5213831324628b239 HTTP/1.1" 200 None 2026-04-22 07:55:13,285 - lava_callback - ERROR - Error processing callback for node 69e5dbd5213831324628b239: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35372 - "GET / HTTP/1.0" 200 OK 2026-04-22 07:56:46,705 - lava_callback - INFO - Received callback for node 69e5dc2d213831324628b267 INFO: 172.21.0.1:35374 - "POST /node/69e5dc2d213831324628b267 HTTP/1.0" 202 Accepted 2026-04-22 07:56:46,711 - lava_callback - INFO - Starting async job submit for node 69e5dc2d213831324628b267 2026-04-22 07:56:46,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:56:46,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5dc2d213831324628b267 HTTP/1.1" 200 None 2026-04-22 07:56:46,727 - lava_callback - DEBUG - Processing node 69e5dc2d213831324628b267: baseline-arm64-baylibre 2026-04-22 07:56:46,728 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5dc2d213831324628b267 2026-04-22 07:56:46,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:56:46,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5dc2d213831324628b267 HTTP/1.1" 200 None 2026-04-22 07:56:46,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:56:46,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-22 07:56:46,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:56:46,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5dc2d213831324628b267 HTTP/1.1" 200 None 2026-04-22 07:56:46,776 - lava_callback - ERROR - Error processing callback for node 69e5dc2d213831324628b267: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57638 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45260 - "GET / HTTP/1.0" 200 OK 2026-04-22 07:57:53,288 - lava_callback - INFO - Received callback for node 69e5dc76213831324628b2cb INFO: 172.21.0.1:44558 - "POST /node/69e5dc76213831324628b2cb HTTP/1.0" 202 Accepted 2026-04-22 07:57:53,294 - lava_callback - INFO - Starting async job submit for node 69e5dc76213831324628b2cb 2026-04-22 07:57:53,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:57:53,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5dc76213831324628b2cb HTTP/1.1" 200 None 2026-04-22 07:57:53,311 - lava_callback - DEBUG - Processing node 69e5dc76213831324628b2cb: baseline-arm64-clabbe 2026-04-22 07:57:53,312 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5dc76213831324628b2cb 2026-04-22 07:57:53,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:57:53,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5dc76213831324628b2cb HTTP/1.1" 200 None 2026-04-22 07:57:53,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:57:53,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-22 07:57:53,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:57:53,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5dc76213831324628b2cb HTTP/1.1" 200 None 2026-04-22 07:57:53,372 - lava_callback - ERROR - Error processing callback for node 69e5dc76213831324628b2cb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47984 - "GET / HTTP/1.0" 200 OK 2026-04-22 07:59:33,435 - lava_callback - INFO - Received callback for node 69e5dce0213831324628b2e6 INFO: 172.21.0.1:56996 - "POST /node/69e5dce0213831324628b2e6 HTTP/1.0" 202 Accepted 2026-04-22 07:59:33,441 - lava_callback - INFO - Starting async job submit for node 69e5dce0213831324628b2e6 2026-04-22 07:59:33,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:59:33,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5dce0213831324628b2e6 HTTP/1.1" 200 None 2026-04-22 07:59:33,459 - lava_callback - DEBUG - Processing node 69e5dce0213831324628b2e6: baseline-arm64-clabbe 2026-04-22 07:59:33,459 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5dce0213831324628b2e6 2026-04-22 07:59:33,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:59:33,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5dce0213831324628b2e6 HTTP/1.1" 200 None 2026-04-22 07:59:33,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:59:33,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-22 07:59:33,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 07:59:33,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5dce0213831324628b2e6 HTTP/1.1" 200 None 2026-04-22 07:59:33,517 - lava_callback - ERROR - Error processing callback for node 69e5dce0213831324628b2e6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50030 - "GET / HTTP/1.0" 200 OK 2026-04-22 08:00:46,878 - lava_callback - INFO - Received callback for node 69e5dd2d213831324628b307 INFO: 172.21.0.1:50036 - "POST /node/69e5dd2d213831324628b307 HTTP/1.0" 202 Accepted 2026-04-22 08:00:46,884 - lava_callback - INFO - Starting async job submit for node 69e5dd2d213831324628b307 2026-04-22 08:00:46,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 08:00:46,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5dd2d213831324628b307 HTTP/1.1" 200 None 2026-04-22 08:00:46,900 - lava_callback - DEBUG - Processing node 69e5dd2d213831324628b307: baseline-arm64-baylibre 2026-04-22 08:00:46,901 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5dd2d213831324628b307 2026-04-22 08:00:46,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 08:00:46,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5dd2d213831324628b307 HTTP/1.1" 200 None 2026-04-22 08:00:46,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 08:00:46,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-22 08:00:46,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 08:00:46,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5dd2d213831324628b307 HTTP/1.1" 200 None 2026-04-22 08:00:46,952 - lava_callback - ERROR - Error processing callback for node 69e5dd2d213831324628b307: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43298 - "GET / HTTP/1.0" 200 OK 2026-04-22 08:02:06,956 - lava_callback - INFO - Received callback for node 69e5dd7a213831324628b323 INFO: 172.21.0.1:43302 - "POST /node/69e5dd7a213831324628b323 HTTP/1.0" 202 Accepted 2026-04-22 08:02:06,962 - lava_callback - INFO - Starting async job submit for node 69e5dd7a213831324628b323 2026-04-22 08:02:06,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 08:02:06,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5dd7a213831324628b323 HTTP/1.1" 200 None 2026-04-22 08:02:06,978 - lava_callback - DEBUG - Processing node 69e5dd7a213831324628b323: baseline-arm64-baylibre 2026-04-22 08:02:06,979 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5dd7a213831324628b323 2026-04-22 08:02:06,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 08:02:06,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5dd7a213831324628b323 HTTP/1.1" 200 None 2026-04-22 08:02:06,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 08:02:07,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-22 08:02:07,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 08:02:07,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5dd7a213831324628b323 HTTP/1.1" 200 None 2026-04-22 08:02:07,033 - lava_callback - ERROR - Error processing callback for node 69e5dd7a213831324628b323: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60326 - "GET / HTTP/1.0" 200 OK 2026-04-22 08:03:27,181 - lava_callback - INFO - Received callback for node 69e5ddc7213831324628b345 INFO: 172.21.0.1:60338 - "POST /node/69e5ddc7213831324628b345 HTTP/1.0" 202 Accepted 2026-04-22 08:03:27,189 - lava_callback - INFO - Starting async job submit for node 69e5ddc7213831324628b345 2026-04-22 08:03:27,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 08:03:27,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5ddc7213831324628b345 HTTP/1.1" 200 None 2026-04-22 08:03:27,212 - lava_callback - DEBUG - Processing node 69e5ddc7213831324628b345: baseline-arm64-baylibre 2026-04-22 08:03:27,213 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5ddc7213831324628b345 2026-04-22 08:03:27,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 08:03:27,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5ddc7213831324628b345 HTTP/1.1" 200 None 2026-04-22 08:03:27,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 08:03:27,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-22 08:03:27,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 08:03:27,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5ddc7213831324628b345 HTTP/1.1" 200 None 2026-04-22 08:03:27,268 - lava_callback - ERROR - Error processing callback for node 69e5ddc7213831324628b345: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54108 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53630 - "GET / HTTP/1.0" 200 OK 2026-04-22 08:04:47,197 - lava_callback - INFO - Received callback for node 69e5de14213831324628b362 INFO: 172.21.0.1:53636 - "POST /node/69e5de14213831324628b362 HTTP/1.0" 202 Accepted 2026-04-22 08:04:47,205 - lava_callback - INFO - Starting async job submit for node 69e5de14213831324628b362 2026-04-22 08:04:47,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 08:04:47,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5de14213831324628b362 HTTP/1.1" 200 None 2026-04-22 08:04:47,224 - lava_callback - DEBUG - Processing node 69e5de14213831324628b362: baseline-arm64-baylibre 2026-04-22 08:04:47,225 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5de14213831324628b362 2026-04-22 08:04:47,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 08:04:47,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5de14213831324628b362 HTTP/1.1" 200 None 2026-04-22 08:04:47,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 08:04:47,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-22 08:04:47,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 08:04:47,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5de14213831324628b362 HTTP/1.1" 200 None 2026-04-22 08:04:47,286 - lava_callback - ERROR - Error processing callback for node 69e5de14213831324628b362: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40972 - "GET / HTTP/1.0" 200 OK 2026-04-22 08:06:07,155 - lava_callback - INFO - Received callback for node 69e5de63213831324628b381 INFO: 172.21.0.1:40980 - "POST /node/69e5de63213831324628b381 HTTP/1.0" 202 Accepted 2026-04-22 08:06:07,160 - lava_callback - INFO - Starting async job submit for node 69e5de63213831324628b381 2026-04-22 08:06:07,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 08:06:07,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5de63213831324628b381 HTTP/1.1" 200 None 2026-04-22 08:06:07,176 - lava_callback - DEBUG - Processing node 69e5de63213831324628b381: baseline-arm64-baylibre 2026-04-22 08:06:07,177 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5de63213831324628b381 2026-04-22 08:06:07,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 08:06:07,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5de63213831324628b381 HTTP/1.1" 200 None 2026-04-22 08:06:07,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 08:06:07,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-22 08:06:07,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 08:06:07,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5de63213831324628b381 HTTP/1.1" 200 None 2026-04-22 08:06:07,224 - lava_callback - ERROR - Error processing callback for node 69e5de63213831324628b381: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38058 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52312 - "GET / HTTP/1.0" 200 OK 2026-04-22 08:07:33,789 - lava_callback - INFO - Received callback for node 69e5deb7213831324628b3a4 INFO: 172.21.0.1:35964 - "POST /node/69e5deb7213831324628b3a4 HTTP/1.0" 202 Accepted 2026-04-22 08:07:33,795 - lava_callback - INFO - Starting async job submit for node 69e5deb7213831324628b3a4 2026-04-22 08:07:33,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 08:07:33,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5deb7213831324628b3a4 HTTP/1.1" 200 None 2026-04-22 08:07:33,811 - lava_callback - DEBUG - Processing node 69e5deb7213831324628b3a4: baseline-arm64-clabbe 2026-04-22 08:07:33,812 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5deb7213831324628b3a4 2026-04-22 08:07:33,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 08:07:33,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5deb7213831324628b3a4 HTTP/1.1" 200 None 2026-04-22 08:07:33,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 08:07:33,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-22 08:07:33,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 08:07:33,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5deb7213831324628b3a4 HTTP/1.1" 200 None 2026-04-22 08:07:33,871 - lava_callback - ERROR - Error processing callback for node 69e5deb7213831324628b3a4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37748 - "GET / HTTP/1.0" 200 OK 2026-04-22 08:08:53,871 - lava_callback - INFO - Received callback for node 69e5df06213831324628b3bd INFO: 172.21.0.1:35094 - "POST /node/69e5df06213831324628b3bd HTTP/1.0" 202 Accepted 2026-04-22 08:08:53,878 - lava_callback - INFO - Starting async job submit for node 69e5df06213831324628b3bd 2026-04-22 08:08:53,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 08:08:53,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5df06213831324628b3bd HTTP/1.1" 200 None 2026-04-22 08:08:53,899 - lava_callback - DEBUG - Processing node 69e5df06213831324628b3bd: baseline-arm64-clabbe 2026-04-22 08:08:53,900 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5df06213831324628b3bd 2026-04-22 08:08:53,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 08:08:53,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5df06213831324628b3bd HTTP/1.1" 200 None 2026-04-22 08:08:53,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 08:08:53,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-22 08:08:53,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 08:08:53,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5df06213831324628b3bd HTTP/1.1" 200 None 2026-04-22 08:08:53,970 - lava_callback - ERROR - Error processing callback for node 69e5df06213831324628b3bd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43478 - "GET / HTTP/1.0" 200 OK 2026-04-22 08:10:13,872 - lava_callback - INFO - Received callback for node 69e5df56213831324628b3dd INFO: 172.21.0.1:48818 - "POST /node/69e5df56213831324628b3dd HTTP/1.0" 202 Accepted 2026-04-22 08:10:13,881 - lava_callback - INFO - Starting async job submit for node 69e5df56213831324628b3dd 2026-04-22 08:10:13,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 08:10:13,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5df56213831324628b3dd HTTP/1.1" 200 None 2026-04-22 08:10:13,898 - lava_callback - DEBUG - Processing node 69e5df56213831324628b3dd: baseline-arm64-clabbe 2026-04-22 08:10:13,898 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5df56213831324628b3dd 2026-04-22 08:10:13,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 08:10:13,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5df56213831324628b3dd HTTP/1.1" 200 None 2026-04-22 08:10:13,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 08:10:13,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-22 08:10:13,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 08:10:13,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5df56213831324628b3dd HTTP/1.1" 200 None 2026-04-22 08:10:13,954 - lava_callback - ERROR - Error processing callback for node 69e5df56213831324628b3dd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37702 - "GET / HTTP/1.0" 200 OK 2026-04-22 08:11:33,937 - lava_callback - INFO - Received callback for node 69e5dfa8213831324628b3fe INFO: 172.21.0.1:53664 - "POST /node/69e5dfa8213831324628b3fe HTTP/1.0" 202 Accepted 2026-04-22 08:11:33,945 - lava_callback - INFO - Starting async job submit for node 69e5dfa8213831324628b3fe 2026-04-22 08:11:33,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 08:11:33,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5dfa8213831324628b3fe HTTP/1.1" 200 None 2026-04-22 08:11:33,974 - lava_callback - DEBUG - Processing node 69e5dfa8213831324628b3fe: baseline-arm64-clabbe 2026-04-22 08:11:33,974 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5dfa8213831324628b3fe 2026-04-22 08:11:33,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 08:11:33,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5dfa8213831324628b3fe HTTP/1.1" 200 None 2026-04-22 08:11:33,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 08:11:34,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-22 08:11:34,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 08:11:34,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5dfa8213831324628b3fe HTTP/1.1" 200 None 2026-04-22 08:11:34,054 - lava_callback - ERROR - Error processing callback for node 69e5dfa8213831324628b3fe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47214 - "GET / HTTP/1.0" 200 OK 2026-04-22 08:12:53,998 - lava_callback - INFO - Received callback for node 69e5dffa213831324628b418 INFO: 172.21.0.1:35752 - "POST /node/69e5dffa213831324628b418 HTTP/1.0" 202 Accepted 2026-04-22 08:12:54,007 - lava_callback - INFO - Starting async job submit for node 69e5dffa213831324628b418 2026-04-22 08:12:54,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 08:12:54,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5dffa213831324628b418 HTTP/1.1" 200 None 2026-04-22 08:12:54,029 - lava_callback - DEBUG - Processing node 69e5dffa213831324628b418: baseline-arm64-clabbe 2026-04-22 08:12:54,030 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69e5dffa213831324628b418 2026-04-22 08:12:54,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 08:12:54,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e5dffa213831324628b418 HTTP/1.1" 200 None 2026-04-22 08:12:54,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 08:12:54,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69e02a3a1fb14b744a5488a9 HTTP/1.1" 200 None 2026-04-22 08:12:54,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-22 08:12:54,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69e5dffa213831324628b418 HTTP/1.1" 200 None 2026-04-22 08:12:54,101 - lava_callback - ERROR - Error processing callback for node 69e5dffa213831324628b418: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48028 - "GET / HTTP/1.0" 200 OK INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1]