INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.21.0.1:38076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59416 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33138 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:18:35,429 - lava_callback - INFO - Received callback for node 69cf77d3000c489abc2bf957 2026-04-05 08:18:35,436 - lava_callback - INFO - Starting async job submit for node 69cf77d3000c489abc2bf957 INFO: 172.21.0.1:33140 - "POST /node/69cf77d3000c489abc2bf957 HTTP/1.0" 202 Accepted 2026-04-05 08:18:35,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:18:35,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77d3000c489abc2bf957 HTTP/1.1" 200 None 2026-04-05 08:18:35,458 - lava_callback - DEBUG - Processing node 69cf77d3000c489abc2bf957: baseline-arm64-baylibre 2026-04-05 08:18:35,459 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf77d3000c489abc2bf957 2026-04-05 08:18:35,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:18:35,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77d3000c489abc2bf957 HTTP/1.1" 200 None 2026-04-05 08:18:35,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:18:35,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-05 08:18:35,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:18:35,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf77d3000c489abc2bf957 HTTP/1.1" 200 None 2026-04-05 08:18:35,540 - lava_callback - ERROR - Error processing callback for node 69cf77d3000c489abc2bf957: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50980 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:21:35,035 - lava_callback - INFO - Received callback for node 69cf7888000c489abc2bf9b5 INFO: 172.21.0.1:50984 - "POST /node/69cf7888000c489abc2bf9b5 HTTP/1.0" 202 Accepted 2026-04-05 08:21:35,040 - lava_callback - INFO - Starting async job submit for node 69cf7888000c489abc2bf9b5 2026-04-05 08:21:35,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:21:35,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7888000c489abc2bf9b5 HTTP/1.1" 200 None 2026-04-05 08:21:35,056 - lava_callback - DEBUG - Processing node 69cf7888000c489abc2bf9b5: baseline-arm64-baylibre 2026-04-05 08:21:35,057 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf7888000c489abc2bf9b5 2026-04-05 08:21:35,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:21:35,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7888000c489abc2bf9b5 HTTP/1.1" 200 None 2026-04-05 08:21:35,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:21:35,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-05 08:21:35,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:21:35,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf7888000c489abc2bf9b5 HTTP/1.1" 200 None 2026-04-05 08:21:35,111 - lava_callback - ERROR - Error processing callback for node 69cf7888000c489abc2bf9b5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36044 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:23:03,797 - lava_callback - INFO - Received callback for node 69cf78d7000c489abc2bf9e8 INFO: 172.21.0.1:52118 - "POST /node/69cf78d7000c489abc2bf9e8 HTTP/1.0" 202 Accepted 2026-04-05 08:23:03,802 - lava_callback - INFO - Starting async job submit for node 69cf78d7000c489abc2bf9e8 2026-04-05 08:23:03,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:23:03,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf78d7000c489abc2bf9e8 HTTP/1.1" 200 None 2026-04-05 08:23:03,819 - lava_callback - DEBUG - Processing node 69cf78d7000c489abc2bf9e8: baseline-arm64-clabbe 2026-04-05 08:23:03,819 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf78d7000c489abc2bf9e8 2026-04-05 08:23:03,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:23:03,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf78d7000c489abc2bf9e8 HTTP/1.1" 200 None 2026-04-05 08:23:03,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:23:03,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-05 08:23:03,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:23:03,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf78d7000c489abc2bf9e8 HTTP/1.1" 200 None 2026-04-05 08:23:03,874 - lava_callback - ERROR - Error processing callback for node 69cf78d7000c489abc2bf9e8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44680 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41304 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:24:03,856 - lava_callback - INFO - Received callback for node 69cf791c000c489abc2bfbf4 INFO: 172.21.0.1:54396 - "POST /node/69cf791c000c489abc2bfbf4 HTTP/1.0" 202 Accepted 2026-04-05 08:24:03,865 - lava_callback - INFO - Starting async job submit for node 69cf791c000c489abc2bfbf4 2026-04-05 08:24:03,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:24:03,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf791c000c489abc2bfbf4 HTTP/1.1" 200 None 2026-04-05 08:24:03,889 - lava_callback - DEBUG - Processing node 69cf791c000c489abc2bfbf4: baseline-arm64-clabbe 2026-04-05 08:24:03,889 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf791c000c489abc2bfbf4 2026-04-05 08:24:03,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:24:03,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf791c000c489abc2bfbf4 HTTP/1.1" 200 None 2026-04-05 08:24:03,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:24:03,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-05 08:24:03,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:24:03,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf791c000c489abc2bfbf4 HTTP/1.1" 200 None 2026-04-05 08:24:03,954 - lava_callback - ERROR - Error processing callback for node 69cf791c000c489abc2bfbf4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51996 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:25:24,082 - lava_callback - INFO - Received callback for node 69cf7965000c489abc2bfc24 INFO: 172.21.0.1:50618 - "POST /node/69cf7965000c489abc2bfc24 HTTP/1.0" 202 Accepted 2026-04-05 08:25:24,088 - lava_callback - INFO - Starting async job submit for node 69cf7965000c489abc2bfc24 2026-04-05 08:25:24,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:25:24,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7965000c489abc2bfc24 HTTP/1.1" 200 None 2026-04-05 08:25:24,104 - lava_callback - DEBUG - Processing node 69cf7965000c489abc2bfc24: baseline-arm64-clabbe 2026-04-05 08:25:24,104 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf7965000c489abc2bfc24 2026-04-05 08:25:24,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:25:24,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7965000c489abc2bfc24 HTTP/1.1" 200 None 2026-04-05 08:25:24,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:25:24,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-05 08:25:24,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:25:24,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf7965000c489abc2bfc24 HTTP/1.1" 200 None 2026-04-05 08:25:24,155 - lava_callback - ERROR - Error processing callback for node 69cf7965000c489abc2bfc24: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57210 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:26:43,932 - lava_callback - INFO - Received callback for node 69cf79af000c489abc2bfc72 INFO: 172.21.0.1:48366 - "POST /node/69cf79af000c489abc2bfc72 HTTP/1.0" 202 Accepted 2026-04-05 08:26:43,938 - lava_callback - INFO - Starting async job submit for node 69cf79af000c489abc2bfc72 2026-04-05 08:26:43,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:26:43,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf79af000c489abc2bfc72 HTTP/1.1" 200 None 2026-04-05 08:26:43,955 - lava_callback - DEBUG - Processing node 69cf79af000c489abc2bfc72: baseline-arm64-clabbe 2026-04-05 08:26:43,955 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf79af000c489abc2bfc72 2026-04-05 08:26:43,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:26:43,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf79af000c489abc2bfc72 HTTP/1.1" 200 None 2026-04-05 08:26:43,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:26:44,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-05 08:26:44,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:26:44,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf79af000c489abc2bfc72 HTTP/1.1" 200 None 2026-04-05 08:26:44,038 - lava_callback - ERROR - Error processing callback for node 69cf79af000c489abc2bfc72: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40184 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:27:44,030 - lava_callback - INFO - Received callback for node 69cf79f5000c489abc2bfcab INFO: 172.21.0.1:42404 - "POST /node/69cf79f5000c489abc2bfcab HTTP/1.0" 202 Accepted 2026-04-05 08:27:44,039 - lava_callback - INFO - Starting async job submit for node 69cf79f5000c489abc2bfcab 2026-04-05 08:27:44,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:27:44,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf79f5000c489abc2bfcab HTTP/1.1" 200 None 2026-04-05 08:27:44,060 - lava_callback - DEBUG - Processing node 69cf79f5000c489abc2bfcab: baseline-arm64-clabbe 2026-04-05 08:27:44,061 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf79f5000c489abc2bfcab 2026-04-05 08:27:44,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:27:44,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf79f5000c489abc2bfcab HTTP/1.1" 200 None 2026-04-05 08:27:44,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:27:44,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-05 08:27:44,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:27:44,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf79f5000c489abc2bfcab HTTP/1.1" 200 None 2026-04-05 08:27:44,124 - lava_callback - ERROR - Error processing callback for node 69cf79f5000c489abc2bfcab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47316 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:29:44,160 - lava_callback - INFO - Received callback for node 69cf7a6d000c489abc2bfce2 INFO: 172.21.0.1:36288 - "POST /node/69cf7a6d000c489abc2bfce2 HTTP/1.0" 202 Accepted 2026-04-05 08:29:44,166 - lava_callback - INFO - Starting async job submit for node 69cf7a6d000c489abc2bfce2 2026-04-05 08:29:44,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:29:44,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7a6d000c489abc2bfce2 HTTP/1.1" 200 None 2026-04-05 08:29:44,184 - lava_callback - DEBUG - Processing node 69cf7a6d000c489abc2bfce2: baseline-arm64-clabbe 2026-04-05 08:29:44,184 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf7a6d000c489abc2bfce2 2026-04-05 08:29:44,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:29:44,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7a6d000c489abc2bfce2 HTTP/1.1" 200 None 2026-04-05 08:29:44,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:29:44,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-05 08:29:44,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:29:44,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf7a6d000c489abc2bfce2 HTTP/1.1" 200 None 2026-04-05 08:29:44,255 - lava_callback - ERROR - Error processing callback for node 69cf7a6d000c489abc2bfce2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35536 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:30:39,664 - lava_callback - INFO - Received callback for node 69d21d300d94ee66016fb3cd INFO: 172.21.0.1:35548 - "POST /node/69d21d300d94ee66016fb3cd HTTP/1.0" 202 Accepted 2026-04-05 08:30:39,671 - lava_callback - INFO - Starting async job submit for node 69d21d300d94ee66016fb3cd 2026-04-05 08:30:39,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:30:39,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21d300d94ee66016fb3cd HTTP/1.1" 200 None 2026-04-05 08:30:39,712 - lava_callback - DEBUG - Processing node 69d21d300d94ee66016fb3cd: baseline-arm 2026-04-05 08:30:39,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:30:40,254 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:30:40,256 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d21d300d94ee66016fb3cd/log.txt.gz 2026-04-05 08:30:40,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:30:40,585 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:30:40,587 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d21d300d94ee66016fb3cd/lava-logs.yaml 2026-04-05 08:30:40,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:30:40,747 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:30:40,749 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d21d300d94ee66016fb3cd/lava_callback.json.gz 2026-04-05 08:30:40,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:30:40,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21d300d94ee66016fb3cd HTTP/1.1" 200 None 2026-04-05 08:30:40,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:30:40,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9f0d94ee66016fb135 HTTP/1.1" 200 None 2026-04-05 08:30:40,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:30:40,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d21d300d94ee66016fb3cd HTTP/1.1" 200 None 2026-04-05 08:30:40,845 - lava_callback - INFO - Completed processing callback for node 69d21d300d94ee66016fb3cd INFO: 172.21.0.1:40836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50618 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:31:05,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:31:05,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55512 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:37:21,507 - lava_callback - INFO - Received callback for node 69d21f250d94ee66016fb3f8 INFO: 172.21.0.1:56312 - "POST /node/69d21f250d94ee66016fb3f8 HTTP/1.0" 202 Accepted 2026-04-05 08:37:21,525 - lava_callback - INFO - Starting async job submit for node 69d21f250d94ee66016fb3f8 2026-04-05 08:37:21,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:37:21,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f250d94ee66016fb3f8 HTTP/1.1" 200 None 2026-04-05 08:37:21,585 - lava_callback - DEBUG - Processing node 69d21f250d94ee66016fb3f8: baseline-x86 2026-04-05 08:37:21,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:37:22,251 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:37:22,254 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69d21f250d94ee66016fb3f8/log.txt.gz 2026-04-05 08:37:22,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:37:22,941 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:37:22,944 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69d21f250d94ee66016fb3f8/lava-logs.yaml 2026-04-05 08:37:22,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:37:23,131 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:37:23,133 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69d21f250d94ee66016fb3f8/lava_callback.json.gz 2026-04-05 08:37:23,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:37:23,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f250d94ee66016fb3f8 HTTP/1.1" 200 None 2026-04-05 08:37:23,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:37:23,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21ab90d94ee66016fb15b HTTP/1.1" 200 None 2026-04-05 08:37:23,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:37:23,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d21f250d94ee66016fb3f8 HTTP/1.1" 200 None 2026-04-05 08:37:23,247 - lava_callback - INFO - Completed processing callback for node 69d21f250d94ee66016fb3f8 INFO: 172.21.0.1:56324 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:37:31,331 - lava_callback - INFO - Received callback for node 69d21f270d94ee66016fb401 INFO: 172.21.0.1:34060 - "POST /node/69d21f270d94ee66016fb401 HTTP/1.0" 202 Accepted 2026-04-05 08:37:31,338 - lava_callback - INFO - Starting async job submit for node 69d21f270d94ee66016fb401 2026-04-05 08:37:31,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:37:31,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f270d94ee66016fb401 HTTP/1.1" 200 None 2026-04-05 08:37:31,375 - lava_callback - DEBUG - Processing node 69d21f270d94ee66016fb401: baseline-x86 2026-04-05 08:37:31,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:37:31,988 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:37:31,991 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69d21f270d94ee66016fb401/log.txt.gz 2026-04-05 08:37:32,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:37:32,643 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:37:32,645 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69d21f270d94ee66016fb401/lava-logs.yaml 2026-04-05 08:37:32,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:37:32,834 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:37:32,836 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69d21f270d94ee66016fb401/lava_callback.json.gz 2026-04-05 08:37:32,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:37:32,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f270d94ee66016fb401 HTTP/1.1" 200 None 2026-04-05 08:37:32,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:37:32,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21ab90d94ee66016fb15b HTTP/1.1" 200 None 2026-04-05 08:37:32,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:37:32,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d21f270d94ee66016fb401 HTTP/1.1" 200 None 2026-04-05 08:37:32,987 - lava_callback - INFO - Completed processing callback for node 69d21f270d94ee66016fb401 INFO: 172.21.0.1:34072 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:37:35,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:37:35,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60508 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:38:08,427 - lava_callback - INFO - Received callback for node 69d21f620d94ee66016fb432 INFO: 172.21.0.1:60518 - "POST /node/69d21f620d94ee66016fb432 HTTP/1.0" 202 Accepted 2026-04-05 08:38:08,434 - lava_callback - INFO - Starting async job submit for node 69d21f620d94ee66016fb432 2026-04-05 08:38:08,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:38:08,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f620d94ee66016fb432 HTTP/1.1" 200 None 2026-04-05 08:38:08,456 - lava_callback - DEBUG - Processing node 69d21f620d94ee66016fb432: baseline-arm 2026-04-05 08:38:08,461 - lava_callback - WARNING - Failed to upload log 2026-04-05 08:38:08,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:38:08,577 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:38:08,579 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d21f620d94ee66016fb432/lava-logs.yaml 2026-04-05 08:38:08,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:38:08,718 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:38:08,720 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d21f620d94ee66016fb432/lava_callback.json.gz 2026-04-05 08:38:08,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:38:08,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f620d94ee66016fb432 HTTP/1.1" 200 None 2026-04-05 08:38:08,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:38:08,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-05 08:38:08,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:38:08,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d21f620d94ee66016fb432 HTTP/1.1" 200 None 2026-04-05 08:38:08,829 - lava_callback - INFO - Completed processing callback for node 69d21f620d94ee66016fb432 INFO: 172.21.0.1:35404 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-05 08:38:16,112 - lava_callback - INFO - Received callback for node 69cf7c6b000c489abc2bfd6b INFO: 172.21.0.1:35414 - "POST /node/69cf7c6b000c489abc2bfd6b HTTP/1.0" 202 Accepted 2026-04-05 08:38:16,119 - lava_callback - INFO - Starting async job submit for node 69cf7c6b000c489abc2bfd6b 2026-04-05 08:38:16,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:38:16,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7c6b000c489abc2bfd6b HTTP/1.1" 200 None 2026-04-05 08:38:16,139 - lava_callback - DEBUG - Processing node 69cf7c6b000c489abc2bfd6b: baseline-arm-baylibre 2026-04-05 08:38:16,139 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf7c6b000c489abc2bfd6b 2026-04-05 08:38:16,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:38:16,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7c6b000c489abc2bfd6b HTTP/1.1" 200 None 2026-04-05 08:38:16,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:38:16,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-05 08:38:16,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:38:16,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf7c6b000c489abc2bfd6b HTTP/1.1" 200 None 2026-04-05 08:38:16,221 - lava_callback - ERROR - Error processing callback for node 69cf7c6b000c489abc2bfd6b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36250 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:38:32,159 - lava_callback - INFO - Received callback for node 69d21f630d94ee66016fb435 INFO: 172.21.0.1:45270 - "POST /node/69d21f630d94ee66016fb435 HTTP/1.0" 202 Accepted 2026-04-05 08:38:32,206 - lava_callback - INFO - Starting async job submit for node 69d21f630d94ee66016fb435 2026-04-05 08:38:32,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:38:32,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f630d94ee66016fb435 HTTP/1.1" 200 None 2026-04-05 08:38:32,248 - lava_callback - DEBUG - Processing node 69d21f630d94ee66016fb435: baseline-arm 2026-04-05 08:38:32,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:38:32,517 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:38:32,519 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d21f630d94ee66016fb435/log.txt.gz 2026-04-05 08:38:32,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:38:32,778 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:38:32,780 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d21f630d94ee66016fb435/lava-logs.yaml 2026-04-05 08:38:32,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:38:32,939 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:38:32,941 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d21f630d94ee66016fb435/lava_callback.json.gz 2026-04-05 08:38:32,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:38:32,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f630d94ee66016fb435 HTTP/1.1" 200 None 2026-04-05 08:38:32,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:38:32,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-05 08:38:32,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:38:33,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d21f630d94ee66016fb435 HTTP/1.1" 200 None 2026-04-05 08:38:33,031 - lava_callback - INFO - Completed processing callback for node 69d21f630d94ee66016fb435 INFO: 172.21.0.1:45278 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:38:35,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:38:35,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45290 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:38:39,328 - lava_callback - INFO - Received callback for node 69d21f260d94ee66016fb3fe INFO: 172.21.0.1:45298 - "POST /node/69d21f260d94ee66016fb3fe HTTP/1.0" 202 Accepted 2026-04-05 08:38:39,335 - lava_callback - INFO - Starting async job submit for node 69d21f260d94ee66016fb3fe 2026-04-05 08:38:39,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:38:39,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f260d94ee66016fb3fe HTTP/1.1" 200 None 2026-04-05 08:38:39,370 - lava_callback - DEBUG - Processing node 69d21f260d94ee66016fb3fe: baseline-x86 2026-04-05 08:38:39,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:38:39,791 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:38:39,793 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69d21f260d94ee66016fb3fe/log.txt.gz 2026-04-05 08:38:39,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:38:40,160 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:38:40,162 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69d21f260d94ee66016fb3fe/lava-logs.yaml 2026-04-05 08:38:40,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:38:40,301 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:38:40,303 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69d21f260d94ee66016fb3fe/lava_callback.json.gz 2026-04-05 08:38:40,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:38:40,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f260d94ee66016fb3fe HTTP/1.1" 200 None 2026-04-05 08:38:40,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:38:40,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21ab90d94ee66016fb15b HTTP/1.1" 200 None 2026-04-05 08:38:40,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:38:40,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d21f260d94ee66016fb3fe HTTP/1.1" 200 None 2026-04-05 08:38:40,419 - lava_callback - INFO - Completed processing callback for node 69d21f260d94ee66016fb3fe INFO: 172.21.0.1:34580 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:38:54,426 - lava_callback - INFO - Received callback for node 69d21f660d94ee66016fb43e INFO: 172.21.0.1:37368 - "POST /node/69d21f660d94ee66016fb43e HTTP/1.0" 202 Accepted 2026-04-05 08:38:54,474 - lava_callback - INFO - Starting async job submit for node 69d21f660d94ee66016fb43e 2026-04-05 08:38:54,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:38:54,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f660d94ee66016fb43e HTTP/1.1" 200 None 2026-04-05 08:38:54,518 - lava_callback - DEBUG - Processing node 69d21f660d94ee66016fb43e: baseline-arm 2026-04-05 08:38:54,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:38:55,043 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:38:55,045 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d21f660d94ee66016fb43e/log.txt.gz 2026-04-05 08:38:55,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:38:55,424 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:38:55,427 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d21f660d94ee66016fb43e/lava-logs.yaml 2026-04-05 08:38:55,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:38:55,560 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:38:55,562 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d21f660d94ee66016fb43e/lava_callback.json.gz 2026-04-05 08:38:55,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:38:55,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f660d94ee66016fb43e HTTP/1.1" 200 None 2026-04-05 08:38:55,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:38:55,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-05 08:38:55,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:38:55,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d21f660d94ee66016fb43e HTTP/1.1" 200 None 2026-04-05 08:38:55,647 - lava_callback - INFO - Completed processing callback for node 69d21f660d94ee66016fb43e 2026-04-05 08:38:55,915 - lava_callback - INFO - Received callback for node 69cf7c90000c489abc2bfd86 INFO: 172.21.0.1:37384 - "POST /node/69cf7c90000c489abc2bfd86 HTTP/1.0" 202 Accepted 2026-04-05 08:38:55,921 - lava_callback - INFO - Starting async job submit for node 69cf7c90000c489abc2bfd86 2026-04-05 08:38:55,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:38:55,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7c90000c489abc2bfd86 HTTP/1.1" 200 None 2026-04-05 08:38:55,944 - lava_callback - DEBUG - Processing node 69cf7c90000c489abc2bfd86: baseline-arm-baylibre 2026-04-05 08:38:55,944 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf7c90000c489abc2bfd86 2026-04-05 08:38:55,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:38:55,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7c90000c489abc2bfd86 HTTP/1.1" 200 None 2026-04-05 08:38:55,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:38:56,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-05 08:38:56,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:38:56,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf7c90000c489abc2bfd86 HTTP/1.1" 200 None 2026-04-05 08:38:56,038 - lava_callback - ERROR - Error processing callback for node 69cf7c90000c489abc2bfd86: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37394 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:38:58,638 - lava_callback - INFO - Received callback for node 69d21f260d94ee66016fb3fb INFO: 172.21.0.1:37402 - "POST /node/69d21f260d94ee66016fb3fb HTTP/1.0" 202 Accepted 2026-04-05 08:38:58,645 - lava_callback - INFO - Starting async job submit for node 69d21f260d94ee66016fb3fb 2026-04-05 08:38:58,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:38:58,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f260d94ee66016fb3fb HTTP/1.1" 200 None 2026-04-05 08:38:58,687 - lava_callback - DEBUG - Processing node 69d21f260d94ee66016fb3fb: baseline-x86 2026-04-05 08:38:59,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:38:59,252 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:38:59,254 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69d21f260d94ee66016fb3fb/log.txt.gz 2026-04-05 08:38:59,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:38:59,769 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:38:59,771 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69d21f260d94ee66016fb3fb/lava-logs.yaml 2026-04-05 08:38:59,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:38:59,937 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:38:59,939 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69d21f260d94ee66016fb3fb/lava_callback.json.gz 2026-04-05 08:38:59,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:38:59,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f260d94ee66016fb3fb HTTP/1.1" 200 None 2026-04-05 08:38:59,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:39:00,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21ab90d94ee66016fb15b HTTP/1.1" 200 None 2026-04-05 08:39:00,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:39:00,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d21f260d94ee66016fb3fb HTTP/1.1" 200 None 2026-04-05 08:39:00,045 - lava_callback - INFO - Completed processing callback for node 69d21f260d94ee66016fb3fb 2026-04-05 08:39:05,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:39:05,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46742 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:39:14,676 - lava_callback - INFO - Received callback for node 69d21f620d94ee66016fb42f INFO: 172.21.0.1:36598 - "POST /node/69d21f620d94ee66016fb42f HTTP/1.0" 202 Accepted 2026-04-05 08:39:14,682 - lava_callback - INFO - Starting async job submit for node 69d21f620d94ee66016fb42f 2026-04-05 08:39:14,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:39:14,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f620d94ee66016fb42f HTTP/1.1" 200 None 2026-04-05 08:39:14,720 - lava_callback - DEBUG - Processing node 69d21f620d94ee66016fb42f: baseline-arm 2026-04-05 08:39:14,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:39:15,046 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:39:15,048 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d21f620d94ee66016fb42f/log.txt.gz INFO: 172.21.0.1:36600 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-05 08:39:15,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:39:15,346 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:39:15,348 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d21f620d94ee66016fb42f/lava-logs.yaml 2026-04-05 08:39:15,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:39:15,502 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:39:15,504 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d21f620d94ee66016fb42f/lava_callback.json.gz 2026-04-05 08:39:15,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:39:15,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f620d94ee66016fb42f HTTP/1.1" 200 None 2026-04-05 08:39:15,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:39:15,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-05 08:39:15,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:39:15,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d21f620d94ee66016fb42f HTTP/1.1" 200 None 2026-04-05 08:39:15,602 - lava_callback - INFO - Completed processing callback for node 69d21f620d94ee66016fb42f INFO: 172.21.0.1:36612 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:39:22,783 - lava_callback - INFO - Received callback for node 69d21f650d94ee66016fb43b INFO: 172.21.0.1:57776 - "POST /node/69d21f650d94ee66016fb43b HTTP/1.0" 202 Accepted 2026-04-05 08:39:22,792 - lava_callback - INFO - Starting async job submit for node 69d21f650d94ee66016fb43b 2026-04-05 08:39:22,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:39:22,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f650d94ee66016fb43b HTTP/1.1" 200 None 2026-04-05 08:39:22,839 - lava_callback - DEBUG - Processing node 69d21f650d94ee66016fb43b: baseline-arm 2026-04-05 08:39:23,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:39:23,275 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:39:23,277 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d21f650d94ee66016fb43b/log.txt.gz 2026-04-05 08:39:23,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:39:23,673 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:39:23,675 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d21f650d94ee66016fb43b/lava-logs.yaml 2026-04-05 08:39:23,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:39:23,875 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:39:23,877 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d21f650d94ee66016fb43b/lava_callback.json.gz 2026-04-05 08:39:23,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:39:23,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f650d94ee66016fb43b HTTP/1.1" 200 None 2026-04-05 08:39:23,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:39:23,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-05 08:39:23,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:39:23,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d21f650d94ee66016fb43b HTTP/1.1" 200 None 2026-04-05 08:39:23,996 - lava_callback - INFO - Completed processing callback for node 69d21f650d94ee66016fb43b INFO: 172.21.0.1:57784 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:39:30,637 - lava_callback - INFO - Received callback for node 69d21f890d94ee66016fb4cc INFO: 172.21.0.1:41950 - "POST /node/69d21f890d94ee66016fb4cc HTTP/1.0" 202 Accepted 2026-04-05 08:39:30,686 - lava_callback - INFO - Starting async job submit for node 69d21f890d94ee66016fb4cc 2026-04-05 08:39:30,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:39:30,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f890d94ee66016fb4cc HTTP/1.1" 200 None 2026-04-05 08:39:30,726 - lava_callback - DEBUG - Processing node 69d21f890d94ee66016fb4cc: baseline-arm-pengutronix 2026-04-05 08:39:30,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:39:31,005 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:39:31,007 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d21f890d94ee66016fb4cc/log.txt.gz 2026-04-05 08:39:31,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:39:31,285 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:39:31,287 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d21f890d94ee66016fb4cc/lava-logs.yaml 2026-04-05 08:39:31,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:39:31,427 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:39:31,429 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d21f890d94ee66016fb4cc/lava_callback.json.gz 2026-04-05 08:39:31,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:39:31,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f890d94ee66016fb4cc HTTP/1.1" 200 None 2026-04-05 08:39:31,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:39:31,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-05 08:39:31,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:39:31,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d21f890d94ee66016fb4cc HTTP/1.1" 200 None 2026-04-05 08:39:31,521 - lava_callback - INFO - Completed processing callback for node 69d21f890d94ee66016fb4cc 2026-04-05 08:39:34,147 - lava_callback - INFO - Received callback for node 69d21f860d94ee66016fb4c2 INFO: 172.21.0.1:41954 - "POST /node/69d21f860d94ee66016fb4c2 HTTP/1.0" 202 Accepted 2026-04-05 08:39:34,153 - lava_callback - INFO - Starting async job submit for node 69d21f860d94ee66016fb4c2 2026-04-05 08:39:34,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:39:34,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f860d94ee66016fb4c2 HTTP/1.1" 200 None 2026-04-05 08:39:34,188 - lava_callback - DEBUG - Processing node 69d21f860d94ee66016fb4c2: baseline-arm-pengutronix 2026-04-05 08:39:34,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:39:34,461 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:39:34,463 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d21f860d94ee66016fb4c2/log.txt.gz 2026-04-05 08:39:34,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:41970 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:39:34,731 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:39:34,733 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d21f860d94ee66016fb4c2/lava-logs.yaml 2026-04-05 08:39:34,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:39:34,873 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:39:34,876 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d21f860d94ee66016fb4c2/lava_callback.json.gz 2026-04-05 08:39:34,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:39:34,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f860d94ee66016fb4c2 HTTP/1.1" 200 None 2026-04-05 08:39:34,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:39:34,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-05 08:39:34,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:39:34,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d21f860d94ee66016fb4c2 HTTP/1.1" 200 None 2026-04-05 08:39:34,968 - lava_callback - INFO - Completed processing callback for node 69d21f860d94ee66016fb4c2 2026-04-05 08:39:35,582 - lava_callback - INFO - Received callback for node 69d21f880d94ee66016fb4c5 INFO: 172.21.0.1:41984 - "POST /node/69d21f880d94ee66016fb4c5 HTTP/1.0" 202 Accepted 2026-04-05 08:39:35,588 - lava_callback - INFO - Starting async job submit for node 69d21f880d94ee66016fb4c5 2026-04-05 08:39:35,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:39:35,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f880d94ee66016fb4c5 HTTP/1.1" 200 None 2026-04-05 08:39:35,622 - lava_callback - DEBUG - Processing node 69d21f880d94ee66016fb4c5: baseline-arm-pengutronix 2026-04-05 08:39:35,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:39:35,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-05 08:39:35,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:39:35,918 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:39:35,920 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d21f880d94ee66016fb4c5/log.txt.gz 2026-04-05 08:39:36,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:39:36,026 - lava_callback - INFO - Received callback for node 69cf7cb6000c489abc2bfdaf 2026-04-05 08:39:36,031 - lava_callback - INFO - Starting async job submit for node 69cf7cb6000c489abc2bfdaf INFO: 172.21.0.1:42000 - "POST /node/69cf7cb6000c489abc2bfdaf HTTP/1.0" 202 Accepted 2026-04-05 08:39:36,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:39:36,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7cb6000c489abc2bfdaf HTTP/1.1" 200 None 2026-04-05 08:39:36,050 - lava_callback - DEBUG - Processing node 69cf7cb6000c489abc2bfdaf: baseline-arm-baylibre 2026-04-05 08:39:36,050 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf7cb6000c489abc2bfdaf 2026-04-05 08:39:36,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:39:36,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7cb6000c489abc2bfdaf HTTP/1.1" 200 None 2026-04-05 08:39:36,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:39:36,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-05 08:39:36,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:39:36,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf7cb6000c489abc2bfdaf HTTP/1.1" 200 None 2026-04-05 08:39:36,115 - lava_callback - ERROR - Error processing callback for node 69cf7cb6000c489abc2bfdaf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-05 08:39:36,237 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:39:36,240 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d21f880d94ee66016fb4c5/lava-logs.yaml 2026-04-05 08:39:36,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:39:36,405 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:39:36,407 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d21f880d94ee66016fb4c5/lava_callback.json.gz 2026-04-05 08:39:36,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:39:36,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f880d94ee66016fb4c5 HTTP/1.1" 200 None 2026-04-05 08:39:36,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:39:36,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-05 08:39:36,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:39:36,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d21f880d94ee66016fb4c5 HTTP/1.1" 200 None 2026-04-05 08:39:36,491 - lava_callback - INFO - Completed processing callback for node 69d21f880d94ee66016fb4c5 INFO: 172.21.0.1:42002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46958 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:40:04,948 - lava_callback - INFO - Received callback for node 69cf7cdd000c489abc2bfdc3 INFO: 172.21.0.1:34152 - "POST /node/69cf7cdd000c489abc2bfdc3 HTTP/1.0" 202 Accepted 2026-04-05 08:40:04,954 - lava_callback - INFO - Starting async job submit for node 69cf7cdd000c489abc2bfdc3 2026-04-05 08:40:04,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:40:04,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7cdd000c489abc2bfdc3 HTTP/1.1" 200 None 2026-04-05 08:40:04,970 - lava_callback - DEBUG - Processing node 69cf7cdd000c489abc2bfdc3: baseline-arm-clabbe 2026-04-05 08:40:04,970 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf7cdd000c489abc2bfdc3 2026-04-05 08:40:04,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:40:04,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7cdd000c489abc2bfdc3 HTTP/1.1" 200 None 2026-04-05 08:40:04,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:40:04,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-05 08:40:05,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:40:05,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf7cdd000c489abc2bfdc3 HTTP/1.1" 200 None 2026-04-05 08:40:05,029 - lava_callback - ERROR - Error processing callback for node 69cf7cdd000c489abc2bfdc3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-05 08:40:05,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:40:05,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-05 08:40:06,268 - lava_callback - INFO - Received callback for node 69d21f760d94ee66016fb48a INFO: 172.21.0.1:34164 - "POST /node/69d21f760d94ee66016fb48a HTTP/1.0" 202 Accepted 2026-04-05 08:40:06,275 - lava_callback - INFO - Starting async job submit for node 69d21f760d94ee66016fb48a 2026-04-05 08:40:06,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:40:06,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f760d94ee66016fb48a HTTP/1.1" 200 None 2026-04-05 08:40:06,316 - lava_callback - DEBUG - Processing node 69d21f760d94ee66016fb48a: baseline-arm-broonie INFO: 172.21.0.1:34178 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:40:06,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:40:06,688 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:40:06,690 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d21f760d94ee66016fb48a/log.txt.gz 2026-04-05 08:40:06,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:40:07,116 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:40:07,118 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d21f760d94ee66016fb48a/lava-logs.yaml 2026-04-05 08:40:07,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:40:07,262 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:40:07,264 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d21f760d94ee66016fb48a/lava_callback.json.gz 2026-04-05 08:40:07,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:40:07,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f760d94ee66016fb48a HTTP/1.1" 200 None 2026-04-05 08:40:07,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:40:07,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-05 08:40:07,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:40:07,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d21f760d94ee66016fb48a HTTP/1.1" 200 None 2026-04-05 08:40:07,369 - lava_callback - INFO - Completed processing callback for node 69d21f760d94ee66016fb48a 2026-04-05 08:40:13,830 - lava_callback - INFO - Received callback for node 69d21f820d94ee66016fb4b4 INFO: 172.21.0.1:58530 - "POST /node/69d21f820d94ee66016fb4b4 HTTP/1.0" 202 Accepted 2026-04-05 08:40:13,837 - lava_callback - INFO - Starting async job submit for node 69d21f820d94ee66016fb4b4 2026-04-05 08:40:13,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:40:13,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f820d94ee66016fb4b4 HTTP/1.1" 200 None 2026-04-05 08:40:13,877 - lava_callback - DEBUG - Processing node 69d21f820d94ee66016fb4b4: baseline-arm-kontron 2026-04-05 08:40:14,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:40:14,218 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:40:14,220 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69d21f820d94ee66016fb4b4/log.txt.gz 2026-04-05 08:40:14,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:40:14,516 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:40:14,518 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69d21f820d94ee66016fb4b4/lava-logs.yaml 2026-04-05 08:40:14,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:40:14,669 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:40:14,671 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69d21f820d94ee66016fb4b4/lava_callback.json.gz 2026-04-05 08:40:14,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:40:14,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f820d94ee66016fb4b4 HTTP/1.1" 200 None 2026-04-05 08:40:14,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:40:14,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-05 08:40:14,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:40:14,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d21f820d94ee66016fb4b4 HTTP/1.1" 200 None 2026-04-05 08:40:14,761 - lava_callback - INFO - Completed processing callback for node 69d21f820d94ee66016fb4b4 2026-04-05 08:40:15,074 - lava_callback - INFO - Received callback for node 69d21f830d94ee66016fb4b7 INFO: 172.21.0.1:58546 - "POST /node/69d21f830d94ee66016fb4b7 HTTP/1.0" 202 Accepted 2026-04-05 08:40:15,080 - lava_callback - INFO - Starting async job submit for node 69d21f830d94ee66016fb4b7 2026-04-05 08:40:15,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:40:15,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f830d94ee66016fb4b7 HTTP/1.1" 200 None 2026-04-05 08:40:15,121 - lava_callback - DEBUG - Processing node 69d21f830d94ee66016fb4b7: baseline-arm-kontron INFO: 172.21.0.1:58560 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-05 08:40:15,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:40:15,439 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:40:15,441 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69d21f830d94ee66016fb4b7/log.txt.gz 2026-04-05 08:40:15,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:40:15,744 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:40:15,746 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69d21f830d94ee66016fb4b7/lava-logs.yaml 2026-04-05 08:40:15,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:40:15,881 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:40:15,883 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69d21f830d94ee66016fb4b7/lava_callback.json.gz 2026-04-05 08:40:15,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:40:15,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f830d94ee66016fb4b7 HTTP/1.1" 200 None 2026-04-05 08:40:15,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:40:15,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-05 08:40:15,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:40:15,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d21f830d94ee66016fb4b7 HTTP/1.1" 200 None 2026-04-05 08:40:15,962 - lava_callback - INFO - Completed processing callback for node 69d21f830d94ee66016fb4b7 INFO: 172.21.0.1:58562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47852 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:40:35,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:40:35,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47856 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:40:38,795 - lava_callback - INFO - Received callback for node 69d21ff10d94ee66016fb5db INFO: 172.21.0.1:47866 - "POST /node/69d21ff10d94ee66016fb5db HTTP/1.0" 202 Accepted 2026-04-05 08:40:38,801 - lava_callback - INFO - Starting async job submit for node 69d21ff10d94ee66016fb5db 2026-04-05 08:40:38,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:40:38,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21ff10d94ee66016fb5db HTTP/1.1" 200 None 2026-04-05 08:40:38,820 - lava_callback - DEBUG - Processing node 69d21ff10d94ee66016fb5db: baseline-arm 2026-04-05 08:40:38,825 - lava_callback - WARNING - Failed to upload log 2026-04-05 08:40:38,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:40:38,954 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:40:38,956 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d21ff10d94ee66016fb5db/lava-logs.yaml 2026-04-05 08:40:38,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:40:39,066 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:40:39,068 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d21ff10d94ee66016fb5db/lava_callback.json.gz 2026-04-05 08:40:39,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:40:39,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21ff10d94ee66016fb5db HTTP/1.1" 200 None 2026-04-05 08:40:39,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:40:39,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-05 08:40:39,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:40:39,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d21ff10d94ee66016fb5db HTTP/1.1" 200 None 2026-04-05 08:40:39,144 - lava_callback - INFO - Completed processing callback for node 69d21ff10d94ee66016fb5db 2026-04-05 08:40:44,648 - lava_callback - INFO - Received callback for node 69cf7d01000c489abc2bfdda INFO: 172.21.0.1:59028 - "POST /node/69cf7d01000c489abc2bfdda HTTP/1.0" 202 Accepted 2026-04-05 08:40:44,653 - lava_callback - INFO - Starting async job submit for node 69cf7d01000c489abc2bfdda 2026-04-05 08:40:44,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:40:44,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7d01000c489abc2bfdda HTTP/1.1" 200 None 2026-04-05 08:40:44,681 - lava_callback - DEBUG - Processing node 69cf7d01000c489abc2bfdda: baseline-arm-clabbe 2026-04-05 08:40:44,681 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf7d01000c489abc2bfdda 2026-04-05 08:40:44,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:40:44,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7d01000c489abc2bfdda HTTP/1.1" 200 None 2026-04-05 08:40:44,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:40:44,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-05 08:40:44,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:40:44,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf7d01000c489abc2bfdda HTTP/1.1" 200 None 2026-04-05 08:40:44,743 - lava_callback - ERROR - Error processing callback for node 69cf7d01000c489abc2bfdda: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47956 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:41:05,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:41:05,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35966 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:41:24,697 - lava_callback - INFO - Received callback for node 69cf7d25000c489abc2bfdf4 INFO: 172.21.0.1:35630 - "POST /node/69cf7d25000c489abc2bfdf4 HTTP/1.0" 202 Accepted 2026-04-05 08:41:24,702 - lava_callback - INFO - Starting async job submit for node 69cf7d25000c489abc2bfdf4 2026-04-05 08:41:24,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:41:24,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7d25000c489abc2bfdf4 HTTP/1.1" 200 None 2026-04-05 08:41:24,719 - lava_callback - DEBUG - Processing node 69cf7d25000c489abc2bfdf4: baseline-arm-clabbe 2026-04-05 08:41:24,719 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf7d25000c489abc2bfdf4 2026-04-05 08:41:24,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:41:24,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7d25000c489abc2bfdf4 HTTP/1.1" 200 None 2026-04-05 08:41:24,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:41:24,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-05 08:41:24,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:41:24,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf7d25000c489abc2bfdf4 HTTP/1.1" 200 None 2026-04-05 08:41:24,781 - lava_callback - ERROR - Error processing callback for node 69cf7d25000c489abc2bfdf4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55480 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:41:43,460 - lava_callback - INFO - Received callback for node 69d21f9f0d94ee66016fb509 INFO: 172.21.0.1:54790 - "POST /node/69d21f9f0d94ee66016fb509 HTTP/1.0" 202 Accepted 2026-04-05 08:41:43,467 - lava_callback - INFO - Starting async job submit for node 69d21f9f0d94ee66016fb509 2026-04-05 08:41:43,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:41:43,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f9f0d94ee66016fb509 HTTP/1.1" 200 None 2026-04-05 08:41:43,509 - lava_callback - DEBUG - Processing node 69d21f9f0d94ee66016fb509: ltp-dio 2026-04-05 08:41:44,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:41:44,482 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:41:44,484 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-69d21f9f0d94ee66016fb509/log.txt.gz 2026-04-05 08:41:44,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:41:45,078 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:41:45,081 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-69d21f9f0d94ee66016fb509/lava-logs.yaml 2026-04-05 08:41:45,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:41:45,427 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:41:45,430 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-69d21f9f0d94ee66016fb509/lava_callback.json.gz 2026-04-05 08:41:45,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:41:45,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f9f0d94ee66016fb509 HTTP/1.1" 200 None 2026-04-05 08:41:45,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:41:45,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-05 08:41:45,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:41:45,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d21f9f0d94ee66016fb509 HTTP/1.1" 200 None 2026-04-05 08:41:45,539 - lava_callback - INFO - Completed processing callback for node 69d21f9f0d94ee66016fb509 INFO: 172.21.0.1:54798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52190 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:42:04,763 - lava_callback - INFO - Received callback for node 69cf7d4b000c489abc2bfe2b INFO: 172.21.0.1:56030 - "POST /node/69cf7d4b000c489abc2bfe2b HTTP/1.0" 202 Accepted 2026-04-05 08:42:04,772 - lava_callback - INFO - Starting async job submit for node 69cf7d4b000c489abc2bfe2b 2026-04-05 08:42:04,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:42:04,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7d4b000c489abc2bfe2b HTTP/1.1" 200 None 2026-04-05 08:42:04,799 - lava_callback - DEBUG - Processing node 69cf7d4b000c489abc2bfe2b: baseline-arm-clabbe 2026-04-05 08:42:04,799 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf7d4b000c489abc2bfe2b 2026-04-05 08:42:04,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:42:04,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7d4b000c489abc2bfe2b HTTP/1.1" 200 None 2026-04-05 08:42:04,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:42:04,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-05 08:42:04,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:42:04,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf7d4b000c489abc2bfe2b HTTP/1.1" 200 None 2026-04-05 08:42:04,878 - lava_callback - ERROR - Error processing callback for node 69cf7d4b000c489abc2bfe2b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-05 08:42:05,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:42:05,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41642 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42792 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:42:44,775 - lava_callback - INFO - Received callback for node 69cf7d6f000c489abc2bfe49 INFO: 172.21.0.1:41200 - "POST /node/69cf7d6f000c489abc2bfe49 HTTP/1.0" 202 Accepted 2026-04-05 08:42:44,784 - lava_callback - INFO - Starting async job submit for node 69cf7d6f000c489abc2bfe49 2026-04-05 08:42:44,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:42:44,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7d6f000c489abc2bfe49 HTTP/1.1" 200 None 2026-04-05 08:42:44,810 - lava_callback - DEBUG - Processing node 69cf7d6f000c489abc2bfe49: baseline-arm-clabbe 2026-04-05 08:42:44,810 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf7d6f000c489abc2bfe49 2026-04-05 08:42:44,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:42:44,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7d6f000c489abc2bfe49 HTTP/1.1" 200 None 2026-04-05 08:42:44,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:42:44,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-05 08:42:44,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:42:44,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf7d6f000c489abc2bfe49 HTTP/1.1" 200 None 2026-04-05 08:42:44,892 - lava_callback - ERROR - Error processing callback for node 69cf7d6f000c489abc2bfe49: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60900 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:42:59,814 - lava_callback - INFO - Received callback for node 69d21fa00d94ee66016fb512 INFO: 172.21.0.1:37542 - "POST /node/69d21fa00d94ee66016fb512 HTTP/1.0" 202 Accepted 2026-04-05 08:42:59,821 - lava_callback - INFO - Starting async job submit for node 69d21fa00d94ee66016fb512 2026-04-05 08:42:59,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:42:59,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21fa00d94ee66016fb512 HTTP/1.1" 200 None 2026-04-05 08:42:59,866 - lava_callback - DEBUG - Processing node 69d21fa00d94ee66016fb512: ltp-fs_bind 2026-04-05 08:43:00,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:43:00,800 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:43:00,802 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69d21fa00d94ee66016fb512/log.txt.gz 2026-04-05 08:43:01,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:43:01,228 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:43:01,230 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69d21fa00d94ee66016fb512/lava-logs.yaml 2026-04-05 08:43:01,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:43:01,535 - lava_callback - INFO - Received callback for node 69d2203c0d94ee66016fb61c INFO: 172.21.0.1:37548 - "POST /node/69d2203c0d94ee66016fb61c HTTP/1.0" 202 Accepted 2026-04-05 08:43:01,544 - lava_callback - INFO - Starting async job submit for node 69d2203c0d94ee66016fb61c 2026-04-05 08:43:01,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:43:01,575 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:43:01,577 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69d21fa00d94ee66016fb512/lava_callback.json.gz 2026-04-05 08:43:01,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:43:01,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2203c0d94ee66016fb61c HTTP/1.1" 200 None 2026-04-05 08:43:01,618 - lava_callback - DEBUG - Processing node 69d2203c0d94ee66016fb61c: baseline-arm-broonie 2026-04-05 08:43:01,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21fa00d94ee66016fb512 HTTP/1.1" 200 None 2026-04-05 08:43:01,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:43:01,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-05 08:43:01,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:43:01,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:43:01,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d21fa00d94ee66016fb512 HTTP/1.1" 200 None 2026-04-05 08:43:01,882 - lava_callback - INFO - Completed processing callback for node 69d21fa00d94ee66016fb512 2026-04-05 08:43:02,078 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:43:02,081 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d2203c0d94ee66016fb61c/log.txt.gz 2026-04-05 08:43:02,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:43:02,536 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:43:02,538 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d2203c0d94ee66016fb61c/lava-logs.yaml 2026-04-05 08:43:02,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:43:02,704 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:43:02,706 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d2203c0d94ee66016fb61c/lava_callback.json.gz 2026-04-05 08:43:02,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:43:02,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2203c0d94ee66016fb61c HTTP/1.1" 200 None 2026-04-05 08:43:02,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:43:02,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-05 08:43:02,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:43:02,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2203c0d94ee66016fb61c HTTP/1.1" 200 None 2026-04-05 08:43:02,795 - lava_callback - INFO - Completed processing callback for node 69d2203c0d94ee66016fb61c 2026-04-05 08:43:04,780 - lava_callback - INFO - Received callback for node 69cf7d95000c489abc2bfe60 INFO: 172.21.0.1:37560 - "POST /node/69cf7d95000c489abc2bfe60 HTTP/1.0" 202 Accepted 2026-04-05 08:43:04,785 - lava_callback - INFO - Starting async job submit for node 69cf7d95000c489abc2bfe60 2026-04-05 08:43:04,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:43:04,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7d95000c489abc2bfe60 HTTP/1.1" 200 None 2026-04-05 08:43:04,802 - lava_callback - DEBUG - Processing node 69cf7d95000c489abc2bfe60: baseline-arm-clabbe 2026-04-05 08:43:04,802 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf7d95000c489abc2bfe60 2026-04-05 08:43:04,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:43:04,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7d95000c489abc2bfe60 HTTP/1.1" 200 None 2026-04-05 08:43:04,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:43:04,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-05 08:43:04,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:43:04,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf7d95000c489abc2bfe60 HTTP/1.1" 200 None 2026-04-05 08:43:04,862 - lava_callback - ERROR - Error processing callback for node 69cf7d95000c489abc2bfe60: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-05 08:43:05,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:43:05,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37562 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:43:06,598 - lava_callback - INFO - Received callback for node 69d21f9a0d94ee66016fb4ff INFO: 172.21.0.1:37572 - "POST /node/69d21f9a0d94ee66016fb4ff HTTP/1.0" 202 Accepted 2026-04-05 08:43:06,609 - lava_callback - INFO - Starting async job submit for node 69d21f9a0d94ee66016fb4ff 2026-04-05 08:43:06,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:43:06,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f9a0d94ee66016fb4ff HTTP/1.1" 200 None 2026-04-05 08:43:06,656 - lava_callback - DEBUG - Processing node 69d21f9a0d94ee66016fb4ff: ltp-containers 2026-04-05 08:43:07,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:43:07,138 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:43:07,140 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-containers-69d21f9a0d94ee66016fb4ff/log.txt.gz 2026-04-05 08:43:07,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:43:07,552 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:43:07,554 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-containers-69d21f9a0d94ee66016fb4ff/lava-logs.yaml 2026-04-05 08:43:07,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:43:07,706 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:43:07,708 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-containers-69d21f9a0d94ee66016fb4ff/lava_callback.json.gz 2026-04-05 08:43:07,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:43:07,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f9a0d94ee66016fb4ff HTTP/1.1" 200 None 2026-04-05 08:43:07,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:43:07,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-05 08:43:07,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:43:07,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d21f9a0d94ee66016fb4ff HTTP/1.1" 200 None 2026-04-05 08:43:07,804 - lava_callback - INFO - Completed processing callback for node 69d21f9a0d94ee66016fb4ff INFO: 172.21.0.1:45738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36058 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:43:26,815 - lava_callback - INFO - Received callback for node 69d21f980d94ee66016fb4fc INFO: 172.21.0.1:36060 - "POST /node/69d21f980d94ee66016fb4fc HTTP/1.0" 202 Accepted 2026-04-05 08:43:26,822 - lava_callback - INFO - Starting async job submit for node 69d21f980d94ee66016fb4fc 2026-04-05 08:43:26,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:43:26,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f980d94ee66016fb4fc HTTP/1.1" 200 None 2026-04-05 08:43:26,863 - lava_callback - DEBUG - Processing node 69d21f980d94ee66016fb4fc: ltp-cap_bounds 2026-04-05 08:43:27,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:43:27,369 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:43:27,371 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69d21f980d94ee66016fb4fc/log.txt.gz 2026-04-05 08:43:27,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:43:27,803 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:43:27,805 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69d21f980d94ee66016fb4fc/lava-logs.yaml 2026-04-05 08:43:27,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:43:28,000 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:43:28,002 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69d21f980d94ee66016fb4fc/lava_callback.json.gz 2026-04-05 08:43:28,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:43:28,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f980d94ee66016fb4fc HTTP/1.1" 200 None 2026-04-05 08:43:28,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:43:28,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-05 08:43:28,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:43:28,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d21f980d94ee66016fb4fc HTTP/1.1" 200 None 2026-04-05 08:43:28,271 - lava_callback - INFO - Completed processing callback for node 69d21f980d94ee66016fb4fc 2026-04-05 08:43:28,412 - lava_callback - INFO - Received callback for node 69d21f9b0d94ee66016fb502 INFO: 172.21.0.1:36068 - "POST /node/69d21f9b0d94ee66016fb502 HTTP/1.0" 202 Accepted 2026-04-05 08:43:28,420 - lava_callback - INFO - Starting async job submit for node 69d21f9b0d94ee66016fb502 2026-04-05 08:43:28,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:43:28,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f9b0d94ee66016fb502 HTTP/1.1" 200 None 2026-04-05 08:43:28,470 - lava_callback - DEBUG - Processing node 69d21f9b0d94ee66016fb502: ltp-controllers 2026-04-05 08:43:28,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:43:29,108 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:43:29,110 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-controllers-69d21f9b0d94ee66016fb502/log.txt.gz 2026-04-05 08:43:29,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:43:29,578 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:43:29,580 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-controllers-69d21f9b0d94ee66016fb502/lava-logs.yaml 2026-04-05 08:43:29,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:43:29,740 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:43:29,742 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-controllers-69d21f9b0d94ee66016fb502/lava_callback.json.gz 2026-04-05 08:43:29,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:43:29,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f9b0d94ee66016fb502 HTTP/1.1" 200 None 2026-04-05 08:43:29,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:43:29,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-05 08:43:29,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:43:29,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d21f9b0d94ee66016fb502 HTTP/1.1" 200 None 2026-04-05 08:43:29,833 - lava_callback - INFO - Completed processing callback for node 69d21f9b0d94ee66016fb502 INFO: 172.21.0.1:56748 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:43:35,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:43:35,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56764 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:43:39,544 - lava_callback - INFO - Received callback for node 69d220620d94ee66016fb639 INFO: 172.21.0.1:56776 - "POST /node/69d220620d94ee66016fb639 HTTP/1.0" 202 Accepted 2026-04-05 08:43:39,553 - lava_callback - INFO - Starting async job submit for node 69d220620d94ee66016fb639 2026-04-05 08:43:39,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:43:39,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d220620d94ee66016fb639 HTTP/1.1" 200 None 2026-04-05 08:43:39,628 - lava_callback - DEBUG - Processing node 69d220620d94ee66016fb639: baseline-arm-broonie 2026-04-05 08:43:40,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:43:40,330 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:43:40,332 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d220620d94ee66016fb639/log.txt.gz 2026-04-05 08:43:40,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:43:41,233 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:43:41,235 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d220620d94ee66016fb639/lava-logs.yaml 2026-04-05 08:43:41,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:43:41,696 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:43:41,698 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d220620d94ee66016fb639/lava_callback.json.gz 2026-04-05 08:43:41,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:43:41,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d220620d94ee66016fb639 HTTP/1.1" 200 None 2026-04-05 08:43:41,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:43:41,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-05 08:43:41,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:43:41,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d220620d94ee66016fb639 HTTP/1.1" 200 None 2026-04-05 08:43:41,848 - lava_callback - INFO - Completed processing callback for node 69d220620d94ee66016fb639 INFO: 172.21.0.1:58114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42204 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:44:05,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:44:05,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52642 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:44:06,865 - lava_callback - INFO - Received callback for node 69d21fa10d94ee66016fb515 INFO: 172.21.0.1:52656 - "POST /node/69d21fa10d94ee66016fb515 HTTP/1.0" 202 Accepted 2026-04-05 08:44:06,877 - lava_callback - INFO - Starting async job submit for node 69d21fa10d94ee66016fb515 2026-04-05 08:44:06,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:44:06,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21fa10d94ee66016fb515 HTTP/1.1" 200 None 2026-04-05 08:44:06,954 - lava_callback - DEBUG - Processing node 69d21fa10d94ee66016fb515: ltp-fsx 2026-04-05 08:44:07,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:44:08,317 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:44:08,320 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fsx-69d21fa10d94ee66016fb515/log.txt.gz 2026-04-05 08:44:08,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:44:10,268 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:44:10,271 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fsx-69d21fa10d94ee66016fb515/lava-logs.yaml 2026-04-05 08:44:10,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:44:11,422 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:44:11,424 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fsx-69d21fa10d94ee66016fb515/lava_callback.json.gz 2026-04-05 08:44:11,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:44:11,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21fa10d94ee66016fb515 HTTP/1.1" 200 None 2026-04-05 08:44:11,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:44:11,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-05 08:44:11,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:44:11,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d21fa10d94ee66016fb515 HTTP/1.1" 200 None 2026-04-05 08:44:11,584 - lava_callback - INFO - Completed processing callback for node 69d21fa10d94ee66016fb515 INFO: 172.21.0.1:45198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59758 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:44:35,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:44:35,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34260 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:46:52,130 - lava_callback - INFO - Received callback for node 69d221540d94ee66016fb708 INFO: 172.21.0.1:51538 - "POST /node/69d221540d94ee66016fb708 HTTP/1.0" 202 Accepted 2026-04-05 08:46:52,140 - lava_callback - INFO - Starting async job submit for node 69d221540d94ee66016fb708 2026-04-05 08:46:52,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:46:52,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221540d94ee66016fb708 HTTP/1.1" 200 None 2026-04-05 08:46:52,211 - lava_callback - DEBUG - Processing node 69d221540d94ee66016fb708: baseline-arm64 2026-04-05 08:46:52,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:46:52,828 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:46:52,830 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d221540d94ee66016fb708/log.txt.gz 2026-04-05 08:46:52,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:46:53,103 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:46:53,105 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d221540d94ee66016fb708/lava-logs.yaml 2026-04-05 08:46:53,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:46:53,325 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:46:53,327 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d221540d94ee66016fb708/lava_callback.json.gz 2026-04-05 08:46:53,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:46:53,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221540d94ee66016fb708 HTTP/1.1" 200 None 2026-04-05 08:46:53,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:46:53,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 08:46:53,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:46:53,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d221540d94ee66016fb708 HTTP/1.1" 200 None 2026-04-05 08:46:53,555 - lava_callback - INFO - Completed processing callback for node 69d221540d94ee66016fb708 INFO: 172.21.0.1:51548 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:46:59,994 - lava_callback - INFO - Received callback for node 69d21fa40d94ee66016fb51c INFO: 172.21.0.1:38946 - "POST /node/69d21fa40d94ee66016fb51c HTTP/1.0" 202 Accepted 2026-04-05 08:47:00,005 - lava_callback - INFO - Starting async job submit for node 69d21fa40d94ee66016fb51c 2026-04-05 08:47:00,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:00,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21fa40d94ee66016fb51c HTTP/1.1" 200 None 2026-04-05 08:47:00,109 - lava_callback - DEBUG - Processing node 69d21fa40d94ee66016fb51c: ltp-input 2026-04-05 08:47:00,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:47:01,016 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:47:01,019 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-input-69d21fa40d94ee66016fb51c/log.txt.gz 2026-04-05 08:47:01,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:47:01,632 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:47:01,634 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-input-69d21fa40d94ee66016fb51c/lava-logs.yaml 2026-04-05 08:47:01,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:47:01,883 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:47:01,884 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-input-69d21fa40d94ee66016fb51c/lava_callback.json.gz 2026-04-05 08:47:01,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:01,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21fa40d94ee66016fb51c HTTP/1.1" 200 None 2026-04-05 08:47:01,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:01,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-05 08:47:01,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:01,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d21fa40d94ee66016fb51c HTTP/1.1" 200 None 2026-04-05 08:47:01,983 - lava_callback - INFO - Completed processing callback for node 69d21fa40d94ee66016fb51c 2026-04-05 08:47:05,112 - lava_callback - INFO - Received callback for node 69cf7e7f000c489abc2bfed5 INFO: 172.21.0.1:38958 - "POST /node/69cf7e7f000c489abc2bfed5 HTTP/1.0" 202 Accepted 2026-04-05 08:47:05,120 - lava_callback - INFO - Starting async job submit for node 69cf7e7f000c489abc2bfed5 2026-04-05 08:47:05,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:05,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7e7f000c489abc2bfed5 HTTP/1.1" 200 None 2026-04-05 08:47:05,169 - lava_callback - DEBUG - Processing node 69cf7e7f000c489abc2bfed5: baseline-arm-clabbe 2026-04-05 08:47:05,170 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf7e7f000c489abc2bfed5 2026-04-05 08:47:05,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:05,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7e7f000c489abc2bfed5 HTTP/1.1" 200 None 2026-04-05 08:47:05,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:05,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eacbe430e18c5d159df HTTP/1.1" 200 None 2026-04-05 08:47:05,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:05,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf7e7f000c489abc2bfed5 HTTP/1.1" 200 None 2026-04-05 08:47:05,275 - lava_callback - ERROR - Error processing callback for node 69cf7e7f000c489abc2bfed5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-05 08:47:05,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:06,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38974 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:47:06,761 - lava_callback - INFO - Received callback for node 69d21fa50d94ee66016fb51f INFO: 172.21.0.1:38982 - "POST /node/69d21fa50d94ee66016fb51f HTTP/1.0" 202 Accepted 2026-04-05 08:47:06,772 - lava_callback - INFO - Starting async job submit for node 69d21fa50d94ee66016fb51f 2026-04-05 08:47:06,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:06,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21fa50d94ee66016fb51f HTTP/1.1" 200 None 2026-04-05 08:47:06,816 - lava_callback - DEBUG - Processing node 69d21fa50d94ee66016fb51f: ltp-ipc 2026-04-05 08:47:07,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:47:07,729 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:47:07,732 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-ipc-69d21fa50d94ee66016fb51f/log.txt.gz 2026-04-05 08:47:07,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:47:08,263 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:47:08,266 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-ipc-69d21fa50d94ee66016fb51f/lava-logs.yaml 2026-04-05 08:47:08,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:47:08,472 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:47:08,474 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-ipc-69d21fa50d94ee66016fb51f/lava_callback.json.gz 2026-04-05 08:47:08,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:08,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21fa50d94ee66016fb51f HTTP/1.1" 200 None 2026-04-05 08:47:08,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:08,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-05 08:47:08,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:08,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d21fa50d94ee66016fb51f HTTP/1.1" 200 None 2026-04-05 08:47:08,666 - lava_callback - INFO - Completed processing callback for node 69d21fa50d94ee66016fb51f 2026-04-05 08:47:09,428 - lava_callback - INFO - Received callback for node 69d221730d94ee66016fb77b INFO: 172.21.0.1:38998 - "POST /node/69d221730d94ee66016fb77b HTTP/1.0" 202 Accepted 2026-04-05 08:47:09,435 - lava_callback - INFO - Starting async job submit for node 69d221730d94ee66016fb77b 2026-04-05 08:47:09,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:09,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221730d94ee66016fb77b HTTP/1.1" 200 None 2026-04-05 08:47:09,454 - lava_callback - DEBUG - Processing node 69d221730d94ee66016fb77b: baseline-nfs-arm64 2026-04-05 08:47:09,456 - lava_callback - WARNING - Failed to upload log 2026-04-05 08:47:09,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:47:09,685 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:47:09,687 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d221730d94ee66016fb77b/lava-logs.yaml 2026-04-05 08:47:09,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:47:10,007 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:47:10,010 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d221730d94ee66016fb77b/lava_callback.json.gz 2026-04-05 08:47:10,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:10,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221730d94ee66016fb77b HTTP/1.1" 200 None 2026-04-05 08:47:10,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:10,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 08:47:10,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:10,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d221730d94ee66016fb77b HTTP/1.1" 200 None 2026-04-05 08:47:10,153 - lava_callback - INFO - Completed processing callback for node 69d221730d94ee66016fb77b 2026-04-05 08:47:11,684 - lava_callback - INFO - Received callback for node 69d221610d94ee66016fb751 INFO: 172.21.0.1:33872 - "POST /node/69d221610d94ee66016fb751 HTTP/1.0" 202 Accepted 2026-04-05 08:47:11,690 - lava_callback - INFO - Starting async job submit for node 69d221610d94ee66016fb751 2026-04-05 08:47:11,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:11,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221610d94ee66016fb751 HTTP/1.1" 200 None 2026-04-05 08:47:11,742 - lava_callback - DEBUG - Processing node 69d221610d94ee66016fb751: baseline-arm64 2026-04-05 08:47:12,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:47:12,180 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:47:12,182 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d221610d94ee66016fb751/log.txt.gz 2026-04-05 08:47:12,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:47:12,622 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:47:12,625 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d221610d94ee66016fb751/lava-logs.yaml 2026-04-05 08:47:12,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:47:12,823 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:47:12,825 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d221610d94ee66016fb751/lava_callback.json.gz 2026-04-05 08:47:12,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:12,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221610d94ee66016fb751 HTTP/1.1" 200 None 2026-04-05 08:47:12,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:12,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 08:47:12,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:12,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d221610d94ee66016fb751 HTTP/1.1" 200 None 2026-04-05 08:47:12,943 - lava_callback - INFO - Completed processing callback for node 69d221610d94ee66016fb751 INFO: 172.21.0.1:33886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33900 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:47:20,272 - lava_callback - INFO - Received callback for node 69d221560d94ee66016fb733 INFO: 172.21.0.1:45506 - "POST /node/69d221560d94ee66016fb733 HTTP/1.0" 202 Accepted 2026-04-05 08:47:20,279 - lava_callback - INFO - Starting async job submit for node 69d221560d94ee66016fb733 2026-04-05 08:47:20,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:20,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221560d94ee66016fb733 HTTP/1.1" 200 None 2026-04-05 08:47:20,318 - lava_callback - DEBUG - Processing node 69d221560d94ee66016fb733: baseline-arm64 2026-04-05 08:47:20,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:47:20,922 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:47:20,924 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d221560d94ee66016fb733/log.txt.gz 2026-04-05 08:47:21,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:47:21,302 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:47:21,304 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d221560d94ee66016fb733/lava-logs.yaml 2026-04-05 08:47:21,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:47:21,630 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:47:21,632 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d221560d94ee66016fb733/lava_callback.json.gz 2026-04-05 08:47:21,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:21,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221560d94ee66016fb733 HTTP/1.1" 200 None 2026-04-05 08:47:21,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:21,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 08:47:21,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:21,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d221560d94ee66016fb733 HTTP/1.1" 200 None 2026-04-05 08:47:21,728 - lava_callback - INFO - Completed processing callback for node 69d221560d94ee66016fb733 INFO: 172.21.0.1:45508 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:47:28,458 - lava_callback - INFO - Received callback for node 69d2215d0d94ee66016fb748 INFO: 172.21.0.1:45522 - "POST /node/69d2215d0d94ee66016fb748 HTTP/1.0" 202 Accepted 2026-04-05 08:47:28,467 - lava_callback - INFO - Starting async job submit for node 69d2215d0d94ee66016fb748 2026-04-05 08:47:28,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:28,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2215d0d94ee66016fb748 HTTP/1.1" 200 None 2026-04-05 08:47:28,515 - lava_callback - DEBUG - Processing node 69d2215d0d94ee66016fb748: baseline-arm64 2026-04-05 08:47:28,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:47:29,138 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:47:29,141 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d2215d0d94ee66016fb748/log.txt.gz 2026-04-05 08:47:29,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:47:29,682 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:47:29,684 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d2215d0d94ee66016fb748/lava-logs.yaml 2026-04-05 08:47:29,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:47:29,844 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:47:29,846 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d2215d0d94ee66016fb748/lava_callback.json.gz 2026-04-05 08:47:29,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:29,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2215d0d94ee66016fb748 HTTP/1.1" 200 None 2026-04-05 08:47:29,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:29,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 08:47:29,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:29,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2215d0d94ee66016fb748 HTTP/1.1" 200 None 2026-04-05 08:47:29,960 - lava_callback - INFO - Completed processing callback for node 69d2215d0d94ee66016fb748 2026-04-05 08:47:33,300 - lava_callback - INFO - Received callback for node 69d221580d94ee66016fb73c INFO: 172.21.0.1:44344 - "POST /node/69d221580d94ee66016fb73c HTTP/1.0" 202 Accepted 2026-04-05 08:47:33,309 - lava_callback - INFO - Starting async job submit for node 69d221580d94ee66016fb73c 2026-04-05 08:47:33,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:33,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221580d94ee66016fb73c HTTP/1.1" 200 None 2026-04-05 08:47:33,356 - lava_callback - DEBUG - Processing node 69d221580d94ee66016fb73c: baseline-arm64 2026-04-05 08:47:33,583 - lava_callback - WARNING - Failed to upload log 2026-04-05 08:47:33,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:47:33,862 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:47:33,864 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d221580d94ee66016fb73c/lava-logs.yaml 2026-04-05 08:47:33,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:47:34,003 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:47:34,004 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d221580d94ee66016fb73c/lava_callback.json.gz 2026-04-05 08:47:34,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:34,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221580d94ee66016fb73c HTTP/1.1" 200 None 2026-04-05 08:47:34,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:34,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 08:47:34,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:34,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d221580d94ee66016fb73c HTTP/1.1" 200 None 2026-04-05 08:47:34,161 - lava_callback - INFO - Completed processing callback for node 69d221580d94ee66016fb73c 2026-04-05 08:47:34,766 - lava_callback - INFO - Received callback for node 69d2215f0d94ee66016fb74b INFO: 172.21.0.1:44360 - "POST /node/69d2215f0d94ee66016fb74b HTTP/1.0" 202 Accepted 2026-04-05 08:47:34,773 - lava_callback - INFO - Starting async job submit for node 69d2215f0d94ee66016fb74b INFO: 172.21.0.1:44368 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:47:34,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:34,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2215f0d94ee66016fb74b HTTP/1.1" 200 None 2026-04-05 08:47:34,812 - lava_callback - DEBUG - Processing node 69d2215f0d94ee66016fb74b: baseline-arm64 2026-04-05 08:47:35,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:47:35,333 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:47:35,335 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d2215f0d94ee66016fb74b/log.txt.gz 2026-04-05 08:47:35,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:47:35,784 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:47:35,787 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d2215f0d94ee66016fb74b/lava-logs.yaml 2026-04-05 08:47:35,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:47:35,942 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:47:35,945 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d2215f0d94ee66016fb74b/lava_callback.json.gz 2026-04-05 08:47:35,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:36,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:36,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2215f0d94ee66016fb74b HTTP/1.1" 200 None 2026-04-05 08:47:36,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:36,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-05 08:47:36,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 08:47:36,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:36,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2215f0d94ee66016fb74b HTTP/1.1" 200 None 2026-04-05 08:47:36,144 - lava_callback - INFO - Completed processing callback for node 69d2215f0d94ee66016fb74b INFO: 172.21.0.1:44382 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:47:37,414 - lava_callback - INFO - Received callback for node 69d2215c0d94ee66016fb745 INFO: 172.21.0.1:44390 - "POST /node/69d2215c0d94ee66016fb745 HTTP/1.0" 202 Accepted 2026-04-05 08:47:37,420 - lava_callback - INFO - Starting async job submit for node 69d2215c0d94ee66016fb745 2026-04-05 08:47:37,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:37,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2215c0d94ee66016fb745 HTTP/1.1" 200 None 2026-04-05 08:47:37,460 - lava_callback - DEBUG - Processing node 69d2215c0d94ee66016fb745: baseline-arm64 2026-04-05 08:47:37,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:47:37,882 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:47:37,884 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d2215c0d94ee66016fb745/log.txt.gz 2026-04-05 08:47:38,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:47:38,263 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:47:38,265 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d2215c0d94ee66016fb745/lava-logs.yaml 2026-04-05 08:47:38,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:47:38,432 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:47:38,434 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d2215c0d94ee66016fb745/lava_callback.json.gz 2026-04-05 08:47:38,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:38,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2215c0d94ee66016fb745 HTTP/1.1" 200 None 2026-04-05 08:47:38,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:38,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 08:47:38,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:38,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2215c0d94ee66016fb745 HTTP/1.1" 200 None 2026-04-05 08:47:38,527 - lava_callback - INFO - Completed processing callback for node 69d2215c0d94ee66016fb745 2026-04-05 08:47:45,050 - lava_callback - INFO - Received callback for node 69cf7eac000c489abc2bfeec INFO: 172.21.0.1:50200 - "POST /node/69cf7eac000c489abc2bfeec HTTP/1.0" 202 Accepted 2026-04-05 08:47:45,056 - lava_callback - INFO - Starting async job submit for node 69cf7eac000c489abc2bfeec 2026-04-05 08:47:45,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:45,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7eac000c489abc2bfeec HTTP/1.1" 200 None 2026-04-05 08:47:45,079 - lava_callback - DEBUG - Processing node 69cf7eac000c489abc2bfeec: baseline-arm-clabbe 2026-04-05 08:47:45,080 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf7eac000c489abc2bfeec 2026-04-05 08:47:45,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:45,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7eac000c489abc2bfeec HTTP/1.1" 200 None 2026-04-05 08:47:45,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:45,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eacbe430e18c5d159df HTTP/1.1" 200 None 2026-04-05 08:47:45,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:45,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf7eac000c489abc2bfeec HTTP/1.1" 200 None 2026-04-05 08:47:45,135 - lava_callback - ERROR - Error processing callback for node 69cf7eac000c489abc2bfeec: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-05 08:47:45,630 - lava_callback - INFO - Received callback for node 69d221550d94ee66016fb70b INFO: 172.21.0.1:50214 - "POST /node/69d221550d94ee66016fb70b HTTP/1.0" 202 Accepted 2026-04-05 08:47:45,636 - lava_callback - INFO - Starting async job submit for node 69d221550d94ee66016fb70b 2026-04-05 08:47:45,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:45,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221550d94ee66016fb70b HTTP/1.1" 200 None 2026-04-05 08:47:45,675 - lava_callback - DEBUG - Processing node 69d221550d94ee66016fb70b: baseline-arm64 2026-04-05 08:47:45,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:47:46,092 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:47:46,095 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d221550d94ee66016fb70b/log.txt.gz 2026-04-05 08:47:46,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:50226 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:47:46,516 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:47:46,518 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d221550d94ee66016fb70b/lava-logs.yaml 2026-04-05 08:47:46,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:47:46,678 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:47:46,680 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d221550d94ee66016fb70b/lava_callback.json.gz 2026-04-05 08:47:46,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:46,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221550d94ee66016fb70b HTTP/1.1" 200 None 2026-04-05 08:47:46,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:46,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 08:47:46,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:46,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d221550d94ee66016fb70b HTTP/1.1" 200 None 2026-04-05 08:47:46,778 - lava_callback - INFO - Completed processing callback for node 69d221550d94ee66016fb70b 2026-04-05 08:47:47,200 - lava_callback - INFO - Received callback for node 69d21fa70d94ee66016fb522 INFO: 172.21.0.1:50240 - "POST /node/69d21fa70d94ee66016fb522 HTTP/1.0" 202 Accepted 2026-04-05 08:47:47,206 - lava_callback - INFO - Starting async job submit for node 69d21fa70d94ee66016fb522 2026-04-05 08:47:47,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:47,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21fa70d94ee66016fb522 HTTP/1.1" 200 None 2026-04-05 08:47:47,248 - lava_callback - DEBUG - Processing node 69d21fa70d94ee66016fb522: ltp-pty 2026-04-05 08:47:47,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:47:47,859 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:47:47,860 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-pty-69d21fa70d94ee66016fb522/log.txt.gz 2026-04-05 08:47:48,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:47:48,338 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:47:48,340 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-pty-69d21fa70d94ee66016fb522/lava-logs.yaml 2026-04-05 08:47:48,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:47:48,536 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:47:48,538 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-pty-69d21fa70d94ee66016fb522/lava_callback.json.gz 2026-04-05 08:47:48,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:48,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21fa70d94ee66016fb522 HTTP/1.1" 200 None 2026-04-05 08:47:48,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:48,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-05 08:47:48,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:48,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d21fa70d94ee66016fb522 HTTP/1.1" 200 None 2026-04-05 08:47:48,641 - lava_callback - INFO - Completed processing callback for node 69d21fa70d94ee66016fb522 2026-04-05 08:47:48,850 - lava_callback - INFO - Received callback for node 69d21fa80d94ee66016fb525 INFO: 172.21.0.1:50250 - "POST /node/69d21fa80d94ee66016fb525 HTTP/1.0" 202 Accepted 2026-04-05 08:47:48,857 - lava_callback - INFO - Starting async job submit for node 69d21fa80d94ee66016fb525 2026-04-05 08:47:48,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:48,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21fa80d94ee66016fb525 HTTP/1.1" 200 None 2026-04-05 08:47:48,899 - lava_callback - DEBUG - Processing node 69d21fa80d94ee66016fb525: ltp-sched 2026-04-05 08:47:49,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:47:49,404 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:47:49,406 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-sched-69d21fa80d94ee66016fb525/log.txt.gz 2026-04-05 08:47:49,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:47:49,845 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:47:49,847 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-sched-69d21fa80d94ee66016fb525/lava-logs.yaml 2026-04-05 08:47:49,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:47:50,000 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:47:50,002 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-sched-69d21fa80d94ee66016fb525/lava_callback.json.gz 2026-04-05 08:47:50,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:50,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21fa80d94ee66016fb525 HTTP/1.1" 200 None 2026-04-05 08:47:50,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:50,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-05 08:47:50,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:50,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d21fa80d94ee66016fb525 HTTP/1.1" 200 None 2026-04-05 08:47:50,106 - lava_callback - INFO - Completed processing callback for node 69d21fa80d94ee66016fb525 2026-04-05 08:47:56,502 - lava_callback - INFO - Received callback for node 69d221590d94ee66016fb73f INFO: 172.21.0.1:44518 - "POST /node/69d221590d94ee66016fb73f HTTP/1.0" 202 Accepted 2026-04-05 08:47:56,515 - lava_callback - INFO - Starting async job submit for node 69d221590d94ee66016fb73f INFO: 172.21.0.1:44532 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:47:56,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:56,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221590d94ee66016fb73f HTTP/1.1" 200 None 2026-04-05 08:47:56,597 - lava_callback - DEBUG - Processing node 69d221590d94ee66016fb73f: baseline-arm64 2026-04-05 08:47:56,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:47:56,949 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:47:56,951 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d221590d94ee66016fb73f/log.txt.gz 2026-04-05 08:47:57,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:47:57,211 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:47:57,213 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d221590d94ee66016fb73f/lava-logs.yaml 2026-04-05 08:47:57,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:47:57,344 - lava_callback - INFO - Received callback for node 69d221670d94ee66016fb761 INFO: 172.21.0.1:44548 - "POST /node/69d221670d94ee66016fb761 HTTP/1.0" 202 Accepted 2026-04-05 08:47:57,350 - lava_callback - INFO - Starting async job submit for node 69d221670d94ee66016fb761 2026-04-05 08:47:57,377 - lava_callback - INFO - Received callback for node 69d221710d94ee66016fb776 2026-04-05 08:47:57,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:57,389 - lava_callback - INFO - Starting async job submit for node 69d221710d94ee66016fb776 INFO: 172.21.0.1:44562 - "POST /node/69d221710d94ee66016fb776 HTTP/1.0" 202 Accepted 2026-04-05 08:47:57,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:57,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221670d94ee66016fb761 HTTP/1.1" 200 None 2026-04-05 08:47:57,431 - lava_callback - DEBUG - Processing node 69d221670d94ee66016fb761: baseline-arm64 2026-04-05 08:47:57,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221710d94ee66016fb776 HTTP/1.1" 200 None 2026-04-05 08:47:57,480 - lava_callback - DEBUG - Processing node 69d221710d94ee66016fb776: baseline-nfs-arm64 2026-04-05 08:47:57,661 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:47:57,701 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d221590d94ee66016fb73f/lava_callback.json.gz 2026-04-05 08:47:57,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:57,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221590d94ee66016fb73f HTTP/1.1" 200 None 2026-04-05 08:47:58,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:58,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 08:47:58,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:58,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:47:58,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d221590d94ee66016fb73f HTTP/1.1" 200 None 2026-04-05 08:47:58,518 - lava_callback - INFO - Completed processing callback for node 69d221590d94ee66016fb73f 2026-04-05 08:47:58,668 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:47:58,700 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d221670d94ee66016fb761/log.txt.gz 2026-04-05 08:47:58,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:47:59,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:47:59,155 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:47:59,158 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d221710d94ee66016fb776/log.txt.gz 2026-04-05 08:47:59,334 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:47:59,379 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d221670d94ee66016fb761/lava-logs.yaml 2026-04-05 08:47:59,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:47:59,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:47:59,721 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:47:59,723 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d221670d94ee66016fb761/lava_callback.json.gz 2026-04-05 08:47:59,757 - lava_callback - INFO - Received callback for node 69d2216f0d94ee66016fb773 INFO: 172.21.0.1:51138 - "POST /node/69d2216f0d94ee66016fb773 HTTP/1.0" 202 Accepted 2026-04-05 08:47:59,765 - lava_callback - INFO - Starting async job submit for node 69d2216f0d94ee66016fb773 2026-04-05 08:47:59,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:59,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:59,810 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:47:59,813 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d221710d94ee66016fb776/lava-logs.yaml 2026-04-05 08:47:59,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221670d94ee66016fb761 HTTP/1.1" 200 None 2026-04-05 08:47:59,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:47:59,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2216f0d94ee66016fb773 HTTP/1.1" 200 None 2026-04-05 08:47:59,820 - lava_callback - DEBUG - Processing node 69d2216f0d94ee66016fb773: baseline-nfs-arm64 2026-04-05 08:47:59,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:47:59,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 08:47:59,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:00,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d221670d94ee66016fb761 HTTP/1.1" 200 None 2026-04-05 08:48:00,080 - lava_callback - INFO - Completed processing callback for node 69d221670d94ee66016fb761 2026-04-05 08:48:00,225 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:48:00,227 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d221710d94ee66016fb776/lava_callback.json.gz 2026-04-05 08:48:00,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:00,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221710d94ee66016fb776 HTTP/1.1" 200 None 2026-04-05 08:48:00,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:00,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:48:00,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 08:48:00,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:00,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d221710d94ee66016fb776 HTTP/1.1" 200 None 2026-04-05 08:48:00,531 - lava_callback - INFO - Completed processing callback for node 69d221710d94ee66016fb776 2026-04-05 08:48:00,750 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:48:00,753 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d2216f0d94ee66016fb773/log.txt.gz 2026-04-05 08:48:01,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:48:01,318 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:48:01,320 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d2216f0d94ee66016fb773/lava-logs.yaml 2026-04-05 08:48:01,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:48:01,501 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:48:01,503 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d2216f0d94ee66016fb773/lava_callback.json.gz 2026-04-05 08:48:01,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:01,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2216f0d94ee66016fb773 HTTP/1.1" 200 None 2026-04-05 08:48:01,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:01,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 08:48:01,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:01,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2216f0d94ee66016fb773 HTTP/1.1" 200 None 2026-04-05 08:48:01,603 - lava_callback - INFO - Completed processing callback for node 69d2216f0d94ee66016fb773 2026-04-05 08:48:05,174 - lava_callback - INFO - Received callback for node 69d221620d94ee66016fb754 INFO: 172.21.0.1:51144 - "POST /node/69d221620d94ee66016fb754 HTTP/1.0" 202 Accepted 2026-04-05 08:48:05,180 - lava_callback - INFO - Starting async job submit for node 69d221620d94ee66016fb754 2026-04-05 08:48:05,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:05,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221620d94ee66016fb754 HTTP/1.1" 200 None 2026-04-05 08:48:05,222 - lava_callback - DEBUG - Processing node 69d221620d94ee66016fb754: baseline-arm64 2026-04-05 08:48:05,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:48:05,619 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:48:05,621 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d221620d94ee66016fb754/log.txt.gz 2026-04-05 08:48:05,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:48:06,008 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:48:06,010 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d221620d94ee66016fb754/lava-logs.yaml 2026-04-05 08:48:06,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:48:06,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:06,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-05 08:48:06,193 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:48:06,195 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d221620d94ee66016fb754/lava_callback.json.gz 2026-04-05 08:48:06,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:06,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221620d94ee66016fb754 HTTP/1.1" 200 None 2026-04-05 08:48:06,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:06,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 08:48:06,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:06,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d221620d94ee66016fb754 HTTP/1.1" 200 None 2026-04-05 08:48:06,299 - lava_callback - INFO - Completed processing callback for node 69d221620d94ee66016fb754 INFO: 172.21.0.1:51150 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:48:13,614 - lava_callback - INFO - Received callback for node 69d221790d94ee66016fb7bd INFO: 172.21.0.1:40354 - "POST /node/69d221790d94ee66016fb7bd HTTP/1.0" 202 Accepted 2026-04-05 08:48:13,621 - lava_callback - INFO - Starting async job submit for node 69d221790d94ee66016fb7bd 2026-04-05 08:48:13,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:13,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221790d94ee66016fb7bd HTTP/1.1" 200 None 2026-04-05 08:48:13,662 - lava_callback - DEBUG - Processing node 69d221790d94ee66016fb7bd: baseline-nfs-arm64 2026-04-05 08:48:14,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:48:14,243 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:48:14,245 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d221790d94ee66016fb7bd/log.txt.gz 2026-04-05 08:48:14,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:48:14,712 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:48:14,715 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d221790d94ee66016fb7bd/lava-logs.yaml 2026-04-05 08:48:14,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:48:14,920 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:48:14,922 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d221790d94ee66016fb7bd/lava_callback.json.gz 2026-04-05 08:48:14,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:14,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221790d94ee66016fb7bd HTTP/1.1" 200 None 2026-04-05 08:48:14,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:14,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 08:48:14,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:15,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d221790d94ee66016fb7bd HTTP/1.1" 200 None 2026-04-05 08:48:15,023 - lava_callback - INFO - Completed processing callback for node 69d221790d94ee66016fb7bd INFO: 172.21.0.1:40368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40376 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:48:18,791 - lava_callback - INFO - Received callback for node 69d221650d94ee66016fb75a INFO: 172.21.0.1:40390 - "POST /node/69d221650d94ee66016fb75a HTTP/1.0" 202 Accepted 2026-04-05 08:48:18,799 - lava_callback - INFO - Starting async job submit for node 69d221650d94ee66016fb75a 2026-04-05 08:48:18,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:18,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221650d94ee66016fb75a HTTP/1.1" 200 None 2026-04-05 08:48:18,855 - lava_callback - DEBUG - Processing node 69d221650d94ee66016fb75a: baseline-arm64 2026-04-05 08:48:19,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:48:19,355 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:48:19,357 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d221650d94ee66016fb75a/log.txt.gz 2026-04-05 08:48:19,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:48:19,795 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:48:19,798 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d221650d94ee66016fb75a/lava-logs.yaml 2026-04-05 08:48:19,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:48:19,970 - lava_callback - INFO - Received callback for node 69d21d320d94ee66016fb3d0 INFO: 172.21.0.1:50624 - "POST /node/69d21d320d94ee66016fb3d0 HTTP/1.0" 202 Accepted 2026-04-05 08:48:19,977 - lava_callback - INFO - Starting async job submit for node 69d21d320d94ee66016fb3d0 2026-04-05 08:48:20,031 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:48:20,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:20,058 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d221650d94ee66016fb75a/lava_callback.json.gz 2026-04-05 08:48:20,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:20,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21d320d94ee66016fb3d0 HTTP/1.1" 200 None 2026-04-05 08:48:20,108 - lava_callback - DEBUG - Processing node 69d21d320d94ee66016fb3d0: ltp-smoke 2026-04-05 08:48:20,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221650d94ee66016fb75a HTTP/1.1" 200 None 2026-04-05 08:48:20,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:20,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 08:48:20,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:20,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d221650d94ee66016fb75a HTTP/1.1" 200 None 2026-04-05 08:48:20,424 - lava_callback - INFO - Completed processing callback for node 69d221650d94ee66016fb75a 2026-04-05 08:48:20,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:48:21,113 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:48:21,115 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69d21d320d94ee66016fb3d0/log.txt.gz 2026-04-05 08:48:21,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:48:21,519 - lava_callback - INFO - Received callback for node 69d221860d94ee66016fb7de INFO: 172.21.0.1:50632 - "POST /node/69d221860d94ee66016fb7de HTTP/1.0" 202 Accepted 2026-04-05 08:48:21,529 - lava_callback - INFO - Starting async job submit for node 69d221860d94ee66016fb7de 2026-04-05 08:48:21,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:21,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221860d94ee66016fb7de HTTP/1.1" 200 None 2026-04-05 08:48:21,588 - lava_callback - DEBUG - Processing node 69d221860d94ee66016fb7de: baseline-arm64-broonie 2026-04-05 08:48:21,786 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:48:21,823 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69d21d320d94ee66016fb3d0/lava-logs.yaml 2026-04-05 08:48:21,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:48:21,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:48:22,038 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:48:22,040 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d221860d94ee66016fb7de/log.txt.gz 2026-04-05 08:48:22,122 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:48:22,136 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69d21d320d94ee66016fb3d0/lava_callback.json.gz 2026-04-05 08:48:22,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:48:22,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:22,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21d320d94ee66016fb3d0 HTTP/1.1" 200 None 2026-04-05 08:48:22,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:22,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9f0d94ee66016fb135 HTTP/1.1" 200 None 2026-04-05 08:48:22,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:22,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d21d320d94ee66016fb3d0 HTTP/1.1" 200 None 2026-04-05 08:48:22,568 - lava_callback - INFO - Completed processing callback for node 69d21d320d94ee66016fb3d0 2026-04-05 08:48:22,624 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:48:22,626 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d221860d94ee66016fb7de/lava-logs.yaml 2026-04-05 08:48:22,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:48:22,791 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:48:22,793 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d221860d94ee66016fb7de/lava_callback.json.gz 2026-04-05 08:48:22,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:22,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221860d94ee66016fb7de HTTP/1.1" 200 None 2026-04-05 08:48:22,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:22,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 08:48:22,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:22,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d221860d94ee66016fb7de HTTP/1.1" 200 None 2026-04-05 08:48:22,901 - lava_callback - INFO - Completed processing callback for node 69d221860d94ee66016fb7de 2026-04-05 08:48:24,576 - lava_callback - INFO - Received callback for node 69d221a30d94ee66016fb863 INFO: 172.21.0.1:50648 - "POST /node/69d221a30d94ee66016fb863 HTTP/1.0" 202 Accepted 2026-04-05 08:48:24,584 - lava_callback - INFO - Starting async job submit for node 69d221a30d94ee66016fb863 2026-04-05 08:48:24,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:24,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221a30d94ee66016fb863 HTTP/1.1" 200 None 2026-04-05 08:48:24,646 - lava_callback - DEBUG - Processing node 69d221a30d94ee66016fb863: baseline-arm64-foundriesio 2026-04-05 08:48:25,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:48:25,273 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:48:25,275 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d221a30d94ee66016fb863/log.txt.gz 2026-04-05 08:48:25,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:48:25,761 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:48:25,764 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d221a30d94ee66016fb863/lava-logs.yaml 2026-04-05 08:48:25,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:48:26,015 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:48:26,018 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d221a30d94ee66016fb863/lava_callback.json.gz 2026-04-05 08:48:26,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:26,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221a30d94ee66016fb863 HTTP/1.1" 200 None 2026-04-05 08:48:26,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:26,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 08:48:26,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:26,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d221a30d94ee66016fb863 HTTP/1.1" 200 None 2026-04-05 08:48:26,134 - lava_callback - INFO - Completed processing callback for node 69d221a30d94ee66016fb863 INFO: 172.21.0.1:50650 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:48:28,304 - lava_callback - INFO - Received callback for node 69d221a00d94ee66016fb856 INFO: 172.21.0.1:50654 - "POST /node/69d221a00d94ee66016fb856 HTTP/1.0" 202 Accepted 2026-04-05 08:48:28,313 - lava_callback - INFO - Starting async job submit for node 69d221a00d94ee66016fb856 2026-04-05 08:48:28,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:28,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221a00d94ee66016fb856 HTTP/1.1" 200 None 2026-04-05 08:48:28,349 - lava_callback - DEBUG - Processing node 69d221a00d94ee66016fb856: baseline-arm64-pengutronix 2026-04-05 08:48:28,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:48:28,708 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:48:28,711 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69d221a00d94ee66016fb856/log.txt.gz 2026-04-05 08:48:28,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:48:29,081 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:48:29,084 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69d221a00d94ee66016fb856/lava-logs.yaml 2026-04-05 08:48:29,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:48:29,243 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:48:29,245 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69d221a00d94ee66016fb856/lava_callback.json.gz 2026-04-05 08:48:29,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:29,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221a00d94ee66016fb856 HTTP/1.1" 200 None 2026-04-05 08:48:29,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:29,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 08:48:29,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:29,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d221a00d94ee66016fb856 HTTP/1.1" 200 None 2026-04-05 08:48:29,354 - lava_callback - INFO - Completed processing callback for node 69d221a00d94ee66016fb856 2026-04-05 08:48:32,235 - lava_callback - INFO - Received callback for node 69d221740d94ee66016fb7ae INFO: 172.21.0.1:48958 - "POST /node/69d221740d94ee66016fb7ae HTTP/1.0" 202 Accepted 2026-04-05 08:48:32,243 - lava_callback - INFO - Starting async job submit for node 69d221740d94ee66016fb7ae 2026-04-05 08:48:32,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:32,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221740d94ee66016fb7ae HTTP/1.1" 200 None 2026-04-05 08:48:32,287 - lava_callback - DEBUG - Processing node 69d221740d94ee66016fb7ae: baseline-nfs-arm64 2026-04-05 08:48:32,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:48:32,818 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:48:32,820 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d221740d94ee66016fb7ae/log.txt.gz 2026-04-05 08:48:33,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:48:33,295 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:48:33,297 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d221740d94ee66016fb7ae/lava-logs.yaml 2026-04-05 08:48:33,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:48:33,475 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:48:33,477 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d221740d94ee66016fb7ae/lava_callback.json.gz 2026-04-05 08:48:33,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:33,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221740d94ee66016fb7ae HTTP/1.1" 200 None 2026-04-05 08:48:33,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:33,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 08:48:33,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:33,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d221740d94ee66016fb7ae HTTP/1.1" 200 None 2026-04-05 08:48:33,583 - lava_callback - INFO - Completed processing callback for node 69d221740d94ee66016fb7ae INFO: 172.21.0.1:48964 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:48:36,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:36,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:48970 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:48:37,327 - lava_callback - INFO - Received callback for node 69d221a10d94ee66016fb859 INFO: 172.21.0.1:48974 - "POST /node/69d221a10d94ee66016fb859 HTTP/1.0" 202 Accepted 2026-04-05 08:48:37,333 - lava_callback - INFO - Starting async job submit for node 69d221a10d94ee66016fb859 2026-04-05 08:48:37,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:37,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221a10d94ee66016fb859 HTTP/1.1" 200 None 2026-04-05 08:48:37,373 - lava_callback - DEBUG - Processing node 69d221a10d94ee66016fb859: baseline-arm64-pengutronix 2026-04-05 08:48:37,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:48:37,758 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:48:37,760 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69d221a10d94ee66016fb859/log.txt.gz 2026-04-05 08:48:37,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:48:38,099 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:48:38,101 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69d221a10d94ee66016fb859/lava-logs.yaml 2026-04-05 08:48:38,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:48:38,672 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:48:38,673 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69d221a10d94ee66016fb859/lava_callback.json.gz 2026-04-05 08:48:38,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:38,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221a10d94ee66016fb859 HTTP/1.1" 200 None 2026-04-05 08:48:38,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:38,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 08:48:38,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:38,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d221a10d94ee66016fb859 HTTP/1.1" 200 None 2026-04-05 08:48:38,756 - lava_callback - INFO - Completed processing callback for node 69d221a10d94ee66016fb859 2026-04-05 08:48:39,785 - lava_callback - INFO - Received callback for node 69d220190d94ee66016fb5fa INFO: 172.21.0.1:37140 - "POST /node/69d220190d94ee66016fb5fa HTTP/1.0" 202 Accepted 2026-04-05 08:48:39,792 - lava_callback - INFO - Starting async job submit for node 69d220190d94ee66016fb5fa 2026-04-05 08:48:39,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:39,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d220190d94ee66016fb5fa HTTP/1.1" 200 None 2026-04-05 08:48:39,844 - lava_callback - DEBUG - Processing node 69d220190d94ee66016fb5fa: baseline-arm-broonie 2026-04-05 08:48:40,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:48:40,229 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:48:40,231 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d220190d94ee66016fb5fa/log.txt.gz 2026-04-05 08:48:40,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:48:40,593 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:48:40,595 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d220190d94ee66016fb5fa/lava-logs.yaml 2026-04-05 08:48:40,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:48:40,797 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:48:40,800 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d220190d94ee66016fb5fa/lava_callback.json.gz 2026-04-05 08:48:40,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:40,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d220190d94ee66016fb5fa HTTP/1.1" 200 None 2026-04-05 08:48:40,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:40,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-05 08:48:40,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:40,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d220190d94ee66016fb5fa HTTP/1.1" 200 None 2026-04-05 08:48:40,890 - lava_callback - INFO - Completed processing callback for node 69d220190d94ee66016fb5fa 2026-04-05 08:48:41,305 - lava_callback - INFO - Received callback for node 69d2218f0d94ee66016fb7fd INFO: 172.21.0.1:37152 - "POST /node/69d2218f0d94ee66016fb7fd HTTP/1.0" 202 Accepted 2026-04-05 08:48:41,311 - lava_callback - INFO - Starting async job submit for node 69d2218f0d94ee66016fb7fd 2026-04-05 08:48:41,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:41,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2218f0d94ee66016fb7fd HTTP/1.1" 200 None 2026-04-05 08:48:41,363 - lava_callback - DEBUG - Processing node 69d2218f0d94ee66016fb7fd: baseline-arm64-broonie 2026-04-05 08:48:41,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:48:41,798 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:48:41,800 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d2218f0d94ee66016fb7fd/log.txt.gz 2026-04-05 08:48:41,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:48:42,173 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:48:42,176 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d2218f0d94ee66016fb7fd/lava-logs.yaml 2026-04-05 08:48:42,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:48:42,340 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:48:42,342 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d2218f0d94ee66016fb7fd/lava_callback.json.gz 2026-04-05 08:48:42,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:42,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2218f0d94ee66016fb7fd HTTP/1.1" 200 None 2026-04-05 08:48:42,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:42,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 08:48:42,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:42,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2218f0d94ee66016fb7fd HTTP/1.1" 200 None 2026-04-05 08:48:42,437 - lava_callback - INFO - Completed processing callback for node 69d2218f0d94ee66016fb7fd INFO: 172.21.0.1:37168 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:48:48,639 - lava_callback - INFO - Received callback for node 69d2216a0d94ee66016fb767 INFO: 172.21.0.1:37180 - "POST /node/69d2216a0d94ee66016fb767 HTTP/1.0" 202 Accepted 2026-04-05 08:48:48,647 - lava_callback - INFO - Starting async job submit for node 69d2216a0d94ee66016fb767 2026-04-05 08:48:48,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:48,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2216a0d94ee66016fb767 HTTP/1.1" 200 None 2026-04-05 08:48:48,687 - lava_callback - DEBUG - Processing node 69d2216a0d94ee66016fb767: baseline-nfs-arm64 2026-04-05 08:48:49,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:48:49,241 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:48:49,243 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d2216a0d94ee66016fb767/log.txt.gz 2026-04-05 08:48:49,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:48:49,645 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:48:49,647 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d2216a0d94ee66016fb767/lava-logs.yaml 2026-04-05 08:48:49,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:48:49,777 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:48:49,778 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d2216a0d94ee66016fb767/lava_callback.json.gz 2026-04-05 08:48:49,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:49,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2216a0d94ee66016fb767 HTTP/1.1" 200 None 2026-04-05 08:48:49,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:49,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 08:48:49,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:49,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2216a0d94ee66016fb767 HTTP/1.1" 200 None 2026-04-05 08:48:49,871 - lava_callback - INFO - Completed processing callback for node 69d2216a0d94ee66016fb767 2026-04-05 08:48:54,160 - lava_callback - INFO - Received callback for node 69d2219d0d94ee66016fb850 INFO: 172.21.0.1:49158 - "POST /node/69d2219d0d94ee66016fb850 HTTP/1.0" 202 Accepted 2026-04-05 08:48:54,167 - lava_callback - INFO - Starting async job submit for node 69d2219d0d94ee66016fb850 2026-04-05 08:48:54,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:54,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2219d0d94ee66016fb850 HTTP/1.1" 200 None 2026-04-05 08:48:54,213 - lava_callback - DEBUG - Processing node 69d2219d0d94ee66016fb850: baseline-arm64-kontron 2026-04-05 08:48:54,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:48:54,643 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:48:54,645 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69d2219d0d94ee66016fb850/log.txt.gz 2026-04-05 08:48:54,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:48:55,016 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:48:55,018 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69d2219d0d94ee66016fb850/lava-logs.yaml 2026-04-05 08:48:55,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:48:55,189 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:48:55,190 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69d2219d0d94ee66016fb850/lava_callback.json.gz 2026-04-05 08:48:55,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:55,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2219d0d94ee66016fb850 HTTP/1.1" 200 None 2026-04-05 08:48:55,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:55,255 - lava_callback - INFO - Received callback for node 69d2219e0d94ee66016fb853 INFO: 172.21.0.1:49170 - "POST /node/69d2219e0d94ee66016fb853 HTTP/1.0" 202 Accepted 2026-04-05 08:48:55,262 - lava_callback - INFO - Starting async job submit for node 69d2219e0d94ee66016fb853 2026-04-05 08:48:55,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 08:48:55,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:55,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:55,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2219e0d94ee66016fb853 HTTP/1.1" 200 None 2026-04-05 08:48:55,321 - lava_callback - DEBUG - Processing node 69d2219e0d94ee66016fb853: baseline-arm64-kontron 2026-04-05 08:48:55,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2219d0d94ee66016fb850 HTTP/1.1" 200 None 2026-04-05 08:48:55,341 - lava_callback - INFO - Completed processing callback for node 69d2219d0d94ee66016fb850 2026-04-05 08:48:55,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:48:55,836 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:48:55,838 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69d2219e0d94ee66016fb853/log.txt.gz 2026-04-05 08:48:56,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:48:56,291 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:48:56,293 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69d2219e0d94ee66016fb853/lava-logs.yaml 2026-04-05 08:48:56,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:48:56,504 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:48:56,505 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69d2219e0d94ee66016fb853/lava_callback.json.gz INFO: 172.21.0.1:49184 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:48:56,515 - lava_callback - INFO - Received callback for node 69cf7ee7000c489abc2bffb1 INFO: 172.21.0.1:49196 - "POST /node/69cf7ee7000c489abc2bffb1 HTTP/1.0" 202 Accepted 2026-04-05 08:48:56,536 - lava_callback - INFO - Starting async job submit for node 69cf7ee7000c489abc2bffb1 2026-04-05 08:48:56,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:56,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:56,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2219e0d94ee66016fb853 HTTP/1.1" 200 None 2026-04-05 08:48:56,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:56,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7ee7000c489abc2bffb1 HTTP/1.1" 200 None 2026-04-05 08:48:56,561 - lava_callback - DEBUG - Processing node 69cf7ee7000c489abc2bffb1: baseline-arm64-baylibre 2026-04-05 08:48:56,561 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf7ee7000c489abc2bffb1 2026-04-05 08:48:56,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:56,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 08:48:56,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:56,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7ee7000c489abc2bffb1 HTTP/1.1" 200 None 2026-04-05 08:48:56,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:56,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-05 08:48:56,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:56,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2219e0d94ee66016fb853 HTTP/1.1" 200 None 2026-04-05 08:48:56,621 - lava_callback - INFO - Completed processing callback for node 69d2219e0d94ee66016fb853 2026-04-05 08:48:56,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf7ee7000c489abc2bffb1 HTTP/1.1" 200 None 2026-04-05 08:48:56,687 - lava_callback - ERROR - Error processing callback for node 69cf7ee7000c489abc2bffb1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-05 08:48:57,217 - lava_callback - INFO - Received callback for node 69cf7ee9000c489abc2bffb4 INFO: 172.21.0.1:49208 - "POST /node/69cf7ee9000c489abc2bffb4 HTTP/1.0" 202 Accepted 2026-04-05 08:48:57,223 - lava_callback - INFO - Starting async job submit for node 69cf7ee9000c489abc2bffb4 2026-04-05 08:48:57,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:57,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7ee9000c489abc2bffb4 HTTP/1.1" 200 None 2026-04-05 08:48:57,240 - lava_callback - DEBUG - Processing node 69cf7ee9000c489abc2bffb4: baseline-arm64-baylibre 2026-04-05 08:48:57,240 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf7ee9000c489abc2bffb4 2026-04-05 08:48:57,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:57,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7ee9000c489abc2bffb4 HTTP/1.1" 200 None 2026-04-05 08:48:57,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:57,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-05 08:48:57,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:57,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf7ee9000c489abc2bffb4 HTTP/1.1" 200 None 2026-04-05 08:48:57,307 - lava_callback - ERROR - Error processing callback for node 69cf7ee9000c489abc2bffb4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-05 08:48:57,910 - lava_callback - INFO - Received callback for node 69cf7eed000c489abc2bffe5 INFO: 172.21.0.1:49222 - "POST /node/69cf7eed000c489abc2bffe5 HTTP/1.0" 202 Accepted 2026-04-05 08:48:57,915 - lava_callback - INFO - Starting async job submit for node 69cf7eed000c489abc2bffe5 2026-04-05 08:48:57,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:57,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7eed000c489abc2bffe5 HTTP/1.1" 200 None 2026-04-05 08:48:57,931 - lava_callback - DEBUG - Processing node 69cf7eed000c489abc2bffe5: baseline-arm64-baylibre 2026-04-05 08:48:57,931 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf7eed000c489abc2bffe5 2026-04-05 08:48:57,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:57,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7eed000c489abc2bffe5 HTTP/1.1" 200 None 2026-04-05 08:48:57,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:57,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-05 08:48:57,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:48:57,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf7eed000c489abc2bffe5 HTTP/1.1" 200 None 2026-04-05 08:48:57,991 - lava_callback - ERROR - Error processing callback for node 69cf7eed000c489abc2bffe5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-05 08:49:05,199 - lava_callback - INFO - Received callback for node 69cf7efb000c489abc2c0011 INFO: 172.21.0.1:54268 - "POST /node/69cf7efb000c489abc2c0011 HTTP/1.0" 202 Accepted 2026-04-05 08:49:05,205 - lava_callback - INFO - Starting async job submit for node 69cf7efb000c489abc2c0011 2026-04-05 08:49:05,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:49:05,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7efb000c489abc2c0011 HTTP/1.1" 200 None 2026-04-05 08:49:05,227 - lava_callback - DEBUG - Processing node 69cf7efb000c489abc2c0011: baseline-arm64-clabbe 2026-04-05 08:49:05,227 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf7efb000c489abc2c0011 2026-04-05 08:49:05,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:49:05,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7efb000c489abc2c0011 HTTP/1.1" 200 None 2026-04-05 08:49:05,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:49:05,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-05 08:49:05,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:49:05,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf7efb000c489abc2c0011 HTTP/1.1" 200 None 2026-04-05 08:49:05,283 - lava_callback - ERROR - Error processing callback for node 69cf7efb000c489abc2c0011: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-05 08:49:05,876 - lava_callback - INFO - Received callback for node 69cf7efd000c489abc2c0014 INFO: 172.21.0.1:54278 - "POST /node/69cf7efd000c489abc2c0014 HTTP/1.0" 202 Accepted 2026-04-05 08:49:05,881 - lava_callback - INFO - Starting async job submit for node 69cf7efd000c489abc2c0014 2026-04-05 08:49:05,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:49:05,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7efd000c489abc2c0014 HTTP/1.1" 200 None 2026-04-05 08:49:05,901 - lava_callback - DEBUG - Processing node 69cf7efd000c489abc2c0014: baseline-arm64-clabbe 2026-04-05 08:49:05,901 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf7efd000c489abc2c0014 2026-04-05 08:49:05,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:49:05,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7efd000c489abc2c0014 HTTP/1.1" 200 None 2026-04-05 08:49:05,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:49:05,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-05 08:49:05,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:49:05,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf7efd000c489abc2c0014 HTTP/1.1" 200 None 2026-04-05 08:49:05,980 - lava_callback - ERROR - Error processing callback for node 69cf7efd000c489abc2c0014: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-05 08:49:06,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:49:06,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:54290 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:49:06,597 - lava_callback - INFO - Received callback for node 69cf7efe000c489abc2c0017 INFO: 172.21.0.1:54304 - "POST /node/69cf7efe000c489abc2c0017 HTTP/1.0" 202 Accepted 2026-04-05 08:49:06,602 - lava_callback - INFO - Starting async job submit for node 69cf7efe000c489abc2c0017 2026-04-05 08:49:06,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:49:06,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7efe000c489abc2c0017 HTTP/1.1" 200 None 2026-04-05 08:49:06,620 - lava_callback - DEBUG - Processing node 69cf7efe000c489abc2c0017: baseline-arm64-clabbe 2026-04-05 08:49:06,620 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf7efe000c489abc2c0017 2026-04-05 08:49:06,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:49:06,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7efe000c489abc2c0017 HTTP/1.1" 200 None 2026-04-05 08:49:06,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:49:06,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-05 08:49:06,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:49:06,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf7efe000c489abc2c0017 HTTP/1.1" 200 None 2026-04-05 08:49:06,692 - lava_callback - ERROR - Error processing callback for node 69cf7efe000c489abc2c0017: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-05 08:49:06,704 - lava_callback - INFO - Received callback for node 69d221890d94ee66016fb7e5 INFO: 172.21.0.1:54318 - "POST /node/69d221890d94ee66016fb7e5 HTTP/1.0" 202 Accepted 2026-04-05 08:49:06,736 - lava_callback - INFO - Starting async job submit for node 69d221890d94ee66016fb7e5 2026-04-05 08:49:06,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:49:06,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221890d94ee66016fb7e5 HTTP/1.1" 200 None 2026-04-05 08:49:06,832 - lava_callback - DEBUG - Processing node 69d221890d94ee66016fb7e5: baseline-arm64-broonie 2026-04-05 08:49:07,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:49:07,280 - lava_callback - INFO - Received callback for node 69cf7eff000c489abc2c001a INFO: 172.21.0.1:54332 - "POST /node/69cf7eff000c489abc2c001a HTTP/1.0" 202 Accepted 2026-04-05 08:49:07,288 - lava_callback - INFO - Starting async job submit for node 69cf7eff000c489abc2c001a 2026-04-05 08:49:07,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:49:07,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7eff000c489abc2c001a HTTP/1.1" 200 None 2026-04-05 08:49:07,307 - lava_callback - DEBUG - Processing node 69cf7eff000c489abc2c001a: baseline-arm64-clabbe 2026-04-05 08:49:07,307 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf7eff000c489abc2c001a 2026-04-05 08:49:07,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:49:07,317 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:49:07,319 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d221890d94ee66016fb7e5/log.txt.gz 2026-04-05 08:49:07,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7eff000c489abc2c001a HTTP/1.1" 200 None 2026-04-05 08:49:07,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:49:07,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-05 08:49:07,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:49:07,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:49:07,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf7eff000c489abc2c001a HTTP/1.1" 200 None 2026-04-05 08:49:07,558 - lava_callback - ERROR - Error processing callback for node 69cf7eff000c489abc2c001a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-05 08:49:07,865 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:49:07,867 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d221890d94ee66016fb7e5/lava-logs.yaml 2026-04-05 08:49:07,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:49:08,041 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:49:08,043 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d221890d94ee66016fb7e5/lava_callback.json.gz 2026-04-05 08:49:08,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:49:08,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221890d94ee66016fb7e5 HTTP/1.1" 200 None 2026-04-05 08:49:08,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:49:08,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 08:49:08,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:49:08,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d221890d94ee66016fb7e5 HTTP/1.1" 200 None 2026-04-05 08:49:08,183 - lava_callback - INFO - Completed processing callback for node 69d221890d94ee66016fb7e5 2026-04-05 08:49:08,223 - lava_callback - INFO - Received callback for node 69d2218b0d94ee66016fb7ee INFO: 172.21.0.1:54342 - "POST /node/69d2218b0d94ee66016fb7ee HTTP/1.0" 202 Accepted 2026-04-05 08:49:08,238 - lava_callback - INFO - Starting async job submit for node 69d2218b0d94ee66016fb7ee 2026-04-05 08:49:08,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:49:08,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2218b0d94ee66016fb7ee HTTP/1.1" 200 None 2026-04-05 08:49:08,292 - lava_callback - DEBUG - Processing node 69d2218b0d94ee66016fb7ee: baseline-arm64-broonie 2026-04-05 08:49:08,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:49:08,798 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:49:08,800 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d2218b0d94ee66016fb7ee/log.txt.gz 2026-04-05 08:49:08,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:49:09,154 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:49:09,156 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d2218b0d94ee66016fb7ee/lava-logs.yaml 2026-04-05 08:49:09,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:49:09,296 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:49:09,298 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d2218b0d94ee66016fb7ee/lava_callback.json.gz 2026-04-05 08:49:09,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:49:09,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2218b0d94ee66016fb7ee HTTP/1.1" 200 None 2026-04-05 08:49:09,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:49:09,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 08:49:09,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:49:09,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2218b0d94ee66016fb7ee HTTP/1.1" 200 None 2026-04-05 08:49:09,550 - lava_callback - INFO - Completed processing callback for node 69d2218b0d94ee66016fb7ee INFO: 172.21.0.1:54748 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54750 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:49:22,179 - lava_callback - INFO - Received callback for node 69d221a20d94ee66016fb860 INFO: 172.21.0.1:37762 - "POST /node/69d221a20d94ee66016fb860 HTTP/1.0" 202 Accepted 2026-04-05 08:49:22,185 - lava_callback - INFO - Starting async job submit for node 69d221a20d94ee66016fb860 2026-04-05 08:49:22,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:49:22,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221a20d94ee66016fb860 HTTP/1.1" 200 None 2026-04-05 08:49:22,232 - lava_callback - DEBUG - Processing node 69d221a20d94ee66016fb860: baseline-arm64-foundriesio 2026-04-05 08:49:22,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:49:22,640 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:49:22,643 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d221a20d94ee66016fb860/log.txt.gz 2026-04-05 08:49:22,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:49:22,982 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:49:22,985 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d221a20d94ee66016fb860/lava-logs.yaml 2026-04-05 08:49:22,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:49:23,138 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:49:23,139 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d221a20d94ee66016fb860/lava_callback.json.gz 2026-04-05 08:49:23,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:49:23,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221a20d94ee66016fb860 HTTP/1.1" 200 None 2026-04-05 08:49:23,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:49:23,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 08:49:23,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:49:23,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d221a20d94ee66016fb860 HTTP/1.1" 200 None 2026-04-05 08:49:23,285 - lava_callback - INFO - Completed processing callback for node 69d221a20d94ee66016fb860 2026-04-05 08:49:25,196 - lava_callback - INFO - Received callback for node 69cf7f01000c489abc2c0023 INFO: 172.21.0.1:37772 - "POST /node/69cf7f01000c489abc2c0023 HTTP/1.0" 202 Accepted 2026-04-05 08:49:25,201 - lava_callback - INFO - Starting async job submit for node 69cf7f01000c489abc2c0023 2026-04-05 08:49:25,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:49:25,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7f01000c489abc2c0023 HTTP/1.1" 200 None 2026-04-05 08:49:25,224 - lava_callback - DEBUG - Processing node 69cf7f01000c489abc2c0023: baseline-arm64-clabbe 2026-04-05 08:49:25,225 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf7f01000c489abc2c0023 2026-04-05 08:49:25,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:49:25,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7f01000c489abc2c0023 HTTP/1.1" 200 None 2026-04-05 08:49:25,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:49:25,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-05 08:49:25,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:49:25,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf7f01000c489abc2c0023 HTTP/1.1" 200 None 2026-04-05 08:49:25,303 - lava_callback - ERROR - Error processing callback for node 69cf7f01000c489abc2c0023: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-05 08:49:25,868 - lava_callback - INFO - Received callback for node 69cf7f00000c489abc2c0020 INFO: 172.21.0.1:37786 - "POST /node/69cf7f00000c489abc2c0020 HTTP/1.0" 202 Accepted 2026-04-05 08:49:25,875 - lava_callback - INFO - Starting async job submit for node 69cf7f00000c489abc2c0020 2026-04-05 08:49:25,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:49:25,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7f00000c489abc2c0020 HTTP/1.1" 200 None 2026-04-05 08:49:25,900 - lava_callback - DEBUG - Processing node 69cf7f00000c489abc2c0020: baseline-arm64-clabbe 2026-04-05 08:49:25,901 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf7f00000c489abc2c0020 2026-04-05 08:49:25,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:49:25,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7f00000c489abc2c0020 HTTP/1.1" 200 None 2026-04-05 08:49:25,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:49:25,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-05 08:49:25,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:49:25,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf7f00000c489abc2c0020 HTTP/1.1" 200 None 2026-04-05 08:49:25,971 - lava_callback - ERROR - Error processing callback for node 69cf7f00000c489abc2c0020: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37794 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:49:26,669 - lava_callback - INFO - Received callback for node 69d221910d94ee66016fb804 INFO: 172.21.0.1:37796 - "POST /node/69d221910d94ee66016fb804 HTTP/1.0" 202 Accepted 2026-04-05 08:49:26,678 - lava_callback - INFO - Starting async job submit for node 69d221910d94ee66016fb804 2026-04-05 08:49:26,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:49:26,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221910d94ee66016fb804 HTTP/1.1" 200 None 2026-04-05 08:49:26,745 - lava_callback - DEBUG - Processing node 69d221910d94ee66016fb804: baseline-arm64-broonie 2026-04-05 08:49:26,791 - lava_callback - INFO - Received callback for node 69d2216c0d94ee66016fb76d INFO: 172.21.0.1:37800 - "POST /node/69d2216c0d94ee66016fb76d HTTP/1.0" 202 Accepted 2026-04-05 08:49:26,823 - lava_callback - INFO - Starting async job submit for node 69d2216c0d94ee66016fb76d 2026-04-05 08:49:26,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:49:26,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2216c0d94ee66016fb76d HTTP/1.1" 200 None 2026-04-05 08:49:26,973 - lava_callback - DEBUG - Processing node 69d2216c0d94ee66016fb76d: baseline-nfs-arm64 2026-04-05 08:49:27,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:49:27,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:49:27,598 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:49:27,599 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d221910d94ee66016fb804/log.txt.gz 2026-04-05 08:49:27,685 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:49:27,728 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d2216c0d94ee66016fb76d/log.txt.gz 2026-04-05 08:49:27,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:49:28,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:49:28,105 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:49:28,107 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d221910d94ee66016fb804/lava-logs.yaml 2026-04-05 08:49:28,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:49:28,242 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:49:28,245 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d221910d94ee66016fb804/lava_callback.json.gz 2026-04-05 08:49:28,263 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:49:28,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:49:28,282 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d2216c0d94ee66016fb76d/lava-logs.yaml 2026-04-05 08:49:28,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:49:28,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221910d94ee66016fb804 HTTP/1.1" 200 None 2026-04-05 08:49:28,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:49:28,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 08:49:28,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:49:28,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d221910d94ee66016fb804 HTTP/1.1" 200 None 2026-04-05 08:49:28,364 - lava_callback - INFO - Completed processing callback for node 69d221910d94ee66016fb804 2026-04-05 08:49:28,526 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:49:28,528 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d2216c0d94ee66016fb76d/lava_callback.json.gz 2026-04-05 08:49:28,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:49:28,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2216c0d94ee66016fb76d HTTP/1.1" 200 None 2026-04-05 08:49:28,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:49:28,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 08:49:28,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:49:28,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2216c0d94ee66016fb76d HTTP/1.1" 200 None 2026-04-05 08:49:28,656 - lava_callback - INFO - Completed processing callback for node 69d2216c0d94ee66016fb76d INFO: 172.21.0.1:37368 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:49:36,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:49:36,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:37378 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:49:40,093 - lava_callback - INFO - Received callback for node 69d221880d94ee66016fb7e1 INFO: 172.21.0.1:46836 - "POST /node/69d221880d94ee66016fb7e1 HTTP/1.0" 202 Accepted 2026-04-05 08:49:40,103 - lava_callback - INFO - Starting async job submit for node 69d221880d94ee66016fb7e1 2026-04-05 08:49:40,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:49:40,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221880d94ee66016fb7e1 HTTP/1.1" 200 None 2026-04-05 08:49:40,142 - lava_callback - DEBUG - Processing node 69d221880d94ee66016fb7e1: baseline-arm64-broonie 2026-04-05 08:49:40,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:49:40,552 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:49:40,554 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d221880d94ee66016fb7e1/log.txt.gz 2026-04-05 08:49:40,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:49:40,915 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:49:40,917 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d221880d94ee66016fb7e1/lava-logs.yaml 2026-04-05 08:49:40,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:49:41,065 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:49:41,067 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d221880d94ee66016fb7e1/lava_callback.json.gz 2026-04-05 08:49:41,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:49:41,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221880d94ee66016fb7e1 HTTP/1.1" 200 None 2026-04-05 08:49:41,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:49:41,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 08:49:41,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:49:41,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d221880d94ee66016fb7e1 HTTP/1.1" 200 None 2026-04-05 08:49:41,161 - lava_callback - INFO - Completed processing callback for node 69d221880d94ee66016fb7e1 INFO: 172.21.0.1:46846 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:49:52,590 - lava_callback - INFO - Received callback for node 69d2215b0d94ee66016fb742 INFO: 172.21.0.1:53564 - "POST /node/69d2215b0d94ee66016fb742 HTTP/1.0" 202 Accepted 2026-04-05 08:49:52,596 - lava_callback - INFO - Starting async job submit for node 69d2215b0d94ee66016fb742 2026-04-05 08:49:52,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:49:52,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2215b0d94ee66016fb742 HTTP/1.1" 200 None 2026-04-05 08:49:52,628 - lava_callback - DEBUG - Processing node 69d2215b0d94ee66016fb742: baseline-arm64 2026-04-05 08:49:52,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:49:53,149 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:49:53,151 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d2215b0d94ee66016fb742/log.txt.gz 2026-04-05 08:49:53,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:49:53,560 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:49:53,562 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d2215b0d94ee66016fb742/lava-logs.yaml 2026-04-05 08:49:53,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:49:53,773 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:49:53,775 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d2215b0d94ee66016fb742/lava_callback.json.gz 2026-04-05 08:49:53,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:49:53,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2215b0d94ee66016fb742 HTTP/1.1" 200 None 2026-04-05 08:49:53,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:49:53,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 08:49:53,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:49:53,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2215b0d94ee66016fb742 HTTP/1.1" 200 None 2026-04-05 08:49:53,866 - lava_callback - INFO - Completed processing callback for node 69d2215b0d94ee66016fb742 INFO: 172.21.0.1:53570 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:50:03,947 - lava_callback - INFO - Received callback for node 69d221570d94ee66016fb738 INFO: 172.21.0.1:39774 - "POST /node/69d221570d94ee66016fb738 HTTP/1.0" 202 Accepted 2026-04-05 08:50:03,953 - lava_callback - INFO - Starting async job submit for node 69d221570d94ee66016fb738 2026-04-05 08:50:03,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:50:03,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221570d94ee66016fb738 HTTP/1.1" 200 None 2026-04-05 08:50:03,994 - lava_callback - DEBUG - Processing node 69d221570d94ee66016fb738: baseline-arm64 2026-04-05 08:50:04,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:50:04,406 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:50:04,409 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d221570d94ee66016fb738/log.txt.gz 2026-04-05 08:50:04,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:50:04,822 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:50:04,824 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d221570d94ee66016fb738/lava-logs.yaml 2026-04-05 08:50:04,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:50:05,016 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:50:05,018 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d221570d94ee66016fb738/lava_callback.json.gz 2026-04-05 08:50:05,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:50:05,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221570d94ee66016fb738 HTTP/1.1" 200 None 2026-04-05 08:50:05,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:50:05,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 08:50:05,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:50:05,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d221570d94ee66016fb738 HTTP/1.1" 200 None 2026-04-05 08:50:05,201 - lava_callback - INFO - Completed processing callback for node 69d221570d94ee66016fb738 2026-04-05 08:50:06,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:50:06,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42512 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:50:16,540 - lava_callback - INFO - Received callback for node 69cf7f41000c489abc2c0117 INFO: 172.21.0.1:42524 - "POST /node/69cf7f41000c489abc2c0117 HTTP/1.0" 202 Accepted 2026-04-05 08:50:16,548 - lava_callback - INFO - Starting async job submit for node 69cf7f41000c489abc2c0117 2026-04-05 08:50:16,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:50:16,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7f41000c489abc2c0117 HTTP/1.1" 200 None 2026-04-05 08:50:16,577 - lava_callback - DEBUG - Processing node 69cf7f41000c489abc2c0117: baseline-arm-baylibre 2026-04-05 08:50:16,577 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf7f41000c489abc2c0117 2026-04-05 08:50:16,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:50:16,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7f41000c489abc2c0117 HTTP/1.1" 200 None 2026-04-05 08:50:16,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:50:16,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-05 08:50:16,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:50:16,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf7f41000c489abc2c0117 HTTP/1.1" 200 None 2026-04-05 08:50:16,641 - lava_callback - ERROR - Error processing callback for node 69cf7f41000c489abc2c0117: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-05 08:50:17,231 - lava_callback - INFO - Received callback for node 69cf7f43000c489abc2c011e INFO: 172.21.0.1:42538 - "POST /node/69cf7f43000c489abc2c011e HTTP/1.0" 202 Accepted 2026-04-05 08:50:17,240 - lava_callback - INFO - Starting async job submit for node 69cf7f43000c489abc2c011e 2026-04-05 08:50:17,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:50:17,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7f43000c489abc2c011e HTTP/1.1" 200 None 2026-04-05 08:50:17,263 - lava_callback - DEBUG - Processing node 69cf7f43000c489abc2c011e: baseline-arm-baylibre 2026-04-05 08:50:17,263 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf7f43000c489abc2c011e 2026-04-05 08:50:17,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:50:17,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7f43000c489abc2c011e HTTP/1.1" 200 None 2026-04-05 08:50:17,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:50:17,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-05 08:50:17,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:50:17,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf7f43000c489abc2c011e HTTP/1.1" 200 None 2026-04-05 08:50:17,344 - lava_callback - ERROR - Error processing callback for node 69cf7f43000c489abc2c011e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-05 08:50:17,896 - lava_callback - INFO - Received callback for node 69cf7f44000c489abc2c0155 INFO: 172.21.0.1:42544 - "POST /node/69cf7f44000c489abc2c0155 HTTP/1.0" 202 Accepted 2026-04-05 08:50:17,901 - lava_callback - INFO - Starting async job submit for node 69cf7f44000c489abc2c0155 2026-04-05 08:50:17,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:50:17,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7f44000c489abc2c0155 HTTP/1.1" 200 None 2026-04-05 08:50:17,918 - lava_callback - DEBUG - Processing node 69cf7f44000c489abc2c0155: baseline-arm-baylibre 2026-04-05 08:50:17,919 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf7f44000c489abc2c0155 2026-04-05 08:50:17,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:50:17,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7f44000c489abc2c0155 HTTP/1.1" 200 None 2026-04-05 08:50:17,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:50:17,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-05 08:50:17,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:50:17,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf7f44000c489abc2c0155 HTTP/1.1" 200 None 2026-04-05 08:50:17,970 - lava_callback - ERROR - Error processing callback for node 69cf7f44000c489abc2c0155: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-05 08:50:18,591 - lava_callback - INFO - Received callback for node 69cf7f45000c489abc2c0159 INFO: 172.21.0.1:42548 - "POST /node/69cf7f45000c489abc2c0159 HTTP/1.0" 202 Accepted 2026-04-05 08:50:18,600 - lava_callback - INFO - Starting async job submit for node 69cf7f45000c489abc2c0159 2026-04-05 08:50:18,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:50:18,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7f45000c489abc2c0159 HTTP/1.1" 200 None 2026-04-05 08:50:18,615 - lava_callback - DEBUG - Processing node 69cf7f45000c489abc2c0159: baseline-arm-baylibre 2026-04-05 08:50:18,616 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf7f45000c489abc2c0159 2026-04-05 08:50:18,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:50:18,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7f45000c489abc2c0159 HTTP/1.1" 200 None 2026-04-05 08:50:18,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:50:18,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-05 08:50:18,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:50:18,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf7f45000c489abc2c0159 HTTP/1.1" 200 None 2026-04-05 08:50:18,689 - lava_callback - ERROR - Error processing callback for node 69cf7f45000c489abc2c0159: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38852 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:50:36,540 - lava_callback - INFO - Received callback for node 69cf7f49000c489abc2c016c INFO: 172.21.0.1:38858 - "POST /node/69cf7f49000c489abc2c016c HTTP/1.0" 202 Accepted 2026-04-05 08:50:36,545 - lava_callback - INFO - Starting async job submit for node 69cf7f49000c489abc2c016c 2026-04-05 08:50:36,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:50:36,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7f49000c489abc2c016c HTTP/1.1" 200 None 2026-04-05 08:50:36,561 - lava_callback - DEBUG - Processing node 69cf7f49000c489abc2c016c: baseline-arm-baylibre 2026-04-05 08:50:36,561 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf7f49000c489abc2c016c 2026-04-05 08:50:36,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:50:36,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7f49000c489abc2c016c HTTP/1.1" 200 None 2026-04-05 08:50:36,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:50:36,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-05 08:50:36,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:50:36,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf7f49000c489abc2c016c HTTP/1.1" 200 None 2026-04-05 08:50:36,619 - lava_callback - ERROR - Error processing callback for node 69cf7f49000c489abc2c016c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-05 08:50:37,229 - lava_callback - INFO - Received callback for node 69cf7f4a000c489abc2c016f INFO: 172.21.0.1:38866 - "POST /node/69cf7f4a000c489abc2c016f HTTP/1.0" 202 Accepted 2026-04-05 08:50:37,234 - lava_callback - INFO - Starting async job submit for node 69cf7f4a000c489abc2c016f 2026-04-05 08:50:37,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:50:37,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7f4a000c489abc2c016f HTTP/1.1" 200 None 2026-04-05 08:50:37,254 - lava_callback - DEBUG - Processing node 69cf7f4a000c489abc2c016f: baseline-arm-baylibre 2026-04-05 08:50:37,254 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf7f4a000c489abc2c016f 2026-04-05 08:50:37,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:50:37,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7f4a000c489abc2c016f HTTP/1.1" 200 None 2026-04-05 08:50:37,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:50:37,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-05 08:50:37,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:50:37,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf7f4a000c489abc2c016f HTTP/1.1" 200 None 2026-04-05 08:50:37,314 - lava_callback - ERROR - Error processing callback for node 69cf7f4a000c489abc2c016f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-05 08:50:45,236 - lava_callback - INFO - Received callback for node 69cf7f52000c489abc2c01b7 INFO: 172.21.0.1:50882 - "POST /node/69cf7f52000c489abc2c01b7 HTTP/1.0" 202 Accepted 2026-04-05 08:50:45,242 - lava_callback - INFO - Starting async job submit for node 69cf7f52000c489abc2c01b7 2026-04-05 08:50:45,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:50:45,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7f52000c489abc2c01b7 HTTP/1.1" 200 None 2026-04-05 08:50:45,259 - lava_callback - DEBUG - Processing node 69cf7f52000c489abc2c01b7: baseline-arm-clabbe 2026-04-05 08:50:45,259 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf7f52000c489abc2c01b7 2026-04-05 08:50:45,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:50:45,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7f52000c489abc2c01b7 HTTP/1.1" 200 None 2026-04-05 08:50:45,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:50:45,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-05 08:50:45,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:50:45,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf7f52000c489abc2c01b7 HTTP/1.1" 200 None 2026-04-05 08:50:45,310 - lava_callback - ERROR - Error processing callback for node 69cf7f52000c489abc2c01b7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-05 08:50:45,895 - lava_callback - INFO - Received callback for node 69cf7f55000c489abc2c01bd INFO: 172.21.0.1:50894 - "POST /node/69cf7f55000c489abc2c01bd HTTP/1.0" 202 Accepted 2026-04-05 08:50:45,901 - lava_callback - INFO - Starting async job submit for node 69cf7f55000c489abc2c01bd 2026-04-05 08:50:45,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:50:45,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7f55000c489abc2c01bd HTTP/1.1" 200 None 2026-04-05 08:50:45,923 - lava_callback - DEBUG - Processing node 69cf7f55000c489abc2c01bd: baseline-arm-clabbe 2026-04-05 08:50:45,923 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf7f55000c489abc2c01bd 2026-04-05 08:50:45,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:50:45,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7f55000c489abc2c01bd HTTP/1.1" 200 None 2026-04-05 08:50:45,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:50:45,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-05 08:50:45,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:50:45,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf7f55000c489abc2c01bd HTTP/1.1" 200 None 2026-04-05 08:50:45,993 - lava_callback - ERROR - Error processing callback for node 69cf7f55000c489abc2c01bd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50906 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:50:46,586 - lava_callback - INFO - Received callback for node 69cf7f58000c489abc2c01c4 INFO: 172.21.0.1:50912 - "POST /node/69cf7f58000c489abc2c01c4 HTTP/1.0" 202 Accepted 2026-04-05 08:50:46,592 - lava_callback - INFO - Starting async job submit for node 69cf7f58000c489abc2c01c4 2026-04-05 08:50:46,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:50:46,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7f58000c489abc2c01c4 HTTP/1.1" 200 None 2026-04-05 08:50:46,612 - lava_callback - DEBUG - Processing node 69cf7f58000c489abc2c01c4: baseline-arm-clabbe 2026-04-05 08:50:46,612 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf7f58000c489abc2c01c4 2026-04-05 08:50:46,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:50:46,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7f58000c489abc2c01c4 HTTP/1.1" 200 None 2026-04-05 08:50:46,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:50:46,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-05 08:50:46,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:50:46,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf7f58000c489abc2c01c4 HTTP/1.1" 200 None 2026-04-05 08:50:46,673 - lava_callback - ERROR - Error processing callback for node 69cf7f58000c489abc2c01c4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-05 08:50:47,257 - lava_callback - INFO - Received callback for node 69cf7f59000c489abc2c01c7 INFO: 172.21.0.1:50926 - "POST /node/69cf7f59000c489abc2c01c7 HTTP/1.0" 202 Accepted 2026-04-05 08:50:47,263 - lava_callback - INFO - Starting async job submit for node 69cf7f59000c489abc2c01c7 2026-04-05 08:50:47,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:50:47,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7f59000c489abc2c01c7 HTTP/1.1" 200 None 2026-04-05 08:50:47,281 - lava_callback - DEBUG - Processing node 69cf7f59000c489abc2c01c7: baseline-arm-clabbe 2026-04-05 08:50:47,281 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf7f59000c489abc2c01c7 2026-04-05 08:50:47,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:50:47,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7f59000c489abc2c01c7 HTTP/1.1" 200 None 2026-04-05 08:50:47,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:50:47,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-05 08:50:47,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:50:47,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf7f59000c489abc2c01c7 HTTP/1.1" 200 None 2026-04-05 08:50:47,345 - lava_callback - ERROR - Error processing callback for node 69cf7f59000c489abc2c01c7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-05 08:50:47,919 - lava_callback - INFO - Received callback for node 69cf7f5a000c489abc2c01ca INFO: 172.21.0.1:50938 - "POST /node/69cf7f5a000c489abc2c01ca HTTP/1.0" 202 Accepted 2026-04-05 08:50:47,925 - lava_callback - INFO - Starting async job submit for node 69cf7f5a000c489abc2c01ca 2026-04-05 08:50:47,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:50:47,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7f5a000c489abc2c01ca HTTP/1.1" 200 None 2026-04-05 08:50:47,942 - lava_callback - DEBUG - Processing node 69cf7f5a000c489abc2c01ca: baseline-arm-clabbe 2026-04-05 08:50:47,942 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf7f5a000c489abc2c01ca 2026-04-05 08:50:47,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:50:47,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7f5a000c489abc2c01ca HTTP/1.1" 200 None 2026-04-05 08:50:47,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:50:47,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-05 08:50:47,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:50:48,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf7f5a000c489abc2c01ca HTTP/1.1" 200 None 2026-04-05 08:50:48,005 - lava_callback - ERROR - Error processing callback for node 69cf7f5a000c489abc2c01ca: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-05 08:50:48,556 - lava_callback - INFO - Received callback for node 69cf7f5c000c489abc2c01d0 INFO: 172.21.0.1:50950 - "POST /node/69cf7f5c000c489abc2c01d0 HTTP/1.0" 202 Accepted 2026-04-05 08:50:48,565 - lava_callback - INFO - Starting async job submit for node 69cf7f5c000c489abc2c01d0 2026-04-05 08:50:48,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:50:48,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7f5c000c489abc2c01d0 HTTP/1.1" 200 None 2026-04-05 08:50:48,590 - lava_callback - DEBUG - Processing node 69cf7f5c000c489abc2c01d0: baseline-arm-clabbe 2026-04-05 08:50:48,591 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf7f5c000c489abc2c01d0 2026-04-05 08:50:48,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:50:48,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7f5c000c489abc2c01d0 HTTP/1.1" 200 None 2026-04-05 08:50:48,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:50:48,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-05 08:50:48,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:50:48,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf7f5c000c489abc2c01d0 HTTP/1.1" 200 None 2026-04-05 08:50:48,666 - lava_callback - ERROR - Error processing callback for node 69cf7f5c000c489abc2c01d0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-05 08:50:49,223 - lava_callback - INFO - Received callback for node 69cf7f5c000c489abc2c01d3 INFO: 172.21.0.1:50960 - "POST /node/69cf7f5c000c489abc2c01d3 HTTP/1.0" 202 Accepted 2026-04-05 08:50:49,229 - lava_callback - INFO - Starting async job submit for node 69cf7f5c000c489abc2c01d3 2026-04-05 08:50:49,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:50:49,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7f5c000c489abc2c01d3 HTTP/1.1" 200 None 2026-04-05 08:50:49,249 - lava_callback - DEBUG - Processing node 69cf7f5c000c489abc2c01d3: baseline-arm-clabbe 2026-04-05 08:50:49,250 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf7f5c000c489abc2c01d3 2026-04-05 08:50:49,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:50:49,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf7f5c000c489abc2c01d3 HTTP/1.1" 200 None 2026-04-05 08:50:49,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:50:49,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-05 08:50:49,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:50:49,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf7f5c000c489abc2c01d3 HTTP/1.1" 200 None 2026-04-05 08:50:49,322 - lava_callback - ERROR - Error processing callback for node 69cf7f5c000c489abc2c01d3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-05 08:50:52,855 - lava_callback - INFO - Received callback for node 69d221770d94ee66016fb7b6 INFO: 172.21.0.1:43368 - "POST /node/69d221770d94ee66016fb7b6 HTTP/1.0" 202 Accepted 2026-04-05 08:50:52,863 - lava_callback - INFO - Starting async job submit for node 69d221770d94ee66016fb7b6 2026-04-05 08:50:52,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:50:52,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221770d94ee66016fb7b6 HTTP/1.1" 200 None 2026-04-05 08:50:52,902 - lava_callback - DEBUG - Processing node 69d221770d94ee66016fb7b6: baseline-nfs-arm64 2026-04-05 08:50:53,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:50:53,413 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:50:53,415 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d221770d94ee66016fb7b6/log.txt.gz 2026-04-05 08:50:53,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:50:53,870 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:50:53,872 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d221770d94ee66016fb7b6/lava-logs.yaml 2026-04-05 08:50:53,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:50:54,057 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:50:54,059 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d221770d94ee66016fb7b6/lava_callback.json.gz 2026-04-05 08:50:54,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:50:54,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221770d94ee66016fb7b6 HTTP/1.1" 200 None 2026-04-05 08:50:54,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:50:54,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 08:50:54,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:50:54,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d221770d94ee66016fb7b6 HTTP/1.1" 200 None 2026-04-05 08:50:54,144 - lava_callback - INFO - Completed processing callback for node 69d221770d94ee66016fb7b6 INFO: 172.21.0.1:43382 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:50:59,931 - lava_callback - INFO - Received callback for node 69d2218e0d94ee66016fb7f6 INFO: 172.21.0.1:41518 - "POST /node/69d2218e0d94ee66016fb7f6 HTTP/1.0" 202 Accepted 2026-04-05 08:50:59,938 - lava_callback - INFO - Starting async job submit for node 69d2218e0d94ee66016fb7f6 2026-04-05 08:50:59,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:50:59,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2218e0d94ee66016fb7f6 HTTP/1.1" 200 None 2026-04-05 08:50:59,980 - lava_callback - DEBUG - Processing node 69d2218e0d94ee66016fb7f6: baseline-arm64-broonie 2026-04-05 08:51:00,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:51:00,623 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:51:00,626 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d2218e0d94ee66016fb7f6/log.txt.gz 2026-04-05 08:51:00,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:51:01,401 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:51:01,404 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d2218e0d94ee66016fb7f6/lava-logs.yaml 2026-04-05 08:51:01,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:51:01,590 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:51:01,592 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d2218e0d94ee66016fb7f6/lava_callback.json.gz 2026-04-05 08:51:01,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:51:01,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2218e0d94ee66016fb7f6 HTTP/1.1" 200 None 2026-04-05 08:51:01,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:51:01,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 08:51:01,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:51:01,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2218e0d94ee66016fb7f6 HTTP/1.1" 200 None 2026-04-05 08:51:01,700 - lava_callback - INFO - Completed processing callback for node 69d2218e0d94ee66016fb7f6 2026-04-05 08:51:06,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:51:06,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41534 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:51:06,935 - lava_callback - INFO - Received callback for node 69d2214e0d94ee66016fb6f6 INFO: 172.21.0.1:41548 - "POST /node/69d2214e0d94ee66016fb6f6 HTTP/1.0" 202 Accepted 2026-04-05 08:51:06,942 - lava_callback - INFO - Starting async job submit for node 69d2214e0d94ee66016fb6f6 2026-04-05 08:51:06,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:51:06,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2214e0d94ee66016fb6f6 HTTP/1.1" 200 None 2026-04-05 08:51:06,997 - lava_callback - DEBUG - Processing node 69d2214e0d94ee66016fb6f6: ltp-cve 2026-04-05 08:51:07,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:51:07,800 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:51:07,802 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cve-69d2214e0d94ee66016fb6f6/log.txt.gz 2026-04-05 08:51:08,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:51:08,563 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:51:08,566 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cve-69d2214e0d94ee66016fb6f6/lava-logs.yaml 2026-04-05 08:51:08,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:51:08,763 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:51:08,765 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cve-69d2214e0d94ee66016fb6f6/lava_callback.json.gz 2026-04-05 08:51:08,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:51:08,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2214e0d94ee66016fb6f6 HTTP/1.1" 200 None 2026-04-05 08:51:08,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:51:08,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-05 08:51:08,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:51:08,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2214e0d94ee66016fb6f6 HTTP/1.1" 200 None 2026-04-05 08:51:08,877 - lava_callback - INFO - Completed processing callback for node 69d2214e0d94ee66016fb6f6 INFO: 172.21.0.1:46132 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46140 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:51:25,717 - lava_callback - INFO - Received callback for node 69d2216b0d94ee66016fb76a INFO: 172.21.0.1:47118 - "POST /node/69d2216b0d94ee66016fb76a HTTP/1.0" 202 Accepted 2026-04-05 08:51:25,724 - lava_callback - INFO - Starting async job submit for node 69d2216b0d94ee66016fb76a 2026-04-05 08:51:25,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:51:25,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2216b0d94ee66016fb76a HTTP/1.1" 200 None 2026-04-05 08:51:25,783 - lava_callback - DEBUG - Processing node 69d2216b0d94ee66016fb76a: baseline-nfs-arm64 2026-04-05 08:51:26,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:47120 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:51:26,617 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:51:26,619 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d2216b0d94ee66016fb76a/log.txt.gz 2026-04-05 08:51:27,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:51:27,324 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:51:27,326 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d2216b0d94ee66016fb76a/lava-logs.yaml 2026-04-05 08:51:27,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:51:27,762 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:51:27,764 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d2216b0d94ee66016fb76a/lava_callback.json.gz 2026-04-05 08:51:27,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:51:27,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2216b0d94ee66016fb76a HTTP/1.1" 200 None 2026-04-05 08:51:27,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:51:27,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 08:51:27,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:51:27,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2216b0d94ee66016fb76a HTTP/1.1" 200 None 2026-04-05 08:51:28,037 - lava_callback - INFO - Completed processing callback for node 69d2216b0d94ee66016fb76a INFO: 172.21.0.1:34278 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:51:36,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:51:36,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37242 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34150 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:52:26,940 - lava_callback - INFO - Received callback for node 69d221d90d94ee66016fb93a INFO: 172.21.0.1:34160 - "POST /node/69d221d90d94ee66016fb93a HTTP/1.0" 202 Accepted 2026-04-05 08:52:26,947 - lava_callback - INFO - Starting async job submit for node 69d221d90d94ee66016fb93a 2026-04-05 08:52:26,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:52:26,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221d90d94ee66016fb93a HTTP/1.1" 200 None 2026-04-05 08:52:26,989 - lava_callback - DEBUG - Processing node 69d221d90d94ee66016fb93a: ltp-timers 2026-04-05 08:52:27,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:52:27,625 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:52:27,627 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-timers-69d221d90d94ee66016fb93a/log.txt.gz 2026-04-05 08:52:27,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:52:28,268 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:52:28,271 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-timers-69d221d90d94ee66016fb93a/lava-logs.yaml 2026-04-05 08:52:28,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:52:28,824 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:52:28,826 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-timers-69d221d90d94ee66016fb93a/lava_callback.json.gz 2026-04-05 08:52:28,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:52:28,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221d90d94ee66016fb93a HTTP/1.1" 200 None 2026-04-05 08:52:28,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:52:28,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-05 08:52:28,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:52:28,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d221d90d94ee66016fb93a HTTP/1.1" 200 None 2026-04-05 08:52:28,953 - lava_callback - INFO - Completed processing callback for node 69d221d90d94ee66016fb93a INFO: 172.21.0.1:34118 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:52:36,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:52:36,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34128 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:52:38,801 - lava_callback - INFO - Received callback for node 69d222bd0d94ee66016fbab9 INFO: 172.21.0.1:34132 - "POST /node/69d222bd0d94ee66016fbab9 HTTP/1.0" 202 Accepted 2026-04-05 08:52:38,807 - lava_callback - INFO - Starting async job submit for node 69d222bd0d94ee66016fbab9 2026-04-05 08:52:38,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:52:38,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d222bd0d94ee66016fbab9 HTTP/1.1" 200 None 2026-04-05 08:52:38,824 - lava_callback - DEBUG - Processing node 69d222bd0d94ee66016fbab9: baseline-arm 2026-04-05 08:52:38,829 - lava_callback - WARNING - Failed to upload log 2026-04-05 08:52:38,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:52:38,955 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:52:38,957 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d222bd0d94ee66016fbab9/lava-logs.yaml 2026-04-05 08:52:38,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:52:39,068 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:52:39,070 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d222bd0d94ee66016fbab9/lava_callback.json.gz 2026-04-05 08:52:39,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:52:39,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d222bd0d94ee66016fbab9 HTTP/1.1" 200 None 2026-04-05 08:52:39,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:52:39,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-05 08:52:39,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:52:39,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d222bd0d94ee66016fbab9 HTTP/1.1" 200 None 2026-04-05 08:52:39,152 - lava_callback - INFO - Completed processing callback for node 69d222bd0d94ee66016fbab9 INFO: 172.21.0.1:60024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40928 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:53:06,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:53:06,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44728 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:53:25,504 - lava_callback - INFO - Received callback for node 69cf8000000c489abc2c03a5 INFO: 172.21.0.1:53498 - "POST /node/69cf8000000c489abc2c03a5 HTTP/1.0" 202 Accepted 2026-04-05 08:53:25,511 - lava_callback - INFO - Starting async job submit for node 69cf8000000c489abc2c03a5 2026-04-05 08:53:25,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:53:25,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf8000000c489abc2c03a5 HTTP/1.1" 200 None 2026-04-05 08:53:25,529 - lava_callback - DEBUG - Processing node 69cf8000000c489abc2c03a5: baseline-arm-clabbe 2026-04-05 08:53:25,529 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf8000000c489abc2c03a5 2026-04-05 08:53:25,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:53:25,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf8000000c489abc2c03a5 HTTP/1.1" 200 None 2026-04-05 08:53:25,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:53:25,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eacbe430e18c5d159df HTTP/1.1" 200 None 2026-04-05 08:53:25,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:53:25,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf8000000c489abc2c03a5 HTTP/1.1" 200 None 2026-04-05 08:53:25,592 - lava_callback - ERROR - Error processing callback for node 69cf8000000c489abc2c03a5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45694 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:53:56,818 - lava_callback - INFO - Received callback for node 69d221690d94ee66016fb764 INFO: 172.21.0.1:45698 - "POST /node/69d221690d94ee66016fb764 HTTP/1.0" 202 Accepted 2026-04-05 08:53:56,825 - lava_callback - INFO - Starting async job submit for node 69d221690d94ee66016fb764 2026-04-05 08:53:56,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:53:56,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221690d94ee66016fb764 HTTP/1.1" 200 None 2026-04-05 08:53:56,876 - lava_callback - DEBUG - Processing node 69d221690d94ee66016fb764: baseline-arm64 2026-04-05 08:53:57,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:53:57,435 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:53:57,437 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d221690d94ee66016fb764/log.txt.gz 2026-04-05 08:53:57,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:53:57,860 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:53:57,862 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d221690d94ee66016fb764/lava-logs.yaml 2026-04-05 08:53:57,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:53:58,028 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:53:58,030 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d221690d94ee66016fb764/lava_callback.json.gz DEBUG: Setup failed for 69d221690d94ee66016fb764. Transitting job node result: incomplete -> fail 2026-04-05 08:53:58,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:53:58,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221690d94ee66016fb764 HTTP/1.1" 200 None 2026-04-05 08:53:58,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:53:58,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 08:53:58,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:53:58,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d221690d94ee66016fb764 HTTP/1.1" 200 None 2026-04-05 08:53:58,313 - lava_callback - INFO - Completed processing callback for node 69d221690d94ee66016fb764 2026-04-05 08:54:06,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:54:06,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42944 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:54:13,384 - lava_callback - INFO - Received callback for node 69d221600d94ee66016fb74e INFO: 172.21.0.1:44848 - "POST /node/69d221600d94ee66016fb74e HTTP/1.0" 202 Accepted 2026-04-05 08:54:13,391 - lava_callback - INFO - Starting async job submit for node 69d221600d94ee66016fb74e 2026-04-05 08:54:13,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:54:13,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221600d94ee66016fb74e HTTP/1.1" 200 None 2026-04-05 08:54:13,439 - lava_callback - DEBUG - Processing node 69d221600d94ee66016fb74e: baseline-arm64 2026-04-05 08:54:14,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:54:14,343 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:54:14,345 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d221600d94ee66016fb74e/log.txt.gz 2026-04-05 08:54:14,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:54:15,057 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:54:15,059 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d221600d94ee66016fb74e/lava-logs.yaml 2026-04-05 08:54:15,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:44860 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-05 08:54:15,249 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:54:15,251 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d221600d94ee66016fb74e/lava_callback.json.gz 2026-04-05 08:54:15,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:54:15,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221600d94ee66016fb74e HTTP/1.1" 200 None 2026-04-05 08:54:15,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:54:15,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 08:54:15,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:54:15,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d221600d94ee66016fb74e HTTP/1.1" 200 None 2026-04-05 08:54:15,483 - lava_callback - INFO - Completed processing callback for node 69d221600d94ee66016fb74e INFO: 172.21.0.1:44870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41446 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:54:36,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:54:36,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36566 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:55:31,372 - lava_callback - INFO - Received callback for node 69d21f640d94ee66016fb438 INFO: 172.21.0.1:54674 - "POST /node/69d21f640d94ee66016fb438 HTTP/1.0" 202 Accepted 2026-04-05 08:55:31,379 - lava_callback - INFO - Starting async job submit for node 69d21f640d94ee66016fb438 2026-04-05 08:55:31,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:55:31,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f640d94ee66016fb438 HTTP/1.1" 200 None 2026-04-05 08:55:31,454 - lava_callback - DEBUG - Processing node 69d21f640d94ee66016fb438: baseline-arm 2026-04-05 08:55:32,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:55:32,686 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:55:32,688 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d21f640d94ee66016fb438/log.txt.gz 2026-04-05 08:55:33,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:55:33,567 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:55:33,569 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d21f640d94ee66016fb438/lava-logs.yaml 2026-04-05 08:55:33,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:55:33,752 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:55:33,754 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d21f640d94ee66016fb438/lava_callback.json.gz DEBUG: Setup failed for 69d21f640d94ee66016fb438. Transitting job node result: incomplete -> fail 2026-04-05 08:55:33,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:55:33,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f640d94ee66016fb438 HTTP/1.1" 200 None 2026-04-05 08:55:33,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:55:33,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-05 08:55:33,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:55:34,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d21f640d94ee66016fb438 HTTP/1.1" 200 None 2026-04-05 08:55:34,284 - lava_callback - INFO - Completed processing callback for node 69d21f640d94ee66016fb438 INFO: 172.21.0.1:54688 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:55:36,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:55:36,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56918 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35794 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:56:39,000 - lava_callback - INFO - Received callback for node 69d221640d94ee66016fb757 INFO: 172.21.0.1:35804 - "POST /node/69d221640d94ee66016fb757 HTTP/1.0" 202 Accepted 2026-04-05 08:56:39,008 - lava_callback - INFO - Starting async job submit for node 69d221640d94ee66016fb757 2026-04-05 08:56:39,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:56:39,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221640d94ee66016fb757 HTTP/1.1" 200 None 2026-04-05 08:56:39,051 - lava_callback - DEBUG - Processing node 69d221640d94ee66016fb757: baseline-arm64 2026-04-05 08:56:39,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:56:39,850 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:56:39,852 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d221640d94ee66016fb757/log.txt.gz 2026-04-05 08:56:40,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:56:40,435 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:56:40,438 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d221640d94ee66016fb757/lava-logs.yaml 2026-04-05 08:56:40,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:56:40,618 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:56:40,620 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d221640d94ee66016fb757/lava_callback.json.gz 2026-04-05 08:56:40,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:56:40,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221640d94ee66016fb757 HTTP/1.1" 200 None 2026-04-05 08:56:40,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:56:40,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 08:56:40,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:56:40,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d221640d94ee66016fb757 HTTP/1.1" 200 None 2026-04-05 08:56:40,762 - lava_callback - INFO - Completed processing callback for node 69d221640d94ee66016fb757 INFO: 172.21.0.1:56848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34962 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:57:06,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:57:06,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60796 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:57:42,125 - lava_callback - INFO - Received callback for node 69d221750d94ee66016fb7b3 INFO: 172.21.0.1:49574 - "POST /node/69d221750d94ee66016fb7b3 HTTP/1.0" 202 Accepted 2026-04-05 08:57:42,132 - lava_callback - INFO - Starting async job submit for node 69d221750d94ee66016fb7b3 2026-04-05 08:57:42,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:57:42,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221750d94ee66016fb7b3 HTTP/1.1" 200 None 2026-04-05 08:57:42,173 - lava_callback - DEBUG - Processing node 69d221750d94ee66016fb7b3: baseline-nfs-arm64 2026-04-05 08:57:42,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:57:42,882 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:57:42,884 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d221750d94ee66016fb7b3/log.txt.gz 2026-04-05 08:57:43,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:57:43,425 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:57:43,428 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d221750d94ee66016fb7b3/lava-logs.yaml 2026-04-05 08:57:43,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 08:57:43,716 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 08:57:43,718 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d221750d94ee66016fb7b3/lava_callback.json.gz 2026-04-05 08:57:43,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:57:43,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d221750d94ee66016fb7b3 HTTP/1.1" 200 None 2026-04-05 08:57:43,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:57:43,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 08:57:43,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:57:43,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d221750d94ee66016fb7b3 HTTP/1.1" 200 None 2026-04-05 08:57:43,938 - lava_callback - INFO - Completed processing callback for node 69d221750d94ee66016fb7b3 INFO: 172.21.0.1:49590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35748 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:58:06,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:58:06,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60520 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:00:57,167 - lava_callback - INFO - Received callback for node 69cf81c0000c489abc2c05e2 INFO: 172.21.0.1:60522 - "POST /node/69cf81c0000c489abc2c05e2 HTTP/1.0" 202 Accepted 2026-04-05 09:00:57,173 - lava_callback - INFO - Starting async job submit for node 69cf81c0000c489abc2c05e2 2026-04-05 09:00:57,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:00:57,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf81c0000c489abc2c05e2 HTTP/1.1" 200 None 2026-04-05 09:00:57,196 - lava_callback - DEBUG - Processing node 69cf81c0000c489abc2c05e2: baseline-arm-baylibre 2026-04-05 09:00:57,196 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf81c0000c489abc2c05e2 2026-04-05 09:00:57,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:00:57,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf81c0000c489abc2c05e2 HTTP/1.1" 200 None 2026-04-05 09:00:57,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:00:57,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ef0e33d030878a87ef HTTP/1.1" 200 None 2026-04-05 09:00:57,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:00:57,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf81c0000c489abc2c05e2 HTTP/1.1" 200 None 2026-04-05 09:00:57,257 - lava_callback - ERROR - Error processing callback for node 69cf81c0000c489abc2c05e2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52464 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:01:17,883 - lava_callback - INFO - Received callback for node 69d224d60d94ee66016fbcdc INFO: 172.21.0.1:52476 - "POST /node/69d224d60d94ee66016fbcdc HTTP/1.0" 202 Accepted 2026-04-05 09:01:17,889 - lava_callback - INFO - Starting async job submit for node 69d224d60d94ee66016fbcdc 2026-04-05 09:01:17,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:01:17,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d224d60d94ee66016fbcdc HTTP/1.1" 200 None 2026-04-05 09:01:17,907 - lava_callback - DEBUG - Processing node 69d224d60d94ee66016fbcdc: baseline-nfs-arm64 2026-04-05 09:01:17,909 - lava_callback - WARNING - Failed to upload log 2026-04-05 09:01:17,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:01:18,071 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:01:18,073 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d224d60d94ee66016fbcdc/lava-logs.yaml 2026-04-05 09:01:18,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:01:18,197 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:01:18,200 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d224d60d94ee66016fbcdc/lava_callback.json.gz 2026-04-05 09:01:18,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:01:18,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d224d60d94ee66016fbcdc HTTP/1.1" 200 None 2026-04-05 09:01:18,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:01:18,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 09:01:18,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:01:18,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d224d60d94ee66016fbcdc HTTP/1.1" 200 None 2026-04-05 09:01:18,265 - lava_callback - INFO - Completed processing callback for node 69d224d60d94ee66016fbcdc INFO: 172.21.0.1:49290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49440 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:01:36,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:01:36,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34400 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38748 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55524 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54898 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:04:27,257 - lava_callback - INFO - Received callback for node 69d2252c0d94ee66016fbd05 INFO: 172.21.0.1:54906 - "POST /node/69d2252c0d94ee66016fbd05 HTTP/1.0" 202 Accepted 2026-04-05 09:04:27,263 - lava_callback - INFO - Starting async job submit for node 69d2252c0d94ee66016fbd05 2026-04-05 09:04:27,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:04:27,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2252c0d94ee66016fbd05 HTTP/1.1" 200 None 2026-04-05 09:04:27,303 - lava_callback - DEBUG - Processing node 69d2252c0d94ee66016fbd05: baseline-arm64-broonie 2026-04-05 09:04:27,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:04:27,721 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:04:27,723 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d2252c0d94ee66016fbd05/log.txt.gz 2026-04-05 09:04:27,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:04:28,088 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:04:28,091 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d2252c0d94ee66016fbd05/lava-logs.yaml 2026-04-05 09:04:28,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:04:28,280 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:04:28,282 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d2252c0d94ee66016fbd05/lava_callback.json.gz 2026-04-05 09:04:28,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:04:28,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2252c0d94ee66016fbd05 HTTP/1.1" 200 None 2026-04-05 09:04:28,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:04:28,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 09:04:28,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:04:28,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2252c0d94ee66016fbd05 HTTP/1.1" 200 None 2026-04-05 09:04:28,410 - lava_callback - INFO - Completed processing callback for node 69d2252c0d94ee66016fbd05 INFO: 172.21.0.1:33126 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:04:36,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:04:36,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46440 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:05:46,045 - lava_callback - INFO - Received callback for node 69cf82df000c489abc2c077b INFO: 172.21.0.1:38078 - "POST /node/69cf82df000c489abc2c077b HTTP/1.0" 202 Accepted 2026-04-05 09:05:46,051 - lava_callback - INFO - Starting async job submit for node 69cf82df000c489abc2c077b 2026-04-05 09:05:46,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:05:46,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf82df000c489abc2c077b HTTP/1.1" 200 None 2026-04-05 09:05:46,073 - lava_callback - DEBUG - Processing node 69cf82df000c489abc2c077b: baseline-arm-clabbe 2026-04-05 09:05:46,073 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf82df000c489abc2c077b 2026-04-05 09:05:46,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:05:46,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf82df000c489abc2c077b HTTP/1.1" 200 None 2026-04-05 09:05:46,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:05:46,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eacbe430e18c5d159df HTTP/1.1" 200 None 2026-04-05 09:05:46,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:05:46,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf82df000c489abc2c077b HTTP/1.1" 200 None 2026-04-05 09:05:46,163 - lava_callback - ERROR - Error processing callback for node 69cf82df000c489abc2c077b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37040 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:06:07,164 - lava_callback - INFO - Received callback for node 69d21faa0d94ee66016fb531 INFO: 172.21.0.1:37052 - "POST /node/69d21faa0d94ee66016fb531 HTTP/1.0" 202 Accepted 2026-04-05 09:06:07,217 - lava_callback - INFO - Starting async job submit for node 69d21faa0d94ee66016fb531 2026-04-05 09:06:07,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:06:07,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21faa0d94ee66016fb531 HTTP/1.1" 200 None 2026-04-05 09:06:07,257 - lava_callback - DEBUG - Processing node 69d21faa0d94ee66016fb531: ltp-smoke 2026-04-05 09:06:07,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:06:07,480 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:06:07,482 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69d21faa0d94ee66016fb531/log.txt.gz 2026-04-05 09:06:07,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:06:07,740 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:06:07,742 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69d21faa0d94ee66016fb531/lava-logs.yaml 2026-04-05 09:06:07,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:06:07,902 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:06:07,904 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69d21faa0d94ee66016fb531/lava_callback.json.gz 2026-04-05 09:06:07,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:06:07,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21faa0d94ee66016fb531 HTTP/1.1" 200 None 2026-04-05 09:06:07,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:06:07,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-05 09:06:07,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:06:08,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d21faa0d94ee66016fb531 HTTP/1.1" 200 None 2026-04-05 09:06:08,082 - lava_callback - INFO - Completed processing callback for node 69d21faa0d94ee66016fb531 2026-04-05 09:06:15,032 - lava_callback - INFO - Received callback for node 69d225c20d94ee66016fbd99 INFO: 172.21.0.1:48172 - "POST /node/69d225c20d94ee66016fbd99 HTTP/1.0" 202 Accepted 2026-04-05 09:06:15,045 - lava_callback - INFO - Starting async job submit for node 69d225c20d94ee66016fbd99 2026-04-05 09:06:15,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:06:15,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d225c20d94ee66016fbd99 HTTP/1.1" 200 None 2026-04-05 09:06:15,108 - lava_callback - DEBUG - Processing node 69d225c20d94ee66016fbd99: baseline-arm64 INFO: 172.21.0.1:48186 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-05 09:06:15,257 - lava_callback - WARNING - Failed to upload log 2026-04-05 09:06:15,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:06:15,521 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:06:15,522 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d225c20d94ee66016fbd99/lava-logs.yaml 2026-04-05 09:06:15,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:06:15,643 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:06:15,644 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d225c20d94ee66016fbd99/lava_callback.json.gz 2026-04-05 09:06:15,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:06:15,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d225c20d94ee66016fbd99 HTTP/1.1" 200 None 2026-04-05 09:06:15,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:06:15,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 09:06:15,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:06:15,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d225c20d94ee66016fbd99 HTTP/1.1" 200 None 2026-04-05 09:06:15,833 - lava_callback - INFO - Completed processing callback for node 69d225c20d94ee66016fbd99 INFO: 172.21.0.1:48202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34628 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:06:32,912 - lava_callback - INFO - Received callback for node 69d2216e0d94ee66016fb770 INFO: 172.21.0.1:42434 - "POST /node/69d2216e0d94ee66016fb770 HTTP/1.0" 202 Accepted 2026-04-05 09:06:32,920 - lava_callback - INFO - Starting async job submit for node 69d2216e0d94ee66016fb770 2026-04-05 09:06:32,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:06:32,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2216e0d94ee66016fb770 HTTP/1.1" 200 None 2026-04-05 09:06:32,980 - lava_callback - DEBUG - Processing node 69d2216e0d94ee66016fb770: baseline-nfs-arm64 2026-04-05 09:06:34,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:06:34,434 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:06:34,436 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d2216e0d94ee66016fb770/log.txt.gz INFO: 172.21.0.1:42438 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:06:35,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:06:35,311 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:06:35,314 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d2216e0d94ee66016fb770/lava-logs.yaml 2026-04-05 09:06:35,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:06:35,509 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:06:35,511 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d2216e0d94ee66016fb770/lava_callback.json.gz DEBUG: Setup failed for 69d2216e0d94ee66016fb770. Transitting job node result: incomplete -> fail 2026-04-05 09:06:35,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:06:35,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2216e0d94ee66016fb770 HTTP/1.1" 200 None 2026-04-05 09:06:35,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:06:35,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 09:06:35,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:06:35,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2216e0d94ee66016fb770 HTTP/1.1" 200 None 2026-04-05 09:06:35,747 - lava_callback - INFO - Completed processing callback for node 69d2216e0d94ee66016fb770 2026-04-05 09:06:36,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:06:36,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42436 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:06:47,920 - lava_callback - INFO - Received callback for node 69d226020d94ee66016fbdda INFO: 172.21.0.1:42452 - "POST /node/69d226020d94ee66016fbdda HTTP/1.0" 202 Accepted 2026-04-05 09:06:47,927 - lava_callback - INFO - Starting async job submit for node 69d226020d94ee66016fbdda 2026-04-05 09:06:47,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:06:47,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d226020d94ee66016fbdda HTTP/1.1" 200 None 2026-04-05 09:06:47,979 - lava_callback - DEBUG - Processing node 69d226020d94ee66016fbdda: baseline-arm64 2026-04-05 09:06:48,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:06:48,597 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:06:48,598 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d226020d94ee66016fbdda/log.txt.gz 2026-04-05 09:06:48,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:06:49,065 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:06:49,067 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d226020d94ee66016fbdda/lava-logs.yaml 2026-04-05 09:06:49,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:06:49,214 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:06:49,215 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d226020d94ee66016fbdda/lava_callback.json.gz 2026-04-05 09:06:49,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:06:49,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d226020d94ee66016fbdda HTTP/1.1" 200 None 2026-04-05 09:06:49,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:06:49,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 09:06:49,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:06:49,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d226020d94ee66016fbdda HTTP/1.1" 200 None 2026-04-05 09:06:49,309 - lava_callback - INFO - Completed processing callback for node 69d226020d94ee66016fbdda INFO: 172.21.0.1:39504 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:07:06,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:07:06,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51946 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:07:57,436 - lava_callback - INFO - Received callback for node 69cf8364000c489abc2c0819 INFO: 172.21.0.1:51954 - "POST /node/69cf8364000c489abc2c0819 HTTP/1.0" 202 Accepted 2026-04-05 09:07:57,443 - lava_callback - INFO - Starting async job submit for node 69cf8364000c489abc2c0819 2026-04-05 09:07:57,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:07:57,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf8364000c489abc2c0819 HTTP/1.1" 200 None 2026-04-05 09:07:57,464 - lava_callback - DEBUG - Processing node 69cf8364000c489abc2c0819: baseline-arm-baylibre 2026-04-05 09:07:57,464 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf8364000c489abc2c0819 2026-04-05 09:07:57,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:07:57,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf8364000c489abc2c0819 HTTP/1.1" 200 None 2026-04-05 09:07:57,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:07:57,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ef0e33d030878a87ef HTTP/1.1" 200 None 2026-04-05 09:07:57,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:07:57,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf8364000c489abc2c0819 HTTP/1.1" 200 None 2026-04-05 09:07:57,527 - lava_callback - ERROR - Error processing callback for node 69cf8364000c489abc2c0819: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52340 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35696 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:08:27,617 - lava_callback - INFO - Received callback for node 69d225be0d94ee66016fbd96 INFO: 172.21.0.1:35706 - "POST /node/69d225be0d94ee66016fbd96 HTTP/1.0" 202 Accepted 2026-04-05 09:08:27,627 - lava_callback - INFO - Starting async job submit for node 69d225be0d94ee66016fbd96 2026-04-05 09:08:27,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:08:27,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d225be0d94ee66016fbd96 HTTP/1.1" 200 None 2026-04-05 09:08:27,678 - lava_callback - DEBUG - Processing node 69d225be0d94ee66016fbd96: ltp-syscalls 2026-04-05 09:08:28,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:08:28,785 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:08:28,787 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-69d225be0d94ee66016fbd96/log.txt.gz 2026-04-05 09:08:29,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:08:29,459 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:08:29,462 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-69d225be0d94ee66016fbd96/lava-logs.yaml 2026-04-05 09:08:29,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:08:29,635 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:08:29,637 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-69d225be0d94ee66016fbd96/lava_callback.json.gz 2026-04-05 09:08:29,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:08:29,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d225be0d94ee66016fbd96 HTTP/1.1" 200 None 2026-04-05 09:08:29,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:08:29,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-05 09:08:29,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:08:29,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d225be0d94ee66016fbd96 HTTP/1.1" 200 None 2026-04-05 09:08:29,737 - lava_callback - INFO - Completed processing callback for node 69d225be0d94ee66016fbd96 INFO: 172.21.0.1:51148 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:08:36,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:51160 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:08:36,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-05 09:08:37,425 - lava_callback - INFO - Received callback for node 69cf8387000c489abc2c083f INFO: 172.21.0.1:51176 - "POST /node/69cf8387000c489abc2c083f HTTP/1.0" 202 Accepted 2026-04-05 09:08:37,431 - lava_callback - INFO - Starting async job submit for node 69cf8387000c489abc2c083f 2026-04-05 09:08:37,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:08:37,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf8387000c489abc2c083f HTTP/1.1" 200 None 2026-04-05 09:08:37,454 - lava_callback - DEBUG - Processing node 69cf8387000c489abc2c083f: baseline-arm-baylibre 2026-04-05 09:08:37,454 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf8387000c489abc2c083f 2026-04-05 09:08:37,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:08:37,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf8387000c489abc2c083f HTTP/1.1" 200 None 2026-04-05 09:08:37,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:08:37,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ef0e33d030878a87ef HTTP/1.1" 200 None 2026-04-05 09:08:37,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:08:37,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf8387000c489abc2c083f HTTP/1.1" 200 None 2026-04-05 09:08:37,510 - lava_callback - ERROR - Error processing callback for node 69cf8387000c489abc2c083f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56854 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:09:13,748 - lava_callback - INFO - Received callback for node 69d226650d94ee66016fbe58 INFO: 172.21.0.1:55926 - "POST /node/69d226650d94ee66016fbe58 HTTP/1.0" 202 Accepted 2026-04-05 09:09:13,755 - lava_callback - INFO - Starting async job submit for node 69d226650d94ee66016fbe58 2026-04-05 09:09:13,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:09:13,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d226650d94ee66016fbe58 HTTP/1.1" 200 None 2026-04-05 09:09:13,800 - lava_callback - DEBUG - Processing node 69d226650d94ee66016fbe58: baseline-arm64 2026-04-05 09:09:14,041 - lava_callback - WARNING - Failed to upload log 2026-04-05 09:09:14,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:09:14,470 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:09:14,472 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d226650d94ee66016fbe58/lava-logs.yaml 2026-04-05 09:09:14,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:09:14,618 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:09:14,620 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d226650d94ee66016fbe58/lava_callback.json.gz 2026-04-05 09:09:14,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:09:14,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d226650d94ee66016fbe58 HTTP/1.1" 200 None 2026-04-05 09:09:14,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:09:14,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 09:09:14,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:09:14,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d226650d94ee66016fbe58 HTTP/1.1" 200 None 2026-04-05 09:09:14,790 - lava_callback - INFO - Completed processing callback for node 69d226650d94ee66016fbe58 INFO: 172.21.0.1:55942 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56252 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:09:36,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:09:36,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41012 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:10:46,536 - lava_callback - INFO - Received callback for node 69cf8410000c489abc2c08b5 INFO: 172.21.0.1:41022 - "POST /node/69cf8410000c489abc2c08b5 HTTP/1.0" 202 Accepted 2026-04-05 09:10:46,541 - lava_callback - INFO - Starting async job submit for node 69cf8410000c489abc2c08b5 2026-04-05 09:10:46,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:10:46,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf8410000c489abc2c08b5 HTTP/1.1" 200 None 2026-04-05 09:10:46,562 - lava_callback - DEBUG - Processing node 69cf8410000c489abc2c08b5: baseline-arm-clabbe 2026-04-05 09:10:46,562 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf8410000c489abc2c08b5 2026-04-05 09:10:46,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:10:46,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf8410000c489abc2c08b5 HTTP/1.1" 200 None 2026-04-05 09:10:46,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:10:46,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ef0e33d030878a87ef HTTP/1.1" 200 None 2026-04-05 09:10:46,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:10:46,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf8410000c489abc2c08b5 HTTP/1.1" 200 None 2026-04-05 09:10:46,642 - lava_callback - ERROR - Error processing callback for node 69cf8410000c489abc2c08b5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40634 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:11:26,485 - lava_callback - INFO - Received callback for node 69cf8433000c489abc2c08db INFO: 172.21.0.1:47944 - "POST /node/69cf8433000c489abc2c08db HTTP/1.0" 202 Accepted 2026-04-05 09:11:26,498 - lava_callback - INFO - Starting async job submit for node 69cf8433000c489abc2c08db 2026-04-05 09:11:26,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:47946 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:11:26,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf8433000c489abc2c08db HTTP/1.1" 200 None 2026-04-05 09:11:26,524 - lava_callback - DEBUG - Processing node 69cf8433000c489abc2c08db: baseline-arm-clabbe 2026-04-05 09:11:26,524 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf8433000c489abc2c08db 2026-04-05 09:11:26,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:11:26,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf8433000c489abc2c08db HTTP/1.1" 200 None 2026-04-05 09:11:26,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:11:26,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ef0e33d030878a87ef HTTP/1.1" 200 None 2026-04-05 09:11:26,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:11:26,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf8433000c489abc2c08db HTTP/1.1" 200 None 2026-04-05 09:11:26,576 - lava_callback - ERROR - Error processing callback for node 69cf8433000c489abc2c08db: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58980 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:12:06,432 - lava_callback - INFO - Received callback for node 69cf8455000c489abc2c0912 INFO: 172.21.0.1:49598 - "POST /node/69cf8455000c489abc2c0912 HTTP/1.0" 202 Accepted 2026-04-05 09:12:06,438 - lava_callback - INFO - Starting async job submit for node 69cf8455000c489abc2c0912 2026-04-05 09:12:06,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:12:06,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf8455000c489abc2c0912 HTTP/1.1" 200 None 2026-04-05 09:12:06,454 - lava_callback - DEBUG - Processing node 69cf8455000c489abc2c0912: baseline-arm-clabbe 2026-04-05 09:12:06,455 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf8455000c489abc2c0912 2026-04-05 09:12:06,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:12:06,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf8455000c489abc2c0912 HTTP/1.1" 200 None 2026-04-05 09:12:06,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:12:06,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ef0e33d030878a87ef HTTP/1.1" 200 None 2026-04-05 09:12:06,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:49610 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:12:06,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf8455000c489abc2c0912 HTTP/1.1" 200 None 2026-04-05 09:12:06,518 - lava_callback - ERROR - Error processing callback for node 69cf8455000c489abc2c0912: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34692 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52522 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:13:46,474 - lava_callback - INFO - Received callback for node 69cf84bb000c489abc2c0966 INFO: 172.21.0.1:44394 - "POST /node/69cf84bb000c489abc2c0966 HTTP/1.0" 202 Accepted 2026-04-05 09:13:46,482 - lava_callback - INFO - Starting async job submit for node 69cf84bb000c489abc2c0966 2026-04-05 09:13:46,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:13:46,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf84bb000c489abc2c0966 HTTP/1.1" 200 None 2026-04-05 09:13:46,503 - lava_callback - DEBUG - Processing node 69cf84bb000c489abc2c0966: baseline-arm-clabbe 2026-04-05 09:13:46,504 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf84bb000c489abc2c0966 2026-04-05 09:13:46,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:44406 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:13:46,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf84bb000c489abc2c0966 HTTP/1.1" 200 None 2026-04-05 09:13:46,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:13:46,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ef0e33d030878a87ef HTTP/1.1" 200 None 2026-04-05 09:13:46,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:13:46,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf84bb000c489abc2c0966 HTTP/1.1" 200 None 2026-04-05 09:13:46,569 - lava_callback - ERROR - Error processing callback for node 69cf84bb000c489abc2c0966: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37834 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:15:26,644 - lava_callback - INFO - Received callback for node 69cf8524000c489abc2c09c1 INFO: 172.21.0.1:37842 - "POST /node/69cf8524000c489abc2c09c1 HTTP/1.0" 202 Accepted 2026-04-05 09:15:26,651 - lava_callback - INFO - Starting async job submit for node 69cf8524000c489abc2c09c1 2026-04-05 09:15:26,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:15:26,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf8524000c489abc2c09c1 HTTP/1.1" 200 None 2026-04-05 09:15:26,678 - lava_callback - DEBUG - Processing node 69cf8524000c489abc2c09c1: baseline-arm-clabbe 2026-04-05 09:15:26,678 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf8524000c489abc2c09c1 2026-04-05 09:15:26,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:15:26,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf8524000c489abc2c09c1 HTTP/1.1" 200 None 2026-04-05 09:15:26,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:15:26,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ef0e33d030878a87ef HTTP/1.1" 200 None 2026-04-05 09:15:26,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:15:26,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf8524000c489abc2c09c1 HTTP/1.1" 200 None 2026-04-05 09:15:26,745 - lava_callback - ERROR - Error processing callback for node 69cf8524000c489abc2c09c1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42454 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:18:05,681 - lava_callback - INFO - Received callback for node 69d2289f0d94ee66016fc02a INFO: 172.21.0.1:51254 - "POST /node/69d2289f0d94ee66016fc02a HTTP/1.0" 202 Accepted 2026-04-05 09:18:05,688 - lava_callback - INFO - Starting async job submit for node 69d2289f0d94ee66016fc02a 2026-04-05 09:18:05,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:18:05,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2289f0d94ee66016fc02a HTTP/1.1" 200 None 2026-04-05 09:18:05,739 - lava_callback - DEBUG - Processing node 69d2289f0d94ee66016fc02a: baseline-arm64-foundriesio 2026-04-05 09:18:05,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:18:06,127 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:18:06,129 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d2289f0d94ee66016fc02a/log.txt.gz 2026-04-05 09:18:06,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:18:06,442 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:18:06,444 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d2289f0d94ee66016fc02a/lava-logs.yaml 2026-04-05 09:18:06,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:51268 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:18:06,588 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:18:06,590 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d2289f0d94ee66016fc02a/lava_callback.json.gz 2026-04-05 09:18:06,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:18:06,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2289f0d94ee66016fc02a HTTP/1.1" 200 None 2026-04-05 09:18:06,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:18:06,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 09:18:06,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:18:06,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2289f0d94ee66016fc02a HTTP/1.1" 200 None 2026-04-05 09:18:06,683 - lava_callback - INFO - Completed processing callback for node 69d2289f0d94ee66016fc02a INFO: 172.21.0.1:36104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40522 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:18:26,822 - lava_callback - INFO - Received callback for node 69cf85cc000c489abc2c0a63 INFO: 172.21.0.1:40526 - "POST /node/69cf85cc000c489abc2c0a63 HTTP/1.0" 202 Accepted 2026-04-05 09:18:26,828 - lava_callback - INFO - Starting async job submit for node 69cf85cc000c489abc2c0a63 2026-04-05 09:18:26,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:18:26,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf85cc000c489abc2c0a63 HTTP/1.1" 200 None 2026-04-05 09:18:26,846 - lava_callback - DEBUG - Processing node 69cf85cc000c489abc2c0a63: baseline-arm-clabbe 2026-04-05 09:18:26,846 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf85cc000c489abc2c0a63 2026-04-05 09:18:26,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:18:26,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf85cc000c489abc2c0a63 HTTP/1.1" 200 None 2026-04-05 09:18:26,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:18:26,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eacbe430e18c5d159df HTTP/1.1" 200 None 2026-04-05 09:18:26,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:18:26,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf85cc000c489abc2c0a63 HTTP/1.1" 200 None 2026-04-05 09:18:26,911 - lava_callback - ERROR - Error processing callback for node 69cf85cc000c489abc2c0a63: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39128 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:18:36,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:18:36,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46722 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:22:16,731 - lava_callback - INFO - Received callback for node 69d2297d0d94ee66016fc092 INFO: 172.21.0.1:46726 - "POST /node/69d2297d0d94ee66016fc092 HTTP/1.0" 202 Accepted 2026-04-05 09:22:16,740 - lava_callback - INFO - Starting async job submit for node 69d2297d0d94ee66016fc092 2026-04-05 09:22:16,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:22:16,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2297d0d94ee66016fc092 HTTP/1.1" 200 None 2026-04-05 09:22:16,788 - lava_callback - DEBUG - Processing node 69d2297d0d94ee66016fc092: baseline-arm64 2026-04-05 09:22:17,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:22:17,461 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:22:17,463 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d2297d0d94ee66016fc092/log.txt.gz 2026-04-05 09:22:17,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:22:17,861 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:22:17,863 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d2297d0d94ee66016fc092/lava-logs.yaml 2026-04-05 09:22:17,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:22:18,032 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:22:18,034 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d2297d0d94ee66016fc092/lava_callback.json.gz 2026-04-05 09:22:18,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:22:18,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2297d0d94ee66016fc092 HTTP/1.1" 200 None 2026-04-05 09:22:18,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:22:18,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 09:22:18,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:22:18,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2297d0d94ee66016fc092 HTTP/1.1" 200 None 2026-04-05 09:22:18,138 - lava_callback - INFO - Completed processing callback for node 69d2297d0d94ee66016fc092 INFO: 172.21.0.1:58218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38106 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:22:36,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:22:36,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34060 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:24:38,338 - lava_callback - INFO - Received callback for node 69cf8746000c489abc2c0b8b INFO: 172.21.0.1:34062 - "POST /node/69cf8746000c489abc2c0b8b HTTP/1.0" 202 Accepted 2026-04-05 09:24:38,343 - lava_callback - INFO - Starting async job submit for node 69cf8746000c489abc2c0b8b 2026-04-05 09:24:38,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:24:38,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf8746000c489abc2c0b8b HTTP/1.1" 200 None 2026-04-05 09:24:38,359 - lava_callback - DEBUG - Processing node 69cf8746000c489abc2c0b8b: baseline-arm64-baylibre 2026-04-05 09:24:38,359 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf8746000c489abc2c0b8b 2026-04-05 09:24:38,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:24:38,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf8746000c489abc2c0b8b HTTP/1.1" 200 None 2026-04-05 09:24:38,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:24:38,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-05 09:24:38,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:24:38,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf8746000c489abc2c0b8b HTTP/1.1" 200 None 2026-04-05 09:24:38,435 - lava_callback - ERROR - Error processing callback for node 69cf8746000c489abc2c0b8b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55162 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56046 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:25:28,241 - lava_callback - INFO - Received callback for node 69d2297b0d94ee66016fc08f INFO: 172.21.0.1:56048 - "POST /node/69d2297b0d94ee66016fc08f HTTP/1.0" 202 Accepted 2026-04-05 09:25:28,247 - lava_callback - INFO - Starting async job submit for node 69d2297b0d94ee66016fc08f 2026-04-05 09:25:28,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:25:28,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2297b0d94ee66016fc08f HTTP/1.1" 200 None 2026-04-05 09:25:28,313 - lava_callback - DEBUG - Processing node 69d2297b0d94ee66016fc08f: ltp-watchqueue 2026-04-05 09:25:28,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:25:28,819 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:25:28,821 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69d2297b0d94ee66016fc08f/log.txt.gz 2026-04-05 09:25:29,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:25:29,315 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:25:29,317 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69d2297b0d94ee66016fc08f/lava-logs.yaml 2026-04-05 09:25:29,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:25:29,515 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:25:29,517 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69d2297b0d94ee66016fc08f/lava_callback.json.gz 2026-04-05 09:25:29,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:25:29,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2297b0d94ee66016fc08f HTTP/1.1" 200 None 2026-04-05 09:25:29,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:25:29,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-05 09:25:29,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:25:29,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2297b0d94ee66016fc08f HTTP/1.1" 200 None 2026-04-05 09:25:29,625 - lava_callback - INFO - Completed processing callback for node 69d2297b0d94ee66016fc08f INFO: 172.21.0.1:44762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44778 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:25:36,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:25:36,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49460 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:26:18,408 - lava_callback - INFO - Received callback for node 69cf87ad000c489abc2c0bd4 INFO: 172.21.0.1:49462 - "POST /node/69cf87ad000c489abc2c0bd4 HTTP/1.0" 202 Accepted 2026-04-05 09:26:18,417 - lava_callback - INFO - Starting async job submit for node 69cf87ad000c489abc2c0bd4 2026-04-05 09:26:18,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:26:18,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf87ad000c489abc2c0bd4 HTTP/1.1" 200 None 2026-04-05 09:26:18,435 - lava_callback - DEBUG - Processing node 69cf87ad000c489abc2c0bd4: baseline-arm64-baylibre 2026-04-05 09:26:18,435 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf87ad000c489abc2c0bd4 2026-04-05 09:26:18,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:26:18,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf87ad000c489abc2c0bd4 HTTP/1.1" 200 None 2026-04-05 09:26:18,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:26:18,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-05 09:26:18,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:26:18,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf87ad000c489abc2c0bd4 HTTP/1.1" 200 None 2026-04-05 09:26:18,529 - lava_callback - ERROR - Error processing callback for node 69cf87ad000c489abc2c0bd4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35452 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:26:41,651 - lava_callback - INFO - Received callback for node 69d226ac0d94ee66016fbe7d INFO: 172.21.0.1:51590 - "POST /node/69d226ac0d94ee66016fbe7d HTTP/1.0" 202 Accepted 2026-04-05 09:26:41,658 - lava_callback - INFO - Starting async job submit for node 69d226ac0d94ee66016fbe7d 2026-04-05 09:26:41,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:26:41,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d226ac0d94ee66016fbe7d HTTP/1.1" 200 None 2026-04-05 09:26:41,732 - lava_callback - DEBUG - Processing node 69d226ac0d94ee66016fbe7d: ltp-smoke 2026-04-05 09:26:42,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:26:42,490 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:26:42,492 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69d226ac0d94ee66016fbe7d/log.txt.gz 2026-04-05 09:26:42,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:26:43,099 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:26:43,102 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69d226ac0d94ee66016fbe7d/lava-logs.yaml 2026-04-05 09:26:43,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:26:43,282 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:26:43,284 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69d226ac0d94ee66016fbe7d/lava_callback.json.gz 2026-04-05 09:26:43,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:26:43,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d226ac0d94ee66016fbe7d HTTP/1.1" 200 None 2026-04-05 09:26:43,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:26:43,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9f0d94ee66016fb135 HTTP/1.1" 200 None 2026-04-05 09:26:43,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:26:43,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d226ac0d94ee66016fbe7d HTTP/1.1" 200 None 2026-04-05 09:26:43,636 - lava_callback - INFO - Completed processing callback for node 69d226ac0d94ee66016fbe7d INFO: 172.21.0.1:51592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46188 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:27:06,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:27:06,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60722 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60726 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:27:18,417 - lava_callback - INFO - Received callback for node 69cf87f3000c489abc2c0bf2 INFO: 172.21.0.1:60740 - "POST /node/69cf87f3000c489abc2c0bf2 HTTP/1.0" 202 Accepted 2026-04-05 09:27:18,423 - lava_callback - INFO - Starting async job submit for node 69cf87f3000c489abc2c0bf2 2026-04-05 09:27:18,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:27:18,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf87f3000c489abc2c0bf2 HTTP/1.1" 200 None 2026-04-05 09:27:18,443 - lava_callback - DEBUG - Processing node 69cf87f3000c489abc2c0bf2: baseline-arm64-baylibre 2026-04-05 09:27:18,443 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf87f3000c489abc2c0bf2 2026-04-05 09:27:18,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:27:18,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf87f3000c489abc2c0bf2 HTTP/1.1" 200 None 2026-04-05 09:27:18,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:27:18,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-05 09:27:18,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:27:18,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf87f3000c489abc2c0bf2 HTTP/1.1" 200 None 2026-04-05 09:27:18,536 - lava_callback - ERROR - Error processing callback for node 69cf87f3000c489abc2c0bf2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32780 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34668 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:28:38,549 - lava_callback - INFO - Received callback for node 69cf883a000c489abc2c0c2e INFO: 172.21.0.1:34676 - "POST /node/69cf883a000c489abc2c0c2e HTTP/1.0" 202 Accepted 2026-04-05 09:28:38,555 - lava_callback - INFO - Starting async job submit for node 69cf883a000c489abc2c0c2e 2026-04-05 09:28:38,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:28:38,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf883a000c489abc2c0c2e HTTP/1.1" 200 None 2026-04-05 09:28:38,577 - lava_callback - DEBUG - Processing node 69cf883a000c489abc2c0c2e: baseline-arm64-baylibre 2026-04-05 09:28:38,577 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf883a000c489abc2c0c2e 2026-04-05 09:28:38,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:28:38,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf883a000c489abc2c0c2e HTTP/1.1" 200 None 2026-04-05 09:28:38,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:28:38,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-05 09:28:38,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:28:38,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf883a000c489abc2c0c2e HTTP/1.1" 200 None 2026-04-05 09:28:38,649 - lava_callback - ERROR - Error processing callback for node 69cf883a000c489abc2c0c2e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36746 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:29:38,557 - lava_callback - INFO - Received callback for node 69cf8880000c489abc2c0c5c INFO: 172.21.0.1:36748 - "POST /node/69cf8880000c489abc2c0c5c HTTP/1.0" 202 Accepted 2026-04-05 09:29:38,563 - lava_callback - INFO - Starting async job submit for node 69cf8880000c489abc2c0c5c 2026-04-05 09:29:38,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:29:38,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf8880000c489abc2c0c5c HTTP/1.1" 200 None 2026-04-05 09:29:38,592 - lava_callback - DEBUG - Processing node 69cf8880000c489abc2c0c5c: baseline-arm64-baylibre 2026-04-05 09:29:38,593 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf8880000c489abc2c0c5c 2026-04-05 09:29:38,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:29:38,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf8880000c489abc2c0c5c HTTP/1.1" 200 None 2026-04-05 09:29:38,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:29:38,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-05 09:29:38,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:29:38,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf8880000c489abc2c0c5c HTTP/1.1" 200 None 2026-04-05 09:29:38,658 - lava_callback - ERROR - Error processing callback for node 69cf8880000c489abc2c0c5c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58068 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:30:58,755 - lava_callback - INFO - Received callback for node 69cf88c4000c489abc2c0c83 INFO: 172.21.0.1:58076 - "POST /node/69cf88c4000c489abc2c0c83 HTTP/1.0" 202 Accepted 2026-04-05 09:30:58,763 - lava_callback - INFO - Starting async job submit for node 69cf88c4000c489abc2c0c83 2026-04-05 09:30:58,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:30:58,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf88c4000c489abc2c0c83 HTTP/1.1" 200 None 2026-04-05 09:30:58,787 - lava_callback - DEBUG - Processing node 69cf88c4000c489abc2c0c83: baseline-arm64-baylibre 2026-04-05 09:30:58,787 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf88c4000c489abc2c0c83 2026-04-05 09:30:58,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:30:58,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf88c4000c489abc2c0c83 HTTP/1.1" 200 None 2026-04-05 09:30:58,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:30:58,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-05 09:30:58,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:30:58,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf88c4000c489abc2c0c83 HTTP/1.1" 200 None 2026-04-05 09:30:58,860 - lava_callback - ERROR - Error processing callback for node 69cf88c4000c489abc2c0c83: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52004 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:31:50,091 - lava_callback - INFO - Received callback for node 69d22bfc0d94ee66016fc2af INFO: 172.21.0.1:40624 - "POST /node/69d22bfc0d94ee66016fc2af HTTP/1.0" 202 Accepted 2026-04-05 09:31:50,097 - lava_callback - INFO - Starting async job submit for node 69d22bfc0d94ee66016fc2af 2026-04-05 09:31:50,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:31:50,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d22bfc0d94ee66016fc2af HTTP/1.1" 200 None 2026-04-05 09:31:50,116 - lava_callback - DEBUG - Processing node 69d22bfc0d94ee66016fc2af: baseline-arm 2026-04-05 09:31:50,121 - lava_callback - WARNING - Failed to upload log 2026-04-05 09:31:50,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:31:50,265 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:31:50,267 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d22bfc0d94ee66016fc2af/lava-logs.yaml 2026-04-05 09:31:50,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:31:50,398 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:31:50,400 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d22bfc0d94ee66016fc2af/lava_callback.json.gz 2026-04-05 09:31:50,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:31:50,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d22bfc0d94ee66016fc2af HTTP/1.1" 200 None 2026-04-05 09:31:50,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:31:50,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-05 09:31:50,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:31:50,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d22bfc0d94ee66016fc2af HTTP/1.1" 200 None 2026-04-05 09:31:50,482 - lava_callback - INFO - Completed processing callback for node 69d22bfc0d94ee66016fc2af INFO: 172.21.0.1:40626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56184 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:32:06,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:32:06,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-05 09:32:07,474 - lava_callback - INFO - Received callback for node 69cf8910000c489abc2c0ccc INFO: 172.21.0.1:56186 - "POST /node/69cf8910000c489abc2c0ccc HTTP/1.0" 202 Accepted 2026-04-05 09:32:07,480 - lava_callback - INFO - Starting async job submit for node 69cf8910000c489abc2c0ccc 2026-04-05 09:32:07,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:32:07,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf8910000c489abc2c0ccc HTTP/1.1" 200 None 2026-04-05 09:32:07,496 - lava_callback - DEBUG - Processing node 69cf8910000c489abc2c0ccc: baseline-arm64-clabbe 2026-04-05 09:32:07,496 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf8910000c489abc2c0ccc 2026-04-05 09:32:07,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:32:07,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf8910000c489abc2c0ccc HTTP/1.1" 200 None 2026-04-05 09:32:07,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:32:07,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-05 09:32:07,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:32:07,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf8910000c489abc2c0ccc HTTP/1.1" 200 None 2026-04-05 09:32:07,549 - lava_callback - ERROR - Error processing callback for node 69cf8910000c489abc2c0ccc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38234 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:33:27,540 - lava_callback - INFO - Received callback for node 69cf8958000c489abc2c0d00 INFO: 172.21.0.1:38250 - "POST /node/69cf8958000c489abc2c0d00 HTTP/1.0" 202 Accepted 2026-04-05 09:33:27,546 - lava_callback - INFO - Starting async job submit for node 69cf8958000c489abc2c0d00 2026-04-05 09:33:27,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:33:27,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf8958000c489abc2c0d00 HTTP/1.1" 200 None 2026-04-05 09:33:27,568 - lava_callback - DEBUG - Processing node 69cf8958000c489abc2c0d00: baseline-arm64-clabbe 2026-04-05 09:33:27,568 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf8958000c489abc2c0d00 2026-04-05 09:33:27,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:33:27,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf8958000c489abc2c0d00 HTTP/1.1" 200 None 2026-04-05 09:33:27,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:33:27,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-05 09:33:27,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:33:27,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf8958000c489abc2c0d00 HTTP/1.1" 200 None 2026-04-05 09:33:27,626 - lava_callback - ERROR - Error processing callback for node 69cf8958000c489abc2c0d00: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53518 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:34:47,904 - lava_callback - INFO - Received callback for node 69d22c6c0d94ee66016fc2dd INFO: 172.21.0.1:53534 - "POST /node/69d22c6c0d94ee66016fc2dd HTTP/1.0" 202 Accepted 2026-04-05 09:34:47,910 - lava_callback - INFO - Starting async job submit for node 69d22c6c0d94ee66016fc2dd 2026-04-05 09:34:47,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:34:47,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d22c6c0d94ee66016fc2dd HTTP/1.1" 200 None 2026-04-05 09:34:47,950 - lava_callback - DEBUG - Processing node 69d22c6c0d94ee66016fc2dd: baseline-arm64 2026-04-05 09:34:48,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:34:48,552 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:34:48,554 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d22c6c0d94ee66016fc2dd/log.txt.gz 2026-04-05 09:34:48,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:34:49,032 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:34:49,034 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d22c6c0d94ee66016fc2dd/lava-logs.yaml 2026-04-05 09:34:49,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:34:49,203 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:34:49,205 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d22c6c0d94ee66016fc2dd/lava_callback.json.gz 2026-04-05 09:34:49,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:34:49,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d22c6c0d94ee66016fc2dd HTTP/1.1" 200 None 2026-04-05 09:34:49,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:34:49,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 09:34:49,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:34:49,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d22c6c0d94ee66016fc2dd HTTP/1.1" 200 None 2026-04-05 09:34:49,325 - lava_callback - INFO - Completed processing callback for node 69d22c6c0d94ee66016fc2dd INFO: 172.21.0.1:48110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37270 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:35:06,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:35:06,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-05 09:35:07,740 - lava_callback - INFO - Received callback for node 69cf89c0000c489abc2c0d67 INFO: 172.21.0.1:37280 - "POST /node/69cf89c0000c489abc2c0d67 HTTP/1.0" 202 Accepted 2026-04-05 09:35:07,749 - lava_callback - INFO - Starting async job submit for node 69cf89c0000c489abc2c0d67 2026-04-05 09:35:07,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:35:07,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf89c0000c489abc2c0d67 HTTP/1.1" 200 None 2026-04-05 09:35:07,767 - lava_callback - DEBUG - Processing node 69cf89c0000c489abc2c0d67: baseline-arm64-clabbe 2026-04-05 09:35:07,768 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf89c0000c489abc2c0d67 2026-04-05 09:35:07,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:35:07,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf89c0000c489abc2c0d67 HTTP/1.1" 200 None 2026-04-05 09:35:07,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:35:07,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-05 09:35:07,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:35:07,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf89c0000c489abc2c0d67 HTTP/1.1" 200 None 2026-04-05 09:35:07,832 - lava_callback - ERROR - Error processing callback for node 69cf89c0000c489abc2c0d67: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-05 09:35:12,938 - lava_callback - INFO - Received callback for node 69d22bbd0d94ee66016fc281 INFO: 172.21.0.1:42106 - "POST /node/69d22bbd0d94ee66016fc281 HTTP/1.0" 202 Accepted 2026-04-05 09:35:12,946 - lava_callback - INFO - Starting async job submit for node 69d22bbd0d94ee66016fc281 2026-04-05 09:35:12,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:35:13,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d22bbd0d94ee66016fc281 HTTP/1.1" 200 None 2026-04-05 09:35:13,013 - lava_callback - DEBUG - Processing node 69d22bbd0d94ee66016fc281: baseline-nfs-arm64 2026-04-05 09:35:13,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:35:13,631 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:35:13,633 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d22bbd0d94ee66016fc281/log.txt.gz 2026-04-05 09:35:13,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:35:14,071 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:35:14,073 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d22bbd0d94ee66016fc281/lava-logs.yaml 2026-04-05 09:35:14,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:35:14,243 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:35:14,245 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d22bbd0d94ee66016fc281/lava_callback.json.gz 2026-04-05 09:35:14,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:35:14,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d22bbd0d94ee66016fc281 HTTP/1.1" 200 None 2026-04-05 09:35:14,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:35:14,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 09:35:14,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:35:14,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d22bbd0d94ee66016fc281 HTTP/1.1" 200 None 2026-04-05 09:35:14,332 - lava_callback - INFO - Completed processing callback for node 69d22bbd0d94ee66016fc281 INFO: 172.21.0.1:42114 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49518 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:35:36,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:35:36,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54196 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:36:27,710 - lava_callback - INFO - Received callback for node 69cf8a0a000c489abc2c0d8b INFO: 172.21.0.1:54202 - "POST /node/69cf8a0a000c489abc2c0d8b HTTP/1.0" 202 Accepted 2026-04-05 09:36:27,715 - lava_callback - INFO - Starting async job submit for node 69cf8a0a000c489abc2c0d8b 2026-04-05 09:36:27,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:36:27,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf8a0a000c489abc2c0d8b HTTP/1.1" 200 None 2026-04-05 09:36:27,731 - lava_callback - DEBUG - Processing node 69cf8a0a000c489abc2c0d8b: baseline-arm64-clabbe 2026-04-05 09:36:27,731 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf8a0a000c489abc2c0d8b 2026-04-05 09:36:27,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:36:27,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf8a0a000c489abc2c0d8b HTTP/1.1" 200 None 2026-04-05 09:36:27,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:36:27,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-05 09:36:27,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:36:27,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf8a0a000c489abc2c0d8b HTTP/1.1" 200 None 2026-04-05 09:36:27,784 - lava_callback - ERROR - Error processing callback for node 69cf8a0a000c489abc2c0d8b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41940 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:37:27,770 - lava_callback - INFO - Received callback for node 69cf8a51000c489abc2c0dcd INFO: 172.21.0.1:41944 - "POST /node/69cf8a51000c489abc2c0dcd HTTP/1.0" 202 Accepted 2026-04-05 09:37:27,776 - lava_callback - INFO - Starting async job submit for node 69cf8a51000c489abc2c0dcd 2026-04-05 09:37:27,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:37:27,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf8a51000c489abc2c0dcd HTTP/1.1" 200 None 2026-04-05 09:37:27,798 - lava_callback - DEBUG - Processing node 69cf8a51000c489abc2c0dcd: baseline-arm64-clabbe 2026-04-05 09:37:27,798 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf8a51000c489abc2c0dcd 2026-04-05 09:37:27,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:37:27,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf8a51000c489abc2c0dcd HTTP/1.1" 200 None 2026-04-05 09:37:27,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:37:27,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-05 09:37:27,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:37:27,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf8a51000c489abc2c0dcd HTTP/1.1" 200 None 2026-04-05 09:37:27,852 - lava_callback - ERROR - Error processing callback for node 69cf8a51000c489abc2c0dcd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40996 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:37:36,842 - lava_callback - INFO - Received callback for node 69d22c250d94ee66016fc2d0 INFO: 172.21.0.1:41002 - "POST /node/69d22c250d94ee66016fc2d0 HTTP/1.0" 202 Accepted 2026-04-05 09:37:36,850 - lava_callback - INFO - Starting async job submit for node 69d22c250d94ee66016fc2d0 2026-04-05 09:37:36,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:37:36,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d22c250d94ee66016fc2d0 HTTP/1.1" 200 None 2026-04-05 09:37:36,910 - lava_callback - DEBUG - Processing node 69d22c250d94ee66016fc2d0: baseline-arm64 2026-04-05 09:37:37,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:37:37,522 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:37:37,524 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d22c250d94ee66016fc2d0/log.txt.gz 2026-04-05 09:37:37,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:37:37,994 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:37:37,996 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d22c250d94ee66016fc2d0/lava-logs.yaml 2026-04-05 09:37:38,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:37:38,192 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:37:38,194 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d22c250d94ee66016fc2d0/lava_callback.json.gz DEBUG: Setup failed for 69d22c250d94ee66016fc2d0. Transitting job node result: incomplete -> fail 2026-04-05 09:37:38,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:37:38,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d22c250d94ee66016fc2d0 HTTP/1.1" 200 None 2026-04-05 09:37:38,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:37:38,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 09:37:38,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:37:38,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d22c250d94ee66016fc2d0 HTTP/1.1" 200 None 2026-04-05 09:37:38,407 - lava_callback - INFO - Completed processing callback for node 69d22c250d94ee66016fc2d0 INFO: 172.21.0.1:47540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56382 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:38:06,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:38:06,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45722 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:38:47,821 - lava_callback - INFO - Received callback for node 69cf8a99000c489abc2c0e00 INFO: 172.21.0.1:45738 - "POST /node/69cf8a99000c489abc2c0e00 HTTP/1.0" 202 Accepted 2026-04-05 09:38:47,827 - lava_callback - INFO - Starting async job submit for node 69cf8a99000c489abc2c0e00 2026-04-05 09:38:47,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:38:47,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf8a99000c489abc2c0e00 HTTP/1.1" 200 None 2026-04-05 09:38:47,843 - lava_callback - DEBUG - Processing node 69cf8a99000c489abc2c0e00: baseline-arm64-clabbe 2026-04-05 09:38:47,844 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf8a99000c489abc2c0e00 2026-04-05 09:38:47,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:38:47,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf8a99000c489abc2c0e00 HTTP/1.1" 200 None 2026-04-05 09:38:47,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:38:47,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-05 09:38:47,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:38:47,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf8a99000c489abc2c0e00 HTTP/1.1" 200 None 2026-04-05 09:38:47,914 - lava_callback - ERROR - Error processing callback for node 69cf8a99000c489abc2c0e00: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57222 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40708 - "GET /node/69834229409235c29c0e0073%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:40722 - "GET /node/6986faf96e077e4126a7d39a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:32952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57960 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:41:39,208 - lava_callback - INFO - Received callback for node 69cf8b42000c489abc2c0e81 INFO: 172.21.0.1:57970 - "POST /node/69cf8b42000c489abc2c0e81 HTTP/1.0" 202 Accepted 2026-04-05 09:41:39,214 - lava_callback - INFO - Starting async job submit for node 69cf8b42000c489abc2c0e81 2026-04-05 09:41:39,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:41:39,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf8b42000c489abc2c0e81 HTTP/1.1" 200 None 2026-04-05 09:41:39,229 - lava_callback - DEBUG - Processing node 69cf8b42000c489abc2c0e81: baseline-arm64-baylibre 2026-04-05 09:41:39,230 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf8b42000c489abc2c0e81 2026-04-05 09:41:39,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:41:39,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf8b42000c489abc2c0e81 HTTP/1.1" 200 None 2026-04-05 09:41:39,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:41:39,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-05 09:41:39,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:41:39,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf8b42000c489abc2c0e81 HTTP/1.1" 200 None 2026-04-05 09:41:39,297 - lava_callback - ERROR - Error processing callback for node 69cf8b42000c489abc2c0e81: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55484 - "GET /node/694a53ea83c67c43d1ed949f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:55486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40476 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:43:39,347 - lava_callback - INFO - Received callback for node 69cf8bc7000c489abc2c0efb INFO: 172.21.0.1:40480 - "POST /node/69cf8bc7000c489abc2c0efb HTTP/1.0" 202 Accepted 2026-04-05 09:43:39,353 - lava_callback - INFO - Starting async job submit for node 69cf8bc7000c489abc2c0efb 2026-04-05 09:43:39,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:43:39,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf8bc7000c489abc2c0efb HTTP/1.1" 200 None 2026-04-05 09:43:39,373 - lava_callback - DEBUG - Processing node 69cf8bc7000c489abc2c0efb: baseline-arm64-baylibre 2026-04-05 09:43:39,373 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf8bc7000c489abc2c0efb 2026-04-05 09:43:39,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:43:39,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf8bc7000c489abc2c0efb HTTP/1.1" 200 None 2026-04-05 09:43:39,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:43:39,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-05 09:43:39,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:43:39,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf8bc7000c489abc2c0efb HTTP/1.1" 200 None 2026-04-05 09:43:39,441 - lava_callback - ERROR - Error processing callback for node 69cf8bc7000c489abc2c0efb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55030 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:43:59,358 - lava_callback - INFO - Received callback for node 69d22ec50d94ee66016fc4f2 INFO: 172.21.0.1:55040 - "POST /node/69d22ec50d94ee66016fc4f2 HTTP/1.0" 202 Accepted 2026-04-05 09:43:59,364 - lava_callback - INFO - Starting async job submit for node 69d22ec50d94ee66016fc4f2 2026-04-05 09:43:59,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:43:59,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d22ec50d94ee66016fc4f2 HTTP/1.1" 200 None 2026-04-05 09:43:59,405 - lava_callback - DEBUG - Processing node 69d22ec50d94ee66016fc4f2: baseline-nfs-arm64 2026-04-05 09:43:59,407 - lava_callback - WARNING - Failed to upload log 2026-04-05 09:43:59,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:43:59,538 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:43:59,539 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d22ec50d94ee66016fc4f2/lava-logs.yaml 2026-04-05 09:43:59,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:43:59,664 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:43:59,666 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d22ec50d94ee66016fc4f2/lava_callback.json.gz 2026-04-05 09:43:59,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:43:59,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d22ec50d94ee66016fc4f2 HTTP/1.1" 200 None 2026-04-05 09:43:59,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:43:59,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 09:43:59,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:43:59,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d22ec50d94ee66016fc4f2 HTTP/1.1" 200 None 2026-04-05 09:43:59,728 - lava_callback - INFO - Completed processing callback for node 69d22ec50d94ee66016fc4f2 INFO: 172.21.0.1:33266 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:44:06,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:44:06,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56896 - "GET /node/693b070dfee8383e92b70a86%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:56902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60752 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:45:59,433 - lava_callback - INFO - Received callback for node 69cf8c52000c489abc2c0f77 INFO: 172.21.0.1:60754 - "POST /node/69cf8c52000c489abc2c0f77 HTTP/1.0" 202 Accepted 2026-04-05 09:45:59,438 - lava_callback - INFO - Starting async job submit for node 69cf8c52000c489abc2c0f77 2026-04-05 09:45:59,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:45:59,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf8c52000c489abc2c0f77 HTTP/1.1" 200 None 2026-04-05 09:45:59,454 - lava_callback - DEBUG - Processing node 69cf8c52000c489abc2c0f77: baseline-arm64-baylibre 2026-04-05 09:45:59,454 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf8c52000c489abc2c0f77 2026-04-05 09:45:59,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:45:59,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf8c52000c489abc2c0f77 HTTP/1.1" 200 None 2026-04-05 09:45:59,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:45:59,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-05 09:45:59,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:45:59,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf8c52000c489abc2c0f77 HTTP/1.1" 200 None 2026-04-05 09:45:59,521 - lava_callback - ERROR - Error processing callback for node 69cf8c52000c489abc2c0f77: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37160 - "GET /node/69892e0685773790cd34b608%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:37172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38446 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:47:06,499 - lava_callback - INFO - Received callback for node 69d22f620d94ee66016fc576 INFO: 172.21.0.1:43286 - "POST /node/69d22f620d94ee66016fc576 HTTP/1.0" 202 Accepted 2026-04-05 09:47:06,507 - lava_callback - INFO - Starting async job submit for node 69d22f620d94ee66016fc576 INFO: 172.21.0.1:43294 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:47:06,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:47:06,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d22f620d94ee66016fc576 HTTP/1.1" 200 None 2026-04-05 09:47:06,555 - lava_callback - DEBUG - Processing node 69d22f620d94ee66016fc576: baseline-arm64 2026-04-05 09:47:06,737 - lava_callback - WARNING - Failed to upload log 2026-04-05 09:47:06,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:47:07,050 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:47:07,053 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d22f620d94ee66016fc576/lava-logs.yaml 2026-04-05 09:47:07,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:47:07,202 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:47:07,204 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d22f620d94ee66016fc576/lava_callback.json.gz 2026-04-05 09:47:07,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:47:07,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d22f620d94ee66016fc576 HTTP/1.1" 200 None 2026-04-05 09:47:07,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:47:07,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 09:47:07,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:47:07,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d22f620d94ee66016fc576 HTTP/1.1" 200 None 2026-04-05 09:47:07,371 - lava_callback - INFO - Completed processing callback for node 69d22f620d94ee66016fc576 2026-04-05 09:47:08,893 - lava_callback - INFO - Received callback for node 69d22f170d94ee66016fc52a INFO: 172.21.0.1:43310 - "POST /node/69d22f170d94ee66016fc52a HTTP/1.0" 202 Accepted 2026-04-05 09:47:08,901 - lava_callback - INFO - Starting async job submit for node 69d22f170d94ee66016fc52a 2026-04-05 09:47:08,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:47:08,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d22f170d94ee66016fc52a HTTP/1.1" 200 None 2026-04-05 09:47:08,954 - lava_callback - DEBUG - Processing node 69d22f170d94ee66016fc52a: baseline-arm64-broonie 2026-04-05 09:47:09,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:47:09,464 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:47:09,466 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d22f170d94ee66016fc52a/log.txt.gz 2026-04-05 09:47:09,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:47:09,882 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:47:09,884 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d22f170d94ee66016fc52a/lava-logs.yaml 2026-04-05 09:47:09,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:47:10,039 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:47:10,041 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d22f170d94ee66016fc52a/lava_callback.json.gz 2026-04-05 09:47:10,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:47:10,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d22f170d94ee66016fc52a HTTP/1.1" 200 None 2026-04-05 09:47:10,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:47:10,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 09:47:10,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:47:10,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d22f170d94ee66016fc52a HTTP/1.1" 200 None 2026-04-05 09:47:10,159 - lava_callback - INFO - Completed processing callback for node 69d22f170d94ee66016fc52a INFO: 172.21.0.1:51022 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51032 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:47:24,120 - lava_callback - INFO - Received callback for node 69d22d0c0d94ee66016fc371 INFO: 172.21.0.1:55528 - "POST /node/69d22d0c0d94ee66016fc371 HTTP/1.0" 202 Accepted 2026-04-05 09:47:24,127 - lava_callback - INFO - Starting async job submit for node 69d22d0c0d94ee66016fc371 2026-04-05 09:47:24,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:47:24,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d22d0c0d94ee66016fc371 HTTP/1.1" 200 None 2026-04-05 09:47:24,168 - lava_callback - DEBUG - Processing node 69d22d0c0d94ee66016fc371: baseline-arm64 2026-04-05 09:47:24,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:47:24,812 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:47:24,814 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d22d0c0d94ee66016fc371/log.txt.gz 2026-04-05 09:47:25,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:47:25,297 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:47:25,300 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d22d0c0d94ee66016fc371/lava-logs.yaml 2026-04-05 09:47:25,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:47:25,492 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:47:25,495 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d22d0c0d94ee66016fc371/lava_callback.json.gz 2026-04-05 09:47:25,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:47:25,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d22d0c0d94ee66016fc371 HTTP/1.1" 200 None 2026-04-05 09:47:25,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:47:25,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 09:47:25,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:47:25,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d22d0c0d94ee66016fc371 HTTP/1.1" 200 None 2026-04-05 09:47:25,658 - lava_callback - INFO - Completed processing callback for node 69d22d0c0d94ee66016fc371 INFO: 172.21.0.1:55538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43776 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:47:36,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:47:36,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53054 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:49:09,660 - lava_callback - INFO - Received callback for node 69cf8d06000c489abc2c1004 INFO: 172.21.0.1:53066 - "POST /node/69cf8d06000c489abc2c1004 HTTP/1.0" 202 Accepted 2026-04-05 09:49:09,666 - lava_callback - INFO - Starting async job submit for node 69cf8d06000c489abc2c1004 2026-04-05 09:49:09,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:49:09,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf8d06000c489abc2c1004 HTTP/1.1" 200 None 2026-04-05 09:49:09,682 - lava_callback - DEBUG - Processing node 69cf8d06000c489abc2c1004: baseline-arm64-clabbe 2026-04-05 09:49:09,682 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf8d06000c489abc2c1004 2026-04-05 09:49:09,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:49:09,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf8d06000c489abc2c1004 HTTP/1.1" 200 None 2026-04-05 09:49:09,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:49:09,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-05 09:49:09,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:49:09,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf8d06000c489abc2c1004 HTTP/1.1" 200 None 2026-04-05 09:49:09,735 - lava_callback - ERROR - Error processing callback for node 69cf8d06000c489abc2c1004: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44076 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50226 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:49:37,572 - lava_callback - INFO - Received callback for node 69d22d9b0d94ee66016fc3f2 INFO: 172.21.0.1:50230 - "POST /node/69d22d9b0d94ee66016fc3f2 HTTP/1.0" 202 Accepted 2026-04-05 09:49:37,579 - lava_callback - INFO - Starting async job submit for node 69d22d9b0d94ee66016fc3f2 2026-04-05 09:49:37,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:49:37,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d22d9b0d94ee66016fc3f2 HTTP/1.1" 200 None 2026-04-05 09:49:37,624 - lava_callback - DEBUG - Processing node 69d22d9b0d94ee66016fc3f2: baseline-nfs-arm64 2026-04-05 09:49:38,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:49:38,457 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:49:38,460 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d22d9b0d94ee66016fc3f2/log.txt.gz 2026-04-05 09:49:38,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:49:39,015 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:49:39,018 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d22d9b0d94ee66016fc3f2/lava-logs.yaml 2026-04-05 09:49:39,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:49:39,212 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:49:39,214 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d22d9b0d94ee66016fc3f2/lava_callback.json.gz 2026-04-05 09:49:39,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:49:39,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d22d9b0d94ee66016fc3f2 HTTP/1.1" 200 None 2026-04-05 09:49:39,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:49:39,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 09:49:39,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:49:39,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d22d9b0d94ee66016fc3f2 HTTP/1.1" 200 None 2026-04-05 09:49:39,361 - lava_callback - INFO - Completed processing callback for node 69d22d9b0d94ee66016fc3f2 INFO: 172.21.0.1:51336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52674 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:50:02,298 - lava_callback - INFO - Received callback for node 69d22f5d0d94ee66016fc573 INFO: 172.21.0.1:44512 - "POST /node/69d22f5d0d94ee66016fc573 HTTP/1.0" 202 Accepted 2026-04-05 09:50:02,305 - lava_callback - INFO - Starting async job submit for node 69d22f5d0d94ee66016fc573 2026-04-05 09:50:02,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:50:02,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d22f5d0d94ee66016fc573 HTTP/1.1" 200 None 2026-04-05 09:50:02,344 - lava_callback - DEBUG - Processing node 69d22f5d0d94ee66016fc573: ltp-smoke 2026-04-05 09:50:02,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:50:02,876 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:50:02,878 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69d22f5d0d94ee66016fc573/log.txt.gz 2026-04-05 09:50:03,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:50:03,364 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:50:03,366 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69d22f5d0d94ee66016fc573/lava-logs.yaml 2026-04-05 09:50:03,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:50:03,550 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:50:03,551 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69d22f5d0d94ee66016fc573/lava_callback.json.gz 2026-04-05 09:50:03,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:50:03,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d22f5d0d94ee66016fc573 HTTP/1.1" 200 None 2026-04-05 09:50:03,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:50:03,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-05 09:50:03,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:50:03,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d22f5d0d94ee66016fc573 HTTP/1.1" 200 None 2026-04-05 09:50:03,653 - lava_callback - INFO - Completed processing callback for node 69d22f5d0d94ee66016fc573 INFO: 172.21.0.1:44530 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:50:06,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:50:06,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54592 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:51:27,226 - lava_callback - INFO - Received callback for node 69d230550d94ee66016fc628 INFO: 172.21.0.1:54606 - "POST /node/69d230550d94ee66016fc628 HTTP/1.0" 202 Accepted 2026-04-05 09:51:27,233 - lava_callback - INFO - Starting async job submit for node 69d230550d94ee66016fc628 2026-04-05 09:51:27,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:51:27,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d230550d94ee66016fc628 HTTP/1.1" 200 None 2026-04-05 09:51:27,291 - lava_callback - DEBUG - Processing node 69d230550d94ee66016fc628: baseline-arm64 2026-04-05 09:51:27,342 - lava_callback - INFO - Received callback for node 69d22cb10d94ee66016fc304 INFO: 172.21.0.1:54616 - "POST /node/69d22cb10d94ee66016fc304 HTTP/1.0" 202 Accepted 2026-04-05 09:51:27,366 - lava_callback - INFO - Starting async job submit for node 69d22cb10d94ee66016fc304 2026-04-05 09:51:27,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:51:27,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:51:27,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d22cb10d94ee66016fc304 HTTP/1.1" 200 None 2026-04-05 09:51:27,550 - lava_callback - DEBUG - Processing node 69d22cb10d94ee66016fc304: baseline-arm 2026-04-05 09:51:27,783 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:51:27,841 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d230550d94ee66016fc628/log.txt.gz 2026-04-05 09:51:28,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:51:28,345 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:51:28,393 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d230550d94ee66016fc628/lava-logs.yaml 2026-04-05 09:51:28,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:51:28,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:51:28,553 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:51:28,555 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d230550d94ee66016fc628/lava_callback.json.gz 2026-04-05 09:51:28,572 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:51:28,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:51:28,588 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d22cb10d94ee66016fc304/log.txt.gz 2026-04-05 09:51:28,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d230550d94ee66016fc628 HTTP/1.1" 200 None 2026-04-05 09:51:28,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:51:28,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 09:51:28,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:51:28,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d230550d94ee66016fc628 HTTP/1.1" 200 None 2026-04-05 09:51:28,881 - lava_callback - INFO - Received callback for node 69cf8d90000c489abc2c106a INFO: 172.21.0.1:54620 - "POST /node/69cf8d90000c489abc2c106a HTTP/1.0" 202 Accepted 2026-04-05 09:51:28,940 - lava_callback - INFO - Starting async job submit for node 69cf8d90000c489abc2c106a 2026-04-05 09:51:28,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:51:29,017 - lava_callback - INFO - Completed processing callback for node 69d230550d94ee66016fc628 2026-04-05 09:51:29,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf8d90000c489abc2c106a HTTP/1.1" 200 None 2026-04-05 09:51:29,037 - lava_callback - DEBUG - Processing node 69cf8d90000c489abc2c106a: baseline-arm64-clabbe 2026-04-05 09:51:29,038 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf8d90000c489abc2c106a 2026-04-05 09:51:29,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:51:29,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:51:29,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf8d90000c489abc2c106a HTTP/1.1" 200 None 2026-04-05 09:51:29,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:51:29,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-05 09:51:29,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:51:29,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf8d90000c489abc2c106a HTTP/1.1" 200 None 2026-04-05 09:51:29,162 - lava_callback - ERROR - Error processing callback for node 69cf8d90000c489abc2c106a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-05 09:51:29,413 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:51:29,416 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d22cb10d94ee66016fc304/lava-logs.yaml 2026-04-05 09:51:29,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:51:29,618 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:51:29,620 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d22cb10d94ee66016fc304/lava_callback.json.gz DEBUG: Setup failed for 69d22cb10d94ee66016fc304. Transitting job node result: incomplete -> fail 2026-04-05 09:51:29,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:51:29,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d22cb10d94ee66016fc304 HTTP/1.1" 200 None 2026-04-05 09:51:29,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:51:29,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-05 09:51:29,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:51:29,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d22cb10d94ee66016fc304 HTTP/1.1" 200 None 2026-04-05 09:51:29,964 - lava_callback - INFO - Completed processing callback for node 69d22cb10d94ee66016fc304 INFO: 172.21.0.1:60216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60228 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:51:36,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:51:36,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35680 - "GET /node/6984a05e3a8748f282087f8a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:35690 - "GET /node/6986fb006e077e4126a7d3cd%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:59382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38462 - "GET /node/693ae826fee8383e92b6568b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:53930 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:53:08,978 - lava_callback - INFO - Received callback for node 69cf8dfb000c489abc2c10b7 INFO: 172.21.0.1:53934 - "POST /node/69cf8dfb000c489abc2c10b7 HTTP/1.0" 202 Accepted 2026-04-05 09:53:08,987 - lava_callback - INFO - Starting async job submit for node 69cf8dfb000c489abc2c10b7 2026-04-05 09:53:08,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:53:09,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf8dfb000c489abc2c10b7 HTTP/1.1" 200 None 2026-04-05 09:53:09,004 - lava_callback - DEBUG - Processing node 69cf8dfb000c489abc2c10b7: baseline-arm64-clabbe 2026-04-05 09:53:09,005 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf8dfb000c489abc2c10b7 2026-04-05 09:53:09,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:53:09,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf8dfb000c489abc2c10b7 HTTP/1.1" 200 None 2026-04-05 09:53:09,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:53:09,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-05 09:53:09,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:53:09,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf8dfb000c489abc2c10b7 HTTP/1.1" 200 None 2026-04-05 09:53:09,071 - lava_callback - ERROR - Error processing callback for node 69cf8dfb000c489abc2c10b7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37178 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:53:29,314 - lava_callback - INFO - Received callback for node 69d230130d94ee66016fc5d7 INFO: 172.21.0.1:37186 - "POST /node/69d230130d94ee66016fc5d7 HTTP/1.0" 202 Accepted 2026-04-05 09:53:29,321 - lava_callback - INFO - Starting async job submit for node 69d230130d94ee66016fc5d7 2026-04-05 09:53:29,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:53:29,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d230130d94ee66016fc5d7 HTTP/1.1" 200 None 2026-04-05 09:53:29,361 - lava_callback - DEBUG - Processing node 69d230130d94ee66016fc5d7: ltp-syscalls-ipc 2026-04-05 09:53:29,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:53:29,938 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:53:29,939 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69d230130d94ee66016fc5d7/log.txt.gz 2026-04-05 09:53:30,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:53:30,371 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:53:30,374 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69d230130d94ee66016fc5d7/lava-logs.yaml 2026-04-05 09:53:30,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 09:53:30,529 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 09:53:30,531 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69d230130d94ee66016fc5d7/lava_callback.json.gz 2026-04-05 09:53:30,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:53:30,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d230130d94ee66016fc5d7 HTTP/1.1" 200 None 2026-04-05 09:53:30,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:53:30,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-05 09:53:30,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:53:30,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d230130d94ee66016fc5d7 HTTP/1.1" 200 None 2026-04-05 09:53:30,619 - lava_callback - INFO - Completed processing callback for node 69d230130d94ee66016fc5d7 INFO: 172.21.0.1:41962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41974 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:53:36,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:53:36,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54348 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46486 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:54:48,968 - lava_callback - INFO - Received callback for node 69cf8e64000c489abc2c110c INFO: 172.21.0.1:46496 - "POST /node/69cf8e64000c489abc2c110c HTTP/1.0" 202 Accepted 2026-04-05 09:54:48,973 - lava_callback - INFO - Starting async job submit for node 69cf8e64000c489abc2c110c 2026-04-05 09:54:48,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:54:48,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf8e64000c489abc2c110c HTTP/1.1" 200 None 2026-04-05 09:54:48,991 - lava_callback - DEBUG - Processing node 69cf8e64000c489abc2c110c: baseline-arm64-clabbe 2026-04-05 09:54:48,991 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf8e64000c489abc2c110c 2026-04-05 09:54:48,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:54:49,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf8e64000c489abc2c110c HTTP/1.1" 200 None 2026-04-05 09:54:49,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:54:49,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-05 09:54:49,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:54:49,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf8e64000c489abc2c110c HTTP/1.1" 200 None 2026-04-05 09:54:49,062 - lava_callback - ERROR - Error processing callback for node 69cf8e64000c489abc2c110c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49038 - "GET /node/698af4bf3b3beb19e7616aa4%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:49046 - "GET /node/69a161baa41e9451dcf4133f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:50518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53996 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55630 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:57:09,047 - lava_callback - INFO - Received callback for node 69cf8eec000c489abc2c11ab INFO: 172.21.0.1:55632 - "POST /node/69cf8eec000c489abc2c11ab HTTP/1.0" 202 Accepted 2026-04-05 09:57:09,053 - lava_callback - INFO - Starting async job submit for node 69cf8eec000c489abc2c11ab 2026-04-05 09:57:09,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:57:09,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf8eec000c489abc2c11ab HTTP/1.1" 200 None 2026-04-05 09:57:09,071 - lava_callback - DEBUG - Processing node 69cf8eec000c489abc2c11ab: baseline-arm64-clabbe 2026-04-05 09:57:09,071 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf8eec000c489abc2c11ab 2026-04-05 09:57:09,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:57:09,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf8eec000c489abc2c11ab HTTP/1.1" 200 None 2026-04-05 09:57:09,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:57:09,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-05 09:57:09,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:57:09,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf8eec000c489abc2c11ab HTTP/1.1" 200 None 2026-04-05 09:57:09,123 - lava_callback - ERROR - Error processing callback for node 69cf8eec000c489abc2c11ab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44054 - "GET / HTTP/1.0" 200 OK 2026-04-05 09:58:29,119 - lava_callback - INFO - Received callback for node 69cf8f33000c489abc2c11d5 INFO: 172.21.0.1:44062 - "POST /node/69cf8f33000c489abc2c11d5 HTTP/1.0" 202 Accepted 2026-04-05 09:58:29,125 - lava_callback - INFO - Starting async job submit for node 69cf8f33000c489abc2c11d5 2026-04-05 09:58:29,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:58:29,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf8f33000c489abc2c11d5 HTTP/1.1" 200 None 2026-04-05 09:58:29,155 - lava_callback - DEBUG - Processing node 69cf8f33000c489abc2c11d5: baseline-arm64-clabbe 2026-04-05 09:58:29,156 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf8f33000c489abc2c11d5 2026-04-05 09:58:29,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:58:29,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf8f33000c489abc2c11d5 HTTP/1.1" 200 None 2026-04-05 09:58:29,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:58:29,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-05 09:58:29,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 09:58:29,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf8f33000c489abc2c11d5 HTTP/1.1" 200 None 2026-04-05 09:58:29,220 - lava_callback - ERROR - Error processing callback for node 69cf8f33000c489abc2c11d5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52068 - "GET /node/693e80f43c8f1be6d3cf1d1d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:47132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45982 - "GET /node/6928f41ea7fbd8958ccefcd4%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:39776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43132 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39950 - "GET /node/698ef3f7f0e3ffbba67d2cde%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:39962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41510 - "GET /node/693e1401407f32424eb56a37%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:41516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52798 - "GET /node/69bd085505e4bbd6ba635415%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:52810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53780 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36494 - "GET / HTTP/1.0" 200 OK 2026-04-05 10:06:40,616 - lava_callback - INFO - Received callback for node 69cf911b000c489abc2c137e INFO: 172.21.0.1:37958 - "POST /node/69cf911b000c489abc2c137e HTTP/1.0" 202 Accepted 2026-04-05 10:06:40,622 - lava_callback - INFO - Starting async job submit for node 69cf911b000c489abc2c137e 2026-04-05 10:06:40,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:06:40,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf911b000c489abc2c137e HTTP/1.1" 200 None 2026-04-05 10:06:40,638 - lava_callback - DEBUG - Processing node 69cf911b000c489abc2c137e: baseline-arm64-baylibre 2026-04-05 10:06:40,638 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf911b000c489abc2c137e 2026-04-05 10:06:40,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:06:40,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf911b000c489abc2c137e HTTP/1.1" 200 None 2026-04-05 10:06:40,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:06:40,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-05 10:06:40,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:06:40,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf911b000c489abc2c137e HTTP/1.1" 200 None 2026-04-05 10:06:40,693 - lava_callback - ERROR - Error processing callback for node 69cf911b000c489abc2c137e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54780 - "GET / HTTP/1.0" 200 OK 2026-04-05 10:07:09,146 - lava_callback - INFO - Received callback for node 69d22fb00d94ee66016fc5bc INFO: 172.21.0.1:54792 - "POST /node/69d22fb00d94ee66016fc5bc HTTP/1.0" 202 Accepted 2026-04-05 10:07:09,156 - lava_callback - INFO - Starting async job submit for node 69d22fb00d94ee66016fc5bc 2026-04-05 10:07:09,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:07:09,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d22fb00d94ee66016fc5bc HTTP/1.1" 200 None 2026-04-05 10:07:09,258 - lava_callback - DEBUG - Processing node 69d22fb00d94ee66016fc5bc: baseline-nfs-arm64 2026-04-05 10:07:10,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 10:07:10,656 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 10:07:10,658 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d22fb00d94ee66016fc5bc/log.txt.gz 2026-04-05 10:07:11,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 10:07:11,494 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 10:07:11,497 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d22fb00d94ee66016fc5bc/lava-logs.yaml 2026-04-05 10:07:11,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 10:07:11,696 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 10:07:11,698 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d22fb00d94ee66016fc5bc/lava_callback.json.gz DEBUG: Setup failed for 69d22fb00d94ee66016fc5bc. Transitting job node result: incomplete -> fail 2026-04-05 10:07:11,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:07:11,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d22fb00d94ee66016fc5bc HTTP/1.1" 200 None 2026-04-05 10:07:11,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:07:11,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 10:07:11,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:07:11,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d22fb00d94ee66016fc5bc HTTP/1.1" 200 None 2026-04-05 10:07:11,959 - lava_callback - INFO - Completed processing callback for node 69d22fb00d94ee66016fc5bc INFO: 172.21.0.1:46504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58050 - "GET / HTTP/1.0" 200 OK 2026-04-05 10:07:36,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:07:36,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48942 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48944 - "GET / HTTP/1.0" 200 OK 2026-04-05 10:08:20,660 - lava_callback - INFO - Received callback for node 69cf9183000c489abc2c13dc INFO: 172.21.0.1:34340 - "POST /node/69cf9183000c489abc2c13dc HTTP/1.0" 202 Accepted 2026-04-05 10:08:20,670 - lava_callback - INFO - Starting async job submit for node 69cf9183000c489abc2c13dc 2026-04-05 10:08:20,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:08:20,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf9183000c489abc2c13dc HTTP/1.1" 200 None 2026-04-05 10:08:20,686 - lava_callback - DEBUG - Processing node 69cf9183000c489abc2c13dc: baseline-arm64-baylibre 2026-04-05 10:08:20,687 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf9183000c489abc2c13dc 2026-04-05 10:08:20,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:08:20,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf9183000c489abc2c13dc HTTP/1.1" 200 None 2026-04-05 10:08:20,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:08:20,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-05 10:08:20,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:08:20,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf9183000c489abc2c13dc HTTP/1.1" 200 None 2026-04-05 10:08:20,766 - lava_callback - ERROR - Error processing callback for node 69cf9183000c489abc2c13dc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44376 - "GET / HTTP/1.0" 200 OK 2026-04-05 10:09:20,626 - lava_callback - INFO - Received callback for node 69cf91cb000c489abc2c1402 INFO: 172.21.0.1:47382 - "POST /node/69cf91cb000c489abc2c1402 HTTP/1.0" 202 Accepted 2026-04-05 10:09:20,633 - lava_callback - INFO - Starting async job submit for node 69cf91cb000c489abc2c1402 2026-04-05 10:09:20,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:09:20,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf91cb000c489abc2c1402 HTTP/1.1" 200 None 2026-04-05 10:09:20,651 - lava_callback - DEBUG - Processing node 69cf91cb000c489abc2c1402: baseline-arm64-baylibre 2026-04-05 10:09:20,651 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf91cb000c489abc2c1402 2026-04-05 10:09:20,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:09:20,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf91cb000c489abc2c1402 HTTP/1.1" 200 None 2026-04-05 10:09:20,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:09:20,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-05 10:09:20,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:09:20,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf91cb000c489abc2c1402 HTTP/1.1" 200 None 2026-04-05 10:09:20,712 - lava_callback - ERROR - Error processing callback for node 69cf91cb000c489abc2c1402: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44462 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35188 - "GET / HTTP/1.0" 200 OK 2026-04-05 10:11:40,766 - lava_callback - INFO - Received callback for node 69cf9253000c489abc2c1482 INFO: 172.21.0.1:60984 - "POST /node/69cf9253000c489abc2c1482 HTTP/1.0" 202 Accepted 2026-04-05 10:11:40,776 - lava_callback - INFO - Starting async job submit for node 69cf9253000c489abc2c1482 2026-04-05 10:11:40,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:11:40,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf9253000c489abc2c1482 HTTP/1.1" 200 None 2026-04-05 10:11:40,797 - lava_callback - DEBUG - Processing node 69cf9253000c489abc2c1482: baseline-arm64-baylibre 2026-04-05 10:11:40,798 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf9253000c489abc2c1482 2026-04-05 10:11:40,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:11:40,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf9253000c489abc2c1482 HTTP/1.1" 200 None 2026-04-05 10:11:40,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:11:40,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-05 10:11:40,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:11:40,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf9253000c489abc2c1482 HTTP/1.1" 200 None 2026-04-05 10:11:40,882 - lava_callback - ERROR - Error processing callback for node 69cf9253000c489abc2c1482: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48424 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44182 - "GET / HTTP/1.0" 200 OK 2026-04-05 10:13:40,939 - lava_callback - INFO - Received callback for node 69cf92bf000c489abc2c14cc INFO: 172.21.0.1:49786 - "POST /node/69cf92bf000c489abc2c14cc HTTP/1.0" 202 Accepted 2026-04-05 10:13:40,945 - lava_callback - INFO - Starting async job submit for node 69cf92bf000c489abc2c14cc 2026-04-05 10:13:40,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:13:40,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf92bf000c489abc2c14cc HTTP/1.1" 200 None 2026-04-05 10:13:40,967 - lava_callback - DEBUG - Processing node 69cf92bf000c489abc2c14cc: baseline-arm64-baylibre 2026-04-05 10:13:40,967 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf92bf000c489abc2c14cc 2026-04-05 10:13:40,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:13:40,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf92bf000c489abc2c14cc HTTP/1.1" 200 None 2026-04-05 10:13:40,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:13:40,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-05 10:13:41,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:13:41,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf92bf000c489abc2c14cc HTTP/1.1" 200 None 2026-04-05 10:13:41,033 - lava_callback - ERROR - Error processing callback for node 69cf92bf000c489abc2c14cc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-05 10:13:43,231 - lava_callback - INFO - Received callback for node 69d231c70d94ee66016fc779 INFO: 172.21.0.1:49794 - "POST /node/69d231c70d94ee66016fc779 HTTP/1.0" 202 Accepted 2026-04-05 10:13:43,238 - lava_callback - INFO - Starting async job submit for node 69d231c70d94ee66016fc779 2026-04-05 10:13:43,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:13:43,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d231c70d94ee66016fc779 HTTP/1.1" 200 None 2026-04-05 10:13:43,318 - lava_callback - DEBUG - Processing node 69d231c70d94ee66016fc779: ltp-smoke 2026-04-05 10:13:43,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 10:13:44,078 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 10:13:44,080 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69d231c70d94ee66016fc779/log.txt.gz 2026-04-05 10:13:44,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 10:13:44,690 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 10:13:44,693 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69d231c70d94ee66016fc779/lava-logs.yaml 2026-04-05 10:13:44,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 10:13:44,903 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 10:13:44,906 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69d231c70d94ee66016fc779/lava_callback.json.gz 2026-04-05 10:13:45,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:13:45,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d231c70d94ee66016fc779 HTTP/1.1" 200 None 2026-04-05 10:13:45,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:13:45,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9f0d94ee66016fb135 HTTP/1.1" 200 None 2026-04-05 10:13:45,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:13:45,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d231c70d94ee66016fc779 HTTP/1.1" 200 None 2026-04-05 10:13:45,219 - lava_callback - INFO - Completed processing callback for node 69d231c70d94ee66016fc779 INFO: 172.21.0.1:49800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59172 - "GET / HTTP/1.0" 200 OK 2026-04-05 10:14:06,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:14:06,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48190 - "GET / HTTP/1.0" 200 OK 2026-04-05 10:14:17,876 - lava_callback - INFO - Received callback for node 69d234490d94ee66016fc90f INFO: 172.21.0.1:48198 - "POST /node/69d234490d94ee66016fc90f HTTP/1.0" 202 Accepted 2026-04-05 10:14:17,888 - lava_callback - INFO - Starting async job submit for node 69d234490d94ee66016fc90f 2026-04-05 10:14:17,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:14:17,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d234490d94ee66016fc90f HTTP/1.1" 200 None 2026-04-05 10:14:17,945 - lava_callback - DEBUG - Processing node 69d234490d94ee66016fc90f: baseline-arm64 2026-04-05 10:14:18,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 10:14:18,497 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 10:14:18,498 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d234490d94ee66016fc90f/log.txt.gz 2026-04-05 10:14:18,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 10:14:18,921 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 10:14:18,923 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d234490d94ee66016fc90f/lava-logs.yaml 2026-04-05 10:14:18,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 10:14:19,087 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 10:14:19,089 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d234490d94ee66016fc90f/lava_callback.json.gz DEBUG: Setup failed for 69d234490d94ee66016fc90f. Transitting job node result: incomplete -> fail 2026-04-05 10:14:19,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:14:19,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d234490d94ee66016fc90f HTTP/1.1" 200 None 2026-04-05 10:14:19,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:14:19,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 10:14:19,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:14:19,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d234490d94ee66016fc90f HTTP/1.1" 200 None 2026-04-05 10:14:19,319 - lava_callback - INFO - Completed processing callback for node 69d234490d94ee66016fc90f INFO: 172.21.0.1:54668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59298 - "GET / HTTP/1.0" 200 OK 2026-04-05 10:14:36,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:14:36,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46828 - "GET / HTTP/1.0" 200 OK 2026-04-05 10:15:12,488 - lava_callback - INFO - Received callback for node 69d2361b0d94ee66016fcae8 INFO: 172.21.0.1:40020 - "POST /node/69d2361b0d94ee66016fcae8 HTTP/1.0" 202 Accepted 2026-04-05 10:15:12,494 - lava_callback - INFO - Starting async job submit for node 69d2361b0d94ee66016fcae8 2026-04-05 10:15:12,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:15:12,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2361b0d94ee66016fcae8 HTTP/1.1" 200 None 2026-04-05 10:15:12,518 - lava_callback - DEBUG - Processing node 69d2361b0d94ee66016fcae8: baseline-nfs-arm64 2026-04-05 10:15:12,520 - lava_callback - WARNING - Failed to upload log 2026-04-05 10:15:12,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 10:15:12,666 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 10:15:12,668 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d2361b0d94ee66016fcae8/lava-logs.yaml 2026-04-05 10:15:12,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 10:15:12,817 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 10:15:12,819 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d2361b0d94ee66016fcae8/lava_callback.json.gz 2026-04-05 10:15:12,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:15:12,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2361b0d94ee66016fcae8 HTTP/1.1" 200 None 2026-04-05 10:15:12,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:15:12,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 10:15:12,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:15:12,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2361b0d94ee66016fcae8 HTTP/1.1" 200 None 2026-04-05 10:15:12,905 - lava_callback - INFO - Completed processing callback for node 69d2361b0d94ee66016fcae8 INFO: 172.21.0.1:40032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47006 - "GET / HTTP/1.0" 200 OK 2026-04-05 10:15:36,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:15:36,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-05 10:15:41,027 - lava_callback - INFO - Received callback for node 69cf9347000c489abc2c154f INFO: 172.21.0.1:39980 - "POST /node/69cf9347000c489abc2c154f HTTP/1.0" 202 Accepted 2026-04-05 10:15:41,036 - lava_callback - INFO - Starting async job submit for node 69cf9347000c489abc2c154f 2026-04-05 10:15:41,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:15:41,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf9347000c489abc2c154f HTTP/1.1" 200 None 2026-04-05 10:15:41,082 - lava_callback - DEBUG - Processing node 69cf9347000c489abc2c154f: baseline-arm64-baylibre 2026-04-05 10:15:41,082 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf9347000c489abc2c154f 2026-04-05 10:15:41,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:15:41,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf9347000c489abc2c154f HTTP/1.1" 200 None 2026-04-05 10:15:41,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:15:41,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-05 10:15:41,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:15:41,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf9347000c489abc2c154f HTTP/1.1" 200 None 2026-04-05 10:15:41,152 - lava_callback - ERROR - Error processing callback for node 69cf9347000c489abc2c154f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52518 - "GET / HTTP/1.0" 200 OK 2026-04-05 10:17:10,288 - lava_callback - INFO - Received callback for node 69cf9393000c489abc2c159d INFO: 172.21.0.1:60644 - "POST /node/69cf9393000c489abc2c159d HTTP/1.0" 202 Accepted 2026-04-05 10:17:10,294 - lava_callback - INFO - Starting async job submit for node 69cf9393000c489abc2c159d 2026-04-05 10:17:10,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:17:10,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf9393000c489abc2c159d HTTP/1.1" 200 None 2026-04-05 10:17:10,310 - lava_callback - DEBUG - Processing node 69cf9393000c489abc2c159d: baseline-arm64-clabbe 2026-04-05 10:17:10,311 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf9393000c489abc2c159d 2026-04-05 10:17:10,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:17:10,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf9393000c489abc2c159d HTTP/1.1" 200 None 2026-04-05 10:17:10,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:17:10,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-05 10:17:10,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:17:10,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf9393000c489abc2c159d HTTP/1.1" 200 None 2026-04-05 10:17:10,381 - lava_callback - ERROR - Error processing callback for node 69cf9393000c489abc2c159d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44872 - "GET / HTTP/1.0" 200 OK 2026-04-05 10:18:05,530 - lava_callback - INFO - Received callback for node 69d236a50d94ee66016fcb0e INFO: 172.21.0.1:46372 - "POST /node/69d236a50d94ee66016fcb0e HTTP/1.0" 202 Accepted 2026-04-05 10:18:05,537 - lava_callback - INFO - Starting async job submit for node 69d236a50d94ee66016fcb0e 2026-04-05 10:18:05,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:18:05,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d236a50d94ee66016fcb0e HTTP/1.1" 200 None 2026-04-05 10:18:05,590 - lava_callback - DEBUG - Processing node 69d236a50d94ee66016fcb0e: baseline-arm64 2026-04-05 10:18:05,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 10:18:05,897 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 10:18:05,899 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d236a50d94ee66016fcb0e/log.txt.gz 2026-04-05 10:18:05,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 10:18:06,160 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 10:18:06,162 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d236a50d94ee66016fcb0e/lava-logs.yaml 2026-04-05 10:18:06,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 10:18:06,341 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 10:18:06,343 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d236a50d94ee66016fcb0e/lava_callback.json.gz 2026-04-05 10:18:06,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:18:06,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d236a50d94ee66016fcb0e HTTP/1.1" 200 None 2026-04-05 10:18:06,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:18:06,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 10:18:06,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:18:06,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d236a50d94ee66016fcb0e HTTP/1.1" 200 None 2026-04-05 10:18:06,501 - lava_callback - INFO - Completed processing callback for node 69d236a50d94ee66016fcb0e INFO: 172.21.0.1:46384 - "GET / HTTP/1.0" 200 OK 2026-04-05 10:18:06,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:18:06,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-05 10:18:10,262 - lava_callback - INFO - Received callback for node 69cf93d7000c489abc2c15e1 INFO: 172.21.0.1:38196 - "POST /node/69cf93d7000c489abc2c15e1 HTTP/1.0" 202 Accepted 2026-04-05 10:18:10,269 - lava_callback - INFO - Starting async job submit for node 69cf93d7000c489abc2c15e1 2026-04-05 10:18:10,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:18:10,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf93d7000c489abc2c15e1 HTTP/1.1" 200 None 2026-04-05 10:18:10,287 - lava_callback - DEBUG - Processing node 69cf93d7000c489abc2c15e1: baseline-arm64-clabbe 2026-04-05 10:18:10,287 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf93d7000c489abc2c15e1 2026-04-05 10:18:10,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:18:10,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf93d7000c489abc2c15e1 HTTP/1.1" 200 None 2026-04-05 10:18:10,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:18:10,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-05 10:18:10,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:18:10,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf93d7000c489abc2c15e1 HTTP/1.1" 200 None 2026-04-05 10:18:10,352 - lava_callback - ERROR - Error processing callback for node 69cf93d7000c489abc2c15e1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54748 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36200 - "GET / HTTP/1.0" 200 OK 2026-04-05 10:19:30,338 - lava_callback - INFO - Received callback for node 69cf9420000c489abc2c1607 INFO: 172.21.0.1:39658 - "POST /node/69cf9420000c489abc2c1607 HTTP/1.0" 202 Accepted 2026-04-05 10:19:30,345 - lava_callback - INFO - Starting async job submit for node 69cf9420000c489abc2c1607 2026-04-05 10:19:30,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:19:30,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf9420000c489abc2c1607 HTTP/1.1" 200 None 2026-04-05 10:19:30,361 - lava_callback - DEBUG - Processing node 69cf9420000c489abc2c1607: baseline-arm64-clabbe 2026-04-05 10:19:30,362 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf9420000c489abc2c1607 2026-04-05 10:19:30,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:19:30,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf9420000c489abc2c1607 HTTP/1.1" 200 None 2026-04-05 10:19:30,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:19:30,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-05 10:19:30,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:19:30,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf9420000c489abc2c1607 HTTP/1.1" 200 None 2026-04-05 10:19:30,447 - lava_callback - ERROR - Error processing callback for node 69cf9420000c489abc2c1607: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41636 - "GET / HTTP/1.0" 200 OK 2026-04-05 10:20:30,493 - lava_callback - INFO - Received callback for node 69cf9468000c489abc2c1634 INFO: 172.21.0.1:59384 - "POST /node/69cf9468000c489abc2c1634 HTTP/1.0" 202 Accepted 2026-04-05 10:20:30,499 - lava_callback - INFO - Starting async job submit for node 69cf9468000c489abc2c1634 2026-04-05 10:20:30,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:20:30,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf9468000c489abc2c1634 HTTP/1.1" 200 None 2026-04-05 10:20:30,522 - lava_callback - DEBUG - Processing node 69cf9468000c489abc2c1634: baseline-arm64-clabbe 2026-04-05 10:20:30,522 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf9468000c489abc2c1634 2026-04-05 10:20:30,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:20:30,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf9468000c489abc2c1634 HTTP/1.1" 200 None 2026-04-05 10:20:30,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:20:30,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-05 10:20:30,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:20:30,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf9468000c489abc2c1634 HTTP/1.1" 200 None 2026-04-05 10:20:30,583 - lava_callback - ERROR - Error processing callback for node 69cf9468000c489abc2c1634: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59500 - "GET / HTTP/1.0" 200 OK 2026-04-05 10:21:50,480 - lava_callback - INFO - Received callback for node 69cf94b4000c489abc2c1652 INFO: 172.21.0.1:56376 - "POST /node/69cf94b4000c489abc2c1652 HTTP/1.0" 202 Accepted 2026-04-05 10:21:50,486 - lava_callback - INFO - Starting async job submit for node 69cf94b4000c489abc2c1652 2026-04-05 10:21:50,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:21:50,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf94b4000c489abc2c1652 HTTP/1.1" 200 None 2026-04-05 10:21:50,504 - lava_callback - DEBUG - Processing node 69cf94b4000c489abc2c1652: baseline-arm64-clabbe 2026-04-05 10:21:50,504 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf94b4000c489abc2c1652 2026-04-05 10:21:50,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:21:50,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf94b4000c489abc2c1652 HTTP/1.1" 200 None 2026-04-05 10:21:50,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:21:50,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-05 10:21:50,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:21:50,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf94b4000c489abc2c1652 HTTP/1.1" 200 None 2026-04-05 10:21:50,571 - lava_callback - ERROR - Error processing callback for node 69cf94b4000c489abc2c1652: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34814 - "GET / HTTP/1.0" 200 OK 2026-04-05 10:23:00,832 - lava_callback - INFO - Received callback for node 69d237b10d94ee66016fcbf8 INFO: 172.21.0.1:57080 - "POST /node/69d237b10d94ee66016fcbf8 HTTP/1.0" 202 Accepted 2026-04-05 10:23:00,839 - lava_callback - INFO - Starting async job submit for node 69d237b10d94ee66016fcbf8 2026-04-05 10:23:00,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:23:00,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d237b10d94ee66016fcbf8 HTTP/1.1" 200 None 2026-04-05 10:23:00,892 - lava_callback - DEBUG - Processing node 69d237b10d94ee66016fcbf8: baseline-arm64 2026-04-05 10:23:01,116 - lava_callback - WARNING - Failed to upload log 2026-04-05 10:23:01,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 10:23:01,428 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 10:23:01,430 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d237b10d94ee66016fcbf8/lava-logs.yaml 2026-04-05 10:23:01,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 10:23:01,595 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 10:23:01,597 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d237b10d94ee66016fcbf8/lava_callback.json.gz 2026-04-05 10:23:01,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:23:01,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d237b10d94ee66016fcbf8 HTTP/1.1" 200 None 2026-04-05 10:23:01,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:23:01,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 10:23:01,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:23:01,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d237b10d94ee66016fcbf8 HTTP/1.1" 200 None 2026-04-05 10:23:01,768 - lava_callback - INFO - Completed processing callback for node 69d237b10d94ee66016fcbf8 INFO: 172.21.0.1:57092 - "GET / HTTP/1.0" 200 OK 2026-04-05 10:23:06,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:23:06,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-05 10:23:10,546 - lava_callback - INFO - Received callback for node 69cf94fa000c489abc2c1688 INFO: 172.21.0.1:55068 - "POST /node/69cf94fa000c489abc2c1688 HTTP/1.0" 202 Accepted 2026-04-05 10:23:10,552 - lava_callback - INFO - Starting async job submit for node 69cf94fa000c489abc2c1688 2026-04-05 10:23:10,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:23:10,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf94fa000c489abc2c1688 HTTP/1.1" 200 None 2026-04-05 10:23:10,578 - lava_callback - DEBUG - Processing node 69cf94fa000c489abc2c1688: baseline-arm64-clabbe 2026-04-05 10:23:10,578 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf94fa000c489abc2c1688 2026-04-05 10:23:10,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:23:10,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf94fa000c489abc2c1688 HTTP/1.1" 200 None 2026-04-05 10:23:10,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:23:10,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-05 10:23:10,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:23:10,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf94fa000c489abc2c1688 HTTP/1.1" 200 None 2026-04-05 10:23:10,649 - lava_callback - ERROR - Error processing callback for node 69cf94fa000c489abc2c1688: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55078 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46516 - "GET / HTTP/1.0" 200 OK 2026-04-05 10:28:22,857 - lava_callback - INFO - Received callback for node 69d236e80d94ee66016fcb45 INFO: 172.21.0.1:55588 - "POST /node/69d236e80d94ee66016fcb45 HTTP/1.0" 202 Accepted 2026-04-05 10:28:22,863 - lava_callback - INFO - Starting async job submit for node 69d236e80d94ee66016fcb45 2026-04-05 10:28:22,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:28:22,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d236e80d94ee66016fcb45 HTTP/1.1" 200 None 2026-04-05 10:28:22,905 - lava_callback - DEBUG - Processing node 69d236e80d94ee66016fcb45: baseline-arm64 2026-04-05 10:28:23,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 10:28:23,560 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 10:28:23,561 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d236e80d94ee66016fcb45/log.txt.gz 2026-04-05 10:28:23,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 10:28:24,055 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 10:28:24,058 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d236e80d94ee66016fcb45/lava-logs.yaml 2026-04-05 10:28:24,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 10:28:24,259 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 10:28:24,261 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d236e80d94ee66016fcb45/lava_callback.json.gz 2026-04-05 10:28:24,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:28:24,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d236e80d94ee66016fcb45 HTTP/1.1" 200 None 2026-04-05 10:28:24,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:28:24,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 10:28:24,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:28:24,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d236e80d94ee66016fcb45 HTTP/1.1" 200 None 2026-04-05 10:28:24,422 - lava_callback - INFO - Completed processing callback for node 69d236e80d94ee66016fcb45 INFO: 172.21.0.1:55594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48170 - "GET / HTTP/1.0" 200 OK 2026-04-05 10:28:36,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:28:36,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56666 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51284 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33140 - "GET / HTTP/1.0" 200 OK 2026-04-05 10:31:39,160 - lava_callback - INFO - Received callback for node 69d237790d94ee66016fcbc2 INFO: 172.21.0.1:33154 - "POST /node/69d237790d94ee66016fcbc2 HTTP/1.0" 202 Accepted 2026-04-05 10:31:39,166 - lava_callback - INFO - Starting async job submit for node 69d237790d94ee66016fcbc2 2026-04-05 10:31:39,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:31:39,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d237790d94ee66016fcbc2 HTTP/1.1" 200 None 2026-04-05 10:31:39,214 - lava_callback - DEBUG - Processing node 69d237790d94ee66016fcbc2: baseline-nfs-arm64 2026-04-05 10:31:39,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 10:31:39,967 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 10:31:39,969 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d237790d94ee66016fcbc2/log.txt.gz 2026-04-05 10:31:40,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 10:31:40,537 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 10:31:40,539 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d237790d94ee66016fcbc2/lava-logs.yaml 2026-04-05 10:31:40,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 10:31:40,756 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 10:31:40,758 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d237790d94ee66016fcbc2/lava_callback.json.gz 2026-04-05 10:31:40,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:31:40,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d237790d94ee66016fcbc2 HTTP/1.1" 200 None 2026-04-05 10:31:40,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:31:40,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 10:31:40,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:31:40,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d237790d94ee66016fcbc2 HTTP/1.1" 200 None 2026-04-05 10:31:40,929 - lava_callback - INFO - Completed processing callback for node 69d237790d94ee66016fcbc2 INFO: 172.21.0.1:54274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37318 - "GET / HTTP/1.0" 200 OK 2026-04-05 10:32:07,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:32:07,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58400 - "GET / HTTP/1.0" 200 OK 2026-04-05 10:37:39,051 - lava_callback - INFO - Received callback for node 69d239b70d94ee66016fcd91 INFO: 172.21.0.1:58414 - "POST /node/69d239b70d94ee66016fcd91 HTTP/1.0" 202 Accepted 2026-04-05 10:37:39,059 - lava_callback - INFO - Starting async job submit for node 69d239b70d94ee66016fcd91 2026-04-05 10:37:39,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:37:39,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d239b70d94ee66016fcd91 HTTP/1.1" 200 None 2026-04-05 10:37:39,142 - lava_callback - DEBUG - Processing node 69d239b70d94ee66016fcd91: baseline-arm64 2026-04-05 10:37:39,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 10:37:39,723 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 10:37:39,725 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d239b70d94ee66016fcd91/log.txt.gz 2026-04-05 10:37:39,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 10:37:40,162 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 10:37:40,164 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d239b70d94ee66016fcd91/lava-logs.yaml 2026-04-05 10:37:40,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 10:37:40,333 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 10:37:40,335 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d239b70d94ee66016fcd91/lava_callback.json.gz DEBUG: Setup failed for 69d239b70d94ee66016fcd91. Transitting job node result: incomplete -> fail 2026-04-05 10:37:40,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:37:40,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d239b70d94ee66016fcd91 HTTP/1.1" 200 None 2026-04-05 10:37:40,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:37:40,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 10:37:40,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:37:40,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d239b70d94ee66016fcd91 HTTP/1.1" 200 None 2026-04-05 10:37:40,539 - lava_callback - INFO - Completed processing callback for node 69d239b70d94ee66016fcd91 INFO: 172.21.0.1:33598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43970 - "GET / HTTP/1.0" 200 OK 2026-04-05 10:38:07,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:38:07,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37684 - "GET / HTTP/1.0" 200 OK 2026-04-05 10:41:55,557 - lava_callback - INFO - Received callback for node 69d2383e0d94ee66016fcc5c INFO: 172.21.0.1:43426 - "POST /node/69d2383e0d94ee66016fcc5c HTTP/1.0" 202 Accepted 2026-04-05 10:41:55,564 - lava_callback - INFO - Starting async job submit for node 69d2383e0d94ee66016fcc5c 2026-04-05 10:41:55,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:41:55,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2383e0d94ee66016fcc5c HTTP/1.1" 200 None 2026-04-05 10:41:55,647 - lava_callback - DEBUG - Processing node 69d2383e0d94ee66016fcc5c: baseline-arm 2026-04-05 10:41:56,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:43434 - "GET / HTTP/1.0" 200 OK 2026-04-05 10:41:56,510 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 10:41:56,512 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d2383e0d94ee66016fcc5c/log.txt.gz 2026-04-05 10:41:56,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 10:41:57,125 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 10:41:57,127 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d2383e0d94ee66016fcc5c/lava-logs.yaml 2026-04-05 10:41:57,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 10:41:57,318 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 10:41:57,320 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d2383e0d94ee66016fcc5c/lava_callback.json.gz DEBUG: Setup failed for 69d2383e0d94ee66016fcc5c. Transitting job node result: incomplete -> fail 2026-04-05 10:41:57,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:41:57,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2383e0d94ee66016fcc5c HTTP/1.1" 200 None 2026-04-05 10:41:57,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:41:57,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-05 10:41:57,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:41:57,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2383e0d94ee66016fcc5c HTTP/1.1" 200 None 2026-04-05 10:41:57,605 - lava_callback - INFO - Completed processing callback for node 69d2383e0d94ee66016fcc5c INFO: 172.21.0.1:47450 - "GET / HTTP/1.0" 200 OK 2026-04-05 10:42:07,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:42:07,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-05 10:42:07,953 - lava_callback - INFO - Received callback for node 69d239f60d94ee66016fcdd5 INFO: 172.21.0.1:47458 - "POST /node/69d239f60d94ee66016fcdd5 HTTP/1.0" 202 Accepted 2026-04-05 10:42:07,960 - lava_callback - INFO - Starting async job submit for node 69d239f60d94ee66016fcdd5 2026-04-05 10:42:07,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:42:07,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d239f60d94ee66016fcdd5 HTTP/1.1" 200 None 2026-04-05 10:42:07,999 - lava_callback - DEBUG - Processing node 69d239f60d94ee66016fcdd5: baseline-arm64 2026-04-05 10:42:08,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 10:42:08,664 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 10:42:08,667 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d239f60d94ee66016fcdd5/log.txt.gz 2026-04-05 10:42:08,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 10:42:09,203 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 10:42:09,205 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d239f60d94ee66016fcdd5/lava-logs.yaml 2026-04-05 10:42:09,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 10:42:09,416 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 10:42:09,418 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d239f60d94ee66016fcdd5/lava_callback.json.gz 2026-04-05 10:42:09,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:42:09,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d239f60d94ee66016fcdd5 HTTP/1.1" 200 None 2026-04-05 10:42:09,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:42:09,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 10:42:09,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:42:09,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d239f60d94ee66016fcdd5 HTTP/1.1" 200 None 2026-04-05 10:42:09,587 - lava_callback - INFO - Completed processing callback for node 69d239f60d94ee66016fcdd5 INFO: 172.21.0.1:35576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51682 - "GET / HTTP/1.0" 200 OK 2026-04-05 10:42:34,504 - lava_callback - INFO - Received callback for node 69d23a3b0d94ee66016fce54 INFO: 172.21.0.1:35886 - "POST /node/69d23a3b0d94ee66016fce54 HTTP/1.0" 202 Accepted 2026-04-05 10:42:34,510 - lava_callback - INFO - Starting async job submit for node 69d23a3b0d94ee66016fce54 2026-04-05 10:42:34,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:42:34,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d23a3b0d94ee66016fce54 HTTP/1.1" 200 None 2026-04-05 10:42:34,571 - lava_callback - DEBUG - Processing node 69d23a3b0d94ee66016fce54: baseline-nfs-arm64 2026-04-05 10:42:35,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 10:42:35,360 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 10:42:35,362 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d23a3b0d94ee66016fce54/log.txt.gz 2026-04-05 10:42:35,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 10:42:35,848 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 10:42:35,850 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d23a3b0d94ee66016fce54/lava-logs.yaml 2026-04-05 10:42:35,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 10:42:36,055 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 10:42:36,057 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d23a3b0d94ee66016fce54/lava_callback.json.gz 2026-04-05 10:42:36,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:42:36,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d23a3b0d94ee66016fce54 HTTP/1.1" 200 None 2026-04-05 10:42:36,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:42:36,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 10:42:36,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:42:36,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d23a3b0d94ee66016fce54 HTTP/1.1" 200 None 2026-04-05 10:42:36,218 - lava_callback - INFO - Completed processing callback for node 69d23a3b0d94ee66016fce54 INFO: 172.21.0.1:35888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35892 - "GET / HTTP/1.0" 200 OK 2026-04-05 10:42:37,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:42:37,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34710 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56320 - "GET / HTTP/1.0" 200 OK 2026-04-05 10:47:44,440 - lava_callback - INFO - Received callback for node 69d239af0d94ee66016fcd8e INFO: 172.21.0.1:34888 - "POST /node/69d239af0d94ee66016fcd8e HTTP/1.0" 202 Accepted 2026-04-05 10:47:44,447 - lava_callback - INFO - Starting async job submit for node 69d239af0d94ee66016fcd8e 2026-04-05 10:47:44,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:47:44,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d239af0d94ee66016fcd8e HTTP/1.1" 200 None 2026-04-05 10:47:44,550 - lava_callback - DEBUG - Processing node 69d239af0d94ee66016fcd8e: ltp-smoke 2026-04-05 10:47:45,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 10:47:45,180 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 10:47:45,182 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69d239af0d94ee66016fcd8e/log.txt.gz 2026-04-05 10:47:45,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 10:47:45,685 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 10:47:45,687 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69d239af0d94ee66016fcd8e/lava-logs.yaml 2026-04-05 10:47:45,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 10:47:45,861 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 10:47:45,863 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69d239af0d94ee66016fcd8e/lava_callback.json.gz 2026-04-05 10:47:45,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:47:46,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d239af0d94ee66016fcd8e HTTP/1.1" 200 None 2026-04-05 10:47:46,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:47:46,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9f0d94ee66016fb135 HTTP/1.1" 200 None 2026-04-05 10:47:46,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:47:46,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d239af0d94ee66016fcd8e HTTP/1.1" 200 None 2026-04-05 10:47:46,205 - lava_callback - INFO - Completed processing callback for node 69d239af0d94ee66016fcd8e INFO: 172.21.0.1:34898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51166 - "GET / HTTP/1.0" 200 OK 2026-04-05 10:48:07,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:48:07,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33320 - "GET / HTTP/1.0" 200 OK 2026-04-05 10:49:12,368 - lava_callback - INFO - Received callback for node 69d2397a0d94ee66016fcd4a INFO: 172.21.0.1:54938 - "POST /node/69d2397a0d94ee66016fcd4a HTTP/1.0" 202 Accepted 2026-04-05 10:49:12,376 - lava_callback - INFO - Starting async job submit for node 69d2397a0d94ee66016fcd4a 2026-04-05 10:49:12,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:49:12,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2397a0d94ee66016fcd4a HTTP/1.1" 200 None 2026-04-05 10:49:12,471 - lava_callback - DEBUG - Processing node 69d2397a0d94ee66016fcd4a: baseline-nfs-arm64 2026-04-05 10:49:13,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 10:49:13,800 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 10:49:13,802 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d2397a0d94ee66016fcd4a/log.txt.gz 2026-04-05 10:49:14,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 10:49:14,663 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 10:49:14,665 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d2397a0d94ee66016fcd4a/lava-logs.yaml 2026-04-05 10:49:14,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 10:49:14,871 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 10:49:14,873 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d2397a0d94ee66016fcd4a/lava_callback.json.gz DEBUG: Setup failed for 69d2397a0d94ee66016fcd4a. Transitting job node result: incomplete -> fail 2026-04-05 10:49:14,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:49:15,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d2397a0d94ee66016fcd4a HTTP/1.1" 200 None 2026-04-05 10:49:15,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:49:15,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 10:49:15,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:49:15,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d2397a0d94ee66016fcd4a HTTP/1.1" 200 None INFO: 172.21.0.1:54940 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-05 10:49:15,190 - lava_callback - INFO - Completed processing callback for node 69d2397a0d94ee66016fcd4a INFO: 172.21.0.1:54950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57304 - "GET / HTTP/1.0" 200 OK 2026-04-05 10:49:37,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:49:37,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33320 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53472 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57468 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57138 - "GET / HTTP/1.0" 200 OK 2026-04-05 10:59:53,840 - lava_callback - INFO - Received callback for node 69d23c760d94ee66016fce82 INFO: 172.21.0.1:33114 - "POST /node/69d23c760d94ee66016fce82 HTTP/1.0" 202 Accepted 2026-04-05 10:59:53,847 - lava_callback - INFO - Starting async job submit for node 69d23c760d94ee66016fce82 2026-04-05 10:59:53,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:59:53,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d23c760d94ee66016fce82 HTTP/1.1" 200 None 2026-04-05 10:59:53,918 - lava_callback - DEBUG - Processing node 69d23c760d94ee66016fce82: baseline-arm 2026-04-05 10:59:54,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 10:59:54,671 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 10:59:54,674 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d23c760d94ee66016fce82/log.txt.gz 2026-04-05 10:59:55,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 10:59:55,371 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 10:59:55,374 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d23c760d94ee66016fce82/lava-logs.yaml 2026-04-05 10:59:55,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 10:59:55,552 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 10:59:55,554 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d23c760d94ee66016fce82/lava_callback.json.gz DEBUG: Setup failed for 69d23c760d94ee66016fce82. Transitting job node result: incomplete -> fail 2026-04-05 10:59:55,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:59:55,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d23c760d94ee66016fce82 HTTP/1.1" 200 None 2026-04-05 10:59:55,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:59:55,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21a9b0d94ee66016fb12f HTTP/1.1" 200 None 2026-04-05 10:59:55,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 10:59:55,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d23c760d94ee66016fce82 HTTP/1.1" 200 None 2026-04-05 10:59:55,870 - lava_callback - INFO - Completed processing callback for node 69d23c760d94ee66016fce82 INFO: 172.21.0.1:33120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49090 - "GET / HTTP/1.0" 200 OK 2026-04-05 11:00:07,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 11:00:07,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46182 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59456 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39010 - "GET / HTTP/1.0" 200 OK 2026-04-05 11:09:12,180 - lava_callback - INFO - Received callback for node 69d23e330d94ee66016fcead INFO: 172.21.0.1:57184 - "POST /node/69d23e330d94ee66016fcead HTTP/1.0" 202 Accepted 2026-04-05 11:09:12,188 - lava_callback - INFO - Starting async job submit for node 69d23e330d94ee66016fcead 2026-04-05 11:09:12,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 11:09:12,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d23e330d94ee66016fcead HTTP/1.1" 200 None 2026-04-05 11:09:12,250 - lava_callback - DEBUG - Processing node 69d23e330d94ee66016fcead: baseline-nfs-arm64 2026-04-05 11:09:13,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 11:09:13,493 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 11:09:13,496 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d23e330d94ee66016fcead/log.txt.gz 2026-04-05 11:09:14,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 11:09:14,347 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 11:09:14,350 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d23e330d94ee66016fcead/lava-logs.yaml 2026-04-05 11:09:14,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 11:09:14,552 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 11:09:14,554 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d23e330d94ee66016fcead/lava_callback.json.gz DEBUG: Setup failed for 69d23e330d94ee66016fcead. Transitting job node result: incomplete -> fail 2026-04-05 11:09:14,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 11:09:14,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d23e330d94ee66016fcead HTTP/1.1" 200 None 2026-04-05 11:09:14,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 11:09:14,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21aa70d94ee66016fb140 HTTP/1.1" 200 None 2026-04-05 11:09:14,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 11:09:14,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d23e330d94ee66016fcead HTTP/1.1" 200 None 2026-04-05 11:09:14,819 - lava_callback - INFO - Completed processing callback for node 69d23e330d94ee66016fcead INFO: 172.21.0.1:57186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40372 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:40382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40396 - "GET / HTTP/1.0" 200 OK 2026-04-05 11:09:37,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 11:09:37,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40404 - "GET /robots.txt HTTP/1.0" 404 Not Found INFO: 172.21.0.1:48954 - "GET /sitemap.xml HTTP/1.0" 404 Not Found INFO: 172.21.0.1:48964 - "GET /config.json HTTP/1.0" 404 Not Found INFO: 172.21.0.1:48970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34540 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53120 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52642 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47558 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35114 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49660 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:49676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56736 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59418 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39810 - "GET / HTTP/1.0" 200 OK 2026-04-05 11:44:50,467 - lava_callback - INFO - Received callback for node 69d21f290d94ee66016fb404 INFO: 172.21.0.1:52684 - "POST /node/69d21f290d94ee66016fb404 HTTP/1.0" 202 Accepted 2026-04-05 11:44:50,473 - lava_callback - INFO - Starting async job submit for node 69d21f290d94ee66016fb404 2026-04-05 11:44:50,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 11:44:50,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f290d94ee66016fb404 HTTP/1.1" 200 None 2026-04-05 11:44:50,506 - lava_callback - DEBUG - Processing node 69d21f290d94ee66016fb404: baseline-x86 2026-04-05 11:44:50,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 11:44:51,020 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 11:44:51,022 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69d21f290d94ee66016fb404/log.txt.gz 2026-04-05 11:44:51,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 11:44:51,422 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 11:44:51,424 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69d21f290d94ee66016fb404/lava-logs.yaml 2026-04-05 11:44:51,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 11:44:51,720 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 11:44:51,721 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69d21f290d94ee66016fb404/lava_callback.json.gz 2026-04-05 11:44:51,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 11:44:51,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21f290d94ee66016fb404 HTTP/1.1" 200 None 2026-04-05 11:44:51,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 11:44:51,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d21ab90d94ee66016fb15b HTTP/1.1" 200 None 2026-04-05 11:44:51,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 11:44:51,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d21f290d94ee66016fb404 HTTP/1.1" 200 None 2026-04-05 11:44:51,809 - lava_callback - INFO - Completed processing callback for node 69d21f290d94ee66016fb404 INFO: 172.21.0.1:52698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58824 - "GET / HTTP/1.0" 200 OK 2026-04-05 11:45:07,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 11:45:07,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34162 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38268 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38220 - "GET /node/69936029cebe99dd8e063126%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:38226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58906 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60860 - "GET /node/6990218676d4b6342e9df479%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:60864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52710 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55516 - "GET /node/69884cabe408e9ea60fad505%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:55528 - "GET /node/693b02befee8383e92b6f198%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:47200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35026 - "GET /node/694bd565c19e09af58d48c8b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:35030 - "GET /node/69881fc6e31b58f834f1ebfa%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:41480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35240 - "GET /node/69b1ab02a26b422765ba3c7e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:35244 - "GET /node/69402c3e575bc060ce155780%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:35252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58680 - "GET /node/698a0f8422b4cc0f227ad937%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:58690 - "GET /node/6941190e459ff5fc64d29fa2%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:45492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41992 - "GET /node/69938458cebe99dd8e06fa6b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:42004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57524 - "GET /node/69a62d367da105ad09835a86%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:57534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36448 - "GET /node/693b148afee8383e92b74419%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:50630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60742 - "GET /node/6989376d85773790cd34cc91%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:45986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41968 - "GET /node/693b0e38fee8383e92b72552%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:41974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56776 - "GET /node/693f348424745582e399d7ea%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:56788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35326 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44410 - "GET /node/698b6fb00a16aea5a0dc7dfd%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:44412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48448 - "GET /node/6983ed37969566dcb0d29a73%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:48450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59220 - "GET /node/693771f70c55536e7dddab75%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:36030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42090 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59406 - "GET /node/699e98c6d2d5ed2e75fdd34f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:59420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45920 - "GET /node/693b7c4841fb4c95097633f3%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:45928 - "GET /node/69863493177ca0f097bd2a37%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:45932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50560 - "GET /node/693b3e634b47c3f87266e407%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:50566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47120 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50348 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55284 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45392 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44498 - "GET /node/693ae38bfee8383e92b6417b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:44510 - "GET /node/694aeb7a6c96ed51d3171656%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:43870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48284 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44938 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59124 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35928 - "GET / HTTP/1.0" 200 OK 2026-04-05 12:39:49,070 - lava_callback - INFO - Received callback for node 69cfb50e000c489abc2c196d INFO: 172.21.0.1:35938 - "POST /node/69cfb50e000c489abc2c196d HTTP/1.0" 202 Accepted 2026-04-05 12:39:49,076 - lava_callback - INFO - Starting async job submit for node 69cfb50e000c489abc2c196d 2026-04-05 12:39:49,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:39:49,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfb50e000c489abc2c196d HTTP/1.1" 200 None 2026-04-05 12:39:49,092 - lava_callback - DEBUG - Processing node 69cfb50e000c489abc2c196d: baseline-arm-baylibre 2026-04-05 12:39:49,093 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfb50e000c489abc2c196d 2026-04-05 12:39:49,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:39:49,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfb50e000c489abc2c196d HTTP/1.1" 200 None 2026-04-05 12:39:49,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:39:49,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-05 12:39:49,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:39:49,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfb50e000c489abc2c196d HTTP/1.1" 200 None 2026-04-05 12:39:49,169 - lava_callback - ERROR - Error processing callback for node 69cfb50e000c489abc2c196d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48332 - "GET / HTTP/1.0" 200 OK 2026-04-05 12:40:29,020 - lava_callback - INFO - Received callback for node 69cfb533000c489abc2c197a INFO: 172.21.0.1:48340 - "POST /node/69cfb533000c489abc2c197a HTTP/1.0" 202 Accepted 2026-04-05 12:40:29,025 - lava_callback - INFO - Starting async job submit for node 69cfb533000c489abc2c197a 2026-04-05 12:40:29,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:40:29,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfb533000c489abc2c197a HTTP/1.1" 200 None 2026-04-05 12:40:29,042 - lava_callback - DEBUG - Processing node 69cfb533000c489abc2c197a: baseline-arm-baylibre 2026-04-05 12:40:29,042 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfb533000c489abc2c197a 2026-04-05 12:40:29,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:40:29,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfb533000c489abc2c197a HTTP/1.1" 200 None 2026-04-05 12:40:29,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:40:29,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-05 12:40:29,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:40:29,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfb533000c489abc2c197a HTTP/1.1" 200 None 2026-04-05 12:40:29,108 - lava_callback - ERROR - Error processing callback for node 69cfb533000c489abc2c197a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32912 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37436 - "GET / HTTP/1.0" 200 OK 2026-04-05 12:42:08,726 - lava_callback - INFO - Received callback for node 69cfb597000c489abc2c19e4 INFO: 172.21.0.1:37450 - "POST /node/69cfb597000c489abc2c19e4 HTTP/1.0" 202 Accepted 2026-04-05 12:42:08,731 - lava_callback - INFO - Starting async job submit for node 69cfb597000c489abc2c19e4 2026-04-05 12:42:08,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:42:08,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfb597000c489abc2c19e4 HTTP/1.1" 200 None 2026-04-05 12:42:08,747 - lava_callback - DEBUG - Processing node 69cfb597000c489abc2c19e4: baseline-arm-clabbe 2026-04-05 12:42:08,747 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfb597000c489abc2c19e4 2026-04-05 12:42:08,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:42:08,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfb597000c489abc2c19e4 HTTP/1.1" 200 None 2026-04-05 12:42:08,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:42:08,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-05 12:42:08,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:42:08,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfb597000c489abc2c19e4 HTTP/1.1" 200 None 2026-04-05 12:42:08,800 - lava_callback - ERROR - Error processing callback for node 69cfb597000c489abc2c19e4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58878 - "GET / HTTP/1.0" 200 OK 2026-04-05 12:43:07,651 - lava_callback - INFO - Received callback for node 69cfb5d8000c489abc2c1a2b INFO: 172.21.0.1:58882 - "POST /node/69cfb5d8000c489abc2c1a2b HTTP/1.0" 202 Accepted 2026-04-05 12:43:07,657 - lava_callback - INFO - Starting async job submit for node 69cfb5d8000c489abc2c1a2b 2026-04-05 12:43:07,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:43:07,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfb5d8000c489abc2c1a2b HTTP/1.1" 200 None 2026-04-05 12:43:07,673 - lava_callback - DEBUG - Processing node 69cfb5d8000c489abc2c1a2b: baseline-arm-clabbe 2026-04-05 12:43:07,673 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfb5d8000c489abc2c1a2b 2026-04-05 12:43:07,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:43:07,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfb5d8000c489abc2c1a2b HTTP/1.1" 200 None 2026-04-05 12:43:07,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:43:07,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-05 12:43:07,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:43:07,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfb5d8000c489abc2c1a2b HTTP/1.1" 200 None 2026-04-05 12:43:07,759 - lava_callback - ERROR - Error processing callback for node 69cfb5d8000c489abc2c1a2b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34602 - "GET / HTTP/1.0" 200 OK 2026-04-05 12:43:47,644 - lava_callback - INFO - Received callback for node 69cfb5fb000c489abc2c1a49 INFO: 172.21.0.1:34614 - "POST /node/69cfb5fb000c489abc2c1a49 HTTP/1.0" 202 Accepted 2026-04-05 12:43:47,650 - lava_callback - INFO - Starting async job submit for node 69cfb5fb000c489abc2c1a49 2026-04-05 12:43:47,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:43:47,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfb5fb000c489abc2c1a49 HTTP/1.1" 200 None 2026-04-05 12:43:47,666 - lava_callback - DEBUG - Processing node 69cfb5fb000c489abc2c1a49: baseline-arm-clabbe 2026-04-05 12:43:47,666 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfb5fb000c489abc2c1a49 2026-04-05 12:43:47,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:43:47,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfb5fb000c489abc2c1a49 HTTP/1.1" 200 None 2026-04-05 12:43:47,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:43:47,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-05 12:43:47,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:43:47,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfb5fb000c489abc2c1a49 HTTP/1.1" 200 None 2026-04-05 12:43:47,737 - lava_callback - ERROR - Error processing callback for node 69cfb5fb000c489abc2c1a49: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42884 - "GET / HTTP/1.0" 200 OK 2026-04-05 12:44:27,701 - lava_callback - INFO - Received callback for node 69cfb61e000c489abc2c1a61 INFO: 172.21.0.1:42892 - "POST /node/69cfb61e000c489abc2c1a61 HTTP/1.0" 202 Accepted 2026-04-05 12:44:27,707 - lava_callback - INFO - Starting async job submit for node 69cfb61e000c489abc2c1a61 2026-04-05 12:44:27,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:44:27,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfb61e000c489abc2c1a61 HTTP/1.1" 200 None 2026-04-05 12:44:27,726 - lava_callback - DEBUG - Processing node 69cfb61e000c489abc2c1a61: baseline-arm-clabbe 2026-04-05 12:44:27,726 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfb61e000c489abc2c1a61 2026-04-05 12:44:27,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:44:27,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfb61e000c489abc2c1a61 HTTP/1.1" 200 None 2026-04-05 12:44:27,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:44:27,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-05 12:44:27,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:44:27,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfb61e000c489abc2c1a61 HTTP/1.1" 200 None 2026-04-05 12:44:27,796 - lava_callback - ERROR - Error processing callback for node 69cfb61e000c489abc2c1a61: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38852 - "GET / HTTP/1.0" 200 OK 2026-04-05 12:45:07,672 - lava_callback - INFO - Received callback for node 69cfb643000c489abc2c1a8b INFO: 172.21.0.1:38858 - "POST /node/69cfb643000c489abc2c1a8b HTTP/1.0" 202 Accepted 2026-04-05 12:45:07,678 - lava_callback - INFO - Starting async job submit for node 69cfb643000c489abc2c1a8b 2026-04-05 12:45:07,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:45:07,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfb643000c489abc2c1a8b HTTP/1.1" 200 None 2026-04-05 12:45:07,700 - lava_callback - DEBUG - Processing node 69cfb643000c489abc2c1a8b: baseline-arm-clabbe 2026-04-05 12:45:07,700 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfb643000c489abc2c1a8b 2026-04-05 12:45:07,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:45:07,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfb643000c489abc2c1a8b HTTP/1.1" 200 None 2026-04-05 12:45:07,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:45:07,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-05 12:45:07,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:45:07,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfb643000c489abc2c1a8b HTTP/1.1" 200 None 2026-04-05 12:45:07,763 - lava_callback - ERROR - Error processing callback for node 69cfb643000c489abc2c1a8b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33622 - "GET / HTTP/1.0" 200 OK 2026-04-05 12:45:47,751 - lava_callback - INFO - Received callback for node 69cfb667000c489abc2c1a9b INFO: 172.21.0.1:33632 - "POST /node/69cfb667000c489abc2c1a9b HTTP/1.0" 202 Accepted 2026-04-05 12:45:47,757 - lava_callback - INFO - Starting async job submit for node 69cfb667000c489abc2c1a9b 2026-04-05 12:45:47,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:45:47,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfb667000c489abc2c1a9b HTTP/1.1" 200 None 2026-04-05 12:45:47,795 - lava_callback - DEBUG - Processing node 69cfb667000c489abc2c1a9b: baseline-arm-clabbe 2026-04-05 12:45:47,795 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfb667000c489abc2c1a9b 2026-04-05 12:45:47,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:45:47,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfb667000c489abc2c1a9b HTTP/1.1" 200 None 2026-04-05 12:45:47,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:45:47,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-05 12:45:47,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:45:47,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfb667000c489abc2c1a9b HTTP/1.1" 200 None 2026-04-05 12:45:47,847 - lava_callback - ERROR - Error processing callback for node 69cfb667000c489abc2c1a9b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58450 - "GET / HTTP/1.0" 200 OK 2026-04-05 12:46:07,701 - lava_callback - INFO - Received callback for node 69cfb688000c489abc2c1ac5 INFO: 172.21.0.1:58454 - "POST /node/69cfb688000c489abc2c1ac5 HTTP/1.0" 202 Accepted 2026-04-05 12:46:07,707 - lava_callback - INFO - Starting async job submit for node 69cfb688000c489abc2c1ac5 2026-04-05 12:46:07,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:46:07,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfb688000c489abc2c1ac5 HTTP/1.1" 200 None 2026-04-05 12:46:07,724 - lava_callback - DEBUG - Processing node 69cfb688000c489abc2c1ac5: baseline-arm-clabbe 2026-04-05 12:46:07,725 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfb688000c489abc2c1ac5 2026-04-05 12:46:07,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:46:07,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfb688000c489abc2c1ac5 HTTP/1.1" 200 None 2026-04-05 12:46:07,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:46:07,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-05 12:46:07,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:46:07,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfb688000c489abc2c1ac5 HTTP/1.1" 200 None 2026-04-05 12:46:07,812 - lava_callback - ERROR - Error processing callback for node 69cfb688000c489abc2c1ac5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35462 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53102 - "GET / HTTP/1.0" 200 OK 2026-04-05 12:46:47,772 - lava_callback - INFO - Received callback for node 69cfb6a9000c489abc2c1af2 INFO: 172.21.0.1:53112 - "POST /node/69cfb6a9000c489abc2c1af2 HTTP/1.0" 202 Accepted 2026-04-05 12:46:47,777 - lava_callback - INFO - Starting async job submit for node 69cfb6a9000c489abc2c1af2 2026-04-05 12:46:47,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:46:47,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfb6a9000c489abc2c1af2 HTTP/1.1" 200 None 2026-04-05 12:46:47,793 - lava_callback - DEBUG - Processing node 69cfb6a9000c489abc2c1af2: baseline-arm-clabbe 2026-04-05 12:46:47,793 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfb6a9000c489abc2c1af2 2026-04-05 12:46:47,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:46:47,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfb6a9000c489abc2c1af2 HTTP/1.1" 200 None 2026-04-05 12:46:47,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:46:47,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-05 12:46:47,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:46:47,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfb6a9000c489abc2c1af2 HTTP/1.1" 200 None 2026-04-05 12:46:47,856 - lava_callback - ERROR - Error processing callback for node 69cfb6a9000c489abc2c1af2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59044 - "GET / HTTP/1.0" 200 OK 2026-04-05 12:47:27,756 - lava_callback - INFO - Received callback for node 69cfb6cb000c489abc2c1b0b INFO: 172.21.0.1:59054 - "POST /node/69cfb6cb000c489abc2c1b0b HTTP/1.0" 202 Accepted 2026-04-05 12:47:27,762 - lava_callback - INFO - Starting async job submit for node 69cfb6cb000c489abc2c1b0b 2026-04-05 12:47:27,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:47:27,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfb6cb000c489abc2c1b0b HTTP/1.1" 200 None 2026-04-05 12:47:27,777 - lava_callback - DEBUG - Processing node 69cfb6cb000c489abc2c1b0b: baseline-arm-clabbe 2026-04-05 12:47:27,778 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfb6cb000c489abc2c1b0b 2026-04-05 12:47:27,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:47:27,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfb6cb000c489abc2c1b0b HTTP/1.1" 200 None 2026-04-05 12:47:27,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:47:27,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-05 12:47:27,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:47:27,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfb6cb000c489abc2c1b0b HTTP/1.1" 200 None 2026-04-05 12:47:27,833 - lava_callback - ERROR - Error processing callback for node 69cfb6cb000c489abc2c1b0b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52900 - "GET / HTTP/1.0" 200 OK 2026-04-05 12:47:47,820 - lava_callback - INFO - Received callback for node 69cfb6f0000c489abc2c1b31 INFO: 172.21.0.1:52912 - "POST /node/69cfb6f0000c489abc2c1b31 HTTP/1.0" 202 Accepted 2026-04-05 12:47:47,825 - lava_callback - INFO - Starting async job submit for node 69cfb6f0000c489abc2c1b31 2026-04-05 12:47:47,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:47:47,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfb6f0000c489abc2c1b31 HTTP/1.1" 200 None 2026-04-05 12:47:47,844 - lava_callback - DEBUG - Processing node 69cfb6f0000c489abc2c1b31: baseline-arm-clabbe 2026-04-05 12:47:47,844 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfb6f0000c489abc2c1b31 2026-04-05 12:47:47,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:47:47,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfb6f0000c489abc2c1b31 HTTP/1.1" 200 None 2026-04-05 12:47:47,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:47:47,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-05 12:47:47,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:47:47,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfb6f0000c489abc2c1b31 HTTP/1.1" 200 None 2026-04-05 12:47:47,911 - lava_callback - ERROR - Error processing callback for node 69cfb6f0000c489abc2c1b31: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58360 - "GET / HTTP/1.0" 200 OK 2026-04-05 12:48:27,790 - lava_callback - INFO - Received callback for node 69cfb712000c489abc2c1b3f INFO: 172.21.0.1:58372 - "POST /node/69cfb712000c489abc2c1b3f HTTP/1.0" 202 Accepted 2026-04-05 12:48:27,795 - lava_callback - INFO - Starting async job submit for node 69cfb712000c489abc2c1b3f 2026-04-05 12:48:27,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:48:27,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfb712000c489abc2c1b3f HTTP/1.1" 200 None 2026-04-05 12:48:27,811 - lava_callback - DEBUG - Processing node 69cfb712000c489abc2c1b3f: baseline-arm-clabbe 2026-04-05 12:48:27,811 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfb712000c489abc2c1b3f 2026-04-05 12:48:27,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:48:27,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfb712000c489abc2c1b3f HTTP/1.1" 200 None 2026-04-05 12:48:27,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:48:27,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-05 12:48:27,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:48:27,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfb712000c489abc2c1b3f HTTP/1.1" 200 None 2026-04-05 12:48:27,867 - lava_callback - ERROR - Error processing callback for node 69cfb712000c489abc2c1b3f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53592 - "GET / HTTP/1.0" 200 OK 2026-04-05 12:49:07,874 - lava_callback - INFO - Received callback for node 69cfb734000c489abc2c1b77 INFO: 172.21.0.1:53602 - "POST /node/69cfb734000c489abc2c1b77 HTTP/1.0" 202 Accepted 2026-04-05 12:49:07,880 - lava_callback - INFO - Starting async job submit for node 69cfb734000c489abc2c1b77 2026-04-05 12:49:07,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:49:07,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfb734000c489abc2c1b77 HTTP/1.1" 200 None 2026-04-05 12:49:07,896 - lava_callback - DEBUG - Processing node 69cfb734000c489abc2c1b77: baseline-arm-clabbe 2026-04-05 12:49:07,897 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfb734000c489abc2c1b77 2026-04-05 12:49:07,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:49:07,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfb734000c489abc2c1b77 HTTP/1.1" 200 None 2026-04-05 12:49:07,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:49:07,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-05 12:49:07,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:49:07,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfb734000c489abc2c1b77 HTTP/1.1" 200 None 2026-04-05 12:49:07,948 - lava_callback - ERROR - Error processing callback for node 69cfb734000c489abc2c1b77: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36664 - "GET / HTTP/1.0" 200 OK 2026-04-05 12:49:47,914 - lava_callback - INFO - Received callback for node 69cfb757000c489abc2c1b94 INFO: 172.21.0.1:36674 - "POST /node/69cfb757000c489abc2c1b94 HTTP/1.0" 202 Accepted 2026-04-05 12:49:47,919 - lava_callback - INFO - Starting async job submit for node 69cfb757000c489abc2c1b94 2026-04-05 12:49:47,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:49:47,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfb757000c489abc2c1b94 HTTP/1.1" 200 None 2026-04-05 12:49:47,936 - lava_callback - DEBUG - Processing node 69cfb757000c489abc2c1b94: baseline-arm-clabbe 2026-04-05 12:49:47,936 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfb757000c489abc2c1b94 2026-04-05 12:49:47,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:49:47,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfb757000c489abc2c1b94 HTTP/1.1" 200 None 2026-04-05 12:49:47,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:49:47,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-05 12:49:47,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:49:48,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfb757000c489abc2c1b94 HTTP/1.1" 200 None 2026-04-05 12:49:48,005 - lava_callback - ERROR - Error processing callback for node 69cfb757000c489abc2c1b94: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42218 - "GET / HTTP/1.0" 200 OK 2026-04-05 12:50:07,902 - lava_callback - INFO - Received callback for node 69cfb77b000c489abc2c1bb9 INFO: 172.21.0.1:42232 - "POST /node/69cfb77b000c489abc2c1bb9 HTTP/1.0" 202 Accepted 2026-04-05 12:50:07,907 - lava_callback - INFO - Starting async job submit for node 69cfb77b000c489abc2c1bb9 2026-04-05 12:50:07,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:50:07,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfb77b000c489abc2c1bb9 HTTP/1.1" 200 None 2026-04-05 12:50:07,923 - lava_callback - DEBUG - Processing node 69cfb77b000c489abc2c1bb9: baseline-arm-clabbe 2026-04-05 12:50:07,923 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfb77b000c489abc2c1bb9 2026-04-05 12:50:07,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:50:07,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfb77b000c489abc2c1bb9 HTTP/1.1" 200 None 2026-04-05 12:50:07,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:50:07,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-05 12:50:07,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:50:08,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfb77b000c489abc2c1bb9 HTTP/1.1" 200 None 2026-04-05 12:50:08,009 - lava_callback - ERROR - Error processing callback for node 69cfb77b000c489abc2c1bb9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35610 - "GET / HTTP/1.0" 200 OK 2026-04-05 12:50:47,904 - lava_callback - INFO - Received callback for node 69cfb79d000c489abc2c1bce INFO: 172.21.0.1:35622 - "POST /node/69cfb79d000c489abc2c1bce HTTP/1.0" 202 Accepted 2026-04-05 12:50:47,912 - lava_callback - INFO - Starting async job submit for node 69cfb79d000c489abc2c1bce 2026-04-05 12:50:47,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:50:47,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfb79d000c489abc2c1bce HTTP/1.1" 200 None 2026-04-05 12:50:47,930 - lava_callback - DEBUG - Processing node 69cfb79d000c489abc2c1bce: baseline-arm-clabbe 2026-04-05 12:50:47,931 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfb79d000c489abc2c1bce 2026-04-05 12:50:47,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:50:47,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfb79d000c489abc2c1bce HTTP/1.1" 200 None 2026-04-05 12:50:47,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:50:47,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-05 12:50:47,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:50:47,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfb79d000c489abc2c1bce HTTP/1.1" 200 None 2026-04-05 12:50:47,988 - lava_callback - ERROR - Error processing callback for node 69cfb79d000c489abc2c1bce: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35698 - "GET / HTTP/1.0" 200 OK 2026-04-05 12:51:28,014 - lava_callback - INFO - Received callback for node 69cfb7c1000c489abc2c1bef INFO: 172.21.0.1:35702 - "POST /node/69cfb7c1000c489abc2c1bef HTTP/1.0" 202 Accepted 2026-04-05 12:51:28,020 - lava_callback - INFO - Starting async job submit for node 69cfb7c1000c489abc2c1bef 2026-04-05 12:51:28,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:51:28,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfb7c1000c489abc2c1bef HTTP/1.1" 200 None 2026-04-05 12:51:28,036 - lava_callback - DEBUG - Processing node 69cfb7c1000c489abc2c1bef: baseline-arm-clabbe 2026-04-05 12:51:28,036 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfb7c1000c489abc2c1bef 2026-04-05 12:51:28,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:51:28,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfb7c1000c489abc2c1bef HTTP/1.1" 200 None 2026-04-05 12:51:28,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:51:28,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-05 12:51:28,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:51:28,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfb7c1000c489abc2c1bef HTTP/1.1" 200 None 2026-04-05 12:51:28,091 - lava_callback - ERROR - Error processing callback for node 69cfb7c1000c489abc2c1bef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39020 - "GET / HTTP/1.0" 200 OK 2026-04-05 12:52:07,951 - lava_callback - INFO - Received callback for node 69cfb7e3000c489abc2c1c01 INFO: 172.21.0.1:39022 - "POST /node/69cfb7e3000c489abc2c1c01 HTTP/1.0" 202 Accepted 2026-04-05 12:52:07,958 - lava_callback - INFO - Starting async job submit for node 69cfb7e3000c489abc2c1c01 2026-04-05 12:52:07,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:52:07,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfb7e3000c489abc2c1c01 HTTP/1.1" 200 None 2026-04-05 12:52:07,975 - lava_callback - DEBUG - Processing node 69cfb7e3000c489abc2c1c01: baseline-arm-clabbe 2026-04-05 12:52:07,975 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfb7e3000c489abc2c1c01 2026-04-05 12:52:07,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:52:07,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfb7e3000c489abc2c1c01 HTTP/1.1" 200 None 2026-04-05 12:52:07,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:52:08,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-05 12:52:08,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:52:08,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfb7e3000c489abc2c1c01 HTTP/1.1" 200 None 2026-04-05 12:52:08,044 - lava_callback - ERROR - Error processing callback for node 69cfb7e3000c489abc2c1c01: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60860 - "GET / HTTP/1.0" 200 OK 2026-04-05 12:52:28,031 - lava_callback - INFO - Received callback for node 69cfb807000c489abc2c1c39 INFO: 172.21.0.1:60866 - "POST /node/69cfb807000c489abc2c1c39 HTTP/1.0" 202 Accepted 2026-04-05 12:52:28,037 - lava_callback - INFO - Starting async job submit for node 69cfb807000c489abc2c1c39 2026-04-05 12:52:28,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:52:28,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfb807000c489abc2c1c39 HTTP/1.1" 200 None 2026-04-05 12:52:28,053 - lava_callback - DEBUG - Processing node 69cfb807000c489abc2c1c39: baseline-arm-clabbe 2026-04-05 12:52:28,053 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfb807000c489abc2c1c39 2026-04-05 12:52:28,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:52:28,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfb807000c489abc2c1c39 HTTP/1.1" 200 None 2026-04-05 12:52:28,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:52:28,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-05 12:52:28,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:52:28,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfb807000c489abc2c1c39 HTTP/1.1" 200 None 2026-04-05 12:52:28,128 - lava_callback - ERROR - Error processing callback for node 69cfb807000c489abc2c1c39: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50462 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51770 - "GET / HTTP/1.0" 200 OK 2026-04-05 12:54:49,910 - lava_callback - INFO - Received callback for node 69cfb88b000c489abc2c1c9b INFO: 172.21.0.1:42464 - "POST /node/69cfb88b000c489abc2c1c9b HTTP/1.0" 202 Accepted 2026-04-05 12:54:49,916 - lava_callback - INFO - Starting async job submit for node 69cfb88b000c489abc2c1c9b 2026-04-05 12:54:49,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:54:49,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfb88b000c489abc2c1c9b HTTP/1.1" 200 None 2026-04-05 12:54:49,934 - lava_callback - DEBUG - Processing node 69cfb88b000c489abc2c1c9b: baseline-arm-baylibre 2026-04-05 12:54:49,934 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfb88b000c489abc2c1c9b 2026-04-05 12:54:49,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:54:49,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfb88b000c489abc2c1c9b HTTP/1.1" 200 None 2026-04-05 12:54:49,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:54:49,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-05 12:54:49,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:54:49,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfb88b000c489abc2c1c9b HTTP/1.1" 200 None 2026-04-05 12:54:50,007 - lava_callback - ERROR - Error processing callback for node 69cfb88b000c489abc2c1c9b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50916 - "GET / HTTP/1.0" 200 OK 2026-04-05 12:55:29,785 - lava_callback - INFO - Received callback for node 69cfb8b0000c489abc2c1ca9 INFO: 172.21.0.1:39534 - "POST /node/69cfb8b0000c489abc2c1ca9 HTTP/1.0" 202 Accepted 2026-04-05 12:55:29,792 - lava_callback - INFO - Starting async job submit for node 69cfb8b0000c489abc2c1ca9 2026-04-05 12:55:29,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:55:29,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfb8b0000c489abc2c1ca9 HTTP/1.1" 200 None 2026-04-05 12:55:29,807 - lava_callback - DEBUG - Processing node 69cfb8b0000c489abc2c1ca9: baseline-arm-baylibre 2026-04-05 12:55:29,808 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfb8b0000c489abc2c1ca9 2026-04-05 12:55:29,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:55:29,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfb8b0000c489abc2c1ca9 HTTP/1.1" 200 None 2026-04-05 12:55:29,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:55:29,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-05 12:55:29,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:55:29,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfb8b0000c489abc2c1ca9 HTTP/1.1" 200 None 2026-04-05 12:55:29,871 - lava_callback - ERROR - Error processing callback for node 69cfb8b0000c489abc2c1ca9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55856 - "GET / HTTP/1.0" 200 OK 2026-04-05 12:56:09,869 - lava_callback - INFO - Received callback for node 69cfb8d4000c489abc2c1cbf INFO: 172.21.0.1:48448 - "POST /node/69cfb8d4000c489abc2c1cbf HTTP/1.0" 202 Accepted 2026-04-05 12:56:09,876 - lava_callback - INFO - Starting async job submit for node 69cfb8d4000c489abc2c1cbf 2026-04-05 12:56:09,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:56:09,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfb8d4000c489abc2c1cbf HTTP/1.1" 200 None 2026-04-05 12:56:09,894 - lava_callback - DEBUG - Processing node 69cfb8d4000c489abc2c1cbf: baseline-arm-baylibre 2026-04-05 12:56:09,894 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfb8d4000c489abc2c1cbf 2026-04-05 12:56:09,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:56:09,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfb8d4000c489abc2c1cbf HTTP/1.1" 200 None 2026-04-05 12:56:09,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:56:09,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-05 12:56:09,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:56:09,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfb8d4000c489abc2c1cbf HTTP/1.1" 200 None 2026-04-05 12:56:09,951 - lava_callback - ERROR - Error processing callback for node 69cfb8d4000c489abc2c1cbf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48454 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42352 - "GET / HTTP/1.0" 200 OK 2026-04-05 12:57:49,943 - lava_callback - INFO - Received callback for node 69cfb941000c489abc2c1cef INFO: 172.21.0.1:59762 - "POST /node/69cfb941000c489abc2c1cef HTTP/1.0" 202 Accepted 2026-04-05 12:57:49,949 - lava_callback - INFO - Starting async job submit for node 69cfb941000c489abc2c1cef 2026-04-05 12:57:49,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:57:49,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfb941000c489abc2c1cef HTTP/1.1" 200 None 2026-04-05 12:57:49,966 - lava_callback - DEBUG - Processing node 69cfb941000c489abc2c1cef: baseline-arm-baylibre 2026-04-05 12:57:49,966 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfb941000c489abc2c1cef 2026-04-05 12:57:49,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:57:49,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfb941000c489abc2c1cef HTTP/1.1" 200 None 2026-04-05 12:57:49,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:57:50,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-05 12:57:50,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:57:50,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfb941000c489abc2c1cef HTTP/1.1" 200 None 2026-04-05 12:57:50,047 - lava_callback - ERROR - Error processing callback for node 69cfb941000c489abc2c1cef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60678 - "GET / HTTP/1.0" 200 OK 2026-04-05 12:58:29,932 - lava_callback - INFO - Received callback for node 69cfb964000c489abc2c1d02 INFO: 172.21.0.1:56176 - "POST /node/69cfb964000c489abc2c1d02 HTTP/1.0" 202 Accepted 2026-04-05 12:58:29,938 - lava_callback - INFO - Starting async job submit for node 69cfb964000c489abc2c1d02 2026-04-05 12:58:29,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:58:29,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfb964000c489abc2c1d02 HTTP/1.1" 200 None 2026-04-05 12:58:29,954 - lava_callback - DEBUG - Processing node 69cfb964000c489abc2c1d02: baseline-arm-baylibre 2026-04-05 12:58:29,954 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfb964000c489abc2c1d02 2026-04-05 12:58:29,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:58:29,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfb964000c489abc2c1d02 HTTP/1.1" 200 None 2026-04-05 12:58:29,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:58:29,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-05 12:58:29,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 12:58:30,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfb964000c489abc2c1d02 HTTP/1.1" 200 None 2026-04-05 12:58:30,006 - lava_callback - ERROR - Error processing callback for node 69cfb964000c489abc2c1d02: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43782 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46638 - "GET / HTTP/1.0" 200 OK 2026-04-05 13:00:28,314 - lava_callback - INFO - Received callback for node 69cfb9e3000c489abc2c1d7c INFO: 172.21.0.1:46640 - "POST /node/69cfb9e3000c489abc2c1d7c HTTP/1.0" 202 Accepted 2026-04-05 13:00:28,320 - lava_callback - INFO - Starting async job submit for node 69cfb9e3000c489abc2c1d7c 2026-04-05 13:00:28,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:00:28,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfb9e3000c489abc2c1d7c HTTP/1.1" 200 None 2026-04-05 13:00:28,336 - lava_callback - DEBUG - Processing node 69cfb9e3000c489abc2c1d7c: baseline-arm-clabbe 2026-04-05 13:00:28,336 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfb9e3000c489abc2c1d7c 2026-04-05 13:00:28,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:00:28,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfb9e3000c489abc2c1d7c HTTP/1.1" 200 None 2026-04-05 13:00:28,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:00:28,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-05 13:00:28,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:00:28,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfb9e3000c489abc2c1d7c HTTP/1.1" 200 None 2026-04-05 13:00:28,395 - lava_callback - ERROR - Error processing callback for node 69cfb9e3000c489abc2c1d7c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46604 - "GET / HTTP/1.0" 200 OK 2026-04-05 13:01:08,313 - lava_callback - INFO - Received callback for node 69cfba06000c489abc2c1db3 INFO: 172.21.0.1:46606 - "POST /node/69cfba06000c489abc2c1db3 HTTP/1.0" 202 Accepted 2026-04-05 13:01:08,319 - lava_callback - INFO - Starting async job submit for node 69cfba06000c489abc2c1db3 2026-04-05 13:01:08,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:01:08,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfba06000c489abc2c1db3 HTTP/1.1" 200 None 2026-04-05 13:01:08,339 - lava_callback - DEBUG - Processing node 69cfba06000c489abc2c1db3: baseline-arm-clabbe 2026-04-05 13:01:08,339 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfba06000c489abc2c1db3 2026-04-05 13:01:08,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:01:08,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfba06000c489abc2c1db3 HTTP/1.1" 200 None 2026-04-05 13:01:08,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:01:08,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-05 13:01:08,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:01:08,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfba06000c489abc2c1db3 HTTP/1.1" 200 None 2026-04-05 13:01:08,407 - lava_callback - ERROR - Error processing callback for node 69cfba06000c489abc2c1db3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54448 - "GET / HTTP/1.0" 200 OK 2026-04-05 13:01:48,372 - lava_callback - INFO - Received callback for node 69cfba2a000c489abc2c1dc2 INFO: 172.21.0.1:54450 - "POST /node/69cfba2a000c489abc2c1dc2 HTTP/1.0" 202 Accepted 2026-04-05 13:01:48,378 - lava_callback - INFO - Starting async job submit for node 69cfba2a000c489abc2c1dc2 2026-04-05 13:01:48,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:01:48,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfba2a000c489abc2c1dc2 HTTP/1.1" 200 None 2026-04-05 13:01:48,394 - lava_callback - DEBUG - Processing node 69cfba2a000c489abc2c1dc2: baseline-arm-clabbe 2026-04-05 13:01:48,394 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfba2a000c489abc2c1dc2 2026-04-05 13:01:48,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:01:48,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfba2a000c489abc2c1dc2 HTTP/1.1" 200 None 2026-04-05 13:01:48,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:01:48,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-05 13:01:48,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:01:48,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfba2a000c489abc2c1dc2 HTTP/1.1" 200 None 2026-04-05 13:01:48,447 - lava_callback - ERROR - Error processing callback for node 69cfba2a000c489abc2c1dc2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45060 - "GET / HTTP/1.0" 200 OK 2026-04-05 13:02:08,386 - lava_callback - INFO - Received callback for node 69cfba4b000c489abc2c1de7 INFO: 172.21.0.1:45076 - "POST /node/69cfba4b000c489abc2c1de7 HTTP/1.0" 202 Accepted 2026-04-05 13:02:08,392 - lava_callback - INFO - Starting async job submit for node 69cfba4b000c489abc2c1de7 2026-04-05 13:02:08,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:02:08,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfba4b000c489abc2c1de7 HTTP/1.1" 200 None 2026-04-05 13:02:08,407 - lava_callback - DEBUG - Processing node 69cfba4b000c489abc2c1de7: baseline-arm-clabbe 2026-04-05 13:02:08,407 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfba4b000c489abc2c1de7 2026-04-05 13:02:08,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:02:08,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfba4b000c489abc2c1de7 HTTP/1.1" 200 None 2026-04-05 13:02:08,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:02:08,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-05 13:02:08,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:02:08,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfba4b000c489abc2c1de7 HTTP/1.1" 200 None 2026-04-05 13:02:08,469 - lava_callback - ERROR - Error processing callback for node 69cfba4b000c489abc2c1de7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52778 - "GET / HTTP/1.0" 200 OK 2026-04-05 13:02:48,437 - lava_callback - INFO - Received callback for node 69cfba71000c489abc2c1e07 INFO: 172.21.0.1:52794 - "POST /node/69cfba71000c489abc2c1e07 HTTP/1.0" 202 Accepted 2026-04-05 13:02:48,446 - lava_callback - INFO - Starting async job submit for node 69cfba71000c489abc2c1e07 2026-04-05 13:02:48,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:02:48,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfba71000c489abc2c1e07 HTTP/1.1" 200 None 2026-04-05 13:02:48,469 - lava_callback - DEBUG - Processing node 69cfba71000c489abc2c1e07: baseline-arm-clabbe 2026-04-05 13:02:48,469 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfba71000c489abc2c1e07 2026-04-05 13:02:48,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:02:48,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfba71000c489abc2c1e07 HTTP/1.1" 200 None 2026-04-05 13:02:48,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:02:48,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-05 13:02:48,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:02:48,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfba71000c489abc2c1e07 HTTP/1.1" 200 None 2026-04-05 13:02:48,530 - lava_callback - ERROR - Error processing callback for node 69cfba71000c489abc2c1e07: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36942 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45294 - "GET / HTTP/1.0" 200 OK 2026-04-05 13:13:10,944 - lava_callback - INFO - Received callback for node 69cfbcd3000c489abc2c1f17 INFO: 172.21.0.1:35448 - "POST /node/69cfbcd3000c489abc2c1f17 HTTP/1.0" 202 Accepted 2026-04-05 13:13:10,953 - lava_callback - INFO - Starting async job submit for node 69cfbcd3000c489abc2c1f17 2026-04-05 13:13:10,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:13:10,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfbcd3000c489abc2c1f17 HTTP/1.1" 200 None 2026-04-05 13:13:10,969 - lava_callback - DEBUG - Processing node 69cfbcd3000c489abc2c1f17: baseline-arm64-baylibre 2026-04-05 13:13:10,969 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfbcd3000c489abc2c1f17 2026-04-05 13:13:10,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:13:10,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfbcd3000c489abc2c1f17 HTTP/1.1" 200 None 2026-04-05 13:13:10,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:13:10,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf070a9e2394c38fe00f4e HTTP/1.1" 200 None 2026-04-05 13:13:11,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:13:11,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfbcd3000c489abc2c1f17 HTTP/1.1" 200 None 2026-04-05 13:13:11,021 - lava_callback - ERROR - Error processing callback for node 69cfbcd3000c489abc2c1f17: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45606 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40528 - "GET / HTTP/1.0" 200 OK 2026-04-05 13:14:29,057 - lava_callback - INFO - Received callback for node 69cfbd1f000c489abc2c1f40 INFO: 172.21.0.1:40540 - "POST /node/69cfbd1f000c489abc2c1f40 HTTP/1.0" 202 Accepted 2026-04-05 13:14:29,063 - lava_callback - INFO - Starting async job submit for node 69cfbd1f000c489abc2c1f40 2026-04-05 13:14:29,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:14:29,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfbd1f000c489abc2c1f40 HTTP/1.1" 200 None 2026-04-05 13:14:29,083 - lava_callback - DEBUG - Processing node 69cfbd1f000c489abc2c1f40: baseline-arm64-clabbe 2026-04-05 13:14:29,083 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfbd1f000c489abc2c1f40 2026-04-05 13:14:29,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:14:29,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfbd1f000c489abc2c1f40 HTTP/1.1" 200 None 2026-04-05 13:14:29,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:14:29,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf070a9e2394c38fe00f4e HTTP/1.1" 200 None 2026-04-05 13:14:29,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:14:29,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfbd1f000c489abc2c1f40 HTTP/1.1" 200 None 2026-04-05 13:14:29,150 - lava_callback - ERROR - Error processing callback for node 69cfbd1f000c489abc2c1f40: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60298 - "GET / HTTP/1.0" 200 OK 2026-04-05 13:15:29,038 - lava_callback - INFO - Received callback for node 69cfbd67000c489abc2c1f63 INFO: 172.21.0.1:60306 - "POST /node/69cfbd67000c489abc2c1f63 HTTP/1.0" 202 Accepted 2026-04-05 13:15:29,044 - lava_callback - INFO - Starting async job submit for node 69cfbd67000c489abc2c1f63 2026-04-05 13:15:29,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:15:29,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfbd67000c489abc2c1f63 HTTP/1.1" 200 None 2026-04-05 13:15:29,061 - lava_callback - DEBUG - Processing node 69cfbd67000c489abc2c1f63: baseline-arm64-clabbe 2026-04-05 13:15:29,062 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfbd67000c489abc2c1f63 2026-04-05 13:15:29,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:15:29,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfbd67000c489abc2c1f63 HTTP/1.1" 200 None 2026-04-05 13:15:29,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:15:29,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf070a9e2394c38fe00f4e HTTP/1.1" 200 None 2026-04-05 13:15:29,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:15:29,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfbd67000c489abc2c1f63 HTTP/1.1" 200 None 2026-04-05 13:15:29,119 - lava_callback - ERROR - Error processing callback for node 69cfbd67000c489abc2c1f63: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56252 - "GET / HTTP/1.0" 200 OK 2026-04-05 13:17:09,094 - lava_callback - INFO - Received callback for node 69cfbdc7000c489abc2c1f8d INFO: 172.21.0.1:56268 - "POST /node/69cfbdc7000c489abc2c1f8d HTTP/1.0" 202 Accepted 2026-04-05 13:17:09,100 - lava_callback - INFO - Starting async job submit for node 69cfbdc7000c489abc2c1f8d 2026-04-05 13:17:09,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:17:09,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfbdc7000c489abc2c1f8d HTTP/1.1" 200 None 2026-04-05 13:17:09,116 - lava_callback - DEBUG - Processing node 69cfbdc7000c489abc2c1f8d: baseline-arm64-clabbe 2026-04-05 13:17:09,116 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfbdc7000c489abc2c1f8d 2026-04-05 13:17:09,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:17:09,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfbdc7000c489abc2c1f8d HTTP/1.1" 200 None 2026-04-05 13:17:09,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:17:09,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf070a9e2394c38fe00f4e HTTP/1.1" 200 None 2026-04-05 13:17:09,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:17:09,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfbdc7000c489abc2c1f8d HTTP/1.1" 200 None 2026-04-05 13:17:09,180 - lava_callback - ERROR - Error processing callback for node 69cfbdc7000c489abc2c1f8d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56684 - "GET / HTTP/1.0" 200 OK 2026-04-05 13:18:09,168 - lava_callback - INFO - Received callback for node 69cfbe0d000c489abc2c1fce INFO: 172.21.0.1:56696 - "POST /node/69cfbe0d000c489abc2c1fce HTTP/1.0" 202 Accepted 2026-04-05 13:18:09,175 - lava_callback - INFO - Starting async job submit for node 69cfbe0d000c489abc2c1fce 2026-04-05 13:18:09,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:18:09,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfbe0d000c489abc2c1fce HTTP/1.1" 200 None 2026-04-05 13:18:09,193 - lava_callback - DEBUG - Processing node 69cfbe0d000c489abc2c1fce: baseline-arm64-clabbe 2026-04-05 13:18:09,193 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfbe0d000c489abc2c1fce 2026-04-05 13:18:09,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:18:09,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfbe0d000c489abc2c1fce HTTP/1.1" 200 None 2026-04-05 13:18:09,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:18:09,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf070a9e2394c38fe00f4e HTTP/1.1" 200 None 2026-04-05 13:18:09,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:18:09,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfbe0d000c489abc2c1fce HTTP/1.1" 200 None 2026-04-05 13:18:09,257 - lava_callback - ERROR - Error processing callback for node 69cfbe0d000c489abc2c1fce: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39072 - "GET / HTTP/1.0" 200 OK 2026-04-05 13:19:11,214 - lava_callback - INFO - Received callback for node 69cfbe4c000c489abc2c2003 INFO: 172.21.0.1:55928 - "POST /node/69cfbe4c000c489abc2c2003 HTTP/1.0" 202 Accepted 2026-04-05 13:19:11,220 - lava_callback - INFO - Starting async job submit for node 69cfbe4c000c489abc2c2003 2026-04-05 13:19:11,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:19:11,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfbe4c000c489abc2c2003 HTTP/1.1" 200 None 2026-04-05 13:19:11,238 - lava_callback - DEBUG - Processing node 69cfbe4c000c489abc2c2003: baseline-arm64-baylibre 2026-04-05 13:19:11,238 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfbe4c000c489abc2c2003 2026-04-05 13:19:11,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:19:11,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfbe4c000c489abc2c2003 HTTP/1.1" 200 None 2026-04-05 13:19:11,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:19:11,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-05 13:19:11,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:19:11,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfbe4c000c489abc2c2003 HTTP/1.1" 200 None 2026-04-05 13:19:11,305 - lava_callback - ERROR - Error processing callback for node 69cfbe4c000c489abc2c2003: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33370 - "GET / HTTP/1.0" 200 OK 2026-04-05 13:20:49,318 - lava_callback - INFO - Received callback for node 69cfbe9e000c489abc2c2024 INFO: 172.21.0.1:33386 - "POST /node/69cfbe9e000c489abc2c2024 HTTP/1.0" 202 Accepted 2026-04-05 13:20:49,328 - lava_callback - INFO - Starting async job submit for node 69cfbe9e000c489abc2c2024 2026-04-05 13:20:49,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:20:49,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfbe9e000c489abc2c2024 HTTP/1.1" 200 None 2026-04-05 13:20:49,345 - lava_callback - DEBUG - Processing node 69cfbe9e000c489abc2c2024: baseline-arm64-clabbe 2026-04-05 13:20:49,345 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfbe9e000c489abc2c2024 2026-04-05 13:20:49,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:20:49,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfbe9e000c489abc2c2024 HTTP/1.1" 200 None 2026-04-05 13:20:49,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:20:49,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf070a9e2394c38fe00f4e HTTP/1.1" 200 None 2026-04-05 13:20:49,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:20:49,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfbe9e000c489abc2c2024 HTTP/1.1" 200 None 2026-04-05 13:20:49,399 - lava_callback - ERROR - Error processing callback for node 69cfbe9e000c489abc2c2024: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52380 - "GET / HTTP/1.0" 200 OK 2026-04-05 13:21:49,402 - lava_callback - INFO - Received callback for node 69cfbee2000c489abc2c2063 INFO: 172.21.0.1:52382 - "POST /node/69cfbee2000c489abc2c2063 HTTP/1.0" 202 Accepted 2026-04-05 13:21:49,408 - lava_callback - INFO - Starting async job submit for node 69cfbee2000c489abc2c2063 2026-04-05 13:21:49,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:21:49,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfbee2000c489abc2c2063 HTTP/1.1" 200 None 2026-04-05 13:21:49,423 - lava_callback - DEBUG - Processing node 69cfbee2000c489abc2c2063: baseline-arm64-clabbe 2026-04-05 13:21:49,424 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfbee2000c489abc2c2063 2026-04-05 13:21:49,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:21:49,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfbee2000c489abc2c2063 HTTP/1.1" 200 None 2026-04-05 13:21:49,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:21:49,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf070a9e2394c38fe00f4e HTTP/1.1" 200 None 2026-04-05 13:21:49,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:21:49,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfbee2000c489abc2c2063 HTTP/1.1" 200 None 2026-04-05 13:21:49,480 - lava_callback - ERROR - Error processing callback for node 69cfbee2000c489abc2c2063: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52362 - "GET / HTTP/1.0" 200 OK 2026-04-05 13:22:51,237 - lava_callback - INFO - Received callback for node 69cfbf23000c489abc2c2098 INFO: 172.21.0.1:46542 - "POST /node/69cfbf23000c489abc2c2098 HTTP/1.0" 202 Accepted 2026-04-05 13:22:51,243 - lava_callback - INFO - Starting async job submit for node 69cfbf23000c489abc2c2098 2026-04-05 13:22:51,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:22:51,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfbf23000c489abc2c2098 HTTP/1.1" 200 None 2026-04-05 13:22:51,258 - lava_callback - DEBUG - Processing node 69cfbf23000c489abc2c2098: baseline-arm64-baylibre 2026-04-05 13:22:51,259 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfbf23000c489abc2c2098 2026-04-05 13:22:51,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:22:51,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfbf23000c489abc2c2098 HTTP/1.1" 200 None 2026-04-05 13:22:51,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:22:51,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-05 13:22:51,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:22:51,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfbf23000c489abc2c2098 HTTP/1.1" 200 None 2026-04-05 13:22:51,329 - lava_callback - ERROR - Error processing callback for node 69cfbf23000c489abc2c2098: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50060 - "GET / HTTP/1.0" 200 OK 2026-04-05 13:24:11,445 - lava_callback - INFO - Received callback for node 69cfbf6d000c489abc2c20c8 INFO: 172.21.0.1:51192 - "POST /node/69cfbf6d000c489abc2c20c8 HTTP/1.0" 202 Accepted 2026-04-05 13:24:11,450 - lava_callback - INFO - Starting async job submit for node 69cfbf6d000c489abc2c20c8 2026-04-05 13:24:11,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:24:11,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfbf6d000c489abc2c20c8 HTTP/1.1" 200 None 2026-04-05 13:24:11,467 - lava_callback - DEBUG - Processing node 69cfbf6d000c489abc2c20c8: baseline-arm64-baylibre 2026-04-05 13:24:11,467 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfbf6d000c489abc2c20c8 2026-04-05 13:24:11,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:24:11,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfbf6d000c489abc2c20c8 HTTP/1.1" 200 None 2026-04-05 13:24:11,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:24:11,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-05 13:24:11,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:24:11,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfbf6d000c489abc2c20c8 HTTP/1.1" 200 None 2026-04-05 13:24:11,521 - lava_callback - ERROR - Error processing callback for node 69cfbf6d000c489abc2c20c8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54730 - "GET / HTTP/1.0" 200 OK 2026-04-05 13:25:31,420 - lava_callback - INFO - Received callback for node 69cfbfb6000c489abc2c20f5 INFO: 172.21.0.1:37054 - "POST /node/69cfbfb6000c489abc2c20f5 HTTP/1.0" 202 Accepted 2026-04-05 13:25:31,426 - lava_callback - INFO - Starting async job submit for node 69cfbfb6000c489abc2c20f5 2026-04-05 13:25:31,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:25:31,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfbfb6000c489abc2c20f5 HTTP/1.1" 200 None 2026-04-05 13:25:31,471 - lava_callback - DEBUG - Processing node 69cfbfb6000c489abc2c20f5: baseline-arm64-baylibre 2026-04-05 13:25:31,472 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfbfb6000c489abc2c20f5 2026-04-05 13:25:31,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:25:31,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfbfb6000c489abc2c20f5 HTTP/1.1" 200 None 2026-04-05 13:25:31,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:25:31,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-05 13:25:31,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:25:31,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfbfb6000c489abc2c20f5 HTTP/1.1" 200 None 2026-04-05 13:25:31,540 - lava_callback - ERROR - Error processing callback for node 69cfbfb6000c489abc2c20f5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39814 - "GET / HTTP/1.0" 200 OK 2026-04-05 13:26:31,442 - lava_callback - INFO - Received callback for node 69cfbffd000c489abc2c2134 INFO: 172.21.0.1:50726 - "POST /node/69cfbffd000c489abc2c2134 HTTP/1.0" 202 Accepted 2026-04-05 13:26:31,448 - lava_callback - INFO - Starting async job submit for node 69cfbffd000c489abc2c2134 2026-04-05 13:26:31,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:26:31,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfbffd000c489abc2c2134 HTTP/1.1" 200 None 2026-04-05 13:26:31,465 - lava_callback - DEBUG - Processing node 69cfbffd000c489abc2c2134: baseline-arm64-baylibre 2026-04-05 13:26:31,465 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfbffd000c489abc2c2134 2026-04-05 13:26:31,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:26:31,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfbffd000c489abc2c2134 HTTP/1.1" 200 None 2026-04-05 13:26:31,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:26:31,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-05 13:26:31,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:26:31,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfbffd000c489abc2c2134 HTTP/1.1" 200 None 2026-04-05 13:26:31,530 - lava_callback - ERROR - Error processing callback for node 69cfbffd000c489abc2c2134: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54560 - "GET / HTTP/1.0" 200 OK 2026-04-05 13:27:29,589 - lava_callback - INFO - Received callback for node 69cfc039000c489abc2c2186 INFO: 172.21.0.1:54574 - "POST /node/69cfc039000c489abc2c2186 HTTP/1.0" 202 Accepted 2026-04-05 13:27:29,596 - lava_callback - INFO - Starting async job submit for node 69cfc039000c489abc2c2186 2026-04-05 13:27:29,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:27:29,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfc039000c489abc2c2186 HTTP/1.1" 200 None 2026-04-05 13:27:29,621 - lava_callback - DEBUG - Processing node 69cfc039000c489abc2c2186: baseline-arm-clabbe 2026-04-05 13:27:29,621 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfc039000c489abc2c2186 2026-04-05 13:27:29,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:27:29,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfc039000c489abc2c2186 HTTP/1.1" 200 None 2026-04-05 13:27:29,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:27:29,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-05 13:27:29,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:27:29,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfc039000c489abc2c2186 HTTP/1.1" 200 None 2026-04-05 13:27:29,688 - lava_callback - ERROR - Error processing callback for node 69cfc039000c489abc2c2186: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49330 - "GET / HTTP/1.0" 200 OK 2026-04-05 13:28:11,677 - lava_callback - INFO - Received callback for node 69cfc064000c489abc2c21a0 INFO: 172.21.0.1:49544 - "POST /node/69cfc064000c489abc2c21a0 HTTP/1.0" 202 Accepted 2026-04-05 13:28:11,683 - lava_callback - INFO - Starting async job submit for node 69cfc064000c489abc2c21a0 2026-04-05 13:28:11,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:28:11,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfc064000c489abc2c21a0 HTTP/1.1" 200 None 2026-04-05 13:28:11,699 - lava_callback - DEBUG - Processing node 69cfc064000c489abc2c21a0: baseline-arm64-baylibre 2026-04-05 13:28:11,699 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfc064000c489abc2c21a0 2026-04-05 13:28:11,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:28:11,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfc064000c489abc2c21a0 HTTP/1.1" 200 None 2026-04-05 13:28:11,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:28:11,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-05 13:28:11,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:28:11,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfc064000c489abc2c21a0 HTTP/1.1" 200 None 2026-04-05 13:28:11,751 - lava_callback - ERROR - Error processing callback for node 69cfc064000c489abc2c21a0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42510 - "GET / HTTP/1.0" 200 OK 2026-04-05 13:29:31,679 - lava_callback - INFO - Received callback for node 69cfc0ae000c489abc2c21b8 INFO: 172.21.0.1:50026 - "POST /node/69cfc0ae000c489abc2c21b8 HTTP/1.0" 202 Accepted 2026-04-05 13:29:31,686 - lava_callback - INFO - Starting async job submit for node 69cfc0ae000c489abc2c21b8 2026-04-05 13:29:31,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:29:31,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfc0ae000c489abc2c21b8 HTTP/1.1" 200 None 2026-04-05 13:29:31,703 - lava_callback - DEBUG - Processing node 69cfc0ae000c489abc2c21b8: baseline-arm64-baylibre 2026-04-05 13:29:31,703 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfc0ae000c489abc2c21b8 2026-04-05 13:29:31,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:29:31,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfc0ae000c489abc2c21b8 HTTP/1.1" 200 None 2026-04-05 13:29:31,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:29:31,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-05 13:29:31,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:29:31,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfc0ae000c489abc2c21b8 HTTP/1.1" 200 None 2026-04-05 13:29:31,771 - lava_callback - ERROR - Error processing callback for node 69cfc0ae000c489abc2c21b8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45942 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60692 - "GET / HTTP/1.0" 200 OK 2026-04-05 13:30:49,751 - lava_callback - INFO - Received callback for node 69cfc100000c489abc2c21e9 INFO: 172.21.0.1:36522 - "POST /node/69cfc100000c489abc2c21e9 HTTP/1.0" 202 Accepted 2026-04-05 13:30:49,757 - lava_callback - INFO - Starting async job submit for node 69cfc100000c489abc2c21e9 2026-04-05 13:30:49,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:30:49,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfc100000c489abc2c21e9 HTTP/1.1" 200 None 2026-04-05 13:30:49,781 - lava_callback - DEBUG - Processing node 69cfc100000c489abc2c21e9: baseline-arm64-clabbe 2026-04-05 13:30:49,781 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfc100000c489abc2c21e9 2026-04-05 13:30:49,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:30:49,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfc100000c489abc2c21e9 HTTP/1.1" 200 None 2026-04-05 13:30:49,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:30:49,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-05 13:30:49,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:30:49,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfc100000c489abc2c21e9 HTTP/1.1" 200 None 2026-04-05 13:30:49,833 - lava_callback - ERROR - Error processing callback for node 69cfc100000c489abc2c21e9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54532 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45040 - "GET / HTTP/1.0" 200 OK 2026-04-05 13:31:51,841 - lava_callback - INFO - Received callback for node 69cfc145000c489abc2c2215 INFO: 172.21.0.1:44384 - "POST /node/69cfc145000c489abc2c2215 HTTP/1.0" 202 Accepted 2026-04-05 13:31:51,848 - lava_callback - INFO - Starting async job submit for node 69cfc145000c489abc2c2215 2026-04-05 13:31:51,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:31:51,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfc145000c489abc2c2215 HTTP/1.1" 200 None 2026-04-05 13:31:51,865 - lava_callback - DEBUG - Processing node 69cfc145000c489abc2c2215: baseline-arm64-baylibre 2026-04-05 13:31:51,865 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfc145000c489abc2c2215 2026-04-05 13:31:51,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:31:51,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfc145000c489abc2c2215 HTTP/1.1" 200 None 2026-04-05 13:31:51,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:31:51,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-05 13:31:51,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:31:51,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfc145000c489abc2c2215 HTTP/1.1" 200 None 2026-04-05 13:31:51,917 - lava_callback - ERROR - Error processing callback for node 69cfc145000c489abc2c2215: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56874 - "GET / HTTP/1.0" 200 OK 2026-04-05 13:33:29,923 - lava_callback - INFO - Received callback for node 69cfc194000c489abc2c223b INFO: 172.21.0.1:59238 - "POST /node/69cfc194000c489abc2c223b HTTP/1.0" 202 Accepted 2026-04-05 13:33:29,932 - lava_callback - INFO - Starting async job submit for node 69cfc194000c489abc2c223b 2026-04-05 13:33:29,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:33:29,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfc194000c489abc2c223b HTTP/1.1" 200 None 2026-04-05 13:33:29,947 - lava_callback - DEBUG - Processing node 69cfc194000c489abc2c223b: baseline-arm64-clabbe 2026-04-05 13:33:29,947 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfc194000c489abc2c223b 2026-04-05 13:33:29,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:33:29,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfc194000c489abc2c223b HTTP/1.1" 200 None 2026-04-05 13:33:29,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:33:29,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-05 13:33:29,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:33:30,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfc194000c489abc2c223b HTTP/1.1" 200 None 2026-04-05 13:33:30,002 - lava_callback - ERROR - Error processing callback for node 69cfc194000c489abc2c223b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42710 - "GET / HTTP/1.0" 200 OK 2026-04-05 13:34:31,846 - lava_callback - INFO - Received callback for node 69cfc1d7000c489abc2c226f INFO: 172.21.0.1:42666 - "POST /node/69cfc1d7000c489abc2c226f HTTP/1.0" 202 Accepted 2026-04-05 13:34:31,853 - lava_callback - INFO - Starting async job submit for node 69cfc1d7000c489abc2c226f 2026-04-05 13:34:31,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:34:31,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfc1d7000c489abc2c226f HTTP/1.1" 200 None 2026-04-05 13:34:31,873 - lava_callback - DEBUG - Processing node 69cfc1d7000c489abc2c226f: baseline-arm64-baylibre 2026-04-05 13:34:31,873 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfc1d7000c489abc2c226f 2026-04-05 13:34:31,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:34:31,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfc1d7000c489abc2c226f HTTP/1.1" 200 None 2026-04-05 13:34:31,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:34:31,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-05 13:34:31,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:34:31,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfc1d7000c489abc2c226f HTTP/1.1" 200 None 2026-04-05 13:34:31,956 - lava_callback - ERROR - Error processing callback for node 69cfc1d7000c489abc2c226f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38640 - "GET / HTTP/1.0" 200 OK 2026-04-05 13:35:31,900 - lava_callback - INFO - Received callback for node 69cfc21e000c489abc2c22b8 INFO: 172.21.0.1:38806 - "POST /node/69cfc21e000c489abc2c22b8 HTTP/1.0" 202 Accepted 2026-04-05 13:35:31,909 - lava_callback - INFO - Starting async job submit for node 69cfc21e000c489abc2c22b8 2026-04-05 13:35:31,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:35:31,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfc21e000c489abc2c22b8 HTTP/1.1" 200 None 2026-04-05 13:35:31,927 - lava_callback - DEBUG - Processing node 69cfc21e000c489abc2c22b8: baseline-arm64-baylibre 2026-04-05 13:35:31,927 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfc21e000c489abc2c22b8 2026-04-05 13:35:31,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:35:31,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfc21e000c489abc2c22b8 HTTP/1.1" 200 None 2026-04-05 13:35:31,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:35:31,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-05 13:35:31,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:35:32,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfc21e000c489abc2c22b8 HTTP/1.1" 200 None 2026-04-05 13:35:32,002 - lava_callback - ERROR - Error processing callback for node 69cfc21e000c489abc2c22b8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34954 - "GET / HTTP/1.0" 200 OK 2026-04-05 13:36:50,032 - lava_callback - INFO - Received callback for node 69cfc26c000c489abc2c22e8 INFO: 172.21.0.1:37280 - "POST /node/69cfc26c000c489abc2c22e8 HTTP/1.0" 202 Accepted 2026-04-05 13:36:50,038 - lava_callback - INFO - Starting async job submit for node 69cfc26c000c489abc2c22e8 2026-04-05 13:36:50,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:36:50,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfc26c000c489abc2c22e8 HTTP/1.1" 200 None 2026-04-05 13:36:50,057 - lava_callback - DEBUG - Processing node 69cfc26c000c489abc2c22e8: baseline-arm64-clabbe 2026-04-05 13:36:50,057 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfc26c000c489abc2c22e8 2026-04-05 13:36:50,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:36:50,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfc26c000c489abc2c22e8 HTTP/1.1" 200 None 2026-04-05 13:36:50,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:36:50,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-05 13:36:50,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:36:50,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfc26c000c489abc2c22e8 HTTP/1.1" 200 None 2026-04-05 13:36:50,114 - lava_callback - ERROR - Error processing callback for node 69cfc26c000c489abc2c22e8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56352 - "GET / HTTP/1.0" 200 OK 2026-04-05 13:38:10,034 - lava_callback - INFO - Received callback for node 69cfc2b0000c489abc2c2334 INFO: 172.21.0.1:37570 - "POST /node/69cfc2b0000c489abc2c2334 HTTP/1.0" 202 Accepted 2026-04-05 13:38:10,041 - lava_callback - INFO - Starting async job submit for node 69cfc2b0000c489abc2c2334 2026-04-05 13:38:10,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:38:10,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfc2b0000c489abc2c2334 HTTP/1.1" 200 None 2026-04-05 13:38:10,058 - lava_callback - DEBUG - Processing node 69cfc2b0000c489abc2c2334: baseline-arm64-clabbe 2026-04-05 13:38:10,058 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfc2b0000c489abc2c2334 2026-04-05 13:38:10,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:38:10,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfc2b0000c489abc2c2334 HTTP/1.1" 200 None 2026-04-05 13:38:10,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:38:10,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-05 13:38:10,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:38:10,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfc2b0000c489abc2c2334 HTTP/1.1" 200 None 2026-04-05 13:38:10,116 - lava_callback - ERROR - Error processing callback for node 69cfc2b0000c489abc2c2334: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42442 - "GET / HTTP/1.0" 200 OK 2026-04-05 13:39:10,097 - lava_callback - INFO - Received callback for node 69cfc2f8000c489abc2c2367 INFO: 172.21.0.1:59436 - "POST /node/69cfc2f8000c489abc2c2367 HTTP/1.0" 202 Accepted 2026-04-05 13:39:10,103 - lava_callback - INFO - Starting async job submit for node 69cfc2f8000c489abc2c2367 2026-04-05 13:39:10,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:39:10,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfc2f8000c489abc2c2367 HTTP/1.1" 200 None 2026-04-05 13:39:10,121 - lava_callback - DEBUG - Processing node 69cfc2f8000c489abc2c2367: baseline-arm64-clabbe 2026-04-05 13:39:10,121 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfc2f8000c489abc2c2367 2026-04-05 13:39:10,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:39:10,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfc2f8000c489abc2c2367 HTTP/1.1" 200 None 2026-04-05 13:39:10,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:39:10,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-05 13:39:10,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:39:10,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfc2f8000c489abc2c2367 HTTP/1.1" 200 None 2026-04-05 13:39:10,204 - lava_callback - ERROR - Error processing callback for node 69cfc2f8000c489abc2c2367: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39472 - "GET / HTTP/1.0" 200 OK 2026-04-05 13:40:30,240 - lava_callback - INFO - Received callback for node 69cfc341000c489abc2c2397 INFO: 172.21.0.1:60920 - "POST /node/69cfc341000c489abc2c2397 HTTP/1.0" 202 Accepted 2026-04-05 13:40:30,246 - lava_callback - INFO - Starting async job submit for node 69cfc341000c489abc2c2397 2026-04-05 13:40:30,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:40:30,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfc341000c489abc2c2397 HTTP/1.1" 200 None 2026-04-05 13:40:30,264 - lava_callback - DEBUG - Processing node 69cfc341000c489abc2c2397: baseline-arm64-clabbe 2026-04-05 13:40:30,265 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfc341000c489abc2c2397 2026-04-05 13:40:30,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:40:30,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfc341000c489abc2c2397 HTTP/1.1" 200 None 2026-04-05 13:40:30,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:40:30,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-05 13:40:30,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:40:30,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfc341000c489abc2c2397 HTTP/1.1" 200 None 2026-04-05 13:40:30,323 - lava_callback - ERROR - Error processing callback for node 69cfc341000c489abc2c2397: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47228 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51284 - "GET / HTTP/1.0" 200 OK 2026-04-05 13:41:50,218 - lava_callback - INFO - Received callback for node 69cfc38b000c489abc2c23c1 INFO: 172.21.0.1:54794 - "POST /node/69cfc38b000c489abc2c23c1 HTTP/1.0" 202 Accepted 2026-04-05 13:41:50,224 - lava_callback - INFO - Starting async job submit for node 69cfc38b000c489abc2c23c1 2026-04-05 13:41:50,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:41:50,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfc38b000c489abc2c23c1 HTTP/1.1" 200 None 2026-04-05 13:41:50,241 - lava_callback - DEBUG - Processing node 69cfc38b000c489abc2c23c1: baseline-arm64-clabbe 2026-04-05 13:41:50,242 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfc38b000c489abc2c23c1 2026-04-05 13:41:50,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:41:50,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfc38b000c489abc2c23c1 HTTP/1.1" 200 None 2026-04-05 13:41:50,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:41:50,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-05 13:41:50,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:41:50,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfc38b000c489abc2c23c1 HTTP/1.1" 200 None 2026-04-05 13:41:50,310 - lava_callback - ERROR - Error processing callback for node 69cfc38b000c489abc2c23c1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53086 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34956 - "GET / HTTP/1.0" 200 OK 2026-04-05 13:42:50,349 - lava_callback - INFO - Received callback for node 69cfc3cf000c489abc2c2414 INFO: 172.21.0.1:48874 - "POST /node/69cfc3cf000c489abc2c2414 HTTP/1.0" 202 Accepted 2026-04-05 13:42:50,358 - lava_callback - INFO - Starting async job submit for node 69cfc3cf000c489abc2c2414 2026-04-05 13:42:50,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:42:50,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfc3cf000c489abc2c2414 HTTP/1.1" 200 None 2026-04-05 13:42:50,379 - lava_callback - DEBUG - Processing node 69cfc3cf000c489abc2c2414: baseline-arm64-clabbe 2026-04-05 13:42:50,379 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfc3cf000c489abc2c2414 2026-04-05 13:42:50,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:42:50,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfc3cf000c489abc2c2414 HTTP/1.1" 200 None 2026-04-05 13:42:50,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:42:50,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-05 13:42:50,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:42:50,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfc3cf000c489abc2c2414 HTTP/1.1" 200 None 2026-04-05 13:42:50,458 - lava_callback - ERROR - Error processing callback for node 69cfc3cf000c489abc2c2414: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56166 - "GET / HTTP/1.0" 200 OK 2026-04-05 13:44:10,301 - lava_callback - INFO - Received callback for node 69cfc414000c489abc2c2455 INFO: 172.21.0.1:35410 - "POST /node/69cfc414000c489abc2c2455 HTTP/1.0" 202 Accepted 2026-04-05 13:44:10,307 - lava_callback - INFO - Starting async job submit for node 69cfc414000c489abc2c2455 2026-04-05 13:44:10,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:44:10,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfc414000c489abc2c2455 HTTP/1.1" 200 None 2026-04-05 13:44:10,323 - lava_callback - DEBUG - Processing node 69cfc414000c489abc2c2455: baseline-arm64-clabbe 2026-04-05 13:44:10,323 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfc414000c489abc2c2455 2026-04-05 13:44:10,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:44:10,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfc414000c489abc2c2455 HTTP/1.1" 200 None 2026-04-05 13:44:10,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:44:10,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-05 13:44:10,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:44:10,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfc414000c489abc2c2455 HTTP/1.1" 200 None 2026-04-05 13:44:10,382 - lava_callback - ERROR - Error processing callback for node 69cfc414000c489abc2c2455: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42306 - "GET / HTTP/1.0" 200 OK 2026-04-05 13:45:10,372 - lava_callback - INFO - Received callback for node 69cfc458000c489abc2c249e INFO: 172.21.0.1:52846 - "POST /node/69cfc458000c489abc2c249e HTTP/1.0" 202 Accepted 2026-04-05 13:45:10,377 - lava_callback - INFO - Starting async job submit for node 69cfc458000c489abc2c249e 2026-04-05 13:45:10,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:45:10,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfc458000c489abc2c249e HTTP/1.1" 200 None 2026-04-05 13:45:10,392 - lava_callback - DEBUG - Processing node 69cfc458000c489abc2c249e: baseline-arm64-clabbe 2026-04-05 13:45:10,392 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfc458000c489abc2c249e 2026-04-05 13:45:10,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:45:10,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfc458000c489abc2c249e HTTP/1.1" 200 None 2026-04-05 13:45:10,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:45:10,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-05 13:45:10,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:45:10,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfc458000c489abc2c249e HTTP/1.1" 200 None 2026-04-05 13:45:10,443 - lava_callback - ERROR - Error processing callback for node 69cfc458000c489abc2c249e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39064 - "GET / HTTP/1.0" 200 OK 2026-04-05 13:46:30,429 - lava_callback - INFO - Received callback for node 69cfc4a0000c489abc2c24d1 INFO: 172.21.0.1:56710 - "POST /node/69cfc4a0000c489abc2c24d1 HTTP/1.0" 202 Accepted 2026-04-05 13:46:30,439 - lava_callback - INFO - Starting async job submit for node 69cfc4a0000c489abc2c24d1 2026-04-05 13:46:30,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:46:30,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfc4a0000c489abc2c24d1 HTTP/1.1" 200 None 2026-04-05 13:46:30,455 - lava_callback - DEBUG - Processing node 69cfc4a0000c489abc2c24d1: baseline-arm64-clabbe 2026-04-05 13:46:30,455 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfc4a0000c489abc2c24d1 2026-04-05 13:46:30,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:46:30,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfc4a0000c489abc2c24d1 HTTP/1.1" 200 None 2026-04-05 13:46:30,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:46:30,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-05 13:46:30,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:46:30,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfc4a0000c489abc2c24d1 HTTP/1.1" 200 None 2026-04-05 13:46:30,511 - lava_callback - ERROR - Error processing callback for node 69cfc4a0000c489abc2c24d1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40318 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58024 - "GET / HTTP/1.0" 200 OK 2026-04-05 13:47:30,528 - lava_callback - INFO - Received callback for node 69cfc4e5000c489abc2c2506 INFO: 172.21.0.1:44130 - "POST /node/69cfc4e5000c489abc2c2506 HTTP/1.0" 202 Accepted 2026-04-05 13:47:30,533 - lava_callback - INFO - Starting async job submit for node 69cfc4e5000c489abc2c2506 2026-04-05 13:47:30,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:47:30,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfc4e5000c489abc2c2506 HTTP/1.1" 200 None 2026-04-05 13:47:30,568 - lava_callback - DEBUG - Processing node 69cfc4e5000c489abc2c2506: baseline-arm64-clabbe 2026-04-05 13:47:30,568 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfc4e5000c489abc2c2506 2026-04-05 13:47:30,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:47:30,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfc4e5000c489abc2c2506 HTTP/1.1" 200 None 2026-04-05 13:47:30,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:47:30,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-05 13:47:30,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:47:30,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfc4e5000c489abc2c2506 HTTP/1.1" 200 None 2026-04-05 13:47:30,639 - lava_callback - ERROR - Error processing callback for node 69cfc4e5000c489abc2c2506: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32968 - "GET / HTTP/1.0" 200 OK 2026-04-05 13:50:12,805 - lava_callback - INFO - Received callback for node 69cfc580000c489abc2c2558 INFO: 172.21.0.1:42756 - "POST /node/69cfc580000c489abc2c2558 HTTP/1.0" 202 Accepted 2026-04-05 13:50:12,811 - lava_callback - INFO - Starting async job submit for node 69cfc580000c489abc2c2558 2026-04-05 13:50:12,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:50:12,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfc580000c489abc2c2558 HTTP/1.1" 200 None 2026-04-05 13:50:12,827 - lava_callback - DEBUG - Processing node 69cfc580000c489abc2c2558: baseline-arm64-baylibre 2026-04-05 13:50:12,828 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfc580000c489abc2c2558 2026-04-05 13:50:12,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:50:12,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfc580000c489abc2c2558 HTTP/1.1" 200 None 2026-04-05 13:50:12,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:50:12,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-05 13:50:12,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:50:12,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfc580000c489abc2c2558 HTTP/1.1" 200 None 2026-04-05 13:50:12,887 - lava_callback - ERROR - Error processing callback for node 69cfc580000c489abc2c2558: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42606 - "GET / HTTP/1.0" 200 OK 2026-04-05 13:56:13,252 - lava_callback - INFO - Received callback for node 69cfc6ea000c489abc2c2599 INFO: 172.21.0.1:40690 - "POST /node/69cfc6ea000c489abc2c2599 HTTP/1.0" 202 Accepted 2026-04-05 13:56:13,258 - lava_callback - INFO - Starting async job submit for node 69cfc6ea000c489abc2c2599 2026-04-05 13:56:13,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:56:13,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfc6ea000c489abc2c2599 HTTP/1.1" 200 None 2026-04-05 13:56:13,275 - lava_callback - DEBUG - Processing node 69cfc6ea000c489abc2c2599: baseline-arm64-baylibre 2026-04-05 13:56:13,275 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfc6ea000c489abc2c2599 2026-04-05 13:56:13,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:56:13,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfc6ea000c489abc2c2599 HTTP/1.1" 200 None 2026-04-05 13:56:13,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:56:13,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-05 13:56:13,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:56:13,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfc6ea000c489abc2c2599 HTTP/1.1" 200 None 2026-04-05 13:56:13,339 - lava_callback - ERROR - Error processing callback for node 69cfc6ea000c489abc2c2599: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51748 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43576 - "GET / HTTP/1.0" 200 OK 2026-04-05 13:58:13,258 - lava_callback - INFO - Received callback for node 69cfc763000c489abc2c25bd INFO: 172.21.0.1:34776 - "POST /node/69cfc763000c489abc2c25bd HTTP/1.0" 202 Accepted 2026-04-05 13:58:13,264 - lava_callback - INFO - Starting async job submit for node 69cfc763000c489abc2c25bd 2026-04-05 13:58:13,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:58:13,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfc763000c489abc2c25bd HTTP/1.1" 200 None 2026-04-05 13:58:13,280 - lava_callback - DEBUG - Processing node 69cfc763000c489abc2c25bd: baseline-arm64-baylibre 2026-04-05 13:58:13,280 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfc763000c489abc2c25bd 2026-04-05 13:58:13,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:58:13,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfc763000c489abc2c25bd HTTP/1.1" 200 None 2026-04-05 13:58:13,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:58:13,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-05 13:58:13,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 13:58:13,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfc763000c489abc2c25bd HTTP/1.1" 200 None 2026-04-05 13:58:13,348 - lava_callback - ERROR - Error processing callback for node 69cfc763000c489abc2c25bd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58192 - "GET / HTTP/1.0" 200 OK 2026-04-05 14:01:11,218 - lava_callback - INFO - Received callback for node 69cfc81d000c489abc2c25f5 INFO: 172.21.0.1:53130 - "POST /node/69cfc81d000c489abc2c25f5 HTTP/1.0" 202 Accepted 2026-04-05 14:01:11,224 - lava_callback - INFO - Starting async job submit for node 69cfc81d000c489abc2c25f5 2026-04-05 14:01:11,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:01:11,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfc81d000c489abc2c25f5 HTTP/1.1" 200 None 2026-04-05 14:01:11,244 - lava_callback - DEBUG - Processing node 69cfc81d000c489abc2c25f5: baseline-arm64-clabbe 2026-04-05 14:01:11,245 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfc81d000c489abc2c25f5 2026-04-05 14:01:11,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:01:11,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfc81d000c489abc2c25f5 HTTP/1.1" 200 None 2026-04-05 14:01:11,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:01:11,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-05 14:01:11,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:01:11,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfc81d000c489abc2c25f5 HTTP/1.1" 200 None 2026-04-05 14:01:11,310 - lava_callback - ERROR - Error processing callback for node 69cfc81d000c489abc2c25f5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59192 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48026 - "GET / HTTP/1.0" 200 OK 2026-04-05 14:02:31,223 - lava_callback - INFO - Received callback for node 69cfc864000c489abc2c2630 INFO: 172.21.0.1:49254 - "POST /node/69cfc864000c489abc2c2630 HTTP/1.0" 202 Accepted 2026-04-05 14:02:31,228 - lava_callback - INFO - Starting async job submit for node 69cfc864000c489abc2c2630 2026-04-05 14:02:31,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:02:31,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfc864000c489abc2c2630 HTTP/1.1" 200 None 2026-04-05 14:02:31,416 - lava_callback - DEBUG - Processing node 69cfc864000c489abc2c2630: baseline-arm64-clabbe 2026-04-05 14:02:31,416 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfc864000c489abc2c2630 2026-04-05 14:02:31,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:02:31,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfc864000c489abc2c2630 HTTP/1.1" 200 None 2026-04-05 14:02:31,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:02:31,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-05 14:02:31,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:02:31,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfc864000c489abc2c2630 HTTP/1.1" 200 None 2026-04-05 14:02:31,468 - lava_callback - ERROR - Error processing callback for node 69cfc864000c489abc2c2630: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57286 - "GET / HTTP/1.0" 200 OK 2026-04-05 14:06:11,368 - lava_callback - INFO - Received callback for node 69cfc949000c489abc2c266c INFO: 172.21.0.1:44882 - "POST /node/69cfc949000c489abc2c266c HTTP/1.0" 202 Accepted 2026-04-05 14:06:11,373 - lava_callback - INFO - Starting async job submit for node 69cfc949000c489abc2c266c 2026-04-05 14:06:11,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:06:11,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfc949000c489abc2c266c HTTP/1.1" 200 None 2026-04-05 14:06:11,409 - lava_callback - DEBUG - Processing node 69cfc949000c489abc2c266c: baseline-arm64-clabbe 2026-04-05 14:06:11,410 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfc949000c489abc2c266c 2026-04-05 14:06:11,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:06:11,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfc949000c489abc2c266c HTTP/1.1" 200 None 2026-04-05 14:06:11,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:06:11,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-05 14:06:11,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:06:11,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfc949000c489abc2c266c HTTP/1.1" 200 None 2026-04-05 14:06:11,466 - lava_callback - ERROR - Error processing callback for node 69cfc949000c489abc2c266c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51340 - "GET / HTTP/1.0" 200 OK 2026-04-05 14:07:31,426 - lava_callback - INFO - Received callback for node 69cfc98f000c489abc2c26a6 INFO: 172.21.0.1:41290 - "POST /node/69cfc98f000c489abc2c26a6 HTTP/1.0" 202 Accepted 2026-04-05 14:07:31,432 - lava_callback - INFO - Starting async job submit for node 69cfc98f000c489abc2c26a6 2026-04-05 14:07:31,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:07:31,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfc98f000c489abc2c26a6 HTTP/1.1" 200 None 2026-04-05 14:07:31,457 - lava_callback - DEBUG - Processing node 69cfc98f000c489abc2c26a6: baseline-arm64-clabbe 2026-04-05 14:07:31,457 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfc98f000c489abc2c26a6 2026-04-05 14:07:31,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:07:31,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfc98f000c489abc2c26a6 HTTP/1.1" 200 None 2026-04-05 14:07:31,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:07:31,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-05 14:07:31,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:07:31,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfc98f000c489abc2c26a6 HTTP/1.1" 200 None 2026-04-05 14:07:31,520 - lava_callback - ERROR - Error processing callback for node 69cfc98f000c489abc2c26a6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47540 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38322 - "GET / HTTP/1.0" 200 OK 2026-04-05 14:09:11,525 - lava_callback - INFO - Received callback for node 69cfc9fc000c489abc2c26d0 INFO: 172.21.0.1:48788 - "POST /node/69cfc9fc000c489abc2c26d0 HTTP/1.0" 202 Accepted 2026-04-05 14:09:11,534 - lava_callback - INFO - Starting async job submit for node 69cfc9fc000c489abc2c26d0 2026-04-05 14:09:11,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:09:11,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfc9fc000c489abc2c26d0 HTTP/1.1" 200 None 2026-04-05 14:09:11,556 - lava_callback - DEBUG - Processing node 69cfc9fc000c489abc2c26d0: baseline-arm64-clabbe 2026-04-05 14:09:11,557 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfc9fc000c489abc2c26d0 2026-04-05 14:09:11,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:09:11,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfc9fc000c489abc2c26d0 HTTP/1.1" 200 None 2026-04-05 14:09:11,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:09:11,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-05 14:09:11,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:09:11,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfc9fc000c489abc2c26d0 HTTP/1.1" 200 None 2026-04-05 14:09:11,627 - lava_callback - ERROR - Error processing callback for node 69cfc9fc000c489abc2c26d0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45884 - "GET / HTTP/1.0" 200 OK 2026-04-05 14:12:11,638 - lava_callback - INFO - Received callback for node 69cfcab1000c489abc2c2701 INFO: 172.21.0.1:58872 - "POST /node/69cfcab1000c489abc2c2701 HTTP/1.0" 202 Accepted 2026-04-05 14:12:11,644 - lava_callback - INFO - Starting async job submit for node 69cfcab1000c489abc2c2701 2026-04-05 14:12:11,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:12:11,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfcab1000c489abc2c2701 HTTP/1.1" 200 None 2026-04-05 14:12:11,660 - lava_callback - DEBUG - Processing node 69cfcab1000c489abc2c2701: baseline-arm64-clabbe 2026-04-05 14:12:11,661 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfcab1000c489abc2c2701 2026-04-05 14:12:11,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:12:11,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfcab1000c489abc2c2701 HTTP/1.1" 200 None 2026-04-05 14:12:11,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:12:11,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-05 14:12:11,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:12:11,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfcab1000c489abc2c2701 HTTP/1.1" 200 None 2026-04-05 14:12:11,716 - lava_callback - ERROR - Error processing callback for node 69cfcab1000c489abc2c2701: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54162 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49558 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43374 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39086 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48540 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36242 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54254 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33264 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38456 - "GET / HTTP/1.0" 200 OK 2026-04-05 14:38:55,832 - lava_callback - INFO - Received callback for node 69cfd0f5000c489abc2c275e INFO: 172.21.0.1:56494 - "POST /node/69cfd0f5000c489abc2c275e HTTP/1.0" 202 Accepted 2026-04-05 14:38:55,837 - lava_callback - INFO - Starting async job submit for node 69cfd0f5000c489abc2c275e 2026-04-05 14:38:55,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:38:55,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd0f5000c489abc2c275e HTTP/1.1" 200 None 2026-04-05 14:38:55,854 - lava_callback - DEBUG - Processing node 69cfd0f5000c489abc2c275e: baseline-arm-baylibre 2026-04-05 14:38:55,855 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfd0f5000c489abc2c275e 2026-04-05 14:38:55,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:38:55,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd0f5000c489abc2c275e HTTP/1.1" 200 None 2026-04-05 14:38:55,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:38:55,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-05 14:38:55,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:38:55,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfd0f5000c489abc2c275e HTTP/1.1" 200 None 2026-04-05 14:38:55,907 - lava_callback - ERROR - Error processing callback for node 69cfd0f5000c489abc2c275e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39612 - "GET / HTTP/1.0" 200 OK 2026-04-05 14:39:35,455 - lava_callback - INFO - Received callback for node 69cfd119000c489abc2c2768 INFO: 172.21.0.1:54162 - "POST /node/69cfd119000c489abc2c2768 HTTP/1.0" 202 Accepted 2026-04-05 14:39:35,461 - lava_callback - INFO - Starting async job submit for node 69cfd119000c489abc2c2768 2026-04-05 14:39:35,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:39:35,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd119000c489abc2c2768 HTTP/1.1" 200 None 2026-04-05 14:39:35,478 - lava_callback - DEBUG - Processing node 69cfd119000c489abc2c2768: baseline-arm-baylibre 2026-04-05 14:39:35,478 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfd119000c489abc2c2768 2026-04-05 14:39:35,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:39:35,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd119000c489abc2c2768 HTTP/1.1" 200 None 2026-04-05 14:39:35,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:39:35,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-05 14:39:35,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:39:35,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfd119000c489abc2c2768 HTTP/1.1" 200 None 2026-04-05 14:39:35,548 - lava_callback - ERROR - Error processing callback for node 69cfd119000c489abc2c2768: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36702 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-05 14:40:15,547 - lava_callback - INFO - Received callback for node 69cfd13d000c489abc2c27a4 INFO: 172.21.0.1:36708 - "POST /node/69cfd13d000c489abc2c27a4 HTTP/1.0" 202 Accepted 2026-04-05 14:40:15,553 - lava_callback - INFO - Starting async job submit for node 69cfd13d000c489abc2c27a4 2026-04-05 14:40:15,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:40:15,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd13d000c489abc2c27a4 HTTP/1.1" 200 None 2026-04-05 14:40:15,574 - lava_callback - DEBUG - Processing node 69cfd13d000c489abc2c27a4: baseline-arm-baylibre 2026-04-05 14:40:15,574 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfd13d000c489abc2c27a4 2026-04-05 14:40:15,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:40:15,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd13d000c489abc2c27a4 HTTP/1.1" 200 None 2026-04-05 14:40:15,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:40:15,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-05 14:40:15,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:40:15,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfd13d000c489abc2c27a4 HTTP/1.1" 200 None 2026-04-05 14:40:15,644 - lava_callback - ERROR - Error processing callback for node 69cfd13d000c489abc2c27a4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52684 - "GET / HTTP/1.0" 200 OK 2026-04-05 14:40:55,557 - lava_callback - INFO - Received callback for node 69cfd162000c489abc2c27b4 INFO: 172.21.0.1:41054 - "POST /node/69cfd162000c489abc2c27b4 HTTP/1.0" 202 Accepted 2026-04-05 14:40:55,563 - lava_callback - INFO - Starting async job submit for node 69cfd162000c489abc2c27b4 2026-04-05 14:40:55,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:40:55,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd162000c489abc2c27b4 HTTP/1.1" 200 None 2026-04-05 14:40:55,579 - lava_callback - DEBUG - Processing node 69cfd162000c489abc2c27b4: baseline-arm-baylibre 2026-04-05 14:40:55,580 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfd162000c489abc2c27b4 2026-04-05 14:40:55,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:40:55,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd162000c489abc2c27b4 HTTP/1.1" 200 None 2026-04-05 14:40:55,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:40:55,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-05 14:40:55,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:40:55,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfd162000c489abc2c27b4 HTTP/1.1" 200 None 2026-04-05 14:40:55,647 - lava_callback - ERROR - Error processing callback for node 69cfd162000c489abc2c27b4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33376 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-05 14:41:15,541 - lava_callback - INFO - Received callback for node 69cfd185000c489abc2c27d2 INFO: 172.21.0.1:33378 - "POST /node/69cfd185000c489abc2c27d2 HTTP/1.0" 202 Accepted 2026-04-05 14:41:15,547 - lava_callback - INFO - Starting async job submit for node 69cfd185000c489abc2c27d2 2026-04-05 14:41:15,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:41:15,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd185000c489abc2c27d2 HTTP/1.1" 200 None 2026-04-05 14:41:15,564 - lava_callback - DEBUG - Processing node 69cfd185000c489abc2c27d2: baseline-arm-baylibre 2026-04-05 14:41:15,564 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfd185000c489abc2c27d2 2026-04-05 14:41:15,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:41:15,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd185000c489abc2c27d2 HTTP/1.1" 200 None 2026-04-05 14:41:15,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:41:15,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-05 14:41:15,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:41:15,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfd185000c489abc2c27d2 HTTP/1.1" 200 None 2026-04-05 14:41:15,625 - lava_callback - ERROR - Error processing callback for node 69cfd185000c489abc2c27d2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47194 - "GET / HTTP/1.0" 200 OK 2026-04-05 14:41:53,155 - lava_callback - INFO - Received callback for node 69cfd1ab000c489abc2c27f0 INFO: 172.21.0.1:52440 - "POST /node/69cfd1ab000c489abc2c27f0 HTTP/1.0" 202 Accepted 2026-04-05 14:41:53,161 - lava_callback - INFO - Starting async job submit for node 69cfd1ab000c489abc2c27f0 2026-04-05 14:41:53,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:41:53,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd1ab000c489abc2c27f0 HTTP/1.1" 200 None 2026-04-05 14:41:53,176 - lava_callback - DEBUG - Processing node 69cfd1ab000c489abc2c27f0: baseline-arm-clabbe 2026-04-05 14:41:53,176 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfd1ab000c489abc2c27f0 2026-04-05 14:41:53,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:41:53,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd1ab000c489abc2c27f0 HTTP/1.1" 200 None 2026-04-05 14:41:53,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:41:53,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-05 14:41:53,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:41:53,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfd1ab000c489abc2c27f0 HTTP/1.1" 200 None 2026-04-05 14:41:53,232 - lava_callback - ERROR - Error processing callback for node 69cfd1ab000c489abc2c27f0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47540 - "GET / HTTP/1.0" 200 OK 2026-04-05 14:42:33,084 - lava_callback - INFO - Received callback for node 69cfd1cf000c489abc2c2835 INFO: 172.21.0.1:36430 - "POST /node/69cfd1cf000c489abc2c2835 HTTP/1.0" 202 Accepted 2026-04-05 14:42:33,090 - lava_callback - INFO - Starting async job submit for node 69cfd1cf000c489abc2c2835 2026-04-05 14:42:33,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:42:33,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd1cf000c489abc2c2835 HTTP/1.1" 200 None 2026-04-05 14:42:33,110 - lava_callback - DEBUG - Processing node 69cfd1cf000c489abc2c2835: baseline-arm-clabbe 2026-04-05 14:42:33,110 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfd1cf000c489abc2c2835 2026-04-05 14:42:33,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:42:33,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd1cf000c489abc2c2835 HTTP/1.1" 200 None 2026-04-05 14:42:33,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:42:33,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-05 14:42:33,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:42:33,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfd1cf000c489abc2c2835 HTTP/1.1" 200 None 2026-04-05 14:42:33,182 - lava_callback - ERROR - Error processing callback for node 69cfd1cf000c489abc2c2835: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42068 - "GET / HTTP/1.0" 200 OK 2026-04-05 14:43:13,199 - lava_callback - INFO - Received callback for node 69cfd1f6000c489abc2c284f INFO: 172.21.0.1:45192 - "POST /node/69cfd1f6000c489abc2c284f HTTP/1.0" 202 Accepted 2026-04-05 14:43:13,208 - lava_callback - INFO - Starting async job submit for node 69cfd1f6000c489abc2c284f 2026-04-05 14:43:13,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:43:13,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd1f6000c489abc2c284f HTTP/1.1" 200 None 2026-04-05 14:43:13,224 - lava_callback - DEBUG - Processing node 69cfd1f6000c489abc2c284f: baseline-arm-clabbe 2026-04-05 14:43:13,225 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfd1f6000c489abc2c284f 2026-04-05 14:43:13,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:43:13,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd1f6000c489abc2c284f HTTP/1.1" 200 None 2026-04-05 14:43:13,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:43:13,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-05 14:43:13,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:43:13,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfd1f6000c489abc2c284f HTTP/1.1" 200 None 2026-04-05 14:43:13,330 - lava_callback - ERROR - Error processing callback for node 69cfd1f6000c489abc2c284f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56742 - "GET / HTTP/1.0" 200 OK 2026-04-05 14:43:53,125 - lava_callback - INFO - Received callback for node 69cfd21a000c489abc2c286b INFO: 172.21.0.1:35352 - "POST /node/69cfd21a000c489abc2c286b HTTP/1.0" 202 Accepted 2026-04-05 14:43:53,131 - lava_callback - INFO - Starting async job submit for node 69cfd21a000c489abc2c286b 2026-04-05 14:43:53,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:43:53,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd21a000c489abc2c286b HTTP/1.1" 200 None 2026-04-05 14:43:53,147 - lava_callback - DEBUG - Processing node 69cfd21a000c489abc2c286b: baseline-arm-clabbe 2026-04-05 14:43:53,147 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfd21a000c489abc2c286b 2026-04-05 14:43:53,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:43:53,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd21a000c489abc2c286b HTTP/1.1" 200 None 2026-04-05 14:43:53,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:43:53,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-05 14:43:53,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:43:53,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfd21a000c489abc2c286b HTTP/1.1" 200 None 2026-04-05 14:43:53,206 - lava_callback - ERROR - Error processing callback for node 69cfd21a000c489abc2c286b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48140 - "GET / HTTP/1.0" 200 OK 2026-04-05 14:44:13,211 - lava_callback - INFO - Received callback for node 69cfd23a000c489abc2c28a7 INFO: 172.21.0.1:52138 - "POST /node/69cfd23a000c489abc2c28a7 HTTP/1.0" 202 Accepted 2026-04-05 14:44:13,216 - lava_callback - INFO - Starting async job submit for node 69cfd23a000c489abc2c28a7 2026-04-05 14:44:13,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:44:13,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd23a000c489abc2c28a7 HTTP/1.1" 200 None 2026-04-05 14:44:13,232 - lava_callback - DEBUG - Processing node 69cfd23a000c489abc2c28a7: baseline-arm-clabbe 2026-04-05 14:44:13,232 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfd23a000c489abc2c28a7 2026-04-05 14:44:13,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:44:13,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd23a000c489abc2c28a7 HTTP/1.1" 200 None 2026-04-05 14:44:13,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:44:13,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-05 14:44:13,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:44:13,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfd23a000c489abc2c28a7 HTTP/1.1" 200 None 2026-04-05 14:44:13,292 - lava_callback - ERROR - Error processing callback for node 69cfd23a000c489abc2c28a7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49848 - "GET / HTTP/1.0" 200 OK 2026-04-05 14:46:13,258 - lava_callback - INFO - Received callback for node 69cfd29f000c489abc2c28ce INFO: 172.21.0.1:48606 - "POST /node/69cfd29f000c489abc2c28ce HTTP/1.0" 202 Accepted 2026-04-05 14:46:13,266 - lava_callback - INFO - Starting async job submit for node 69cfd29f000c489abc2c28ce 2026-04-05 14:46:13,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:46:13,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd29f000c489abc2c28ce HTTP/1.1" 200 None 2026-04-05 14:46:13,287 - lava_callback - DEBUG - Processing node 69cfd29f000c489abc2c28ce: baseline-arm-clabbe 2026-04-05 14:46:13,288 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfd29f000c489abc2c28ce 2026-04-05 14:46:13,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:46:13,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd29f000c489abc2c28ce HTTP/1.1" 200 None 2026-04-05 14:46:13,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:46:13,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-05 14:46:13,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:46:13,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfd29f000c489abc2c28ce HTTP/1.1" 200 None 2026-04-05 14:46:13,348 - lava_callback - ERROR - Error processing callback for node 69cfd29f000c489abc2c28ce: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52166 - "GET / HTTP/1.0" 200 OK 2026-04-05 14:46:33,256 - lava_callback - INFO - Received callback for node 69cfd2c6000c489abc2c28ec INFO: 172.21.0.1:58778 - "POST /node/69cfd2c6000c489abc2c28ec HTTP/1.0" 202 Accepted 2026-04-05 14:46:33,262 - lava_callback - INFO - Starting async job submit for node 69cfd2c6000c489abc2c28ec 2026-04-05 14:46:33,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:46:33,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd2c6000c489abc2c28ec HTTP/1.1" 200 None 2026-04-05 14:46:33,280 - lava_callback - DEBUG - Processing node 69cfd2c6000c489abc2c28ec: baseline-arm-clabbe 2026-04-05 14:46:33,280 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfd2c6000c489abc2c28ec 2026-04-05 14:46:33,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:46:33,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd2c6000c489abc2c28ec HTTP/1.1" 200 None 2026-04-05 14:46:33,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:46:33,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-05 14:46:33,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:46:33,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfd2c6000c489abc2c28ec HTTP/1.1" 200 None 2026-04-05 14:46:33,333 - lava_callback - ERROR - Error processing callback for node 69cfd2c6000c489abc2c28ec: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53160 - "GET / HTTP/1.0" 200 OK 2026-04-05 14:47:13,310 - lava_callback - INFO - Received callback for node 69cfd2ea000c489abc2c2910 INFO: 172.21.0.1:48766 - "POST /node/69cfd2ea000c489abc2c2910 HTTP/1.0" 202 Accepted 2026-04-05 14:47:13,315 - lava_callback - INFO - Starting async job submit for node 69cfd2ea000c489abc2c2910 2026-04-05 14:47:13,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:47:13,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd2ea000c489abc2c2910 HTTP/1.1" 200 None 2026-04-05 14:47:13,340 - lava_callback - DEBUG - Processing node 69cfd2ea000c489abc2c2910: baseline-arm-clabbe 2026-04-05 14:47:13,340 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfd2ea000c489abc2c2910 2026-04-05 14:47:13,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:47:13,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd2ea000c489abc2c2910 HTTP/1.1" 200 None 2026-04-05 14:47:13,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:47:13,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-05 14:47:13,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:47:13,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfd2ea000c489abc2c2910 HTTP/1.1" 200 None 2026-04-05 14:47:13,400 - lava_callback - ERROR - Error processing callback for node 69cfd2ea000c489abc2c2910: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58528 - "GET / HTTP/1.0" 200 OK 2026-04-05 14:47:53,311 - lava_callback - INFO - Received callback for node 69cfd30f000c489abc2c2927 INFO: 172.21.0.1:59158 - "POST /node/69cfd30f000c489abc2c2927 HTTP/1.0" 202 Accepted 2026-04-05 14:47:53,317 - lava_callback - INFO - Starting async job submit for node 69cfd30f000c489abc2c2927 2026-04-05 14:47:53,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:47:53,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd30f000c489abc2c2927 HTTP/1.1" 200 None 2026-04-05 14:47:53,332 - lava_callback - DEBUG - Processing node 69cfd30f000c489abc2c2927: baseline-arm-clabbe 2026-04-05 14:47:53,332 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfd30f000c489abc2c2927 2026-04-05 14:47:53,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:47:53,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd30f000c489abc2c2927 HTTP/1.1" 200 None 2026-04-05 14:47:53,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:47:53,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-05 14:47:53,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:47:53,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfd30f000c489abc2c2927 HTTP/1.1" 200 None 2026-04-05 14:47:53,387 - lava_callback - ERROR - Error processing callback for node 69cfd30f000c489abc2c2927: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48922 - "GET / HTTP/1.0" 200 OK 2026-04-05 14:48:33,363 - lava_callback - INFO - Received callback for node 69cfd335000c489abc2c2942 INFO: 172.21.0.1:57730 - "POST /node/69cfd335000c489abc2c2942 HTTP/1.0" 202 Accepted 2026-04-05 14:48:33,368 - lava_callback - INFO - Starting async job submit for node 69cfd335000c489abc2c2942 2026-04-05 14:48:33,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:48:33,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd335000c489abc2c2942 HTTP/1.1" 200 None 2026-04-05 14:48:33,391 - lava_callback - DEBUG - Processing node 69cfd335000c489abc2c2942: baseline-arm-clabbe 2026-04-05 14:48:33,391 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfd335000c489abc2c2942 2026-04-05 14:48:33,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:48:33,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd335000c489abc2c2942 HTTP/1.1" 200 None 2026-04-05 14:48:33,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:48:33,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-05 14:48:33,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:48:33,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfd335000c489abc2c2942 HTTP/1.1" 200 None 2026-04-05 14:48:33,442 - lava_callback - ERROR - Error processing callback for node 69cfd335000c489abc2c2942: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48956 - "GET / HTTP/1.0" 200 OK 2026-04-05 14:49:13,383 - lava_callback - INFO - Received callback for node 69cfd358000c489abc2c2986 INFO: 172.21.0.1:57700 - "POST /node/69cfd358000c489abc2c2986 HTTP/1.0" 202 Accepted 2026-04-05 14:49:13,389 - lava_callback - INFO - Starting async job submit for node 69cfd358000c489abc2c2986 2026-04-05 14:49:13,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:49:13,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd358000c489abc2c2986 HTTP/1.1" 200 None 2026-04-05 14:49:13,411 - lava_callback - DEBUG - Processing node 69cfd358000c489abc2c2986: baseline-arm-clabbe 2026-04-05 14:49:13,412 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfd358000c489abc2c2986 2026-04-05 14:49:13,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:49:13,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd358000c489abc2c2986 HTTP/1.1" 200 None 2026-04-05 14:49:13,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:49:13,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-05 14:49:13,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:49:13,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfd358000c489abc2c2986 HTTP/1.1" 200 None 2026-04-05 14:49:13,477 - lava_callback - ERROR - Error processing callback for node 69cfd358000c489abc2c2986: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44286 - "GET / HTTP/1.0" 200 OK 2026-04-05 14:49:53,602 - lava_callback - INFO - Received callback for node 69cfd37c000c489abc2c29b5 INFO: 172.21.0.1:58112 - "POST /node/69cfd37c000c489abc2c29b5 HTTP/1.0" 202 Accepted 2026-04-05 14:49:53,608 - lava_callback - INFO - Starting async job submit for node 69cfd37c000c489abc2c29b5 2026-04-05 14:49:53,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:49:53,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd37c000c489abc2c29b5 HTTP/1.1" 200 None 2026-04-05 14:49:53,635 - lava_callback - DEBUG - Processing node 69cfd37c000c489abc2c29b5: baseline-arm-clabbe 2026-04-05 14:49:53,635 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfd37c000c489abc2c29b5 2026-04-05 14:49:53,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:49:53,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd37c000c489abc2c29b5 HTTP/1.1" 200 None 2026-04-05 14:49:53,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:49:53,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-05 14:49:53,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:49:53,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfd37c000c489abc2c29b5 HTTP/1.1" 200 None 2026-04-05 14:49:53,707 - lava_callback - ERROR - Error processing callback for node 69cfd37c000c489abc2c29b5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52004 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-05 14:55:16,351 - lava_callback - INFO - Received callback for node 69cfd4c7000c489abc2c2adb INFO: 172.21.0.1:52014 - "POST /node/69cfd4c7000c489abc2c2adb HTTP/1.0" 202 Accepted 2026-04-05 14:55:16,357 - lava_callback - INFO - Starting async job submit for node 69cfd4c7000c489abc2c2adb 2026-04-05 14:55:16,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:55:16,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd4c7000c489abc2c2adb HTTP/1.1" 200 None 2026-04-05 14:55:16,379 - lava_callback - DEBUG - Processing node 69cfd4c7000c489abc2c2adb: baseline-arm64-baylibre 2026-04-05 14:55:16,379 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfd4c7000c489abc2c2adb 2026-04-05 14:55:16,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:55:16,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd4c7000c489abc2c2adb HTTP/1.1" 200 None 2026-04-05 14:55:16,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:55:16,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-05 14:55:16,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:55:16,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfd4c7000c489abc2c2adb HTTP/1.1" 200 None 2026-04-05 14:55:16,439 - lava_callback - ERROR - Error processing callback for node 69cfd4c7000c489abc2c2adb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56792 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-05 14:56:16,446 - lava_callback - INFO - Received callback for node 69cfd50e000c489abc2c2b1a INFO: 172.21.0.1:56806 - "POST /node/69cfd50e000c489abc2c2b1a HTTP/1.0" 202 Accepted 2026-04-05 14:56:16,451 - lava_callback - INFO - Starting async job submit for node 69cfd50e000c489abc2c2b1a 2026-04-05 14:56:16,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:56:16,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd50e000c489abc2c2b1a HTTP/1.1" 200 None 2026-04-05 14:56:16,468 - lava_callback - DEBUG - Processing node 69cfd50e000c489abc2c2b1a: baseline-arm64-baylibre 2026-04-05 14:56:16,468 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfd50e000c489abc2c2b1a 2026-04-05 14:56:16,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:56:16,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd50e000c489abc2c2b1a HTTP/1.1" 200 None 2026-04-05 14:56:16,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:56:16,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-05 14:56:16,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:56810 - "GET / HTTP/1.0" 200 OK 2026-04-05 14:56:16,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfd50e000c489abc2c2b1a HTTP/1.1" 200 None 2026-04-05 14:56:16,527 - lava_callback - ERROR - Error processing callback for node 69cfd50e000c489abc2c2b1a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50828 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39874 - "GET / HTTP/1.0" 200 OK 2026-04-05 14:57:36,482 - lava_callback - INFO - Received callback for node 69cfd559000c489abc2c2b56 INFO: 172.21.0.1:35614 - "POST /node/69cfd559000c489abc2c2b56 HTTP/1.0" 202 Accepted 2026-04-05 14:57:36,487 - lava_callback - INFO - Starting async job submit for node 69cfd559000c489abc2c2b56 2026-04-05 14:57:36,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:57:36,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd559000c489abc2c2b56 HTTP/1.1" 200 None 2026-04-05 14:57:36,503 - lava_callback - DEBUG - Processing node 69cfd559000c489abc2c2b56: baseline-arm64-baylibre 2026-04-05 14:57:36,504 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfd559000c489abc2c2b56 2026-04-05 14:57:36,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:35628 - "GET / HTTP/1.0" 200 OK 2026-04-05 14:57:36,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd559000c489abc2c2b56 HTTP/1.1" 200 None 2026-04-05 14:57:36,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:57:36,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-05 14:57:36,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:57:36,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfd559000c489abc2c2b56 HTTP/1.1" 200 None 2026-04-05 14:57:36,582 - lava_callback - ERROR - Error processing callback for node 69cfd559000c489abc2c2b56: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48528 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34610 - "GET / HTTP/1.0" 200 OK 2026-04-05 14:58:53,930 - lava_callback - INFO - Received callback for node 69cfd5a5000c489abc2c2b94 INFO: 172.21.0.1:56246 - "POST /node/69cfd5a5000c489abc2c2b94 HTTP/1.0" 202 Accepted 2026-04-05 14:58:53,936 - lava_callback - INFO - Starting async job submit for node 69cfd5a5000c489abc2c2b94 2026-04-05 14:58:53,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:58:53,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd5a5000c489abc2c2b94 HTTP/1.1" 200 None 2026-04-05 14:58:53,958 - lava_callback - DEBUG - Processing node 69cfd5a5000c489abc2c2b94: baseline-arm64-clabbe 2026-04-05 14:58:53,958 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfd5a5000c489abc2c2b94 2026-04-05 14:58:53,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:58:53,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd5a5000c489abc2c2b94 HTTP/1.1" 200 None 2026-04-05 14:58:53,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:58:53,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-05 14:58:53,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 14:58:54,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfd5a5000c489abc2c2b94 HTTP/1.1" 200 None 2026-04-05 14:58:54,010 - lava_callback - ERROR - Error processing callback for node 69cfd5a5000c489abc2c2b94: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56252 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59382 - "GET / HTTP/1.0" 200 OK 2026-04-05 15:00:13,970 - lava_callback - INFO - Received callback for node 69cfd5ec000c489abc2c2be4 INFO: 172.21.0.1:34112 - "POST /node/69cfd5ec000c489abc2c2be4 HTTP/1.0" 202 Accepted 2026-04-05 15:00:13,979 - lava_callback - INFO - Starting async job submit for node 69cfd5ec000c489abc2c2be4 2026-04-05 15:00:13,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:00:14,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd5ec000c489abc2c2be4 HTTP/1.1" 200 None 2026-04-05 15:00:14,003 - lava_callback - DEBUG - Processing node 69cfd5ec000c489abc2c2be4: baseline-arm64-clabbe 2026-04-05 15:00:14,003 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfd5ec000c489abc2c2be4 2026-04-05 15:00:14,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:00:14,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd5ec000c489abc2c2be4 HTTP/1.1" 200 None 2026-04-05 15:00:14,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:00:14,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-05 15:00:14,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:00:14,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfd5ec000c489abc2c2be4 HTTP/1.1" 200 None 2026-04-05 15:00:14,073 - lava_callback - ERROR - Error processing callback for node 69cfd5ec000c489abc2c2be4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34114 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34698 - "GET / HTTP/1.0" 200 OK 2026-04-05 15:01:14,061 - lava_callback - INFO - Received callback for node 69cfd636000c489abc2c2c10 INFO: 172.21.0.1:60508 - "POST /node/69cfd636000c489abc2c2c10 HTTP/1.0" 202 Accepted 2026-04-05 15:01:14,067 - lava_callback - INFO - Starting async job submit for node 69cfd636000c489abc2c2c10 2026-04-05 15:01:14,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:01:14,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd636000c489abc2c2c10 HTTP/1.1" 200 None 2026-04-05 15:01:14,083 - lava_callback - DEBUG - Processing node 69cfd636000c489abc2c2c10: baseline-arm64-clabbe 2026-04-05 15:01:14,083 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfd636000c489abc2c2c10 2026-04-05 15:01:14,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:01:14,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd636000c489abc2c2c10 HTTP/1.1" 200 None 2026-04-05 15:01:14,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:01:14,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-05 15:01:14,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:01:14,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfd636000c489abc2c2c10 HTTP/1.1" 200 None 2026-04-05 15:01:14,136 - lava_callback - ERROR - Error processing callback for node 69cfd636000c489abc2c2c10: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49984 - "GET / HTTP/1.0" 200 OK 2026-04-05 15:02:34,076 - lava_callback - INFO - Received callback for node 69cfd67c000c489abc2c2c4c INFO: 172.21.0.1:38082 - "POST /node/69cfd67c000c489abc2c2c4c HTTP/1.0" 202 Accepted 2026-04-05 15:02:34,082 - lava_callback - INFO - Starting async job submit for node 69cfd67c000c489abc2c2c4c 2026-04-05 15:02:34,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:02:34,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd67c000c489abc2c2c4c HTTP/1.1" 200 None 2026-04-05 15:02:34,098 - lava_callback - DEBUG - Processing node 69cfd67c000c489abc2c2c4c: baseline-arm64-clabbe 2026-04-05 15:02:34,099 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfd67c000c489abc2c2c4c 2026-04-05 15:02:34,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:02:34,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd67c000c489abc2c2c4c HTTP/1.1" 200 None 2026-04-05 15:02:34,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:02:34,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-05 15:02:34,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:02:34,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfd67c000c489abc2c2c4c HTTP/1.1" 200 None 2026-04-05 15:02:34,167 - lava_callback - ERROR - Error processing callback for node 69cfd67c000c489abc2c2c4c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33472 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36328 - "GET / HTTP/1.0" 200 OK 2026-04-05 15:03:54,145 - lava_callback - INFO - Received callback for node 69cfd6c7000c489abc2c2c79 INFO: 172.21.0.1:50516 - "POST /node/69cfd6c7000c489abc2c2c79 HTTP/1.0" 202 Accepted 2026-04-05 15:03:54,151 - lava_callback - INFO - Starting async job submit for node 69cfd6c7000c489abc2c2c79 2026-04-05 15:03:54,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:03:54,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd6c7000c489abc2c2c79 HTTP/1.1" 200 None 2026-04-05 15:03:54,167 - lava_callback - DEBUG - Processing node 69cfd6c7000c489abc2c2c79: baseline-arm64-clabbe 2026-04-05 15:03:54,167 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfd6c7000c489abc2c2c79 2026-04-05 15:03:54,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:03:54,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd6c7000c489abc2c2c79 HTTP/1.1" 200 None 2026-04-05 15:03:54,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:03:54,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-05 15:03:54,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:03:54,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfd6c7000c489abc2c2c79 HTTP/1.1" 200 None 2026-04-05 15:03:54,228 - lava_callback - ERROR - Error processing callback for node 69cfd6c7000c489abc2c2c79: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36090 - "GET / HTTP/1.0" 200 OK 2026-04-05 15:04:54,184 - lava_callback - INFO - Received callback for node 69cfd70a000c489abc2c2ccb INFO: 172.21.0.1:40240 - "POST /node/69cfd70a000c489abc2c2ccb HTTP/1.0" 202 Accepted 2026-04-05 15:04:54,193 - lava_callback - INFO - Starting async job submit for node 69cfd70a000c489abc2c2ccb 2026-04-05 15:04:54,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:04:54,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd70a000c489abc2c2ccb HTTP/1.1" 200 None 2026-04-05 15:04:54,214 - lava_callback - DEBUG - Processing node 69cfd70a000c489abc2c2ccb: baseline-arm64-clabbe 2026-04-05 15:04:54,215 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfd70a000c489abc2c2ccb 2026-04-05 15:04:54,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:04:54,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd70a000c489abc2c2ccb HTTP/1.1" 200 None 2026-04-05 15:04:54,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:04:54,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77bf000c489abc2bf938 HTTP/1.1" 200 None 2026-04-05 15:04:54,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:04:54,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfd70a000c489abc2c2ccb HTTP/1.1" 200 None 2026-04-05 15:04:54,269 - lava_callback - ERROR - Error processing callback for node 69cfd70a000c489abc2c2ccb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50162 - "GET / HTTP/1.0" 200 OK 2026-04-05 15:06:56,964 - lava_callback - INFO - Received callback for node 69cfd785000c489abc2c2d20 INFO: 172.21.0.1:50168 - "POST /node/69cfd785000c489abc2c2d20 HTTP/1.0" 202 Accepted 2026-04-05 15:06:56,969 - lava_callback - INFO - Starting async job submit for node 69cfd785000c489abc2c2d20 2026-04-05 15:06:56,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:06:56,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd785000c489abc2c2d20 HTTP/1.1" 200 None 2026-04-05 15:06:56,985 - lava_callback - DEBUG - Processing node 69cfd785000c489abc2c2d20: baseline-arm-baylibre 2026-04-05 15:06:56,985 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfd785000c489abc2c2d20 2026-04-05 15:06:56,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:06:56,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd785000c489abc2c2d20 HTTP/1.1" 200 None 2026-04-05 15:06:57,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:06:57,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-05 15:06:57,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:06:57,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfd785000c489abc2c2d20 HTTP/1.1" 200 None 2026-04-05 15:06:57,036 - lava_callback - ERROR - Error processing callback for node 69cfd785000c489abc2c2d20: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56496 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42864 - "GET / HTTP/1.0" 200 OK 2026-04-05 15:07:36,915 - lava_callback - INFO - Received callback for node 69cfd7a8000c489abc2c2d46 INFO: 172.21.0.1:42868 - "POST /node/69cfd7a8000c489abc2c2d46 HTTP/1.0" 202 Accepted 2026-04-05 15:07:36,922 - lava_callback - INFO - Starting async job submit for node 69cfd7a8000c489abc2c2d46 2026-04-05 15:07:36,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:07:36,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd7a8000c489abc2c2d46 HTTP/1.1" 200 None 2026-04-05 15:07:36,944 - lava_callback - DEBUG - Processing node 69cfd7a8000c489abc2c2d46: baseline-arm-baylibre 2026-04-05 15:07:36,944 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfd7a8000c489abc2c2d46 2026-04-05 15:07:36,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:07:36,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd7a8000c489abc2c2d46 HTTP/1.1" 200 None 2026-04-05 15:07:36,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:07:36,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-05 15:07:36,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:07:37,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfd7a8000c489abc2c2d46 HTTP/1.1" 200 None 2026-04-05 15:07:37,018 - lava_callback - ERROR - Error processing callback for node 69cfd7a8000c489abc2c2d46: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37056 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37072 - "GET / HTTP/1.0" 200 OK 2026-04-05 15:09:17,053 - lava_callback - INFO - Received callback for node 69cfd80f000c489abc2c2dc0 INFO: 172.21.0.1:37084 - "POST /node/69cfd80f000c489abc2c2dc0 HTTP/1.0" 202 Accepted 2026-04-05 15:09:17,059 - lava_callback - INFO - Starting async job submit for node 69cfd80f000c489abc2c2dc0 2026-04-05 15:09:17,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:09:17,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd80f000c489abc2c2dc0 HTTP/1.1" 200 None 2026-04-05 15:09:17,096 - lava_callback - DEBUG - Processing node 69cfd80f000c489abc2c2dc0: baseline-arm-baylibre 2026-04-05 15:09:17,096 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfd80f000c489abc2c2dc0 2026-04-05 15:09:17,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:09:17,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd80f000c489abc2c2dc0 HTTP/1.1" 200 None 2026-04-05 15:09:17,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:09:17,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-05 15:09:17,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:09:17,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfd80f000c489abc2c2dc0 HTTP/1.1" 200 None 2026-04-05 15:09:17,161 - lava_callback - ERROR - Error processing callback for node 69cfd80f000c489abc2c2dc0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40146 - "GET / HTTP/1.0" 200 OK 2026-04-05 15:09:57,024 - lava_callback - INFO - Received callback for node 69cfd82f000c489abc2c2dea INFO: 172.21.0.1:40160 - "POST /node/69cfd82f000c489abc2c2dea HTTP/1.0" 202 Accepted 2026-04-05 15:09:57,030 - lava_callback - INFO - Starting async job submit for node 69cfd82f000c489abc2c2dea 2026-04-05 15:09:57,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:09:57,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd82f000c489abc2c2dea HTTP/1.1" 200 None 2026-04-05 15:09:57,052 - lava_callback - DEBUG - Processing node 69cfd82f000c489abc2c2dea: baseline-arm-baylibre 2026-04-05 15:09:57,052 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfd82f000c489abc2c2dea 2026-04-05 15:09:57,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:09:57,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd82f000c489abc2c2dea HTTP/1.1" 200 None 2026-04-05 15:09:57,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:09:57,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-05 15:09:57,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:09:57,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfd82f000c489abc2c2dea HTTP/1.1" 200 None 2026-04-05 15:09:57,126 - lava_callback - ERROR - Error processing callback for node 69cfd82f000c489abc2c2dea: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35418 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60800 - "GET / HTTP/1.0" 200 OK 2026-04-05 15:11:34,719 - lava_callback - INFO - Received callback for node 69cfd899000c489abc2c2e46 INFO: 172.21.0.1:43832 - "POST /node/69cfd899000c489abc2c2e46 HTTP/1.0" 202 Accepted 2026-04-05 15:11:34,728 - lava_callback - INFO - Starting async job submit for node 69cfd899000c489abc2c2e46 2026-04-05 15:11:34,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:11:34,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd899000c489abc2c2e46 HTTP/1.1" 200 None 2026-04-05 15:11:34,746 - lava_callback - DEBUG - Processing node 69cfd899000c489abc2c2e46: baseline-arm-clabbe 2026-04-05 15:11:34,746 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfd899000c489abc2c2e46 2026-04-05 15:11:34,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:11:34,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd899000c489abc2c2e46 HTTP/1.1" 200 None 2026-04-05 15:11:34,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:11:34,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-05 15:11:34,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:11:34,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfd899000c489abc2c2e46 HTTP/1.1" 200 None 2026-04-05 15:11:34,822 - lava_callback - ERROR - Error processing callback for node 69cfd899000c489abc2c2e46: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59212 - "GET / HTTP/1.0" 200 OK 2026-04-05 15:12:14,503 - lava_callback - INFO - Received callback for node 69cfd8c0000c489abc2c2e7a INFO: 172.21.0.1:40354 - "POST /node/69cfd8c0000c489abc2c2e7a HTTP/1.0" 202 Accepted 2026-04-05 15:12:14,510 - lava_callback - INFO - Starting async job submit for node 69cfd8c0000c489abc2c2e7a 2026-04-05 15:12:14,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:12:14,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd8c0000c489abc2c2e7a HTTP/1.1" 200 None 2026-04-05 15:12:14,525 - lava_callback - DEBUG - Processing node 69cfd8c0000c489abc2c2e7a: baseline-arm-clabbe 2026-04-05 15:12:14,525 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfd8c0000c489abc2c2e7a 2026-04-05 15:12:14,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:12:14,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd8c0000c489abc2c2e7a HTTP/1.1" 200 None 2026-04-05 15:12:14,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:12:14,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-05 15:12:14,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:12:14,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfd8c0000c489abc2c2e7a HTTP/1.1" 200 None 2026-04-05 15:12:14,587 - lava_callback - ERROR - Error processing callback for node 69cfd8c0000c489abc2c2e7a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42188 - "GET / HTTP/1.0" 200 OK 2026-04-05 15:12:54,617 - lava_callback - INFO - Received callback for node 69cfd8e1000c489abc2c2ea7 INFO: 172.21.0.1:55404 - "POST /node/69cfd8e1000c489abc2c2ea7 HTTP/1.0" 202 Accepted 2026-04-05 15:12:54,623 - lava_callback - INFO - Starting async job submit for node 69cfd8e1000c489abc2c2ea7 2026-04-05 15:12:54,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:12:54,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd8e1000c489abc2c2ea7 HTTP/1.1" 200 None 2026-04-05 15:12:54,640 - lava_callback - DEBUG - Processing node 69cfd8e1000c489abc2c2ea7: baseline-arm-clabbe 2026-04-05 15:12:54,640 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfd8e1000c489abc2c2ea7 2026-04-05 15:12:54,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:12:54,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd8e1000c489abc2c2ea7 HTTP/1.1" 200 None 2026-04-05 15:12:54,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:12:54,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-05 15:12:54,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:12:54,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfd8e1000c489abc2c2ea7 HTTP/1.1" 200 None 2026-04-05 15:12:54,698 - lava_callback - ERROR - Error processing callback for node 69cfd8e1000c489abc2c2ea7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52762 - "GET / HTTP/1.0" 200 OK 2026-04-05 15:13:14,556 - lava_callback - INFO - Received callback for node 69cfd902000c489abc2c2ed9 INFO: 172.21.0.1:44288 - "POST /node/69cfd902000c489abc2c2ed9 HTTP/1.0" 202 Accepted 2026-04-05 15:13:14,562 - lava_callback - INFO - Starting async job submit for node 69cfd902000c489abc2c2ed9 2026-04-05 15:13:14,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:13:14,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd902000c489abc2c2ed9 HTTP/1.1" 200 None 2026-04-05 15:13:14,583 - lava_callback - DEBUG - Processing node 69cfd902000c489abc2c2ed9: baseline-arm-clabbe 2026-04-05 15:13:14,583 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfd902000c489abc2c2ed9 2026-04-05 15:13:14,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:13:14,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd902000c489abc2c2ed9 HTTP/1.1" 200 None 2026-04-05 15:13:14,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:13:14,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-05 15:13:14,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:13:14,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfd902000c489abc2c2ed9 HTTP/1.1" 200 None 2026-04-05 15:13:14,665 - lava_callback - ERROR - Error processing callback for node 69cfd902000c489abc2c2ed9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57332 - "GET / HTTP/1.0" 200 OK 2026-04-05 15:13:54,610 - lava_callback - INFO - Received callback for node 69cfd929000c489abc2c2ee9 INFO: 172.21.0.1:42630 - "POST /node/69cfd929000c489abc2c2ee9 HTTP/1.0" 202 Accepted 2026-04-05 15:13:54,616 - lava_callback - INFO - Starting async job submit for node 69cfd929000c489abc2c2ee9 2026-04-05 15:13:54,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:13:54,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd929000c489abc2c2ee9 HTTP/1.1" 200 None 2026-04-05 15:13:54,632 - lava_callback - DEBUG - Processing node 69cfd929000c489abc2c2ee9: baseline-arm-clabbe 2026-04-05 15:13:54,632 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfd929000c489abc2c2ee9 2026-04-05 15:13:54,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:13:54,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd929000c489abc2c2ee9 HTTP/1.1" 200 None 2026-04-05 15:13:54,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:13:54,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-05 15:13:54,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:13:54,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfd929000c489abc2c2ee9 HTTP/1.1" 200 None 2026-04-05 15:13:54,704 - lava_callback - ERROR - Error processing callback for node 69cfd929000c489abc2c2ee9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34940 - "GET / HTTP/1.0" 200 OK 2026-04-05 15:14:34,608 - lava_callback - INFO - Received callback for node 69cfd950000c489abc2c2f03 INFO: 172.21.0.1:44712 - "POST /node/69cfd950000c489abc2c2f03 HTTP/1.0" 202 Accepted 2026-04-05 15:14:34,614 - lava_callback - INFO - Starting async job submit for node 69cfd950000c489abc2c2f03 2026-04-05 15:14:34,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:14:34,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd950000c489abc2c2f03 HTTP/1.1" 200 None 2026-04-05 15:14:34,637 - lava_callback - DEBUG - Processing node 69cfd950000c489abc2c2f03: baseline-arm-clabbe 2026-04-05 15:14:34,637 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfd950000c489abc2c2f03 2026-04-05 15:14:34,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:14:34,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd950000c489abc2c2f03 HTTP/1.1" 200 None 2026-04-05 15:14:34,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:14:34,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-05 15:14:34,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:14:34,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfd950000c489abc2c2f03 HTTP/1.1" 200 None 2026-04-05 15:14:34,693 - lava_callback - ERROR - Error processing callback for node 69cfd950000c489abc2c2f03: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60604 - "GET / HTTP/1.0" 200 OK 2026-04-05 15:15:14,683 - lava_callback - INFO - Received callback for node 69cfd96f000c489abc2c2f3f INFO: 172.21.0.1:54682 - "POST /node/69cfd96f000c489abc2c2f3f HTTP/1.0" 202 Accepted 2026-04-05 15:15:14,689 - lava_callback - INFO - Starting async job submit for node 69cfd96f000c489abc2c2f3f 2026-04-05 15:15:14,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:15:14,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd96f000c489abc2c2f3f HTTP/1.1" 200 None 2026-04-05 15:15:14,704 - lava_callback - DEBUG - Processing node 69cfd96f000c489abc2c2f3f: baseline-arm-clabbe 2026-04-05 15:15:14,704 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfd96f000c489abc2c2f3f 2026-04-05 15:15:14,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:15:14,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd96f000c489abc2c2f3f HTTP/1.1" 200 None 2026-04-05 15:15:14,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:15:14,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf77b3000c489abc2bf929 HTTP/1.1" 200 None 2026-04-05 15:15:14,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:15:14,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfd96f000c489abc2c2f3f HTTP/1.1" 200 None 2026-04-05 15:15:14,755 - lava_callback - ERROR - Error processing callback for node 69cfd96f000c489abc2c2f3f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53306 - "GET / HTTP/1.0" 200 OK 2026-04-05 15:15:34,684 - lava_callback - INFO - Received callback for node 69cfd992000c489abc2c2f67 INFO: 172.21.0.1:60062 - "POST /node/69cfd992000c489abc2c2f67 HTTP/1.0" 202 Accepted 2026-04-05 15:15:34,690 - lava_callback - INFO - Starting async job submit for node 69cfd992000c489abc2c2f67 2026-04-05 15:15:34,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:15:34,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd992000c489abc2c2f67 HTTP/1.1" 200 None 2026-04-05 15:15:34,708 - lava_callback - DEBUG - Processing node 69cfd992000c489abc2c2f67: baseline-arm-clabbe 2026-04-05 15:15:34,709 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfd992000c489abc2c2f67 2026-04-05 15:15:34,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:15:34,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd992000c489abc2c2f67 HTTP/1.1" 200 None 2026-04-05 15:15:34,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:15:34,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ef0e33d030878a87ef HTTP/1.1" 200 None 2026-04-05 15:15:34,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:15:34,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfd992000c489abc2c2f67 HTTP/1.1" 200 None 2026-04-05 15:15:34,777 - lava_callback - ERROR - Error processing callback for node 69cfd992000c489abc2c2f67: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46580 - "GET / HTTP/1.0" 200 OK 2026-04-05 15:16:14,720 - lava_callback - INFO - Received callback for node 69cfd9b8000c489abc2c2f7d INFO: 172.21.0.1:56872 - "POST /node/69cfd9b8000c489abc2c2f7d HTTP/1.0" 202 Accepted 2026-04-05 15:16:14,727 - lava_callback - INFO - Starting async job submit for node 69cfd9b8000c489abc2c2f7d 2026-04-05 15:16:14,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:16:14,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd9b8000c489abc2c2f7d HTTP/1.1" 200 None 2026-04-05 15:16:14,743 - lava_callback - DEBUG - Processing node 69cfd9b8000c489abc2c2f7d: baseline-arm-clabbe 2026-04-05 15:16:14,743 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfd9b8000c489abc2c2f7d 2026-04-05 15:16:14,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:16:14,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd9b8000c489abc2c2f7d HTTP/1.1" 200 None 2026-04-05 15:16:14,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:16:14,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ef0e33d030878a87ef HTTP/1.1" 200 None 2026-04-05 15:16:14,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:16:14,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfd9b8000c489abc2c2f7d HTTP/1.1" 200 None 2026-04-05 15:16:14,829 - lava_callback - ERROR - Error processing callback for node 69cfd9b8000c489abc2c2f7d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55420 - "GET / HTTP/1.0" 200 OK 2026-04-05 15:16:54,715 - lava_callback - INFO - Received callback for node 69cfd9e0000c489abc2c2f94 INFO: 172.21.0.1:35662 - "POST /node/69cfd9e0000c489abc2c2f94 HTTP/1.0" 202 Accepted 2026-04-05 15:16:54,721 - lava_callback - INFO - Starting async job submit for node 69cfd9e0000c489abc2c2f94 2026-04-05 15:16:54,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:16:54,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd9e0000c489abc2c2f94 HTTP/1.1" 200 None 2026-04-05 15:16:54,744 - lava_callback - DEBUG - Processing node 69cfd9e0000c489abc2c2f94: baseline-arm-clabbe 2026-04-05 15:16:54,745 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfd9e0000c489abc2c2f94 2026-04-05 15:16:54,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:16:54,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfd9e0000c489abc2c2f94 HTTP/1.1" 200 None 2026-04-05 15:16:54,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:16:54,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ef0e33d030878a87ef HTTP/1.1" 200 None 2026-04-05 15:16:54,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:16:54,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfd9e0000c489abc2c2f94 HTTP/1.1" 200 None 2026-04-05 15:16:54,796 - lava_callback - ERROR - Error processing callback for node 69cfd9e0000c489abc2c2f94: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45936 - "GET / HTTP/1.0" 200 OK 2026-04-05 15:17:34,788 - lava_callback - INFO - Received callback for node 69cfda02000c489abc2c2fa3 INFO: 172.21.0.1:40498 - "POST /node/69cfda02000c489abc2c2fa3 HTTP/1.0" 202 Accepted 2026-04-05 15:17:34,794 - lava_callback - INFO - Starting async job submit for node 69cfda02000c489abc2c2fa3 2026-04-05 15:17:34,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:17:34,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfda02000c489abc2c2fa3 HTTP/1.1" 200 None 2026-04-05 15:17:34,810 - lava_callback - DEBUG - Processing node 69cfda02000c489abc2c2fa3: baseline-arm-clabbe 2026-04-05 15:17:34,810 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfda02000c489abc2c2fa3 2026-04-05 15:17:34,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:17:34,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfda02000c489abc2c2fa3 HTTP/1.1" 200 None 2026-04-05 15:17:34,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:17:34,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ef0e33d030878a87ef HTTP/1.1" 200 None 2026-04-05 15:17:34,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:17:34,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfda02000c489abc2c2fa3 HTTP/1.1" 200 None 2026-04-05 15:17:34,882 - lava_callback - ERROR - Error processing callback for node 69cfda02000c489abc2c2fa3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39650 - "GET / HTTP/1.0" 200 OK 2026-04-05 15:17:57,688 - lava_callback - INFO - Received callback for node 69cfda22000c489abc2c2fe2 INFO: 172.21.0.1:39666 - "POST /node/69cfda22000c489abc2c2fe2 HTTP/1.0" 202 Accepted 2026-04-05 15:17:57,696 - lava_callback - INFO - Starting async job submit for node 69cfda22000c489abc2c2fe2 2026-04-05 15:17:57,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:17:57,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfda22000c489abc2c2fe2 HTTP/1.1" 200 None 2026-04-05 15:17:57,717 - lava_callback - DEBUG - Processing node 69cfda22000c489abc2c2fe2: baseline-arm-baylibre 2026-04-05 15:17:57,718 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfda22000c489abc2c2fe2 2026-04-05 15:17:57,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:17:57,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfda22000c489abc2c2fe2 HTTP/1.1" 200 None 2026-04-05 15:17:57,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:17:57,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ef0e33d030878a87ef HTTP/1.1" 200 None 2026-04-05 15:17:57,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:17:57,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfda22000c489abc2c2fe2 HTTP/1.1" 200 None 2026-04-05 15:17:57,793 - lava_callback - ERROR - Error processing callback for node 69cfda22000c489abc2c2fe2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54998 - "GET / HTTP/1.0" 200 OK 2026-04-05 15:19:14,880 - lava_callback - INFO - Received callback for node 69cfda65000c489abc2c3035 INFO: 172.21.0.1:58852 - "POST /node/69cfda65000c489abc2c3035 HTTP/1.0" 202 Accepted 2026-04-05 15:19:14,885 - lava_callback - INFO - Starting async job submit for node 69cfda65000c489abc2c3035 2026-04-05 15:19:14,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:19:14,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfda65000c489abc2c3035 HTTP/1.1" 200 None 2026-04-05 15:19:14,908 - lava_callback - DEBUG - Processing node 69cfda65000c489abc2c3035: baseline-arm-clabbe 2026-04-05 15:19:14,908 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfda65000c489abc2c3035 2026-04-05 15:19:14,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:19:14,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfda65000c489abc2c3035 HTTP/1.1" 200 None 2026-04-05 15:19:14,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:19:14,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ef0e33d030878a87ef HTTP/1.1" 200 None 2026-04-05 15:19:14,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:19:14,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfda65000c489abc2c3035 HTTP/1.1" 200 None 2026-04-05 15:19:14,965 - lava_callback - ERROR - Error processing callback for node 69cfda65000c489abc2c3035: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57716 - "GET / HTTP/1.0" 200 OK 2026-04-05 15:19:54,874 - lava_callback - INFO - Received callback for node 69cfda87000c489abc2c305d INFO: 172.21.0.1:50084 - "POST /node/69cfda87000c489abc2c305d HTTP/1.0" 202 Accepted 2026-04-05 15:19:54,880 - lava_callback - INFO - Starting async job submit for node 69cfda87000c489abc2c305d 2026-04-05 15:19:54,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:19:54,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfda87000c489abc2c305d HTTP/1.1" 200 None 2026-04-05 15:19:54,896 - lava_callback - DEBUG - Processing node 69cfda87000c489abc2c305d: baseline-arm-clabbe 2026-04-05 15:19:54,896 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfda87000c489abc2c305d 2026-04-05 15:19:54,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:19:54,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfda87000c489abc2c305d HTTP/1.1" 200 None 2026-04-05 15:19:54,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:19:54,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ef0e33d030878a87ef HTTP/1.1" 200 None 2026-04-05 15:19:54,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:19:54,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfda87000c489abc2c305d HTTP/1.1" 200 None 2026-04-05 15:19:54,959 - lava_callback - ERROR - Error processing callback for node 69cfda87000c489abc2c305d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60734 - "GET / HTTP/1.0" 200 OK 2026-04-05 15:20:14,881 - lava_callback - INFO - Received callback for node 69cfdaac000c489abc2c307b INFO: 172.21.0.1:56776 - "POST /node/69cfdaac000c489abc2c307b HTTP/1.0" 202 Accepted 2026-04-05 15:20:14,886 - lava_callback - INFO - Starting async job submit for node 69cfdaac000c489abc2c307b 2026-04-05 15:20:14,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:20:14,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfdaac000c489abc2c307b HTTP/1.1" 200 None 2026-04-05 15:20:14,911 - lava_callback - DEBUG - Processing node 69cfdaac000c489abc2c307b: baseline-arm-clabbe 2026-04-05 15:20:14,911 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfdaac000c489abc2c307b 2026-04-05 15:20:14,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:20:14,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfdaac000c489abc2c307b HTTP/1.1" 200 None 2026-04-05 15:20:14,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:20:14,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ef0e33d030878a87ef HTTP/1.1" 200 None 2026-04-05 15:20:14,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:20:14,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfdaac000c489abc2c307b HTTP/1.1" 200 None 2026-04-05 15:20:14,970 - lava_callback - ERROR - Error processing callback for node 69cfdaac000c489abc2c307b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39866 - "GET / HTTP/1.0" 200 OK 2026-04-05 15:20:57,634 - lava_callback - INFO - Received callback for node 69cfdacd000c489abc2c3090 INFO: 172.21.0.1:39876 - "POST /node/69cfdacd000c489abc2c3090 HTTP/1.0" 202 Accepted 2026-04-05 15:20:57,640 - lava_callback - INFO - Starting async job submit for node 69cfdacd000c489abc2c3090 2026-04-05 15:20:57,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:20:57,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfdacd000c489abc2c3090 HTTP/1.1" 200 None 2026-04-05 15:20:57,655 - lava_callback - DEBUG - Processing node 69cfdacd000c489abc2c3090: baseline-arm-baylibre 2026-04-05 15:20:57,655 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfdacd000c489abc2c3090 2026-04-05 15:20:57,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:20:57,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfdacd000c489abc2c3090 HTTP/1.1" 200 None 2026-04-05 15:20:57,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:20:57,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ef0e33d030878a87ef HTTP/1.1" 200 None 2026-04-05 15:20:57,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:20:57,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfdacd000c489abc2c3090 HTTP/1.1" 200 None 2026-04-05 15:20:57,708 - lava_callback - ERROR - Error processing callback for node 69cfdacd000c489abc2c3090: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42512 - "GET / HTTP/1.0" 200 OK 2026-04-05 15:21:35,004 - lava_callback - INFO - Received callback for node 69cfdaf3000c489abc2c30d9 INFO: 172.21.0.1:38814 - "POST /node/69cfdaf3000c489abc2c30d9 HTTP/1.0" 202 Accepted 2026-04-05 15:21:35,011 - lava_callback - INFO - Starting async job submit for node 69cfdaf3000c489abc2c30d9 2026-04-05 15:21:35,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:21:35,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfdaf3000c489abc2c30d9 HTTP/1.1" 200 None 2026-04-05 15:21:35,027 - lava_callback - DEBUG - Processing node 69cfdaf3000c489abc2c30d9: baseline-arm-clabbe 2026-04-05 15:21:35,027 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfdaf3000c489abc2c30d9 2026-04-05 15:21:35,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:21:35,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfdaf3000c489abc2c30d9 HTTP/1.1" 200 None 2026-04-05 15:21:35,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:21:35,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ef0e33d030878a87ef HTTP/1.1" 200 None 2026-04-05 15:21:35,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:21:35,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfdaf3000c489abc2c30d9 HTTP/1.1" 200 None 2026-04-05 15:21:35,096 - lava_callback - ERROR - Error processing callback for node 69cfdaf3000c489abc2c30d9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45552 - "GET / HTTP/1.0" 200 OK 2026-04-05 15:22:14,990 - lava_callback - INFO - Received callback for node 69cfdb19000c489abc2c30e7 INFO: 172.21.0.1:58886 - "POST /node/69cfdb19000c489abc2c30e7 HTTP/1.0" 202 Accepted 2026-04-05 15:22:14,996 - lava_callback - INFO - Starting async job submit for node 69cfdb19000c489abc2c30e7 2026-04-05 15:22:14,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:22:15,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfdb19000c489abc2c30e7 HTTP/1.1" 200 None 2026-04-05 15:22:15,011 - lava_callback - DEBUG - Processing node 69cfdb19000c489abc2c30e7: baseline-arm-clabbe 2026-04-05 15:22:15,011 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfdb19000c489abc2c30e7 2026-04-05 15:22:15,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:22:15,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfdb19000c489abc2c30e7 HTTP/1.1" 200 None 2026-04-05 15:22:15,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:22:15,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ef0e33d030878a87ef HTTP/1.1" 200 None 2026-04-05 15:22:15,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:22:15,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfdb19000c489abc2c30e7 HTTP/1.1" 200 None 2026-04-05 15:22:15,075 - lava_callback - ERROR - Error processing callback for node 69cfdb19000c489abc2c30e7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56752 - "GET / HTTP/1.0" 200 OK 2026-04-05 15:22:55,039 - lava_callback - INFO - Received callback for node 69cfdb3e000c489abc2c3104 INFO: 172.21.0.1:40060 - "POST /node/69cfdb3e000c489abc2c3104 HTTP/1.0" 202 Accepted 2026-04-05 15:22:55,048 - lava_callback - INFO - Starting async job submit for node 69cfdb3e000c489abc2c3104 2026-04-05 15:22:55,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:22:55,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfdb3e000c489abc2c3104 HTTP/1.1" 200 None 2026-04-05 15:22:55,079 - lava_callback - DEBUG - Processing node 69cfdb3e000c489abc2c3104: baseline-arm-clabbe 2026-04-05 15:22:55,079 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfdb3e000c489abc2c3104 2026-04-05 15:22:55,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:22:55,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfdb3e000c489abc2c3104 HTTP/1.1" 200 None 2026-04-05 15:22:55,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:22:55,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ef0e33d030878a87ef HTTP/1.1" 200 None 2026-04-05 15:22:55,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:22:55,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfdb3e000c489abc2c3104 HTTP/1.1" 200 None 2026-04-05 15:22:55,141 - lava_callback - ERROR - Error processing callback for node 69cfdb3e000c489abc2c3104: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48606 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39910 - "GET / HTTP/1.0" 200 OK 2026-04-05 15:24:35,162 - lava_callback - INFO - Received callback for node 69cfdba7000c489abc2c315b INFO: 172.21.0.1:50002 - "POST /node/69cfdba7000c489abc2c315b HTTP/1.0" 202 Accepted 2026-04-05 15:24:35,169 - lava_callback - INFO - Starting async job submit for node 69cfdba7000c489abc2c315b 2026-04-05 15:24:35,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:24:35,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfdba7000c489abc2c315b HTTP/1.1" 200 None 2026-04-05 15:24:35,188 - lava_callback - DEBUG - Processing node 69cfdba7000c489abc2c315b: baseline-arm-clabbe 2026-04-05 15:24:35,189 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfdba7000c489abc2c315b 2026-04-05 15:24:35,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:24:35,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfdba7000c489abc2c315b HTTP/1.1" 200 None 2026-04-05 15:24:35,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:24:35,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ef0e33d030878a87ef HTTP/1.1" 200 None 2026-04-05 15:24:35,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:24:35,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfdba7000c489abc2c315b HTTP/1.1" 200 None 2026-04-05 15:24:35,244 - lava_callback - ERROR - Error processing callback for node 69cfdba7000c489abc2c315b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56342 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56358 - "GET / HTTP/1.0" 200 OK 2026-04-05 15:25:18,048 - lava_callback - INFO - Received callback for node 69cfdbcf000c489abc2c319a INFO: 172.21.0.1:56368 - "POST /node/69cfdbcf000c489abc2c319a HTTP/1.0" 202 Accepted 2026-04-05 15:25:18,057 - lava_callback - INFO - Starting async job submit for node 69cfdbcf000c489abc2c319a 2026-04-05 15:25:18,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:25:18,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfdbcf000c489abc2c319a HTTP/1.1" 200 None 2026-04-05 15:25:18,106 - lava_callback - DEBUG - Processing node 69cfdbcf000c489abc2c319a: baseline-arm64-baylibre 2026-04-05 15:25:18,106 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfdbcf000c489abc2c319a 2026-04-05 15:25:18,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:25:18,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfdbcf000c489abc2c319a HTTP/1.1" 200 None 2026-04-05 15:25:18,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:25:18,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-05 15:25:18,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:25:18,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfdbcf000c489abc2c319a HTTP/1.1" 200 None 2026-04-05 15:25:18,263 - lava_callback - ERROR - Error processing callback for node 69cfdbcf000c489abc2c319a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52714 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-05 15:26:15,163 - lava_callback - INFO - Received callback for node 69cfdc10000c489abc2c31cd INFO: 172.21.0.1:52720 - "POST /node/69cfdc10000c489abc2c31cd HTTP/1.0" 202 Accepted 2026-04-05 15:26:15,169 - lava_callback - INFO - Starting async job submit for node 69cfdc10000c489abc2c31cd 2026-04-05 15:26:15,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:26:15,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfdc10000c489abc2c31cd HTTP/1.1" 200 None 2026-04-05 15:26:15,194 - lava_callback - DEBUG - Processing node 69cfdc10000c489abc2c31cd: baseline-arm-clabbe 2026-04-05 15:26:15,195 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfdc10000c489abc2c31cd 2026-04-05 15:26:15,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:26:15,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfdc10000c489abc2c31cd HTTP/1.1" 200 None 2026-04-05 15:26:15,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:26:15,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ef0e33d030878a87ef HTTP/1.1" 200 None 2026-04-05 15:26:15,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:26:15,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfdc10000c489abc2c31cd HTTP/1.1" 200 None 2026-04-05 15:26:15,247 - lava_callback - ERROR - Error processing callback for node 69cfdc10000c489abc2c31cd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48510 - "GET / HTTP/1.0" 200 OK 2026-04-05 15:26:57,975 - lava_callback - INFO - Received callback for node 69cfdc37000c489abc2c31e4 INFO: 172.21.0.1:48522 - "POST /node/69cfdc37000c489abc2c31e4 HTTP/1.0" 202 Accepted 2026-04-05 15:26:57,984 - lava_callback - INFO - Starting async job submit for node 69cfdc37000c489abc2c31e4 2026-04-05 15:26:57,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:26:58,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfdc37000c489abc2c31e4 HTTP/1.1" 200 None 2026-04-05 15:26:58,001 - lava_callback - DEBUG - Processing node 69cfdc37000c489abc2c31e4: baseline-arm64-baylibre 2026-04-05 15:26:58,001 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfdc37000c489abc2c31e4 2026-04-05 15:26:58,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:26:58,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfdc37000c489abc2c31e4 HTTP/1.1" 200 None 2026-04-05 15:26:58,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:26:58,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-05 15:26:58,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:26:58,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfdc37000c489abc2c31e4 HTTP/1.1" 200 None 2026-04-05 15:26:58,056 - lava_callback - ERROR - Error processing callback for node 69cfdc37000c489abc2c31e4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38840 - "GET / HTTP/1.0" 200 OK 2026-04-05 15:27:55,467 - lava_callback - INFO - Received callback for node 69cfdc75000c489abc2c323b INFO: 172.21.0.1:44192 - "POST /node/69cfdc75000c489abc2c323b HTTP/1.0" 202 Accepted 2026-04-05 15:27:55,473 - lava_callback - INFO - Starting async job submit for node 69cfdc75000c489abc2c323b 2026-04-05 15:27:55,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:27:55,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfdc75000c489abc2c323b HTTP/1.1" 200 None 2026-04-05 15:27:55,500 - lava_callback - DEBUG - Processing node 69cfdc75000c489abc2c323b: baseline-arm-clabbe 2026-04-05 15:27:55,501 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfdc75000c489abc2c323b 2026-04-05 15:27:55,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:27:55,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfdc75000c489abc2c323b HTTP/1.1" 200 None 2026-04-05 15:27:55,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:27:55,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ef0e33d030878a87ef HTTP/1.1" 200 None 2026-04-05 15:27:55,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:27:55,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfdc75000c489abc2c323b HTTP/1.1" 200 None 2026-04-05 15:27:55,568 - lava_callback - ERROR - Error processing callback for node 69cfdc75000c489abc2c323b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43782 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55802 - "GET / HTTP/1.0" 200 OK 2026-04-05 15:28:35,251 - lava_callback - INFO - Received callback for node 69cfdc9d000c489abc2c3269 INFO: 172.21.0.1:51586 - "POST /node/69cfdc9d000c489abc2c3269 HTTP/1.0" 202 Accepted 2026-04-05 15:28:35,257 - lava_callback - INFO - Starting async job submit for node 69cfdc9d000c489abc2c3269 2026-04-05 15:28:35,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:28:35,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfdc9d000c489abc2c3269 HTTP/1.1" 200 None 2026-04-05 15:28:35,273 - lava_callback - DEBUG - Processing node 69cfdc9d000c489abc2c3269: baseline-arm-clabbe 2026-04-05 15:28:35,273 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfdc9d000c489abc2c3269 2026-04-05 15:28:35,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:28:35,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfdc9d000c489abc2c3269 HTTP/1.1" 200 None 2026-04-05 15:28:35,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:28:35,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ef0e33d030878a87ef HTTP/1.1" 200 None 2026-04-05 15:28:35,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:28:35,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfdc9d000c489abc2c3269 HTTP/1.1" 200 None 2026-04-05 15:28:35,326 - lava_callback - ERROR - Error processing callback for node 69cfdc9d000c489abc2c3269: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42272 - "GET / HTTP/1.0" 200 OK 2026-04-05 15:29:18,120 - lava_callback - INFO - Received callback for node 69cfdcc6000c489abc2c3290 INFO: 172.21.0.1:42280 - "POST /node/69cfdcc6000c489abc2c3290 HTTP/1.0" 202 Accepted 2026-04-05 15:29:18,126 - lava_callback - INFO - Starting async job submit for node 69cfdcc6000c489abc2c3290 2026-04-05 15:29:18,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:29:18,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfdcc6000c489abc2c3290 HTTP/1.1" 200 None 2026-04-05 15:29:18,142 - lava_callback - DEBUG - Processing node 69cfdcc6000c489abc2c3290: baseline-arm64-baylibre 2026-04-05 15:29:18,142 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfdcc6000c489abc2c3290 2026-04-05 15:29:18,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:29:18,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfdcc6000c489abc2c3290 HTTP/1.1" 200 None 2026-04-05 15:29:18,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:29:18,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-05 15:29:18,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:29:18,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfdcc6000c489abc2c3290 HTTP/1.1" 200 None 2026-04-05 15:29:18,206 - lava_callback - ERROR - Error processing callback for node 69cfdcc6000c489abc2c3290: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47106 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47118 - "GET / HTTP/1.0" 200 OK 2026-04-05 15:30:18,120 - lava_callback - INFO - Received callback for node 69cfdd08000c489abc2c32e5 INFO: 172.21.0.1:47130 - "POST /node/69cfdd08000c489abc2c32e5 HTTP/1.0" 202 Accepted 2026-04-05 15:30:18,129 - lava_callback - INFO - Starting async job submit for node 69cfdd08000c489abc2c32e5 2026-04-05 15:30:18,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:30:18,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfdd08000c489abc2c32e5 HTTP/1.1" 200 None 2026-04-05 15:30:18,146 - lava_callback - DEBUG - Processing node 69cfdd08000c489abc2c32e5: baseline-arm64-baylibre 2026-04-05 15:30:18,146 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfdd08000c489abc2c32e5 2026-04-05 15:30:18,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:30:18,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfdd08000c489abc2c32e5 HTTP/1.1" 200 None 2026-04-05 15:30:18,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:30:18,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-05 15:30:18,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:30:18,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfdd08000c489abc2c32e5 HTTP/1.1" 200 None 2026-04-05 15:30:18,216 - lava_callback - ERROR - Error processing callback for node 69cfdd08000c489abc2c32e5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45100 - "GET / HTTP/1.0" 200 OK 2026-04-05 15:31:35,381 - lava_callback - INFO - Received callback for node 69cfdd47000c489abc2c3320 INFO: 172.21.0.1:50808 - "POST /node/69cfdd47000c489abc2c3320 HTTP/1.0" 202 Accepted 2026-04-05 15:31:35,387 - lava_callback - INFO - Starting async job submit for node 69cfdd47000c489abc2c3320 2026-04-05 15:31:35,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:31:35,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfdd47000c489abc2c3320 HTTP/1.1" 200 None 2026-04-05 15:31:35,405 - lava_callback - DEBUG - Processing node 69cfdd47000c489abc2c3320: baseline-arm-clabbe 2026-04-05 15:31:35,405 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfdd47000c489abc2c3320 2026-04-05 15:31:35,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:31:35,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfdd47000c489abc2c3320 HTTP/1.1" 200 None 2026-04-05 15:31:35,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:31:35,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ef0e33d030878a87ef HTTP/1.1" 200 None 2026-04-05 15:31:35,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:31:35,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfdd47000c489abc2c3320 HTTP/1.1" 200 None 2026-04-05 15:31:35,462 - lava_callback - ERROR - Error processing callback for node 69cfdd47000c489abc2c3320: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55974 - "GET / HTTP/1.0" 200 OK 2026-04-05 15:32:18,360 - lava_callback - INFO - Received callback for node 69cfdd70000c489abc2c335d INFO: 172.21.0.1:55982 - "POST /node/69cfdd70000c489abc2c335d HTTP/1.0" 202 Accepted 2026-04-05 15:32:18,366 - lava_callback - INFO - Starting async job submit for node 69cfdd70000c489abc2c335d 2026-04-05 15:32:18,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:32:18,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfdd70000c489abc2c335d HTTP/1.1" 200 None 2026-04-05 15:32:18,392 - lava_callback - DEBUG - Processing node 69cfdd70000c489abc2c335d: baseline-arm64-baylibre 2026-04-05 15:32:18,393 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfdd70000c489abc2c335d 2026-04-05 15:32:18,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:32:18,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfdd70000c489abc2c335d HTTP/1.1" 200 None 2026-04-05 15:32:18,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:32:18,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-05 15:32:18,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:32:18,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfdd70000c489abc2c335d HTTP/1.1" 200 None 2026-04-05 15:32:18,451 - lava_callback - ERROR - Error processing callback for node 69cfdd70000c489abc2c335d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47556 - "GET / HTTP/1.0" 200 OK 2026-04-05 15:33:18,283 - lava_callback - INFO - Received callback for node 69cfddbc000c489abc2c3374 INFO: 172.21.0.1:47568 - "POST /node/69cfddbc000c489abc2c3374 HTTP/1.0" 202 Accepted 2026-04-05 15:33:18,288 - lava_callback - INFO - Starting async job submit for node 69cfddbc000c489abc2c3374 2026-04-05 15:33:18,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:33:18,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfddbc000c489abc2c3374 HTTP/1.1" 200 None 2026-04-05 15:33:18,307 - lava_callback - DEBUG - Processing node 69cfddbc000c489abc2c3374: baseline-arm64-baylibre 2026-04-05 15:33:18,307 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfddbc000c489abc2c3374 2026-04-05 15:33:18,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:33:18,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfddbc000c489abc2c3374 HTTP/1.1" 200 None 2026-04-05 15:33:18,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:33:18,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-05 15:33:18,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:33:18,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfddbc000c489abc2c3374 HTTP/1.1" 200 None 2026-04-05 15:33:18,368 - lava_callback - ERROR - Error processing callback for node 69cfddbc000c489abc2c3374: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34060 - "GET / HTTP/1.0" 200 OK 2026-04-05 15:34:55,595 - lava_callback - INFO - Received callback for node 69cfde0c000c489abc2c3395 INFO: 172.21.0.1:45826 - "POST /node/69cfde0c000c489abc2c3395 HTTP/1.0" 202 Accepted 2026-04-05 15:34:55,601 - lava_callback - INFO - Starting async job submit for node 69cfde0c000c489abc2c3395 2026-04-05 15:34:55,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:34:55,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfde0c000c489abc2c3395 HTTP/1.1" 200 None 2026-04-05 15:34:55,628 - lava_callback - DEBUG - Processing node 69cfde0c000c489abc2c3395: baseline-arm64-clabbe 2026-04-05 15:34:55,628 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfde0c000c489abc2c3395 2026-04-05 15:34:55,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:34:55,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfde0c000c489abc2c3395 HTTP/1.1" 200 None 2026-04-05 15:34:55,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:34:55,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-05 15:34:55,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:34:55,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfde0c000c489abc2c3395 HTTP/1.1" 200 None 2026-04-05 15:34:55,859 - lava_callback - ERROR - Error processing callback for node 69cfde0c000c489abc2c3395: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34524 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44988 - "GET / HTTP/1.0" 200 OK 2026-04-05 15:35:55,610 - lava_callback - INFO - Received callback for node 69cfde54000c489abc2c33cc INFO: 172.21.0.1:53114 - "POST /node/69cfde54000c489abc2c33cc HTTP/1.0" 202 Accepted 2026-04-05 15:35:55,616 - lava_callback - INFO - Starting async job submit for node 69cfde54000c489abc2c33cc 2026-04-05 15:35:55,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:35:55,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfde54000c489abc2c33cc HTTP/1.1" 200 None 2026-04-05 15:35:55,632 - lava_callback - DEBUG - Processing node 69cfde54000c489abc2c33cc: baseline-arm64-clabbe 2026-04-05 15:35:55,632 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfde54000c489abc2c33cc 2026-04-05 15:35:55,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:35:55,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfde54000c489abc2c33cc HTTP/1.1" 200 None 2026-04-05 15:35:55,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:35:55,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-05 15:35:55,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:35:55,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfde54000c489abc2c33cc HTTP/1.1" 200 None 2026-04-05 15:35:55,699 - lava_callback - ERROR - Error processing callback for node 69cfde54000c489abc2c33cc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60806 - "GET / HTTP/1.0" 200 OK 2026-04-05 15:36:55,672 - lava_callback - INFO - Received callback for node 69cfde94000c489abc2c341e INFO: 172.21.0.1:53776 - "POST /node/69cfde94000c489abc2c341e HTTP/1.0" 202 Accepted 2026-04-05 15:36:55,678 - lava_callback - INFO - Starting async job submit for node 69cfde94000c489abc2c341e 2026-04-05 15:36:55,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:36:55,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfde94000c489abc2c341e HTTP/1.1" 200 None 2026-04-05 15:36:55,693 - lava_callback - DEBUG - Processing node 69cfde94000c489abc2c341e: baseline-arm64-clabbe 2026-04-05 15:36:55,693 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfde94000c489abc2c341e 2026-04-05 15:36:55,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:36:55,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfde94000c489abc2c341e HTTP/1.1" 200 None 2026-04-05 15:36:55,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:36:55,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-05 15:36:55,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:36:55,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfde94000c489abc2c341e HTTP/1.1" 200 None 2026-04-05 15:36:55,776 - lava_callback - ERROR - Error processing callback for node 69cfde94000c489abc2c341e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37472 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39832 - "GET / HTTP/1.0" 200 OK 2026-04-05 15:39:35,790 - lava_callback - INFO - Received callback for node 69cfdf26000c489abc2c3475 INFO: 172.21.0.1:53878 - "POST /node/69cfdf26000c489abc2c3475 HTTP/1.0" 202 Accepted 2026-04-05 15:39:35,796 - lava_callback - INFO - Starting async job submit for node 69cfdf26000c489abc2c3475 2026-04-05 15:39:35,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:39:35,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfdf26000c489abc2c3475 HTTP/1.1" 200 None 2026-04-05 15:39:35,812 - lava_callback - DEBUG - Processing node 69cfdf26000c489abc2c3475: baseline-arm64-clabbe 2026-04-05 15:39:35,812 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfdf26000c489abc2c3475 2026-04-05 15:39:35,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:39:35,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfdf26000c489abc2c3475 HTTP/1.1" 200 None 2026-04-05 15:39:35,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:39:35,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-05 15:39:35,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:39:35,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfdf26000c489abc2c3475 HTTP/1.1" 200 None 2026-04-05 15:39:35,864 - lava_callback - ERROR - Error processing callback for node 69cfdf26000c489abc2c3475: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58120 - "GET / HTTP/1.0" 200 OK 2026-04-05 15:40:39,098 - lava_callback - INFO - Received callback for node 69cfdf65000c489abc2c3490 INFO: 172.21.0.1:58128 - "POST /node/69cfdf65000c489abc2c3490 HTTP/1.0" 202 Accepted 2026-04-05 15:40:39,104 - lava_callback - INFO - Starting async job submit for node 69cfdf65000c489abc2c3490 2026-04-05 15:40:39,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:40:39,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfdf65000c489abc2c3490 HTTP/1.1" 200 None 2026-04-05 15:40:39,129 - lava_callback - DEBUG - Processing node 69cfdf65000c489abc2c3490: baseline-arm64-baylibre 2026-04-05 15:40:39,130 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfdf65000c489abc2c3490 2026-04-05 15:40:39,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:40:39,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfdf65000c489abc2c3490 HTTP/1.1" 200 None 2026-04-05 15:40:39,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:40:39,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-05 15:40:39,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:40:39,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfdf65000c489abc2c3490 HTTP/1.1" 200 None 2026-04-05 15:40:39,181 - lava_callback - ERROR - Error processing callback for node 69cfdf65000c489abc2c3490: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47220 - "GET / HTTP/1.0" 200 OK 2026-04-05 15:41:56,144 - lava_callback - INFO - Received callback for node 69cfdfb4000c489abc2c34cf INFO: 172.21.0.1:52090 - "POST /node/69cfdfb4000c489abc2c34cf HTTP/1.0" 202 Accepted 2026-04-05 15:41:56,149 - lava_callback - INFO - Starting async job submit for node 69cfdfb4000c489abc2c34cf 2026-04-05 15:41:56,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:41:56,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfdfb4000c489abc2c34cf HTTP/1.1" 200 None 2026-04-05 15:41:56,167 - lava_callback - DEBUG - Processing node 69cfdfb4000c489abc2c34cf: baseline-arm64-clabbe 2026-04-05 15:41:56,167 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfdfb4000c489abc2c34cf 2026-04-05 15:41:56,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:41:56,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfdfb4000c489abc2c34cf HTTP/1.1" 200 None 2026-04-05 15:41:56,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:41:56,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-05 15:41:56,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:41:56,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfdfb4000c489abc2c34cf HTTP/1.1" 200 None 2026-04-05 15:41:56,229 - lava_callback - ERROR - Error processing callback for node 69cfdfb4000c489abc2c34cf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41196 - "GET / HTTP/1.0" 200 OK 2026-04-05 15:42:58,875 - lava_callback - INFO - Received callback for node 69cfdff7000c489abc2c34f7 INFO: 172.21.0.1:41202 - "POST /node/69cfdff7000c489abc2c34f7 HTTP/1.0" 202 Accepted 2026-04-05 15:42:58,881 - lava_callback - INFO - Starting async job submit for node 69cfdff7000c489abc2c34f7 2026-04-05 15:42:58,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:42:58,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfdff7000c489abc2c34f7 HTTP/1.1" 200 None 2026-04-05 15:42:58,897 - lava_callback - DEBUG - Processing node 69cfdff7000c489abc2c34f7: baseline-arm64-baylibre 2026-04-05 15:42:58,897 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfdff7000c489abc2c34f7 2026-04-05 15:42:58,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:42:58,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfdff7000c489abc2c34f7 HTTP/1.1" 200 None 2026-04-05 15:42:58,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:42:58,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-05 15:42:58,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:42:58,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfdff7000c489abc2c34f7 HTTP/1.1" 200 None 2026-04-05 15:42:58,960 - lava_callback - ERROR - Error processing callback for node 69cfdff7000c489abc2c34f7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42430 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43228 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-05 15:44:16,080 - lava_callback - INFO - Received callback for node 69cfe042000c489abc2c354f INFO: 172.21.0.1:43244 - "POST /node/69cfe042000c489abc2c354f HTTP/1.0" 202 Accepted 2026-04-05 15:44:16,086 - lava_callback - INFO - Starting async job submit for node 69cfe042000c489abc2c354f 2026-04-05 15:44:16,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:44:16,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfe042000c489abc2c354f HTTP/1.1" 200 None 2026-04-05 15:44:16,103 - lava_callback - DEBUG - Processing node 69cfe042000c489abc2c354f: baseline-arm64-clabbe 2026-04-05 15:44:16,103 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfe042000c489abc2c354f 2026-04-05 15:44:16,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:44:16,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfe042000c489abc2c354f HTTP/1.1" 200 None 2026-04-05 15:44:16,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:44:16,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-05 15:44:16,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:44:16,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfe042000c489abc2c354f HTTP/1.1" 200 None 2026-04-05 15:44:16,185 - lava_callback - ERROR - Error processing callback for node 69cfe042000c489abc2c354f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33976 - "GET / HTTP/1.0" 200 OK 2026-04-05 15:45:19,031 - lava_callback - INFO - Received callback for node 69cfe082000c489abc2c3579 INFO: 172.21.0.1:33986 - "POST /node/69cfe082000c489abc2c3579 HTTP/1.0" 202 Accepted 2026-04-05 15:45:19,036 - lava_callback - INFO - Starting async job submit for node 69cfe082000c489abc2c3579 2026-04-05 15:45:19,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:45:19,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfe082000c489abc2c3579 HTTP/1.1" 200 None 2026-04-05 15:45:19,060 - lava_callback - DEBUG - Processing node 69cfe082000c489abc2c3579: baseline-arm64-baylibre 2026-04-05 15:45:19,060 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfe082000c489abc2c3579 2026-04-05 15:45:19,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:45:19,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfe082000c489abc2c3579 HTTP/1.1" 200 None 2026-04-05 15:45:19,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:45:19,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-05 15:45:19,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:45:19,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfe082000c489abc2c3579 HTTP/1.1" 200 None 2026-04-05 15:45:19,112 - lava_callback - ERROR - Error processing callback for node 69cfe082000c489abc2c3579: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60294 - "GET / HTTP/1.0" 200 OK 2026-04-05 15:46:39,174 - lava_callback - INFO - Received callback for node 69cfe0cc000c489abc2c3592 INFO: 172.21.0.1:60308 - "POST /node/69cfe0cc000c489abc2c3592 HTTP/1.0" 202 Accepted 2026-04-05 15:46:39,179 - lava_callback - INFO - Starting async job submit for node 69cfe0cc000c489abc2c3592 2026-04-05 15:46:39,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:46:39,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfe0cc000c489abc2c3592 HTTP/1.1" 200 None 2026-04-05 15:46:39,196 - lava_callback - DEBUG - Processing node 69cfe0cc000c489abc2c3592: baseline-arm64-baylibre 2026-04-05 15:46:39,196 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfe0cc000c489abc2c3592 2026-04-05 15:46:39,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:46:39,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfe0cc000c489abc2c3592 HTTP/1.1" 200 None 2026-04-05 15:46:39,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:46:39,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-05 15:46:39,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:46:39,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfe0cc000c489abc2c3592 HTTP/1.1" 200 None 2026-04-05 15:46:39,248 - lava_callback - ERROR - Error processing callback for node 69cfe0cc000c489abc2c3592: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49990 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42980 - "GET / HTTP/1.0" 200 OK 2026-04-05 15:47:39,078 - lava_callback - INFO - Received callback for node 69cfe114000c489abc2c35c8 INFO: 172.21.0.1:42990 - "POST /node/69cfe114000c489abc2c35c8 HTTP/1.0" 202 Accepted 2026-04-05 15:47:39,084 - lava_callback - INFO - Starting async job submit for node 69cfe114000c489abc2c35c8 2026-04-05 15:47:39,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:47:39,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfe114000c489abc2c35c8 HTTP/1.1" 200 None 2026-04-05 15:47:39,109 - lava_callback - DEBUG - Processing node 69cfe114000c489abc2c35c8: baseline-arm64-baylibre 2026-04-05 15:47:39,109 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfe114000c489abc2c35c8 2026-04-05 15:47:39,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:47:39,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfe114000c489abc2c35c8 HTTP/1.1" 200 None 2026-04-05 15:47:39,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:47:39,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-05 15:47:39,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:47:39,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfe114000c489abc2c35c8 HTTP/1.1" 200 None 2026-04-05 15:47:39,166 - lava_callback - ERROR - Error processing callback for node 69cfe114000c489abc2c35c8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49822 - "GET / HTTP/1.0" 200 OK 2026-04-05 15:48:59,214 - lava_callback - INFO - Received callback for node 69cfe15a000c489abc2c3605 INFO: 172.21.0.1:49824 - "POST /node/69cfe15a000c489abc2c3605 HTTP/1.0" 202 Accepted 2026-04-05 15:48:59,220 - lava_callback - INFO - Starting async job submit for node 69cfe15a000c489abc2c3605 2026-04-05 15:48:59,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:48:59,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfe15a000c489abc2c3605 HTTP/1.1" 200 None 2026-04-05 15:48:59,242 - lava_callback - DEBUG - Processing node 69cfe15a000c489abc2c3605: baseline-arm64-baylibre 2026-04-05 15:48:59,243 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfe15a000c489abc2c3605 2026-04-05 15:48:59,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:48:59,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfe15a000c489abc2c3605 HTTP/1.1" 200 None 2026-04-05 15:48:59,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:48:59,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-05 15:48:59,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:48:59,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfe15a000c489abc2c3605 HTTP/1.1" 200 None 2026-04-05 15:48:59,313 - lava_callback - ERROR - Error processing callback for node 69cfe15a000c489abc2c3605: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49750 - "GET / HTTP/1.0" 200 OK 2026-04-05 15:49:56,301 - lava_callback - INFO - Received callback for node 69cfe19a000c489abc2c3663 INFO: 172.21.0.1:50096 - "POST /node/69cfe19a000c489abc2c3663 HTTP/1.0" 202 Accepted 2026-04-05 15:49:56,307 - lava_callback - INFO - Starting async job submit for node 69cfe19a000c489abc2c3663 2026-04-05 15:49:56,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:49:56,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfe19a000c489abc2c3663 HTTP/1.1" 200 None 2026-04-05 15:49:56,323 - lava_callback - DEBUG - Processing node 69cfe19a000c489abc2c3663: baseline-arm64-clabbe 2026-04-05 15:49:56,323 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfe19a000c489abc2c3663 2026-04-05 15:49:56,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:49:56,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfe19a000c489abc2c3663 HTTP/1.1" 200 None 2026-04-05 15:49:56,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:49:56,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-05 15:49:56,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:49:56,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfe19a000c489abc2c3663 HTTP/1.1" 200 None 2026-04-05 15:49:56,381 - lava_callback - ERROR - Error processing callback for node 69cfe19a000c489abc2c3663: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47864 - "GET / HTTP/1.0" 200 OK 2026-04-05 15:50:56,308 - lava_callback - INFO - Received callback for node 69cfe1dd000c489abc2c36b2 INFO: 172.21.0.1:44996 - "POST /node/69cfe1dd000c489abc2c36b2 HTTP/1.0" 202 Accepted 2026-04-05 15:50:56,313 - lava_callback - INFO - Starting async job submit for node 69cfe1dd000c489abc2c36b2 2026-04-05 15:50:56,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:50:56,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfe1dd000c489abc2c36b2 HTTP/1.1" 200 None 2026-04-05 15:50:56,330 - lava_callback - DEBUG - Processing node 69cfe1dd000c489abc2c36b2: baseline-arm64-clabbe 2026-04-05 15:50:56,330 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfe1dd000c489abc2c36b2 2026-04-05 15:50:56,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:50:56,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfe1dd000c489abc2c36b2 HTTP/1.1" 200 None 2026-04-05 15:50:56,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:50:56,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-05 15:50:56,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:50:56,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfe1dd000c489abc2c36b2 HTTP/1.1" 200 None 2026-04-05 15:50:56,385 - lava_callback - ERROR - Error processing callback for node 69cfe1dd000c489abc2c36b2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58644 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:58648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48078 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48092 - "GET / HTTP/1.0" 200 OK 2026-04-05 15:52:19,422 - lava_callback - INFO - Received callback for node 69cfe21f000c489abc2c36e7 INFO: 172.21.0.1:48106 - "POST /node/69cfe21f000c489abc2c36e7 HTTP/1.0" 202 Accepted 2026-04-05 15:52:19,428 - lava_callback - INFO - Starting async job submit for node 69cfe21f000c489abc2c36e7 2026-04-05 15:52:19,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:52:19,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfe21f000c489abc2c36e7 HTTP/1.1" 200 None 2026-04-05 15:52:19,457 - lava_callback - DEBUG - Processing node 69cfe21f000c489abc2c36e7: baseline-arm64-baylibre 2026-04-05 15:52:19,457 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfe21f000c489abc2c36e7 2026-04-05 15:52:19,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:52:19,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfe21f000c489abc2c36e7 HTTP/1.1" 200 None 2026-04-05 15:52:19,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:52:19,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-05 15:52:19,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:52:19,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfe21f000c489abc2c36e7 HTTP/1.1" 200 None 2026-04-05 15:52:19,514 - lava_callback - ERROR - Error processing callback for node 69cfe21f000c489abc2c36e7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46944 - "GET / HTTP/1.0" 200 OK 2026-04-05 15:53:36,419 - lava_callback - INFO - Received callback for node 69cfe26e000c489abc2c3713 INFO: 172.21.0.1:52578 - "POST /node/69cfe26e000c489abc2c3713 HTTP/1.0" 202 Accepted 2026-04-05 15:53:36,424 - lava_callback - INFO - Starting async job submit for node 69cfe26e000c489abc2c3713 2026-04-05 15:53:36,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:53:36,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfe26e000c489abc2c3713 HTTP/1.1" 200 None 2026-04-05 15:53:36,442 - lava_callback - DEBUG - Processing node 69cfe26e000c489abc2c3713: baseline-arm64-clabbe 2026-04-05 15:53:36,442 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfe26e000c489abc2c3713 2026-04-05 15:53:36,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:53:36,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfe26e000c489abc2c3713 HTTP/1.1" 200 None 2026-04-05 15:53:36,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:53:36,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-05 15:53:36,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:53:36,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfe26e000c489abc2c3713 HTTP/1.1" 200 None 2026-04-05 15:53:36,508 - lava_callback - ERROR - Error processing callback for node 69cfe26e000c489abc2c3713: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36486 - "GET / HTTP/1.0" 200 OK 2026-04-05 15:54:39,530 - lava_callback - INFO - Received callback for node 69cfe2ae000c489abc2c374a INFO: 172.21.0.1:36502 - "POST /node/69cfe2ae000c489abc2c374a HTTP/1.0" 202 Accepted 2026-04-05 15:54:39,536 - lava_callback - INFO - Starting async job submit for node 69cfe2ae000c489abc2c374a 2026-04-05 15:54:39,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:54:39,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfe2ae000c489abc2c374a HTTP/1.1" 200 None 2026-04-05 15:54:39,553 - lava_callback - DEBUG - Processing node 69cfe2ae000c489abc2c374a: baseline-arm64-baylibre 2026-04-05 15:54:39,553 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfe2ae000c489abc2c374a 2026-04-05 15:54:39,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:54:39,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfe2ae000c489abc2c374a HTTP/1.1" 200 None 2026-04-05 15:54:39,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:54:39,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-05 15:54:39,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:54:39,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfe2ae000c489abc2c374a HTTP/1.1" 200 None 2026-04-05 15:54:39,616 - lava_callback - ERROR - Error processing callback for node 69cfe2ae000c489abc2c374a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55194 - "GET / HTTP/1.0" 200 OK 2026-04-05 15:55:56,460 - lava_callback - INFO - Received callback for node 69cfe2fb000c489abc2c3775 INFO: 172.21.0.1:58376 - "POST /node/69cfe2fb000c489abc2c3775 HTTP/1.0" 202 Accepted 2026-04-05 15:55:56,465 - lava_callback - INFO - Starting async job submit for node 69cfe2fb000c489abc2c3775 2026-04-05 15:55:56,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:55:56,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfe2fb000c489abc2c3775 HTTP/1.1" 200 None 2026-04-05 15:55:56,482 - lava_callback - DEBUG - Processing node 69cfe2fb000c489abc2c3775: baseline-arm64-clabbe 2026-04-05 15:55:56,482 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfe2fb000c489abc2c3775 2026-04-05 15:55:56,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:55:56,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfe2fb000c489abc2c3775 HTTP/1.1" 200 None 2026-04-05 15:55:56,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:55:56,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-05 15:55:56,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:58380 - "GET / HTTP/1.0" 200 OK 2026-04-05 15:55:56,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfe2fb000c489abc2c3775 HTTP/1.1" 200 None 2026-04-05 15:55:56,538 - lava_callback - ERROR - Error processing callback for node 69cfe2fb000c489abc2c3775: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33482 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40422 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40434 - "GET / HTTP/1.0" 200 OK 2026-04-05 15:57:16,541 - lava_callback - INFO - Received callback for node 69cfe347000c489abc2c378f INFO: 172.21.0.1:40442 - "POST /node/69cfe347000c489abc2c378f HTTP/1.0" 202 Accepted 2026-04-05 15:57:16,550 - lava_callback - INFO - Starting async job submit for node 69cfe347000c489abc2c378f 2026-04-05 15:57:16,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:57:16,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfe347000c489abc2c378f HTTP/1.1" 200 None 2026-04-05 15:57:16,571 - lava_callback - DEBUG - Processing node 69cfe347000c489abc2c378f: baseline-arm64-clabbe 2026-04-05 15:57:16,571 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfe347000c489abc2c378f 2026-04-05 15:57:16,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:57:16,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfe347000c489abc2c378f HTTP/1.1" 200 None 2026-04-05 15:57:16,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:57:16,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-05 15:57:16,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:57:16,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfe347000c489abc2c378f HTTP/1.1" 200 None 2026-04-05 15:57:16,643 - lava_callback - ERROR - Error processing callback for node 69cfe347000c489abc2c378f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50808 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:51946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41734 - "GET / HTTP/1.0" 200 OK 2026-04-05 15:58:16,616 - lava_callback - INFO - Received callback for node 69cfe391000c489abc2c37be INFO: 172.21.0.1:41744 - "POST /node/69cfe391000c489abc2c37be HTTP/1.0" 202 Accepted 2026-04-05 15:58:16,626 - lava_callback - INFO - Starting async job submit for node 69cfe391000c489abc2c37be 2026-04-05 15:58:16,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:58:16,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfe391000c489abc2c37be HTTP/1.1" 200 None 2026-04-05 15:58:16,643 - lava_callback - DEBUG - Processing node 69cfe391000c489abc2c37be: baseline-arm64-clabbe 2026-04-05 15:58:16,643 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfe391000c489abc2c37be 2026-04-05 15:58:16,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:58:16,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfe391000c489abc2c37be HTTP/1.1" 200 None 2026-04-05 15:58:16,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:58:16,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-05 15:58:16,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:58:16,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfe391000c489abc2c37be HTTP/1.1" 200 None 2026-04-05 15:58:16,702 - lava_callback - ERROR - Error processing callback for node 69cfe391000c489abc2c37be: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37136 - "GET / HTTP/1.0" 200 OK 2026-04-05 15:59:36,687 - lava_callback - INFO - Received callback for node 69cfe3d9000c489abc2c37ef INFO: 172.21.0.1:37138 - "POST /node/69cfe3d9000c489abc2c37ef HTTP/1.0" 202 Accepted 2026-04-05 15:59:36,693 - lava_callback - INFO - Starting async job submit for node 69cfe3d9000c489abc2c37ef 2026-04-05 15:59:36,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:59:36,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfe3d9000c489abc2c37ef HTTP/1.1" 200 None 2026-04-05 15:59:36,712 - lava_callback - DEBUG - Processing node 69cfe3d9000c489abc2c37ef: baseline-arm64-clabbe 2026-04-05 15:59:36,713 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfe3d9000c489abc2c37ef 2026-04-05 15:59:36,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:59:36,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfe3d9000c489abc2c37ef HTTP/1.1" 200 None 2026-04-05 15:59:36,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:59:36,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-05 15:59:36,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 15:59:36,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfe3d9000c489abc2c37ef HTTP/1.1" 200 None 2026-04-05 15:59:36,772 - lava_callback - ERROR - Error processing callback for node 69cfe3d9000c489abc2c37ef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60482 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50694 - "GET / HTTP/1.0" 200 OK 2026-04-05 16:00:56,785 - lava_callback - INFO - Received callback for node 69cfe423000c489abc2c3823 INFO: 172.21.0.1:50698 - "POST /node/69cfe423000c489abc2c3823 HTTP/1.0" 202 Accepted 2026-04-05 16:00:56,793 - lava_callback - INFO - Starting async job submit for node 69cfe423000c489abc2c3823 2026-04-05 16:00:56,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 16:00:56,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfe423000c489abc2c3823 HTTP/1.1" 200 None 2026-04-05 16:00:56,818 - lava_callback - DEBUG - Processing node 69cfe423000c489abc2c3823: baseline-arm64-clabbe 2026-04-05 16:00:56,818 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfe423000c489abc2c3823 2026-04-05 16:00:56,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 16:00:56,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfe423000c489abc2c3823 HTTP/1.1" 200 None 2026-04-05 16:00:56,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 16:00:56,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-05 16:00:56,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 16:00:56,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfe423000c489abc2c3823 HTTP/1.1" 200 None 2026-04-05 16:00:56,909 - lava_callback - ERROR - Error processing callback for node 69cfe423000c489abc2c3823: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51212 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39156 - "GET / HTTP/1.0" 200 OK 2026-04-05 16:02:00,120 - lava_callback - INFO - Received callback for node 69cfe469000c489abc2c3841 INFO: 172.21.0.1:55142 - "POST /node/69cfe469000c489abc2c3841 HTTP/1.0" 202 Accepted 2026-04-05 16:02:00,126 - lava_callback - INFO - Starting async job submit for node 69cfe469000c489abc2c3841 2026-04-05 16:02:00,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 16:02:00,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfe469000c489abc2c3841 HTTP/1.1" 200 None 2026-04-05 16:02:00,145 - lava_callback - DEBUG - Processing node 69cfe469000c489abc2c3841: baseline-arm64-baylibre 2026-04-05 16:02:00,146 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfe469000c489abc2c3841 2026-04-05 16:02:00,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 16:02:00,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfe469000c489abc2c3841 HTTP/1.1" 200 None 2026-04-05 16:02:00,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 16:02:00,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-05 16:02:00,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 16:02:00,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfe469000c489abc2c3841 HTTP/1.1" 200 None 2026-04-05 16:02:00,215 - lava_callback - ERROR - Error processing callback for node 69cfe469000c489abc2c3841: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44074 - "GET / HTTP/1.0" 200 OK 2026-04-05 16:02:59,955 - lava_callback - INFO - Received callback for node 69cfe4b2000c489abc2c3869 INFO: 172.21.0.1:41902 - "POST /node/69cfe4b2000c489abc2c3869 HTTP/1.0" 202 Accepted 2026-04-05 16:02:59,961 - lava_callback - INFO - Starting async job submit for node 69cfe4b2000c489abc2c3869 2026-04-05 16:02:59,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 16:02:59,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfe4b2000c489abc2c3869 HTTP/1.1" 200 None 2026-04-05 16:02:59,977 - lava_callback - DEBUG - Processing node 69cfe4b2000c489abc2c3869: baseline-arm64-baylibre 2026-04-05 16:02:59,978 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfe4b2000c489abc2c3869 2026-04-05 16:02:59,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 16:02:59,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfe4b2000c489abc2c3869 HTTP/1.1" 200 None 2026-04-05 16:02:59,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 16:03:00,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-05 16:03:00,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 16:03:00,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfe4b2000c489abc2c3869 HTTP/1.1" 200 None 2026-04-05 16:03:00,041 - lava_callback - ERROR - Error processing callback for node 69cfe4b2000c489abc2c3869: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38458 - "GET / HTTP/1.0" 200 OK 2026-04-05 16:04:16,894 - lava_callback - INFO - Received callback for node 69cfe4fd000c489abc2c389b INFO: 172.21.0.1:38460 - "POST /node/69cfe4fd000c489abc2c389b HTTP/1.0" 202 Accepted 2026-04-05 16:04:16,900 - lava_callback - INFO - Starting async job submit for node 69cfe4fd000c489abc2c389b 2026-04-05 16:04:16,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 16:04:16,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfe4fd000c489abc2c389b HTTP/1.1" 200 None 2026-04-05 16:04:16,916 - lava_callback - DEBUG - Processing node 69cfe4fd000c489abc2c389b: baseline-arm64-clabbe 2026-04-05 16:04:16,916 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfe4fd000c489abc2c389b 2026-04-05 16:04:16,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 16:04:16,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfe4fd000c489abc2c389b HTTP/1.1" 200 None 2026-04-05 16:04:16,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 16:04:16,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-05 16:04:16,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 16:04:16,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfe4fd000c489abc2c389b HTTP/1.1" 200 None 2026-04-05 16:04:16,967 - lava_callback - ERROR - Error processing callback for node 69cfe4fd000c489abc2c389b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40956 - "GET / HTTP/1.0" 200 OK 2026-04-05 16:05:20,081 - lava_callback - INFO - Received callback for node 69cfe53c000c489abc2c38e2 INFO: 172.21.0.1:57074 - "POST /node/69cfe53c000c489abc2c38e2 HTTP/1.0" 202 Accepted 2026-04-05 16:05:20,087 - lava_callback - INFO - Starting async job submit for node 69cfe53c000c489abc2c38e2 2026-04-05 16:05:20,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 16:05:20,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfe53c000c489abc2c38e2 HTTP/1.1" 200 None 2026-04-05 16:05:20,103 - lava_callback - DEBUG - Processing node 69cfe53c000c489abc2c38e2: baseline-arm64-baylibre 2026-04-05 16:05:20,104 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfe53c000c489abc2c38e2 2026-04-05 16:05:20,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 16:05:20,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfe53c000c489abc2c38e2 HTTP/1.1" 200 None 2026-04-05 16:05:20,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 16:05:20,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-05 16:05:20,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 16:05:20,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfe53c000c489abc2c38e2 HTTP/1.1" 200 None 2026-04-05 16:05:20,173 - lava_callback - ERROR - Error processing callback for node 69cfe53c000c489abc2c38e2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51018 - "GET / HTTP/1.0" 200 OK 2026-04-05 16:06:36,973 - lava_callback - INFO - Received callback for node 69cfe58a000c489abc2c3917 INFO: 172.21.0.1:51030 - "POST /node/69cfe58a000c489abc2c3917 HTTP/1.0" 202 Accepted 2026-04-05 16:06:36,979 - lava_callback - INFO - Starting async job submit for node 69cfe58a000c489abc2c3917 2026-04-05 16:06:36,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 16:06:37,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfe58a000c489abc2c3917 HTTP/1.1" 200 None 2026-04-05 16:06:37,002 - lava_callback - DEBUG - Processing node 69cfe58a000c489abc2c3917: baseline-arm64-clabbe 2026-04-05 16:06:37,002 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfe58a000c489abc2c3917 2026-04-05 16:06:37,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 16:06:37,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfe58a000c489abc2c3917 HTTP/1.1" 200 None 2026-04-05 16:06:37,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 16:06:37,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-05 16:06:37,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 16:06:37,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfe58a000c489abc2c3917 HTTP/1.1" 200 None 2026-04-05 16:06:37,065 - lava_callback - ERROR - Error processing callback for node 69cfe58a000c489abc2c3917: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45600 - "GET / HTTP/1.0" 200 OK 2026-04-05 16:07:57,037 - lava_callback - INFO - Received callback for node 69cfe5d3000c489abc2c3942 INFO: 172.21.0.1:45602 - "POST /node/69cfe5d3000c489abc2c3942 HTTP/1.0" 202 Accepted 2026-04-05 16:07:57,043 - lava_callback - INFO - Starting async job submit for node 69cfe5d3000c489abc2c3942 2026-04-05 16:07:57,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 16:07:57,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfe5d3000c489abc2c3942 HTTP/1.1" 200 None 2026-04-05 16:07:57,061 - lava_callback - DEBUG - Processing node 69cfe5d3000c489abc2c3942: baseline-arm64-clabbe 2026-04-05 16:07:57,061 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfe5d3000c489abc2c3942 2026-04-05 16:07:57,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 16:07:57,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfe5d3000c489abc2c3942 HTTP/1.1" 200 None 2026-04-05 16:07:57,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 16:07:57,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-05 16:07:57,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 16:07:57,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfe5d3000c489abc2c3942 HTTP/1.1" 200 None 2026-04-05 16:07:57,129 - lava_callback - ERROR - Error processing callback for node 69cfe5d3000c489abc2c3942: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46092 - "GET / HTTP/1.0" 200 OK 2026-04-05 16:09:00,365 - lava_callback - INFO - Received callback for node 69cfe61a000c489abc2c3957 INFO: 172.21.0.1:50240 - "POST /node/69cfe61a000c489abc2c3957 HTTP/1.0" 202 Accepted 2026-04-05 16:09:00,374 - lava_callback - INFO - Starting async job submit for node 69cfe61a000c489abc2c3957 2026-04-05 16:09:00,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 16:09:00,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfe61a000c489abc2c3957 HTTP/1.1" 200 None 2026-04-05 16:09:00,391 - lava_callback - DEBUG - Processing node 69cfe61a000c489abc2c3957: baseline-arm64-baylibre 2026-04-05 16:09:00,392 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfe61a000c489abc2c3957 2026-04-05 16:09:00,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 16:09:00,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfe61a000c489abc2c3957 HTTP/1.1" 200 None 2026-04-05 16:09:00,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 16:09:00,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-05 16:09:00,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 16:09:00,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfe61a000c489abc2c3957 HTTP/1.1" 200 None 2026-04-05 16:09:00,466 - lava_callback - ERROR - Error processing callback for node 69cfe61a000c489abc2c3957: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45914 - "GET / HTTP/1.0" 200 OK 2026-04-05 16:10:37,134 - lava_callback - INFO - Received callback for node 69cfe667000c489abc2c3999 INFO: 172.21.0.1:45928 - "POST /node/69cfe667000c489abc2c3999 HTTP/1.0" 202 Accepted 2026-04-05 16:10:37,144 - lava_callback - INFO - Starting async job submit for node 69cfe667000c489abc2c3999 2026-04-05 16:10:37,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 16:10:37,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfe667000c489abc2c3999 HTTP/1.1" 200 None 2026-04-05 16:10:37,165 - lava_callback - DEBUG - Processing node 69cfe667000c489abc2c3999: baseline-arm64-clabbe 2026-04-05 16:10:37,166 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfe667000c489abc2c3999 2026-04-05 16:10:37,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 16:10:37,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfe667000c489abc2c3999 HTTP/1.1" 200 None 2026-04-05 16:10:37,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 16:10:37,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-05 16:10:37,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 16:10:37,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfe667000c489abc2c3999 HTTP/1.1" 200 None 2026-04-05 16:10:37,219 - lava_callback - ERROR - Error processing callback for node 69cfe667000c489abc2c3999: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57210 - "GET / HTTP/1.0" 200 OK 2026-04-05 16:11:37,170 - lava_callback - INFO - Received callback for node 69cfe6ab000c489abc2c39db INFO: 172.21.0.1:57216 - "POST /node/69cfe6ab000c489abc2c39db HTTP/1.0" 202 Accepted 2026-04-05 16:11:37,175 - lava_callback - INFO - Starting async job submit for node 69cfe6ab000c489abc2c39db 2026-04-05 16:11:37,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 16:11:37,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfe6ab000c489abc2c39db HTTP/1.1" 200 None 2026-04-05 16:11:37,192 - lava_callback - DEBUG - Processing node 69cfe6ab000c489abc2c39db: baseline-arm64-clabbe 2026-04-05 16:11:37,192 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfe6ab000c489abc2c39db 2026-04-05 16:11:37,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 16:11:37,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfe6ab000c489abc2c39db HTTP/1.1" 200 None 2026-04-05 16:11:37,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 16:11:37,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-05 16:11:37,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 16:11:37,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfe6ab000c489abc2c39db HTTP/1.1" 200 None 2026-04-05 16:11:37,249 - lava_callback - ERROR - Error processing callback for node 69cfe6ab000c489abc2c39db: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53412 - "GET / HTTP/1.0" 200 OK 2026-04-05 16:12:57,221 - lava_callback - INFO - Received callback for node 69cfe6f4000c489abc2c3a0d INFO: 172.21.0.1:53414 - "POST /node/69cfe6f4000c489abc2c3a0d HTTP/1.0" 202 Accepted 2026-04-05 16:12:57,226 - lava_callback - INFO - Starting async job submit for node 69cfe6f4000c489abc2c3a0d 2026-04-05 16:12:57,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 16:12:57,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfe6f4000c489abc2c3a0d HTTP/1.1" 200 None 2026-04-05 16:12:57,243 - lava_callback - DEBUG - Processing node 69cfe6f4000c489abc2c3a0d: baseline-arm64-clabbe 2026-04-05 16:12:57,243 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cfe6f4000c489abc2c3a0d 2026-04-05 16:12:57,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 16:12:57,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cfe6f4000c489abc2c3a0d HTTP/1.1" 200 None 2026-04-05 16:12:57,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 16:12:57,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-05 16:12:57,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 16:12:57,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cfe6f4000c489abc2c3a0d HTTP/1.1" 200 None 2026-04-05 16:12:57,310 - lava_callback - ERROR - Error processing callback for node 69cfe6f4000c489abc2c3a0d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55734 - "GET / HTTP/1.0" 200 OK INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1]