INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.19.0.1:49352 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:14:10,840 - lava_callback - INFO - Received callback for node 69b589451727ff69d6f26256 2026-03-16 16:14:10,846 - lava_callback - INFO - Starting async job submit for node 69b589451727ff69d6f26256 INFO: 172.19.0.1:42600 - "POST /node/69b589451727ff69d6f26256 HTTP/1.0" 202 Accepted 2026-03-16 16:14:10,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:14:10,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b589451727ff69d6f26256 HTTP/1.1" 200 None 2026-03-16 16:14:10,869 - lava_callback - DEBUG - Processing node 69b589451727ff69d6f26256: baseline-arm64-clabbe 2026-03-16 16:14:10,869 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b589451727ff69d6f26256 2026-03-16 16:14:10,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:14:10,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b589451727ff69d6f26256 HTTP/1.1" 200 None 2026-03-16 16:14:10,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:14:10,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-16 16:14:10,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:14:10,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b589451727ff69d6f26256 HTTP/1.1" 200 None 2026-03-16 16:14:10,995 - lava_callback - ERROR - Error processing callback for node 69b589451727ff69d6f26256: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:42616 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42618 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45332 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45340 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45342 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32842 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39534 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.19.0.1:39538 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42584 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43942 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:15:10,850 - lava_callback - INFO - Received callback for node 69b589841727ff69d6f2625e INFO: 172.19.0.1:49120 - "POST /node/69b589841727ff69d6f2625e HTTP/1.0" 202 Accepted 2026-03-16 16:15:10,856 - lava_callback - INFO - Starting async job submit for node 69b589841727ff69d6f2625e 2026-03-16 16:15:10,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:15:10,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b589841727ff69d6f2625e HTTP/1.1" 200 None 2026-03-16 16:15:10,873 - lava_callback - DEBUG - Processing node 69b589841727ff69d6f2625e: baseline-arm-clabbe 2026-03-16 16:15:10,873 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b589841727ff69d6f2625e 2026-03-16 16:15:10,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:15:10,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b589841727ff69d6f2625e HTTP/1.1" 200 None 2026-03-16 16:15:10,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:15:10,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd826ae557f2600f0f036 HTTP/1.1" 200 None 2026-03-16 16:15:10,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:15:10,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b589841727ff69d6f2625e HTTP/1.1" 200 None 2026-03-16 16:15:10,937 - lava_callback - ERROR - Error processing callback for node 69b589841727ff69d6f2625e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:49124 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49136 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37946 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37950 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48004 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50758 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48256 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59014 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:16:10,934 - lava_callback - INFO - Received callback for node 69b589b61727ff69d6f2626c INFO: 172.19.0.1:36584 - "POST /node/69b589b61727ff69d6f2626c HTTP/1.0" 202 Accepted 2026-03-16 16:16:10,940 - lava_callback - INFO - Starting async job submit for node 69b589b61727ff69d6f2626c 2026-03-16 16:16:10,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:16:10,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b589b61727ff69d6f2626c HTTP/1.1" 200 None 2026-03-16 16:16:10,956 - lava_callback - DEBUG - Processing node 69b589b61727ff69d6f2626c: baseline-arm64-clabbe 2026-03-16 16:16:10,956 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b589b61727ff69d6f2626c 2026-03-16 16:16:10,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:16:10,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b589b61727ff69d6f2626c HTTP/1.1" 200 None 2026-03-16 16:16:10,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:16:11,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-16 16:16:11,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:16:11,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b589b61727ff69d6f2626c HTTP/1.1" 200 None 2026-03-16 16:16:11,057 - lava_callback - ERROR - Error processing callback for node 69b589b61727ff69d6f2626c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:36588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36594 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55144 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55160 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34096 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59100 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34896 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38690 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:17:10,991 - lava_callback - INFO - Received callback for node 69b589f41727ff69d6f26273 INFO: 172.19.0.1:60206 - "POST /node/69b589f41727ff69d6f26273 HTTP/1.0" 202 Accepted 2026-03-16 16:17:10,997 - lava_callback - INFO - Starting async job submit for node 69b589f41727ff69d6f26273 2026-03-16 16:17:10,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:17:11,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b589f41727ff69d6f26273 HTTP/1.1" 200 None 2026-03-16 16:17:11,019 - lava_callback - DEBUG - Processing node 69b589f41727ff69d6f26273: baseline-arm-clabbe 2026-03-16 16:17:11,019 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b589f41727ff69d6f26273 2026-03-16 16:17:11,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:17:11,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b589f41727ff69d6f26273 HTTP/1.1" 200 None 2026-03-16 16:17:11,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:17:11,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd826ae557f2600f0f036 HTTP/1.1" 200 None 2026-03-16 16:17:11,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:17:11,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b589f41727ff69d6f26273 HTTP/1.1" 200 None 2026-03-16 16:17:11,096 - lava_callback - ERROR - Error processing callback for node 69b589f41727ff69d6f26273: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:60222 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60230 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45874 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45884 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47368 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41786 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:17:50,972 - lava_callback - INFO - Received callback for node 69b58a191727ff69d6f2627d INFO: 172.19.0.1:33396 - "POST /node/69b58a191727ff69d6f2627d HTTP/1.0" 202 Accepted 2026-03-16 16:17:50,977 - lava_callback - INFO - Starting async job submit for node 69b58a191727ff69d6f2627d 2026-03-16 16:17:50,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:17:51,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b58a191727ff69d6f2627d HTTP/1.1" 200 None 2026-03-16 16:17:51,005 - lava_callback - DEBUG - Processing node 69b58a191727ff69d6f2627d: baseline-arm-clabbe 2026-03-16 16:17:51,005 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b58a191727ff69d6f2627d 2026-03-16 16:17:51,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:17:51,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b58a191727ff69d6f2627d HTTP/1.1" 200 None 2026-03-16 16:17:51,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:17:51,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd826ae557f2600f0f036 HTTP/1.1" 200 None 2026-03-16 16:17:51,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:17:51,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b58a191727ff69d6f2627d HTTP/1.1" 200 None 2026-03-16 16:17:51,064 - lava_callback - ERROR - Error processing callback for node 69b58a191727ff69d6f2627d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:33404 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56068 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56082 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.19.0.1:58804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58818 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50684 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50686 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:18:31,046 - lava_callback - INFO - Received callback for node 69b58a4b1727ff69d6f26288 INFO: 172.19.0.1:50186 - "POST /node/69b58a4b1727ff69d6f26288 HTTP/1.0" 202 Accepted 2026-03-16 16:18:31,051 - lava_callback - INFO - Starting async job submit for node 69b58a4b1727ff69d6f26288 2026-03-16 16:18:31,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:18:31,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b58a4b1727ff69d6f26288 HTTP/1.1" 200 None 2026-03-16 16:18:31,072 - lava_callback - DEBUG - Processing node 69b58a4b1727ff69d6f26288: baseline-arm64-clabbe 2026-03-16 16:18:31,072 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b58a4b1727ff69d6f26288 2026-03-16 16:18:31,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:18:31,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b58a4b1727ff69d6f26288 HTTP/1.1" 200 None 2026-03-16 16:18:31,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:18:31,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-16 16:18:31,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:18:31,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b58a4b1727ff69d6f26288 HTTP/1.1" 200 None 2026-03-16 16:18:31,130 - lava_callback - ERROR - Error processing callback for node 69b58a4b1727ff69d6f26288: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:50200 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44594 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34886 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53840 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34666 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51170 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51182 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:19:31,100 - lava_callback - INFO - Received callback for node 69b58a891727ff69d6f26290 INFO: 172.19.0.1:51148 - "POST /node/69b58a891727ff69d6f26290 HTTP/1.0" 202 Accepted 2026-03-16 16:19:31,105 - lava_callback - INFO - Starting async job submit for node 69b58a891727ff69d6f26290 2026-03-16 16:19:31,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:19:31,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b58a891727ff69d6f26290 HTTP/1.1" 200 None 2026-03-16 16:19:31,122 - lava_callback - DEBUG - Processing node 69b58a891727ff69d6f26290: baseline-arm-clabbe 2026-03-16 16:19:31,122 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b58a891727ff69d6f26290 2026-03-16 16:19:31,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:19:31,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b58a891727ff69d6f26290 HTTP/1.1" 200 None 2026-03-16 16:19:31,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:19:31,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd826ae557f2600f0f036 HTTP/1.1" 200 None 2026-03-16 16:19:31,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:19:31,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b58a891727ff69d6f26290 HTTP/1.1" 200 None 2026-03-16 16:19:31,179 - lava_callback - ERROR - Error processing callback for node 69b58a891727ff69d6f26290: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:51154 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42800 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42354 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57266 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:20:13,381 - lava_callback - INFO - Received callback for node 69b58aa91727ff69d6f26299 INFO: 172.19.0.1:33854 - "POST /node/69b58aa91727ff69d6f26299 HTTP/1.0" 202 Accepted 2026-03-16 16:20:13,387 - lava_callback - INFO - Starting async job submit for node 69b58aa91727ff69d6f26299 2026-03-16 16:20:13,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:20:13,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b58aa91727ff69d6f26299 HTTP/1.1" 200 None 2026-03-16 16:20:13,402 - lava_callback - DEBUG - Processing node 69b58aa91727ff69d6f26299: baseline-arm-baylibre 2026-03-16 16:20:13,403 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b58aa91727ff69d6f26299 2026-03-16 16:20:13,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:20:13,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b58aa91727ff69d6f26299 HTTP/1.1" 200 None 2026-03-16 16:20:13,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:20:13,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-16 16:20:13,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:20:13,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b58aa91727ff69d6f26299 HTTP/1.1" 200 None 2026-03-16 16:20:13,519 - lava_callback - ERROR - Error processing callback for node 69b58aa91727ff69d6f26299: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:33860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33874 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48768 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48778 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:20:33,263 - lava_callback - INFO - Received callback for node 69b58acd1727ff69d6f262a2 INFO: 172.19.0.1:50690 - "POST /node/69b58acd1727ff69d6f262a2 HTTP/1.0" 202 Accepted 2026-03-16 16:20:33,268 - lava_callback - INFO - Starting async job submit for node 69b58acd1727ff69d6f262a2 2026-03-16 16:20:33,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:20:33,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b58acd1727ff69d6f262a2 HTTP/1.1" 200 None 2026-03-16 16:20:33,311 - lava_callback - DEBUG - Processing node 69b58acd1727ff69d6f262a2: baseline-arm-baylibre 2026-03-16 16:20:33,311 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b58acd1727ff69d6f262a2 2026-03-16 16:20:33,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:20:33,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b58acd1727ff69d6f262a2 HTTP/1.1" 200 None 2026-03-16 16:20:33,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:20:33,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-16 16:20:33,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:20:33,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b58acd1727ff69d6f262a2 HTTP/1.1" 200 None 2026-03-16 16:20:33,376 - lava_callback - ERROR - Error processing callback for node 69b58acd1727ff69d6f262a2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:50694 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50082 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:20:53,517 - lava_callback - INFO - Received callback for node 69b82b7e113612b7716bcf4b INFO: 172.19.0.1:60694 - "POST /node/69b82b7e113612b7716bcf4b HTTP/1.0" 202 Accepted 2026-03-16 16:20:53,524 - lava_callback - INFO - Starting async job submit for node 69b82b7e113612b7716bcf4b 2026-03-16 16:20:53,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:20:53,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82b7e113612b7716bcf4b HTTP/1.1" 200 None 2026-03-16 16:20:53,574 - lava_callback - DEBUG - Processing node 69b82b7e113612b7716bcf4b: baseline-arm64 2026-03-16 16:20:54,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:20:54,244 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:20:54,245 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b82b7e113612b7716bcf4b/log.txt.gz 2026-03-16 16:20:54,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:20:54,746 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:20:54,748 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b82b7e113612b7716bcf4b/lava-logs.yaml 2026-03-16 16:20:54,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:20:54,931 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:20:54,933 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b82b7e113612b7716bcf4b/lava_callback.json.gz 2026-03-16 16:20:54,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:20:54,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82b7e113612b7716bcf4b HTTP/1.1" 200 None 2026-03-16 16:20:54,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:20:54,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 16:20:54,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:20:55,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b82b7e113612b7716bcf4b HTTP/1.1" 200 None 2026-03-16 16:20:55,057 - lava_callback - INFO - Completed processing callback for node 69b82b7e113612b7716bcf4b INFO: 172.19.0.1:60710 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34362 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:21:10,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:21:11,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-16 16:21:13,272 - lava_callback - INFO - Received callback for node 69b58af01727ff69d6f262ab INFO: 172.19.0.1:50828 - "POST /node/69b58af01727ff69d6f262ab HTTP/1.0" 202 Accepted 2026-03-16 16:21:13,277 - lava_callback - INFO - Starting async job submit for node 69b58af01727ff69d6f262ab 2026-03-16 16:21:13,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:21:13,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b58af01727ff69d6f262ab HTTP/1.1" 200 None 2026-03-16 16:21:13,293 - lava_callback - DEBUG - Processing node 69b58af01727ff69d6f262ab: baseline-arm-baylibre 2026-03-16 16:21:13,294 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b58af01727ff69d6f262ab 2026-03-16 16:21:13,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:21:13,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b58af01727ff69d6f262ab HTTP/1.1" 200 None 2026-03-16 16:21:13,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:21:13,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-16 16:21:13,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:21:13,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b58af01727ff69d6f262ab HTTP/1.1" 200 None 2026-03-16 16:21:13,362 - lava_callback - ERROR - Error processing callback for node 69b58af01727ff69d6f262ab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:50834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50846 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53000 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53006 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38920 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56722 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:21:53,340 - lava_callback - INFO - Received callback for node 69b58b151727ff69d6f262b7 INFO: 172.19.0.1:55530 - "POST /node/69b58b151727ff69d6f262b7 HTTP/1.0" 202 Accepted 2026-03-16 16:21:53,346 - lava_callback - INFO - Starting async job submit for node 69b58b151727ff69d6f262b7 2026-03-16 16:21:53,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:21:53,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b58b151727ff69d6f262b7 HTTP/1.1" 200 None 2026-03-16 16:21:53,365 - lava_callback - DEBUG - Processing node 69b58b151727ff69d6f262b7: baseline-arm-baylibre 2026-03-16 16:21:53,365 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b58b151727ff69d6f262b7 2026-03-16 16:21:53,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:21:53,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b58b151727ff69d6f262b7 HTTP/1.1" 200 None 2026-03-16 16:21:53,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:21:53,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-16 16:21:53,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:21:53,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b58b151727ff69d6f262b7 HTTP/1.1" 200 None 2026-03-16 16:21:53,421 - lava_callback - ERROR - Error processing callback for node 69b58b151727ff69d6f262b7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:55538 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34112 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48918 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36786 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36802 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:22:33,359 - lava_callback - INFO - Received callback for node 69b58b381727ff69d6f262c0 INFO: 172.19.0.1:45944 - "POST /node/69b58b381727ff69d6f262c0 HTTP/1.0" 202 Accepted 2026-03-16 16:22:33,365 - lava_callback - INFO - Starting async job submit for node 69b58b381727ff69d6f262c0 2026-03-16 16:22:33,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:22:33,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b58b381727ff69d6f262c0 HTTP/1.1" 200 None 2026-03-16 16:22:33,382 - lava_callback - DEBUG - Processing node 69b58b381727ff69d6f262c0: baseline-arm-baylibre 2026-03-16 16:22:33,382 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b58b381727ff69d6f262c0 2026-03-16 16:22:33,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:22:33,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b58b381727ff69d6f262c0 HTTP/1.1" 200 None 2026-03-16 16:22:33,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:22:33,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-16 16:22:33,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:22:33,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b58b381727ff69d6f262c0 HTTP/1.1" 200 None 2026-03-16 16:22:33,446 - lava_callback - ERROR - Error processing callback for node 69b58b381727ff69d6f262c0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:45960 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44112 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:22:53,380 - lava_callback - INFO - Received callback for node 69b58b591727ff69d6f262cb INFO: 172.19.0.1:36456 - "POST /node/69b58b591727ff69d6f262cb HTTP/1.0" 202 Accepted 2026-03-16 16:22:53,385 - lava_callback - INFO - Starting async job submit for node 69b58b591727ff69d6f262cb 2026-03-16 16:22:53,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:22:53,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b58b591727ff69d6f262cb HTTP/1.1" 200 None 2026-03-16 16:22:53,441 - lava_callback - DEBUG - Processing node 69b58b591727ff69d6f262cb: baseline-arm-baylibre 2026-03-16 16:22:53,441 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b58b591727ff69d6f262cb 2026-03-16 16:22:53,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:22:53,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b58b591727ff69d6f262cb HTTP/1.1" 200 None 2026-03-16 16:22:53,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:22:53,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-16 16:22:53,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:22:53,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b58b591727ff69d6f262cb HTTP/1.1" 200 None 2026-03-16 16:22:53,523 - lava_callback - ERROR - Error processing callback for node 69b58b591727ff69d6f262cb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:36462 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58224 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50816 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43046 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43058 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:23:33,499 - lava_callback - INFO - Received callback for node 69b58b7d1727ff69d6f262d4 INFO: 172.19.0.1:49854 - "POST /node/69b58b7d1727ff69d6f262d4 HTTP/1.0" 202 Accepted 2026-03-16 16:23:33,505 - lava_callback - INFO - Starting async job submit for node 69b58b7d1727ff69d6f262d4 2026-03-16 16:23:33,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:23:33,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b58b7d1727ff69d6f262d4 HTTP/1.1" 200 None 2026-03-16 16:23:33,531 - lava_callback - DEBUG - Processing node 69b58b7d1727ff69d6f262d4: baseline-arm-baylibre 2026-03-16 16:23:33,531 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b58b7d1727ff69d6f262d4 2026-03-16 16:23:33,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:23:33,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b58b7d1727ff69d6f262d4 HTTP/1.1" 200 None 2026-03-16 16:23:33,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:23:33,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-16 16:23:33,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:23:33,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b58b7d1727ff69d6f262d4 HTTP/1.1" 200 None 2026-03-16 16:23:33,603 - lava_callback - ERROR - Error processing callback for node 69b58b7d1727ff69d6f262d4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:49866 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49500 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47596 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58228 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:24:11,541 - lava_callback - INFO - Received callback for node 69b58ba51727ff69d6f262dd INFO: 172.19.0.1:59946 - "POST /node/69b58ba51727ff69d6f262dd HTTP/1.0" 202 Accepted 2026-03-16 16:24:11,546 - lava_callback - INFO - Starting async job submit for node 69b58ba51727ff69d6f262dd 2026-03-16 16:24:11,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:24:11,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b58ba51727ff69d6f262dd HTTP/1.1" 200 None 2026-03-16 16:24:11,587 - lava_callback - DEBUG - Processing node 69b58ba51727ff69d6f262dd: baseline-arm-clabbe 2026-03-16 16:24:11,588 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b58ba51727ff69d6f262dd 2026-03-16 16:24:11,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:24:11,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b58ba51727ff69d6f262dd HTTP/1.1" 200 None 2026-03-16 16:24:11,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:24:11,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-16 16:24:11,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:24:11,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b58ba51727ff69d6f262dd HTTP/1.1" 200 None 2026-03-16 16:24:11,641 - lava_callback - ERROR - Error processing callback for node 69b58ba51727ff69d6f262dd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:59954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59962 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:24:21,096 - lava_callback - INFO - Received callback for node 69b82c20113612b7716bcf5e INFO: 172.19.0.1:56028 - "POST /node/69b82c20113612b7716bcf5e HTTP/1.0" 202 Accepted 2026-03-16 16:24:21,103 - lava_callback - INFO - Starting async job submit for node 69b82c20113612b7716bcf5e 2026-03-16 16:24:21,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:24:21,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82c20113612b7716bcf5e HTTP/1.1" 200 None 2026-03-16 16:24:21,162 - lava_callback - DEBUG - Processing node 69b82c20113612b7716bcf5e: baseline-nfs-arm64 2026-03-16 16:24:21,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:24:21,820 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:24:21,822 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b82c20113612b7716bcf5e/log.txt.gz 2026-03-16 16:24:22,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:24:22,297 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:24:22,299 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b82c20113612b7716bcf5e/lava-logs.yaml 2026-03-16 16:24:22,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:24:22,496 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:24:22,499 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b82c20113612b7716bcf5e/lava_callback.json.gz 2026-03-16 16:24:22,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:24:22,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82c20113612b7716bcf5e HTTP/1.1" 200 None 2026-03-16 16:24:22,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:24:22,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 16:24:22,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:24:22,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b82c20113612b7716bcf5e HTTP/1.1" 200 None 2026-03-16 16:24:22,655 - lava_callback - INFO - Completed processing callback for node 69b82c20113612b7716bcf5e INFO: 172.19.0.1:56034 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56048 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57322 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:24:41,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:24:41,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:39360 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:24:53,595 - lava_callback - INFO - Received callback for node 69b58bc51727ff69d6f262eb INFO: 172.19.0.1:38426 - "POST /node/69b58bc51727ff69d6f262eb HTTP/1.0" 202 Accepted 2026-03-16 16:24:53,600 - lava_callback - INFO - Starting async job submit for node 69b58bc51727ff69d6f262eb 2026-03-16 16:24:53,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:24:53,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b58bc51727ff69d6f262eb HTTP/1.1" 200 None 2026-03-16 16:24:53,616 - lava_callback - DEBUG - Processing node 69b58bc51727ff69d6f262eb: baseline-arm-baylibre 2026-03-16 16:24:53,617 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b58bc51727ff69d6f262eb 2026-03-16 16:24:53,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:24:53,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b58bc51727ff69d6f262eb HTTP/1.1" 200 None 2026-03-16 16:24:53,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:24:53,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-16 16:24:53,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:24:53,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b58bc51727ff69d6f262eb HTTP/1.1" 200 None 2026-03-16 16:24:53,694 - lava_callback - ERROR - Error processing callback for node 69b58bc51727ff69d6f262eb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:38434 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40358 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59548 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50322 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50330 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:25:31,461 - lava_callback - INFO - Received callback for node 69b58bec1727ff69d6f262f4 INFO: 172.19.0.1:52712 - "POST /node/69b58bec1727ff69d6f262f4 HTTP/1.0" 202 Accepted 2026-03-16 16:25:31,467 - lava_callback - INFO - Starting async job submit for node 69b58bec1727ff69d6f262f4 2026-03-16 16:25:31,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:25:31,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b58bec1727ff69d6f262f4 HTTP/1.1" 200 None 2026-03-16 16:25:31,485 - lava_callback - DEBUG - Processing node 69b58bec1727ff69d6f262f4: baseline-arm-clabbe 2026-03-16 16:25:31,485 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b58bec1727ff69d6f262f4 2026-03-16 16:25:31,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:25:31,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b58bec1727ff69d6f262f4 HTTP/1.1" 200 None 2026-03-16 16:25:31,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:25:31,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-16 16:25:31,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:25:31,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b58bec1727ff69d6f262f4 HTTP/1.1" 200 None 2026-03-16 16:25:31,553 - lava_callback - ERROR - Error processing callback for node 69b58bec1727ff69d6f262f4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:52714 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40984 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38542 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51532 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:26:11,420 - lava_callback - INFO - Received callback for node 69b58c111727ff69d6f262fd INFO: 172.19.0.1:49010 - "POST /node/69b58c111727ff69d6f262fd HTTP/1.0" 202 Accepted 2026-03-16 16:26:11,426 - lava_callback - INFO - Starting async job submit for node 69b58c111727ff69d6f262fd 2026-03-16 16:26:11,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:26:11,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b58c111727ff69d6f262fd HTTP/1.1" 200 None 2026-03-16 16:26:11,461 - lava_callback - DEBUG - Processing node 69b58c111727ff69d6f262fd: baseline-arm-clabbe 2026-03-16 16:26:11,461 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b58c111727ff69d6f262fd 2026-03-16 16:26:11,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:26:11,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b58c111727ff69d6f262fd HTTP/1.1" 200 None 2026-03-16 16:26:11,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:26:11,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-16 16:26:11,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:26:11,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b58c111727ff69d6f262fd HTTP/1.1" 200 None 2026-03-16 16:26:11,525 - lava_callback - ERROR - Error processing callback for node 69b58c111727ff69d6f262fd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:49016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49020 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48244 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48252 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38146 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45288 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:26:53,794 - lava_callback - INFO - Received callback for node 69b58c3a1727ff69d6f26308 INFO: 172.19.0.1:36942 - "POST /node/69b58c3a1727ff69d6f26308 HTTP/1.0" 202 Accepted 2026-03-16 16:26:53,804 - lava_callback - INFO - Starting async job submit for node 69b58c3a1727ff69d6f26308 2026-03-16 16:26:53,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:26:53,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b58c3a1727ff69d6f26308 HTTP/1.1" 200 None 2026-03-16 16:26:53,824 - lava_callback - DEBUG - Processing node 69b58c3a1727ff69d6f26308: baseline-arm64-baylibre 2026-03-16 16:26:53,824 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b58c3a1727ff69d6f26308 2026-03-16 16:26:53,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:26:53,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b58c3a1727ff69d6f26308 HTTP/1.1" 200 None 2026-03-16 16:26:53,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:26:53,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-16 16:26:53,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:26:53,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b58c3a1727ff69d6f26308 HTTP/1.1" 200 None 2026-03-16 16:26:53,903 - lava_callback - ERROR - Error processing callback for node 69b58c3a1727ff69d6f26308: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:36948 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53660 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:32800 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46758 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46760 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34964 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34976 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:27:53,623 - lava_callback - INFO - Received callback for node 69b58c7d1727ff69d6f26314 INFO: 172.19.0.1:59950 - "POST /node/69b58c7d1727ff69d6f26314 HTTP/1.0" 202 Accepted 2026-03-16 16:27:53,629 - lava_callback - INFO - Starting async job submit for node 69b58c7d1727ff69d6f26314 2026-03-16 16:27:53,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:27:53,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b58c7d1727ff69d6f26314 HTTP/1.1" 200 None 2026-03-16 16:27:53,674 - lava_callback - DEBUG - Processing node 69b58c7d1727ff69d6f26314: baseline-arm-baylibre 2026-03-16 16:27:53,674 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b58c7d1727ff69d6f26314 2026-03-16 16:27:53,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:27:53,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b58c7d1727ff69d6f26314 HTTP/1.1" 200 None 2026-03-16 16:27:53,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:27:53,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-16 16:27:53,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:27:53,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b58c7d1727ff69d6f26314 HTTP/1.1" 200 None 2026-03-16 16:27:53,731 - lava_callback - ERROR - Error processing callback for node 69b58c7d1727ff69d6f26314: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:59966 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38560 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33120 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41478 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41482 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:28:33,754 - lava_callback - INFO - Received callback for node 69b58ca31727ff69d6f2631f INFO: 172.19.0.1:58716 - "POST /node/69b58ca31727ff69d6f2631f HTTP/1.0" 202 Accepted 2026-03-16 16:28:33,760 - lava_callback - INFO - Starting async job submit for node 69b58ca31727ff69d6f2631f 2026-03-16 16:28:33,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:28:33,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b58ca31727ff69d6f2631f HTTP/1.1" 200 None 2026-03-16 16:28:33,776 - lava_callback - DEBUG - Processing node 69b58ca31727ff69d6f2631f: baseline-arm-baylibre 2026-03-16 16:28:33,776 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b58ca31727ff69d6f2631f 2026-03-16 16:28:33,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:28:33,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b58ca31727ff69d6f2631f HTTP/1.1" 200 None 2026-03-16 16:28:33,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:28:33,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-16 16:28:33,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:28:33,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b58ca31727ff69d6f2631f HTTP/1.1" 200 None 2026-03-16 16:28:33,870 - lava_callback - ERROR - Error processing callback for node 69b58ca31727ff69d6f2631f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:58724 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45798 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57006 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48524 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:29:11,585 - lava_callback - INFO - Received callback for node 69b58cc91727ff69d6f2632a INFO: 172.19.0.1:41790 - "POST /node/69b58cc91727ff69d6f2632a HTTP/1.0" 202 Accepted 2026-03-16 16:29:11,590 - lava_callback - INFO - Starting async job submit for node 69b58cc91727ff69d6f2632a 2026-03-16 16:29:11,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:29:11,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b58cc91727ff69d6f2632a HTTP/1.1" 200 None 2026-03-16 16:29:11,607 - lava_callback - DEBUG - Processing node 69b58cc91727ff69d6f2632a: baseline-arm-clabbe 2026-03-16 16:29:11,607 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b58cc91727ff69d6f2632a 2026-03-16 16:29:11,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:29:11,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b58cc91727ff69d6f2632a HTTP/1.1" 200 None 2026-03-16 16:29:11,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:29:11,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-16 16:29:11,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:29:11,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b58cc91727ff69d6f2632a HTTP/1.1" 200 None 2026-03-16 16:29:11,660 - lava_callback - ERROR - Error processing callback for node 69b58cc91727ff69d6f2632a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:41800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41812 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:29:23,824 - lava_callback - INFO - Received callback for node 69b82f590b8ad4124cec35cb INFO: 172.19.0.1:60958 - "POST /node/69b82f590b8ad4124cec35cb HTTP/1.0" 202 Accepted 2026-03-16 16:29:23,830 - lava_callback - INFO - Starting async job submit for node 69b82f590b8ad4124cec35cb 2026-03-16 16:29:23,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:29:23,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82f590b8ad4124cec35cb HTTP/1.1" 200 None 2026-03-16 16:29:23,868 - lava_callback - DEBUG - Processing node 69b82f590b8ad4124cec35cb: baseline-arm 2026-03-16 16:29:24,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:29:24,246 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:29:24,248 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b82f590b8ad4124cec35cb/log.txt.gz 2026-03-16 16:29:24,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:29:24,569 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:29:24,571 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b82f590b8ad4124cec35cb/lava-logs.yaml 2026-03-16 16:29:24,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:29:24,751 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:29:24,753 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b82f590b8ad4124cec35cb/lava_callback.json.gz 2026-03-16 16:29:24,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:29:24,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82f590b8ad4124cec35cb HTTP/1.1" 200 None 2026-03-16 16:29:24,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:29:24,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d3d0b8ad4124cec355d HTTP/1.1" 200 None 2026-03-16 16:29:24,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:29:24,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b82f590b8ad4124cec35cb HTTP/1.1" 200 None 2026-03-16 16:29:24,853 - lava_callback - INFO - Completed processing callback for node 69b82f590b8ad4124cec35cb INFO: 172.19.0.1:60966 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60974 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36020 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:29:41,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:29:41,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:46206 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:29:49,676 - lava_callback - INFO - Received callback for node 69b81945113612b7716bc9ef INFO: 172.19.0.1:46214 - "POST /node/69b81945113612b7716bc9ef HTTP/1.0" 202 Accepted 2026-03-16 16:29:49,682 - lava_callback - INFO - Starting async job submit for node 69b81945113612b7716bc9ef 2026-03-16 16:29:49,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:29:49,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81945113612b7716bc9ef HTTP/1.1" 200 None 2026-03-16 16:29:49,744 - lava_callback - DEBUG - Processing node 69b81945113612b7716bc9ef: baseline-arm64 2026-03-16 16:29:50,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:29:50,213 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:29:50,215 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b81945113612b7716bc9ef/log.txt.gz 2026-03-16 16:29:50,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:29:50,648 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:29:50,650 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b81945113612b7716bc9ef/lava-logs.yaml 2026-03-16 16:29:50,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:29:50,828 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:29:50,830 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b81945113612b7716bc9ef/lava_callback.json.gz 2026-03-16 16:29:50,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:29:50,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81945113612b7716bc9ef HTTP/1.1" 200 None 2026-03-16 16:29:50,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:29:50,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 16:29:50,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:29:50,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b81945113612b7716bc9ef HTTP/1.1" 200 None 2026-03-16 16:29:50,907 - lava_callback - INFO - Completed processing callback for node 69b81945113612b7716bc9ef INFO: 172.19.0.1:35514 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50294 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:30:11,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:30:11,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:40016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40024 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46548 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46556 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44960 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59836 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:30:53,839 - lava_callback - INFO - Received callback for node 69b58d361727ff69d6f2633d INFO: 172.19.0.1:39110 - "POST /node/69b58d361727ff69d6f2633d HTTP/1.0" 202 Accepted 2026-03-16 16:30:53,844 - lava_callback - INFO - Starting async job submit for node 69b58d361727ff69d6f2633d 2026-03-16 16:30:53,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:30:53,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b58d361727ff69d6f2633d HTTP/1.1" 200 None 2026-03-16 16:30:53,861 - lava_callback - DEBUG - Processing node 69b58d361727ff69d6f2633d: baseline-arm-baylibre 2026-03-16 16:30:53,861 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b58d361727ff69d6f2633d 2026-03-16 16:30:53,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:30:53,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b58d361727ff69d6f2633d HTTP/1.1" 200 None 2026-03-16 16:30:53,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:30:53,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-16 16:30:53,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:30:53,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b58d361727ff69d6f2633d HTTP/1.1" 200 None 2026-03-16 16:30:53,965 - lava_callback - ERROR - Error processing callback for node 69b58d361727ff69d6f2633d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:39118 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37450 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33748 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33752 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40110 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40120 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:31:31,699 - lava_callback - INFO - Received callback for node 69b58d5b1727ff69d6f26347 INFO: 172.19.0.1:39422 - "POST /node/69b58d5b1727ff69d6f26347 HTTP/1.0" 202 Accepted 2026-03-16 16:31:31,705 - lava_callback - INFO - Starting async job submit for node 69b58d5b1727ff69d6f26347 2026-03-16 16:31:31,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:31:31,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b58d5b1727ff69d6f26347 HTTP/1.1" 200 None 2026-03-16 16:31:31,726 - lava_callback - DEBUG - Processing node 69b58d5b1727ff69d6f26347: baseline-arm-clabbe 2026-03-16 16:31:31,726 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b58d5b1727ff69d6f26347 2026-03-16 16:31:31,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:31:31,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b58d5b1727ff69d6f26347 HTTP/1.1" 200 None 2026-03-16 16:31:31,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:31:31,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-16 16:31:31,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:31:31,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b58d5b1727ff69d6f26347 HTTP/1.1" 200 None 2026-03-16 16:31:31,790 - lava_callback - ERROR - Error processing callback for node 69b58d5b1727ff69d6f26347: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:39438 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:31:39,744 - lava_callback - INFO - Received callback for node 69b82dec0b8ad4124cec35a5 INFO: 172.19.0.1:34150 - "POST /node/69b82dec0b8ad4124cec35a5 HTTP/1.0" 202 Accepted 2026-03-16 16:31:39,750 - lava_callback - INFO - Starting async job submit for node 69b82dec0b8ad4124cec35a5 2026-03-16 16:31:39,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:31:39,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82dec0b8ad4124cec35a5 HTTP/1.1" 200 None 2026-03-16 16:31:39,791 - lava_callback - DEBUG - Processing node 69b82dec0b8ad4124cec35a5: baseline-arm64 2026-03-16 16:31:40,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:31:40,468 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:31:40,470 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b82dec0b8ad4124cec35a5/log.txt.gz 2026-03-16 16:31:40,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:31:40,960 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:31:40,961 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b82dec0b8ad4124cec35a5/lava-logs.yaml 2026-03-16 16:31:40,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:31:41,150 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:31:41,152 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b82dec0b8ad4124cec35a5/lava_callback.json.gz 2026-03-16 16:31:41,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:31:41,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82dec0b8ad4124cec35a5 HTTP/1.1" 200 None 2026-03-16 16:31:41,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:31:41,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 16:31:41,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:31:41,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b82dec0b8ad4124cec35a5 HTTP/1.1" 200 None 2026-03-16 16:31:41,305 - lava_callback - INFO - Completed processing callback for node 69b82dec0b8ad4124cec35a5 INFO: 172.19.0.1:34158 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52850 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58154 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:32:11,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:32:11,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-16 16:32:13,884 - lava_callback - INFO - Received callback for node 69b58d851727ff69d6f26353 INFO: 172.19.0.1:41812 - "POST /node/69b58d851727ff69d6f26353 HTTP/1.0" 202 Accepted 2026-03-16 16:32:13,890 - lava_callback - INFO - Starting async job submit for node 69b58d851727ff69d6f26353 2026-03-16 16:32:13,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:32:13,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b58d851727ff69d6f26353 HTTP/1.1" 200 None 2026-03-16 16:32:13,908 - lava_callback - DEBUG - Processing node 69b58d851727ff69d6f26353: baseline-arm64-baylibre 2026-03-16 16:32:13,908 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b58d851727ff69d6f26353 2026-03-16 16:32:13,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:32:13,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b58d851727ff69d6f26353 HTTP/1.1" 200 None 2026-03-16 16:32:13,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:32:13,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-16 16:32:13,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:32:13,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b58d851727ff69d6f26353 HTTP/1.1" 200 None 2026-03-16 16:32:13,988 - lava_callback - ERROR - Error processing callback for node 69b58d851727ff69d6f26353: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:41816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41824 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48016 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48022 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47634 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58078 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42616 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43564 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54072 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47178 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47180 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:33:33,976 - lava_callback - INFO - Received callback for node 69b58dd11727ff69d6f2635d INFO: 172.19.0.1:33300 - "POST /node/69b58dd11727ff69d6f2635d HTTP/1.0" 202 Accepted 2026-03-16 16:33:33,981 - lava_callback - INFO - Starting async job submit for node 69b58dd11727ff69d6f2635d 2026-03-16 16:33:33,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:33:33,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b58dd11727ff69d6f2635d HTTP/1.1" 200 None 2026-03-16 16:33:34,000 - lava_callback - DEBUG - Processing node 69b58dd11727ff69d6f2635d: baseline-arm64-baylibre 2026-03-16 16:33:34,000 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b58dd11727ff69d6f2635d 2026-03-16 16:33:34,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:33:34,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b58dd11727ff69d6f2635d HTTP/1.1" 200 None 2026-03-16 16:33:34,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:33:34,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-16 16:33:34,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:33:34,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b58dd11727ff69d6f2635d HTTP/1.1" 200 None 2026-03-16 16:33:34,063 - lava_callback - ERROR - Error processing callback for node 69b58dd11727ff69d6f2635d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:33312 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58066 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45362 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40702 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33692 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39640 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39652 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45548 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41134 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:34:51,809 - lava_callback - INFO - Received callback for node 69b58e161727ff69d6f26367 INFO: 172.19.0.1:46930 - "POST /node/69b58e161727ff69d6f26367 HTTP/1.0" 202 Accepted 2026-03-16 16:34:51,815 - lava_callback - INFO - Starting async job submit for node 69b58e161727ff69d6f26367 2026-03-16 16:34:51,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:34:51,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b58e161727ff69d6f26367 HTTP/1.1" 200 None 2026-03-16 16:34:51,861 - lava_callback - DEBUG - Processing node 69b58e161727ff69d6f26367: baseline-arm-clabbe 2026-03-16 16:34:51,861 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b58e161727ff69d6f26367 2026-03-16 16:34:51,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:34:51,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b58e161727ff69d6f26367 HTTP/1.1" 200 None 2026-03-16 16:34:51,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:34:51,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-16 16:34:51,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:34:51,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b58e161727ff69d6f26367 HTTP/1.1" 200 None 2026-03-16 16:34:51,992 - lava_callback - ERROR - Error processing callback for node 69b58e161727ff69d6f26367: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:46944 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58616 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:35:06,526 - lava_callback - INFO - Received callback for node 69b82ec10b8ad4124cec35bc INFO: 172.19.0.1:58626 - "POST /node/69b82ec10b8ad4124cec35bc HTTP/1.0" 202 Accepted 2026-03-16 16:35:06,533 - lava_callback - INFO - Starting async job submit for node 69b82ec10b8ad4124cec35bc 2026-03-16 16:35:06,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:35:06,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82ec10b8ad4124cec35bc HTTP/1.1" 200 None 2026-03-16 16:35:06,596 - lava_callback - DEBUG - Processing node 69b82ec10b8ad4124cec35bc: baseline-nfs-arm64 2026-03-16 16:35:07,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:35:07,297 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:35:07,299 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b82ec10b8ad4124cec35bc/log.txt.gz 2026-03-16 16:35:07,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:35:07,774 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:35:07,776 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b82ec10b8ad4124cec35bc/lava-logs.yaml 2026-03-16 16:35:07,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:35:07,967 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:35:07,969 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b82ec10b8ad4124cec35bc/lava_callback.json.gz 2026-03-16 16:35:08,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:35:08,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82ec10b8ad4124cec35bc HTTP/1.1" 200 None 2026-03-16 16:35:08,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:35:08,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 16:35:08,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:35:08,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b82ec10b8ad4124cec35bc HTTP/1.1" 200 None 2026-03-16 16:35:08,111 - lava_callback - INFO - Completed processing callback for node 69b82ec10b8ad4124cec35bc 2026-03-16 16:35:11,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:35:11,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-16 16:35:11,694 - lava_callback - INFO - Received callback for node 69b58e3a1727ff69d6f26373 INFO: 172.19.0.1:46514 - "POST /node/69b58e3a1727ff69d6f26373 HTTP/1.0" 202 Accepted 2026-03-16 16:35:11,699 - lava_callback - INFO - Starting async job submit for node 69b58e3a1727ff69d6f26373 2026-03-16 16:35:11,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:35:11,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b58e3a1727ff69d6f26373 HTTP/1.1" 200 None 2026-03-16 16:35:11,715 - lava_callback - DEBUG - Processing node 69b58e3a1727ff69d6f26373: baseline-arm-clabbe 2026-03-16 16:35:11,715 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b58e3a1727ff69d6f26373 2026-03-16 16:35:11,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:35:11,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b58e3a1727ff69d6f26373 HTTP/1.1" 200 None 2026-03-16 16:35:11,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:35:11,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-16 16:35:11,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:35:11,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b58e3a1727ff69d6f26373 HTTP/1.1" 200 None 2026-03-16 16:35:11,772 - lava_callback - ERROR - Error processing callback for node 69b58e3a1727ff69d6f26373: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:46524 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46536 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34208 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34214 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33506 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43820 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:35:54,118 - lava_callback - INFO - Received callback for node 69b58e651727ff69d6f2637d INFO: 172.19.0.1:45864 - "POST /node/69b58e651727ff69d6f2637d HTTP/1.0" 202 Accepted 2026-03-16 16:35:54,128 - lava_callback - INFO - Starting async job submit for node 69b58e651727ff69d6f2637d 2026-03-16 16:35:54,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:35:54,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b58e651727ff69d6f2637d HTTP/1.1" 200 None 2026-03-16 16:35:54,183 - lava_callback - DEBUG - Processing node 69b58e651727ff69d6f2637d: baseline-arm64-baylibre 2026-03-16 16:35:54,183 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b58e651727ff69d6f2637d 2026-03-16 16:35:54,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:35:54,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b58e651727ff69d6f2637d HTTP/1.1" 200 None 2026-03-16 16:35:54,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:35:54,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-16 16:35:54,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:35:54,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b58e651727ff69d6f2637d HTTP/1.1" 200 None 2026-03-16 16:35:54,333 - lava_callback - ERROR - Error processing callback for node 69b58e651727ff69d6f2637d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:45880 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36524 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41640 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53642 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53656 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44706 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:36:42,977 - lava_callback - INFO - Received callback for node 69b8318f0b8ad4124cec3601 INFO: 172.19.0.1:42254 - "POST /node/69b8318f0b8ad4124cec3601 HTTP/1.0" 202 Accepted 2026-03-16 16:36:42,984 - lava_callback - INFO - Starting async job submit for node 69b8318f0b8ad4124cec3601 2026-03-16 16:36:42,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:36:43,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8318f0b8ad4124cec3601 HTTP/1.1" 200 None 2026-03-16 16:36:43,001 - lava_callback - DEBUG - Processing node 69b8318f0b8ad4124cec3601: baseline-arm 2026-03-16 16:36:43,007 - lava_callback - WARNING - Failed to upload log 2026-03-16 16:36:43,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:36:43,145 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:36:43,146 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b8318f0b8ad4124cec3601/lava-logs.yaml 2026-03-16 16:36:43,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:36:43,268 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:36:43,270 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b8318f0b8ad4124cec3601/lava_callback.json.gz 2026-03-16 16:36:43,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:36:43,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8318f0b8ad4124cec3601 HTTP/1.1" 200 None 2026-03-16 16:36:43,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:36:43,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None 2026-03-16 16:36:43,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:36:43,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8318f0b8ad4124cec3601 HTTP/1.1" 200 None 2026-03-16 16:36:43,432 - lava_callback - INFO - Completed processing callback for node 69b8318f0b8ad4124cec3601 INFO: 172.19.0.1:42258 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45128 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:36:59,762 - lava_callback - INFO - Received callback for node 69b8319c0b8ad4124cec3624 INFO: 172.19.0.1:33122 - "POST /node/69b8319c0b8ad4124cec3624 HTTP/1.0" 202 Accepted 2026-03-16 16:36:59,769 - lava_callback - INFO - Starting async job submit for node 69b8319c0b8ad4124cec3624 2026-03-16 16:36:59,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:36:59,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8319c0b8ad4124cec3624 HTTP/1.1" 200 None 2026-03-16 16:36:59,789 - lava_callback - DEBUG - Processing node 69b8319c0b8ad4124cec3624: baseline-arm 2026-03-16 16:36:59,794 - lava_callback - WARNING - Failed to upload log 2026-03-16 16:36:59,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:36:59,908 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:36:59,909 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b8319c0b8ad4124cec3624/lava-logs.yaml 2026-03-16 16:36:59,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:37:00,035 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:37:00,037 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b8319c0b8ad4124cec3624/lava_callback.json.gz 2026-03-16 16:37:00,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:37:00,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8319c0b8ad4124cec3624 HTTP/1.1" 200 None 2026-03-16 16:37:00,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:37:00,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None 2026-03-16 16:37:00,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:37:00,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8319c0b8ad4124cec3624 HTTP/1.1" 200 None 2026-03-16 16:37:00,114 - lava_callback - INFO - Completed processing callback for node 69b8319c0b8ad4124cec3624 INFO: 172.19.0.1:33126 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:37:11,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:37:11,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-16 16:37:12,018 - lava_callback - INFO - Received callback for node 69b58eaa1727ff69d6f26387 INFO: 172.19.0.1:55966 - "POST /node/69b58eaa1727ff69d6f26387 HTTP/1.0" 202 Accepted 2026-03-16 16:37:12,025 - lava_callback - INFO - Starting async job submit for node 69b58eaa1727ff69d6f26387 2026-03-16 16:37:12,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:37:12,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b58eaa1727ff69d6f26387 HTTP/1.1" 200 None 2026-03-16 16:37:12,047 - lava_callback - DEBUG - Processing node 69b58eaa1727ff69d6f26387: baseline-arm-clabbe 2026-03-16 16:37:12,047 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b58eaa1727ff69d6f26387 2026-03-16 16:37:12,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:37:12,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b58eaa1727ff69d6f26387 HTTP/1.1" 200 None 2026-03-16 16:37:12,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:37:12,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-16 16:37:12,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:37:12,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b58eaa1727ff69d6f26387 HTTP/1.1" 200 None 2026-03-16 16:37:12,125 - lava_callback - ERROR - Error processing callback for node 69b58eaa1727ff69d6f26387: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:55976 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55990 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35620 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:37:26,808 - lava_callback - INFO - Received callback for node 69b831930b8ad4124cec360d INFO: 172.19.0.1:35622 - "POST /node/69b831930b8ad4124cec360d HTTP/1.0" 202 Accepted 2026-03-16 16:37:26,861 - lava_callback - INFO - Starting async job submit for node 69b831930b8ad4124cec360d 2026-03-16 16:37:26,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:37:26,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831930b8ad4124cec360d HTTP/1.1" 200 None 2026-03-16 16:37:26,893 - lava_callback - DEBUG - Processing node 69b831930b8ad4124cec360d: baseline-arm 2026-03-16 16:37:27,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:37:27,178 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:37:27,181 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b831930b8ad4124cec360d/log.txt.gz 2026-03-16 16:37:27,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:37:27,424 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:37:27,427 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b831930b8ad4124cec360d/lava-logs.yaml 2026-03-16 16:37:27,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:37:27,556 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:37:27,557 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b831930b8ad4124cec360d/lava_callback.json.gz 2026-03-16 16:37:27,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:37:27,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831930b8ad4124cec360d HTTP/1.1" 200 None 2026-03-16 16:37:27,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:37:27,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None 2026-03-16 16:37:27,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:37:27,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b831930b8ad4124cec360d HTTP/1.1" 200 None 2026-03-16 16:37:27,640 - lava_callback - INFO - Completed processing callback for node 69b831930b8ad4124cec360d INFO: 172.19.0.1:35626 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:37:28,883 - lava_callback - INFO - Received callback for node 69b831900b8ad4124cec3604 INFO: 172.19.0.1:35628 - "POST /node/69b831900b8ad4124cec3604 HTTP/1.0" 202 Accepted 2026-03-16 16:37:28,936 - lava_callback - INFO - Starting async job submit for node 69b831900b8ad4124cec3604 2026-03-16 16:37:28,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:37:28,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831900b8ad4124cec3604 HTTP/1.1" 200 None 2026-03-16 16:37:28,990 - lava_callback - DEBUG - Processing node 69b831900b8ad4124cec3604: baseline-arm 2026-03-16 16:37:29,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:37:29,279 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:37:29,281 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b831900b8ad4124cec3604/log.txt.gz 2026-03-16 16:37:29,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:37:29,544 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:37:29,546 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b831900b8ad4124cec3604/lava-logs.yaml 2026-03-16 16:37:29,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:37:29,660 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:37:29,662 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b831900b8ad4124cec3604/lava_callback.json.gz 2026-03-16 16:37:29,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:37:29,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831900b8ad4124cec3604 HTTP/1.1" 200 None 2026-03-16 16:37:29,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:37:29,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None 2026-03-16 16:37:29,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:37:29,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b831900b8ad4124cec3604 HTTP/1.1" 200 None 2026-03-16 16:37:29,748 - lava_callback - INFO - Completed processing callback for node 69b831900b8ad4124cec3604 INFO: 172.19.0.1:56638 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:37:41,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:37:41,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:39014 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:37:51,802 - lava_callback - INFO - Received callback for node 69b58ecf1727ff69d6f26391 INFO: 172.19.0.1:44340 - "POST /node/69b58ecf1727ff69d6f26391 HTTP/1.0" 202 Accepted 2026-03-16 16:37:51,808 - lava_callback - INFO - Starting async job submit for node 69b58ecf1727ff69d6f26391 2026-03-16 16:37:51,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:37:51,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b58ecf1727ff69d6f26391 HTTP/1.1" 200 None 2026-03-16 16:37:51,831 - lava_callback - DEBUG - Processing node 69b58ecf1727ff69d6f26391: baseline-arm-clabbe 2026-03-16 16:37:51,831 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b58ecf1727ff69d6f26391 2026-03-16 16:37:51,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:37:51,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b58ecf1727ff69d6f26391 HTTP/1.1" 200 None 2026-03-16 16:37:51,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:37:51,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-16 16:37:51,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:37:51,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b58ecf1727ff69d6f26391 HTTP/1.1" 200 None 2026-03-16 16:37:51,888 - lava_callback - ERROR - Error processing callback for node 69b58ecf1727ff69d6f26391: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-16 16:37:54,560 - lava_callback - INFO - Received callback for node 69b8318e0b8ad4124cec35fc INFO: 172.19.0.1:44356 - "POST /node/69b8318e0b8ad4124cec35fc HTTP/1.0" 202 Accepted 2026-03-16 16:37:54,566 - lava_callback - INFO - Starting async job submit for node 69b8318e0b8ad4124cec35fc 2026-03-16 16:37:54,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:37:54,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8318e0b8ad4124cec35fc HTTP/1.1" 200 None 2026-03-16 16:37:54,603 - lava_callback - DEBUG - Processing node 69b8318e0b8ad4124cec35fc: baseline-arm 2026-03-16 16:37:54,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:37:54,985 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:37:54,987 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b8318e0b8ad4124cec35fc/log.txt.gz 2026-03-16 16:37:55,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:37:55,320 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:37:55,323 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b8318e0b8ad4124cec35fc/lava-logs.yaml 2026-03-16 16:37:55,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:37:55,460 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:37:55,462 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b8318e0b8ad4124cec35fc/lava_callback.json.gz 2026-03-16 16:37:55,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:37:55,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8318e0b8ad4124cec35fc HTTP/1.1" 200 None 2026-03-16 16:37:55,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:37:55,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None 2026-03-16 16:37:55,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:37:55,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8318e0b8ad4124cec35fc HTTP/1.1" 200 None 2026-03-16 16:37:55,544 - lava_callback - INFO - Completed processing callback for node 69b8318e0b8ad4124cec35fc INFO: 172.19.0.1:44366 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:38:05,118 - lava_callback - INFO - Received callback for node 69b8196d113612b7716bca82 INFO: 172.19.0.1:37714 - "POST /node/69b8196d113612b7716bca82 HTTP/1.0" 202 Accepted 2026-03-16 16:38:05,128 - lava_callback - INFO - Starting async job submit for node 69b8196d113612b7716bca82 2026-03-16 16:38:05,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:38:05,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8196d113612b7716bca82 HTTP/1.1" 200 None 2026-03-16 16:38:05,216 - lava_callback - DEBUG - Processing node 69b8196d113612b7716bca82: baseline-arm64-broonie 2026-03-16 16:38:05,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:38:05,795 - lava_callback - INFO - Received callback for node 69b831920b8ad4124cec360a 2026-03-16 16:38:05,806 - lava_callback - INFO - Starting async job submit for node 69b831920b8ad4124cec360a INFO: 172.19.0.1:37718 - "POST /node/69b831920b8ad4124cec360a HTTP/1.0" 202 Accepted 2026-03-16 16:38:05,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:38:05,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831920b8ad4124cec360a HTTP/1.1" 200 None 2026-03-16 16:38:05,874 - lava_callback - DEBUG - Processing node 69b831920b8ad4124cec360a: baseline-arm 2026-03-16 16:38:06,000 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:38:06,001 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b8196d113612b7716bca82/log.txt.gz 2026-03-16 16:38:06,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.19.0.1:37730 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:38:06,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:38:07,043 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:38:07,046 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b831920b8ad4124cec360a/log.txt.gz 2026-03-16 16:38:07,086 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:38:07,088 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b8196d113612b7716bca82/lava-logs.yaml 2026-03-16 16:38:07,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:38:07,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:38:07,623 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:38:07,625 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b8196d113612b7716bca82/lava_callback.json.gz 2026-03-16 16:38:07,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:38:07,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8196d113612b7716bca82 HTTP/1.1" 200 None 2026-03-16 16:38:07,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:38:07,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 16:38:07,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:38:07,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8196d113612b7716bca82 HTTP/1.1" 200 None 2026-03-16 16:38:07,797 - lava_callback - INFO - Completed processing callback for node 69b8196d113612b7716bca82 2026-03-16 16:38:08,020 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:38:08,022 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b831920b8ad4124cec360a/lava-logs.yaml 2026-03-16 16:38:08,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:38:08,528 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:38:08,530 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b831920b8ad4124cec360a/lava_callback.json.gz 2026-03-16 16:38:08,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:38:08,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831920b8ad4124cec360a HTTP/1.1" 200 None 2026-03-16 16:38:08,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:38:08,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None 2026-03-16 16:38:08,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:38:08,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b831920b8ad4124cec360a HTTP/1.1" 200 None 2026-03-16 16:38:08,697 - lava_callback - INFO - Completed processing callback for node 69b831920b8ad4124cec360a 2026-03-16 16:38:11,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:38:11,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:36504 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-16 16:38:16,356 - lava_callback - INFO - Received callback for node 69b831b80b8ad4124cec369c INFO: 172.19.0.1:36506 - "POST /node/69b831b80b8ad4124cec369c HTTP/1.0" 202 Accepted 2026-03-16 16:38:16,405 - lava_callback - INFO - Starting async job submit for node 69b831b80b8ad4124cec369c 2026-03-16 16:38:16,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:38:16,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831b80b8ad4124cec369c HTTP/1.1" 200 None 2026-03-16 16:38:16,464 - lava_callback - DEBUG - Processing node 69b831b80b8ad4124cec369c: baseline-arm-pengutronix INFO: 172.19.0.1:36508 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:38:16,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:38:17,043 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:38:17,045 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b831b80b8ad4124cec369c/log.txt.gz 2026-03-16 16:38:17,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:38:17,629 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:38:17,632 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b831b80b8ad4124cec369c/lava-logs.yaml 2026-03-16 16:38:17,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:38:17,950 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:38:17,952 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b831b80b8ad4124cec369c/lava_callback.json.gz 2026-03-16 16:38:17,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:38:18,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831b80b8ad4124cec369c HTTP/1.1" 200 None 2026-03-16 16:38:18,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:38:18,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None 2026-03-16 16:38:18,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:38:18,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b831b80b8ad4124cec369c HTTP/1.1" 200 None 2026-03-16 16:38:18,112 - lava_callback - INFO - Completed processing callback for node 69b831b80b8ad4124cec369c 2026-03-16 16:38:22,645 - lava_callback - INFO - Received callback for node 69b831b40b8ad4124cec3690 INFO: 172.19.0.1:51276 - "POST /node/69b831b40b8ad4124cec3690 HTTP/1.0" 202 Accepted 2026-03-16 16:38:22,654 - lava_callback - INFO - Starting async job submit for node 69b831b40b8ad4124cec3690 2026-03-16 16:38:22,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:38:22,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831b40b8ad4124cec3690 HTTP/1.1" 200 None 2026-03-16 16:38:22,725 - lava_callback - DEBUG - Processing node 69b831b40b8ad4124cec3690: baseline-arm-pengutronix 2026-03-16 16:38:22,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:38:23,271 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:38:23,273 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b831b40b8ad4124cec3690/log.txt.gz 2026-03-16 16:38:23,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:38:23,999 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:38:24,001 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b831b40b8ad4124cec3690/lava-logs.yaml 2026-03-16 16:38:24,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:38:24,353 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:38:24,355 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b831b40b8ad4124cec3690/lava_callback.json.gz 2026-03-16 16:38:24,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:38:24,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831b40b8ad4124cec3690 HTTP/1.1" 200 None 2026-03-16 16:38:24,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:38:24,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None 2026-03-16 16:38:24,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:38:24,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b831b40b8ad4124cec3690 HTTP/1.1" 200 None 2026-03-16 16:38:24,481 - lava_callback - INFO - Completed processing callback for node 69b831b40b8ad4124cec3690 2026-03-16 16:38:25,733 - lava_callback - INFO - Received callback for node 69b831a30b8ad4124cec3632 INFO: 172.19.0.1:51280 - "POST /node/69b831a30b8ad4124cec3632 HTTP/1.0" 202 Accepted 2026-03-16 16:38:25,743 - lava_callback - INFO - Starting async job submit for node 69b831a30b8ad4124cec3632 2026-03-16 16:38:25,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:38:25,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831a30b8ad4124cec3632 HTTP/1.1" 200 None 2026-03-16 16:38:25,831 - lava_callback - DEBUG - Processing node 69b831a30b8ad4124cec3632: baseline-arm-broonie 2026-03-16 16:38:26,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:38:26,433 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:38:26,435 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b831a30b8ad4124cec3632/log.txt.gz INFO: 172.19.0.1:51294 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:38:26,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:38:27,212 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:38:27,214 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b831a30b8ad4124cec3632/lava-logs.yaml 2026-03-16 16:38:27,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:38:27,713 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:38:27,715 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b831a30b8ad4124cec3632/lava_callback.json.gz 2026-03-16 16:38:27,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:38:27,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831a30b8ad4124cec3632 HTTP/1.1" 200 None 2026-03-16 16:38:27,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:38:27,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None 2026-03-16 16:38:27,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:38:27,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b831a30b8ad4124cec3632 HTTP/1.1" 200 None 2026-03-16 16:38:27,862 - lava_callback - INFO - Completed processing callback for node 69b831a30b8ad4124cec3632 INFO: 172.19.0.1:51302 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:38:34,459 - lava_callback - INFO - Received callback for node 69b58efa1727ff69d6f2639c INFO: 172.19.0.1:47026 - "POST /node/69b58efa1727ff69d6f2639c HTTP/1.0" 202 Accepted 2026-03-16 16:38:34,468 - lava_callback - INFO - Starting async job submit for node 69b58efa1727ff69d6f2639c 2026-03-16 16:38:34,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:38:34,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b58efa1727ff69d6f2639c HTTP/1.1" 200 None 2026-03-16 16:38:34,495 - lava_callback - DEBUG - Processing node 69b58efa1727ff69d6f2639c: baseline-arm64-baylibre 2026-03-16 16:38:34,495 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b58efa1727ff69d6f2639c 2026-03-16 16:38:34,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:38:34,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b58efa1727ff69d6f2639c HTTP/1.1" 200 None 2026-03-16 16:38:34,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:38:34,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-16 16:38:34,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:38:34,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b58efa1727ff69d6f2639c HTTP/1.1" 200 None 2026-03-16 16:38:34,590 - lava_callback - ERROR - Error processing callback for node 69b58efa1727ff69d6f2639c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:47034 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:38:40,894 - lava_callback - INFO - Received callback for node 69b831a50b8ad4124cec3638 INFO: 172.19.0.1:40848 - "POST /node/69b831a50b8ad4124cec3638 HTTP/1.0" 202 Accepted 2026-03-16 16:38:40,905 - lava_callback - INFO - Starting async job submit for node 69b831a50b8ad4124cec3638 2026-03-16 16:38:40,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:38:40,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831a50b8ad4124cec3638 HTTP/1.1" 200 None 2026-03-16 16:38:40,982 - lava_callback - DEBUG - Processing node 69b831a50b8ad4124cec3638: baseline-arm-broonie 2026-03-16 16:38:41,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:38:41,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-16 16:38:41,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:38:41,788 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:38:41,791 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b831a50b8ad4124cec3638/log.txt.gz 2026-03-16 16:38:42,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:38:42,579 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:38:42,582 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b831a50b8ad4124cec3638/lava-logs.yaml 2026-03-16 16:38:42,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:38:43,102 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:38:43,104 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b831a50b8ad4124cec3638/lava_callback.json.gz 2026-03-16 16:38:43,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:38:43,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831a50b8ad4124cec3638 HTTP/1.1" 200 None 2026-03-16 16:38:43,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:38:43,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None 2026-03-16 16:38:43,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:38:43,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b831a50b8ad4124cec3638 HTTP/1.1" 200 None 2026-03-16 16:38:43,255 - lava_callback - INFO - Completed processing callback for node 69b831a50b8ad4124cec3638 2026-03-16 16:38:43,479 - lava_callback - INFO - Received callback for node 69b831a90b8ad4124cec3647 INFO: 172.19.0.1:40860 - "POST /node/69b831a90b8ad4124cec3647 HTTP/1.0" 202 Accepted 2026-03-16 16:38:43,489 - lava_callback - INFO - Starting async job submit for node 69b831a90b8ad4124cec3647 2026-03-16 16:38:43,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:38:43,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831a90b8ad4124cec3647 HTTP/1.1" 200 None 2026-03-16 16:38:43,556 - lava_callback - DEBUG - Processing node 69b831a90b8ad4124cec3647: baseline-arm-clabbe 2026-03-16 16:38:43,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:38:44,360 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:38:44,362 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b831a90b8ad4124cec3647/log.txt.gz 2026-03-16 16:38:44,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:38:45,104 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:38:45,107 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b831a90b8ad4124cec3647/lava-logs.yaml 2026-03-16 16:38:45,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:38:45,503 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:38:45,506 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b831a90b8ad4124cec3647/lava_callback.json.gz 2026-03-16 16:38:45,534 - lava_callback - INFO - Received callback for node 69b831a40b8ad4124cec3635 2026-03-16 16:38:45,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.19.0.1:40864 - "POST /node/69b831a40b8ad4124cec3635 HTTP/1.0" 202 Accepted 2026-03-16 16:38:45,555 - lava_callback - INFO - Starting async job submit for node 69b831a40b8ad4124cec3635 2026-03-16 16:38:45,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831a90b8ad4124cec3647 HTTP/1.1" 200 None 2026-03-16 16:38:45,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:38:45,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:38:45,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None 2026-03-16 16:38:45,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:38:45,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831a40b8ad4124cec3635 HTTP/1.1" 200 None 2026-03-16 16:38:45,642 - lava_callback - DEBUG - Processing node 69b831a40b8ad4124cec3635: baseline-arm-broonie 2026-03-16 16:38:45,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b831a90b8ad4124cec3647 HTTP/1.1" 200 None 2026-03-16 16:38:45,733 - lava_callback - INFO - Completed processing callback for node 69b831a90b8ad4124cec3647 2026-03-16 16:38:46,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.19.0.1:40868 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:38:46,597 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:38:46,599 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b831a40b8ad4124cec3635/log.txt.gz 2026-03-16 16:38:46,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:38:47,376 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:38:47,378 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b831a40b8ad4124cec3635/lava-logs.yaml 2026-03-16 16:38:47,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:38:47,788 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:38:47,790 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b831a40b8ad4124cec3635/lava_callback.json.gz 2026-03-16 16:38:47,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:38:47,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831a40b8ad4124cec3635 HTTP/1.1" 200 None 2026-03-16 16:38:47,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:38:47,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None 2026-03-16 16:38:47,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:38:47,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b831a40b8ad4124cec3635 HTTP/1.1" 200 None 2026-03-16 16:38:47,930 - lava_callback - INFO - Completed processing callback for node 69b831a40b8ad4124cec3635 2026-03-16 16:38:51,409 - lava_callback - INFO - Received callback for node 69b831b10b8ad4124cec3685 INFO: 172.19.0.1:50106 - "POST /node/69b831b10b8ad4124cec3685 HTTP/1.0" 202 Accepted 2026-03-16 16:38:51,419 - lava_callback - INFO - Starting async job submit for node 69b831b10b8ad4124cec3685 2026-03-16 16:38:51,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:38:51,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831b10b8ad4124cec3685 HTTP/1.1" 200 None 2026-03-16 16:38:51,494 - lava_callback - DEBUG - Processing node 69b831b10b8ad4124cec3685: baseline-arm-kontron 2026-03-16 16:38:51,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:38:52,193 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:38:52,195 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69b831b10b8ad4124cec3685/log.txt.gz 2026-03-16 16:38:52,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:38:52,971 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:38:52,973 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69b831b10b8ad4124cec3685/lava-logs.yaml 2026-03-16 16:38:52,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:38:53,456 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:38:53,458 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69b831b10b8ad4124cec3685/lava_callback.json.gz 2026-03-16 16:38:53,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:38:53,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831b10b8ad4124cec3685 HTTP/1.1" 200 None 2026-03-16 16:38:53,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:38:53,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None 2026-03-16 16:38:53,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:38:53,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b831b10b8ad4124cec3685 HTTP/1.1" 200 None 2026-03-16 16:38:53,600 - lava_callback - INFO - Completed processing callback for node 69b831b10b8ad4124cec3685 INFO: 172.19.0.1:50110 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36808 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:39:11,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:39:11,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.19.0.1:37312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37316 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:39:22,232 - lava_callback - INFO - Received callback for node 69b831b50b8ad4124cec3693 INFO: 172.19.0.1:44780 - "POST /node/69b831b50b8ad4124cec3693 HTTP/1.0" 202 Accepted 2026-03-16 16:39:22,238 - lava_callback - INFO - Starting async job submit for node 69b831b50b8ad4124cec3693 2026-03-16 16:39:22,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:39:22,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831b50b8ad4124cec3693 HTTP/1.1" 200 None 2026-03-16 16:39:22,279 - lava_callback - DEBUG - Processing node 69b831b50b8ad4124cec3693: baseline-arm-pengutronix 2026-03-16 16:39:22,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:39:22,562 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:39:22,564 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b831b50b8ad4124cec3693/log.txt.gz 2026-03-16 16:39:22,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:39:22,842 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:39:22,844 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b831b50b8ad4124cec3693/lava-logs.yaml 2026-03-16 16:39:22,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:39:22,980 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:39:22,981 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b831b50b8ad4124cec3693/lava_callback.json.gz 2026-03-16 16:39:23,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:39:23,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831b50b8ad4124cec3693 HTTP/1.1" 200 None 2026-03-16 16:39:23,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:39:23,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None 2026-03-16 16:39:23,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:39:23,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b831b50b8ad4124cec3693 HTTP/1.1" 200 None 2026-03-16 16:39:23,173 - lava_callback - INFO - Completed processing callback for node 69b831b50b8ad4124cec3693 INFO: 172.19.0.1:44784 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44800 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46812 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:39:38,750 - lava_callback - INFO - Received callback for node 69b831d20b8ad4124cec36cc INFO: 172.19.0.1:46814 - "POST /node/69b831d20b8ad4124cec36cc HTTP/1.0" 202 Accepted 2026-03-16 16:39:38,757 - lava_callback - INFO - Starting async job submit for node 69b831d20b8ad4124cec36cc 2026-03-16 16:39:38,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:39:38,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831d20b8ad4124cec36cc HTTP/1.1" 200 None 2026-03-16 16:39:38,803 - lava_callback - DEBUG - Processing node 69b831d20b8ad4124cec36cc: ltp-dio 2026-03-16 16:39:39,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:39:39,339 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:39:39,342 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-69b831d20b8ad4124cec36cc/log.txt.gz 2026-03-16 16:39:39,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:39:39,827 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:39:39,829 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-69b831d20b8ad4124cec36cc/lava-logs.yaml 2026-03-16 16:39:39,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:39:40,008 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:39:40,010 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-69b831d20b8ad4124cec36cc/lava_callback.json.gz 2026-03-16 16:39:40,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:39:40,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831d20b8ad4124cec36cc HTTP/1.1" 200 None 2026-03-16 16:39:40,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:39:40,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None 2026-03-16 16:39:40,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:39:40,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b831d20b8ad4124cec36cc HTTP/1.1" 200 None 2026-03-16 16:39:40,093 - lava_callback - INFO - Completed processing callback for node 69b831d20b8ad4124cec36cc 2026-03-16 16:39:41,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:39:41,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:46214 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:39:51,751 - lava_callback - INFO - Received callback for node 69b832410b8ad4124cec376d INFO: 172.19.0.1:56298 - "POST /node/69b832410b8ad4124cec376d HTTP/1.0" 202 Accepted 2026-03-16 16:39:51,757 - lava_callback - INFO - Starting async job submit for node 69b832410b8ad4124cec376d 2026-03-16 16:39:51,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:39:51,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b832410b8ad4124cec376d HTTP/1.1" 200 None 2026-03-16 16:39:51,775 - lava_callback - DEBUG - Processing node 69b832410b8ad4124cec376d: baseline-arm 2026-03-16 16:39:51,780 - lava_callback - WARNING - Failed to upload log 2026-03-16 16:39:51,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:39:51,934 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:39:51,936 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b832410b8ad4124cec376d/lava-logs.yaml 2026-03-16 16:39:51,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:39:52,068 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:39:52,070 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b832410b8ad4124cec376d/lava_callback.json.gz 2026-03-16 16:39:52,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:39:52,082 - lava_callback - INFO - Received callback for node 69b58f4c1727ff69d6f263ab INFO: 172.19.0.1:56308 - "POST /node/69b58f4c1727ff69d6f263ab HTTP/1.0" 202 Accepted 2026-03-16 16:39:52,088 - lava_callback - INFO - Starting async job submit for node 69b58f4c1727ff69d6f263ab 2026-03-16 16:39:52,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:39:52,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b832410b8ad4124cec376d HTTP/1.1" 200 None 2026-03-16 16:39:52,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:39:52,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b58f4c1727ff69d6f263ab HTTP/1.1" 200 None 2026-03-16 16:39:52,106 - lava_callback - DEBUG - Processing node 69b58f4c1727ff69d6f263ab: baseline-arm64-clabbe 2026-03-16 16:39:52,106 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b58f4c1727ff69d6f263ab 2026-03-16 16:39:52,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:39:52,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None 2026-03-16 16:39:52,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:39:52,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b58f4c1727ff69d6f263ab HTTP/1.1" 200 None 2026-03-16 16:39:52,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:39:52,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b832410b8ad4124cec376d HTTP/1.1" 200 None 2026-03-16 16:39:52,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-16 16:39:52,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:39:52,164 - lava_callback - INFO - Completed processing callback for node 69b832410b8ad4124cec376d 2026-03-16 16:39:52,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b58f4c1727ff69d6f263ab HTTP/1.1" 200 None 2026-03-16 16:39:52,228 - lava_callback - ERROR - Error processing callback for node 69b58f4c1727ff69d6f263ab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:56316 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34294 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:40:11,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:40:11,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:50018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50020 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45548 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45552 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:40:30,558 - lava_callback - INFO - Received callback for node 69b831aa0b8ad4124cec364b INFO: 172.19.0.1:40494 - "POST /node/69b831aa0b8ad4124cec364b HTTP/1.0" 202 Accepted 2026-03-16 16:40:30,564 - lava_callback - INFO - Starting async job submit for node 69b831aa0b8ad4124cec364b 2026-03-16 16:40:30,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:40:30,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831aa0b8ad4124cec364b HTTP/1.1" 200 None 2026-03-16 16:40:30,600 - lava_callback - DEBUG - Processing node 69b831aa0b8ad4124cec364b: baseline-arm-clabbe 2026-03-16 16:40:30,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:40:30,972 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:40:30,974 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b831aa0b8ad4124cec364b/log.txt.gz 2026-03-16 16:40:31,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:40:31,480 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:40:31,482 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b831aa0b8ad4124cec364b/lava-logs.yaml 2026-03-16 16:40:31,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:40:31,636 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:40:31,637 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b831aa0b8ad4124cec364b/lava_callback.json.gz 2026-03-16 16:40:31,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:40:31,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831aa0b8ad4124cec364b HTTP/1.1" 200 None 2026-03-16 16:40:31,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:40:31,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None 2026-03-16 16:40:31,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:40:31,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b831aa0b8ad4124cec364b HTTP/1.1" 200 None 2026-03-16 16:40:31,726 - lava_callback - INFO - Completed processing callback for node 69b831aa0b8ad4124cec364b INFO: 172.19.0.1:40508 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:40:41,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:40:41,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:48772 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:40:51,975 - lava_callback - INFO - Received callback for node 69b58f8c1727ff69d6f263b3 INFO: 172.19.0.1:57042 - "POST /node/69b58f8c1727ff69d6f263b3 HTTP/1.0" 202 Accepted 2026-03-16 16:40:51,981 - lava_callback - INFO - Starting async job submit for node 69b58f8c1727ff69d6f263b3 2026-03-16 16:40:51,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:40:51,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b58f8c1727ff69d6f263b3 HTTP/1.1" 200 None 2026-03-16 16:40:51,997 - lava_callback - DEBUG - Processing node 69b58f8c1727ff69d6f263b3: baseline-arm-clabbe 2026-03-16 16:40:51,997 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b58f8c1727ff69d6f263b3 2026-03-16 16:40:51,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:40:52,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b58f8c1727ff69d6f263b3 HTTP/1.1" 200 None 2026-03-16 16:40:52,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:40:52,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-16 16:40:52,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:40:52,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b58f8c1727ff69d6f263b3 HTTP/1.1" 200 None 2026-03-16 16:40:52,057 - lava_callback - ERROR - Error processing callback for node 69b58f8c1727ff69d6f263b3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:57046 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46712 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53042 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55162 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55174 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38016 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33324 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:41:52,145 - lava_callback - INFO - Received callback for node 69b58fbe1727ff69d6f263bb INFO: 172.19.0.1:47314 - "POST /node/69b58fbe1727ff69d6f263bb HTTP/1.0" 202 Accepted 2026-03-16 16:41:52,151 - lava_callback - INFO - Starting async job submit for node 69b58fbe1727ff69d6f263bb 2026-03-16 16:41:52,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:41:52,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b58fbe1727ff69d6f263bb HTTP/1.1" 200 None 2026-03-16 16:41:52,168 - lava_callback - DEBUG - Processing node 69b58fbe1727ff69d6f263bb: baseline-arm64-clabbe 2026-03-16 16:41:52,168 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b58fbe1727ff69d6f263bb 2026-03-16 16:41:52,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:41:52,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b58fbe1727ff69d6f263bb HTTP/1.1" 200 None 2026-03-16 16:41:52,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:41:52,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-16 16:41:52,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:41:52,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b58fbe1727ff69d6f263bb HTTP/1.1" 200 None 2026-03-16 16:41:52,239 - lava_callback - ERROR - Error processing callback for node 69b58fbe1727ff69d6f263bb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:47326 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:42:01,210 - lava_callback - INFO - Received callback for node 69b831df0b8ad4124cec36ea INFO: 172.19.0.1:43388 - "POST /node/69b831df0b8ad4124cec36ea HTTP/1.0" 202 Accepted 2026-03-16 16:42:01,218 - lava_callback - INFO - Starting async job submit for node 69b831df0b8ad4124cec36ea 2026-03-16 16:42:01,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:42:01,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831df0b8ad4124cec36ea HTTP/1.1" 200 None 2026-03-16 16:42:01,258 - lava_callback - DEBUG - Processing node 69b831df0b8ad4124cec36ea: ltp-syscalls 2026-03-16 16:42:01,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:42:02,158 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:42:02,160 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-69b831df0b8ad4124cec36ea/log.txt.gz 2026-03-16 16:42:02,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:42:02,847 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:42:02,850 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-69b831df0b8ad4124cec36ea/lava-logs.yaml 2026-03-16 16:42:02,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:42:03,018 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:42:03,019 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-69b831df0b8ad4124cec36ea/lava_callback.json.gz 2026-03-16 16:42:03,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:42:03,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831df0b8ad4124cec36ea HTTP/1.1" 200 None 2026-03-16 16:42:03,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:42:03,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None 2026-03-16 16:42:03,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:42:03,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b831df0b8ad4124cec36ea HTTP/1.1" 200 None 2026-03-16 16:42:03,105 - lava_callback - INFO - Completed processing callback for node 69b831df0b8ad4124cec36ea INFO: 172.19.0.1:43396 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:42:09,589 - lava_callback - INFO - Received callback for node 69b831ad0b8ad4124cec367c INFO: 172.19.0.1:43412 - "POST /node/69b831ad0b8ad4124cec367c HTTP/1.0" 202 Accepted 2026-03-16 16:42:09,595 - lava_callback - INFO - Starting async job submit for node 69b831ad0b8ad4124cec367c 2026-03-16 16:42:09,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:42:09,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831ad0b8ad4124cec367c HTTP/1.1" 200 None 2026-03-16 16:42:09,631 - lava_callback - DEBUG - Processing node 69b831ad0b8ad4124cec367c: baseline-arm-clabbe 2026-03-16 16:42:09,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:42:10,005 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:42:10,007 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b831ad0b8ad4124cec367c/log.txt.gz 2026-03-16 16:42:10,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:42:10,386 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:42:10,389 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b831ad0b8ad4124cec367c/lava-logs.yaml 2026-03-16 16:42:10,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:42:10,538 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:42:10,540 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b831ad0b8ad4124cec367c/lava_callback.json.gz 2026-03-16 16:42:10,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:42:10,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831ad0b8ad4124cec367c HTTP/1.1" 200 None 2026-03-16 16:42:10,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:42:10,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None 2026-03-16 16:42:10,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:42:10,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b831ad0b8ad4124cec367c HTTP/1.1" 200 None 2026-03-16 16:42:10,621 - lava_callback - INFO - Completed processing callback for node 69b831ad0b8ad4124cec367c 2026-03-16 16:42:11,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:42:11,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:58000 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58014 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43408 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43410 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39856 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:42:45,657 - lava_callback - INFO - Received callback for node 69b832f40b8ad4124cec37c5 INFO: 172.19.0.1:35782 - "POST /node/69b832f40b8ad4124cec37c5 HTTP/1.0" 202 Accepted 2026-03-16 16:42:45,663 - lava_callback - INFO - Starting async job submit for node 69b832f40b8ad4124cec37c5 2026-03-16 16:42:45,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:42:45,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b832f40b8ad4124cec37c5 HTTP/1.1" 200 None 2026-03-16 16:42:45,692 - lava_callback - DEBUG - Processing node 69b832f40b8ad4124cec37c5: baseline-x86 2026-03-16 16:42:45,700 - lava_callback - WARNING - Failed to upload log 2026-03-16 16:42:45,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:42:45,840 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:42:45,842 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69b832f40b8ad4124cec37c5/lava-logs.yaml 2026-03-16 16:42:45,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:42:45,969 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:42:45,971 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69b832f40b8ad4124cec37c5/lava_callback.json.gz 2026-03-16 16:42:45,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:42:45,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b832f40b8ad4124cec37c5 HTTP/1.1" 200 None 2026-03-16 16:42:45,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:42:46,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d700b8ad4124cec3582 HTTP/1.1" 200 None 2026-03-16 16:42:46,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:42:46,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b832f40b8ad4124cec37c5 HTTP/1.1" 200 None 2026-03-16 16:42:46,054 - lava_callback - INFO - Completed processing callback for node 69b832f40b8ad4124cec37c5 INFO: 172.19.0.1:35798 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41314 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:43:00,468 - lava_callback - INFO - Received callback for node 69b832f60b8ad4124cec37ce INFO: 172.19.0.1:50398 - "POST /node/69b832f60b8ad4124cec37ce HTTP/1.0" 202 Accepted 2026-03-16 16:43:00,478 - lava_callback - INFO - Starting async job submit for node 69b832f60b8ad4124cec37ce 2026-03-16 16:43:00,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:43:00,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b832f60b8ad4124cec37ce HTTP/1.1" 200 None 2026-03-16 16:43:00,515 - lava_callback - DEBUG - Processing node 69b832f60b8ad4124cec37ce: baseline-x86 2026-03-16 16:43:00,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:43:00,897 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:43:00,899 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69b832f60b8ad4124cec37ce/log.txt.gz 2026-03-16 16:43:01,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:43:01,196 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:43:01,198 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69b832f60b8ad4124cec37ce/lava-logs.yaml 2026-03-16 16:43:01,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:43:01,416 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:43:01,418 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69b832f60b8ad4124cec37ce/lava_callback.json.gz 2026-03-16 16:43:01,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:43:01,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b832f60b8ad4124cec37ce HTTP/1.1" 200 None 2026-03-16 16:43:01,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:43:01,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d700b8ad4124cec3582 HTTP/1.1" 200 None 2026-03-16 16:43:01,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:43:01,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b832f60b8ad4124cec37ce HTTP/1.1" 200 None 2026-03-16 16:43:01,537 - lava_callback - INFO - Completed processing callback for node 69b832f60b8ad4124cec37ce INFO: 172.19.0.1:50406 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:43:11,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:43:11,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-16 16:43:12,571 - lava_callback - INFO - Received callback for node 69b5900b1727ff69d6f263c8 INFO: 172.19.0.1:51476 - "POST /node/69b5900b1727ff69d6f263c8 HTTP/1.0" 202 Accepted 2026-03-16 16:43:12,577 - lava_callback - INFO - Starting async job submit for node 69b5900b1727ff69d6f263c8 2026-03-16 16:43:12,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:43:12,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5900b1727ff69d6f263c8 HTTP/1.1" 200 None 2026-03-16 16:43:12,593 - lava_callback - DEBUG - Processing node 69b5900b1727ff69d6f263c8: baseline-arm64-clabbe 2026-03-16 16:43:12,593 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5900b1727ff69d6f263c8 2026-03-16 16:43:12,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:43:12,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5900b1727ff69d6f263c8 HTTP/1.1" 200 None 2026-03-16 16:43:12,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:43:12,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-16 16:43:12,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:43:12,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5900b1727ff69d6f263c8 HTTP/1.1" 200 None 2026-03-16 16:43:12,649 - lava_callback - ERROR - Error processing callback for node 69b5900b1727ff69d6f263c8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:51488 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51498 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:43:24,468 - lava_callback - INFO - Received callback for node 69b8196f113612b7716bca85 INFO: 172.19.0.1:51050 - "POST /node/69b8196f113612b7716bca85 HTTP/1.0" 202 Accepted 2026-03-16 16:43:24,474 - lava_callback - INFO - Starting async job submit for node 69b8196f113612b7716bca85 2026-03-16 16:43:24,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:43:24,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8196f113612b7716bca85 HTTP/1.1" 200 None 2026-03-16 16:43:24,512 - lava_callback - DEBUG - Processing node 69b8196f113612b7716bca85: baseline-arm64-broonie 2026-03-16 16:43:24,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:43:24,900 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:43:24,901 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b8196f113612b7716bca85/log.txt.gz 2026-03-16 16:43:25,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:43:25,236 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:43:25,238 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b8196f113612b7716bca85/lava-logs.yaml 2026-03-16 16:43:25,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:43:25,377 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:43:25,379 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b8196f113612b7716bca85/lava_callback.json.gz 2026-03-16 16:43:25,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:43:25,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8196f113612b7716bca85 HTTP/1.1" 200 None 2026-03-16 16:43:25,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:43:25,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 16:43:25,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:43:25,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8196f113612b7716bca85 HTTP/1.1" 200 None 2026-03-16 16:43:25,470 - lava_callback - INFO - Completed processing callback for node 69b8196f113612b7716bca85 INFO: 172.19.0.1:51066 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51072 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39658 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:43:41,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:43:41,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-16 16:43:44,658 - lava_callback - INFO - Received callback for node 69b832f60b8ad4124cec37cb INFO: 172.19.0.1:39286 - "POST /node/69b832f60b8ad4124cec37cb HTTP/1.0" 202 Accepted 2026-03-16 16:43:44,664 - lava_callback - INFO - Starting async job submit for node 69b832f60b8ad4124cec37cb 2026-03-16 16:43:44,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:43:44,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b832f60b8ad4124cec37cb HTTP/1.1" 200 None 2026-03-16 16:43:44,701 - lava_callback - DEBUG - Processing node 69b832f60b8ad4124cec37cb: baseline-x86 2026-03-16 16:43:44,783 - lava_callback - INFO - Received callback for node 69b831ae0b8ad4124cec367f INFO: 172.19.0.1:39298 - "POST /node/69b831ae0b8ad4124cec367f HTTP/1.0" 202 Accepted 2026-03-16 16:43:44,809 - lava_callback - INFO - Starting async job submit for node 69b831ae0b8ad4124cec367f 2026-03-16 16:43:44,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:43:44,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831ae0b8ad4124cec367f HTTP/1.1" 200 None 2026-03-16 16:43:44,984 - lava_callback - DEBUG - Processing node 69b831ae0b8ad4124cec367f: baseline-arm-clabbe 2026-03-16 16:43:45,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:43:45,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:43:45,331 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:43:45,332 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69b832f60b8ad4124cec37cb/log.txt.gz 2026-03-16 16:43:45,380 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:43:45,417 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b831ae0b8ad4124cec367f/log.txt.gz 2026-03-16 16:43:45,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:43:45,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:43:45,826 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:43:45,829 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69b832f60b8ad4124cec37cb/lava-logs.yaml 2026-03-16 16:43:45,837 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:43:45,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:43:45,839 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b831ae0b8ad4124cec367f/lava-logs.yaml 2026-03-16 16:43:45,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:43:45,989 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:43:45,991 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69b832f60b8ad4124cec37cb/lava_callback.json.gz 2026-03-16 16:43:46,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:43:46,034 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:43:46,036 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b831ae0b8ad4124cec367f/lava_callback.json.gz 2026-03-16 16:43:46,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:43:46,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b832f60b8ad4124cec37cb HTTP/1.1" 200 None 2026-03-16 16:43:46,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:43:46,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831ae0b8ad4124cec367f HTTP/1.1" 200 None 2026-03-16 16:43:46,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:43:46,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d700b8ad4124cec3582 HTTP/1.1" 200 None 2026-03-16 16:43:46,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None 2026-03-16 16:43:46,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:43:46,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:43:46,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b832f60b8ad4124cec37cb HTTP/1.1" 200 None 2026-03-16 16:43:46,140 - lava_callback - INFO - Completed processing callback for node 69b832f60b8ad4124cec37cb 2026-03-16 16:43:46,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b831ae0b8ad4124cec367f HTTP/1.1" 200 None 2026-03-16 16:43:46,143 - lava_callback - INFO - Completed processing callback for node 69b831ae0b8ad4124cec367f INFO: 172.19.0.1:39312 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40424 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44324 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:44:11,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:44:11,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-16 16:44:12,230 - lava_callback - INFO - Received callback for node 69b590581727ff69d6f263d6 INFO: 172.19.0.1:39332 - "POST /node/69b590581727ff69d6f263d6 HTTP/1.0" 202 Accepted 2026-03-16 16:44:12,236 - lava_callback - INFO - Starting async job submit for node 69b590581727ff69d6f263d6 2026-03-16 16:44:12,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:44:12,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b590581727ff69d6f263d6 HTTP/1.1" 200 None 2026-03-16 16:44:12,252 - lava_callback - DEBUG - Processing node 69b590581727ff69d6f263d6: baseline-arm64-clabbe 2026-03-16 16:44:12,252 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b590581727ff69d6f263d6 2026-03-16 16:44:12,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:44:12,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b590581727ff69d6f263d6 HTTP/1.1" 200 None 2026-03-16 16:44:12,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:44:12,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-16 16:44:12,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:44:12,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b590581727ff69d6f263d6 HTTP/1.1" 200 None 2026-03-16 16:44:12,304 - lava_callback - ERROR - Error processing callback for node 69b590581727ff69d6f263d6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:39346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39354 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56686 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56696 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46340 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:44:40,686 - lava_callback - INFO - Received callback for node 69b832f50b8ad4124cec37c8 INFO: 172.19.0.1:44628 - "POST /node/69b832f50b8ad4124cec37c8 HTTP/1.0" 202 Accepted 2026-03-16 16:44:40,695 - lava_callback - INFO - Starting async job submit for node 69b832f50b8ad4124cec37c8 2026-03-16 16:44:40,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:44:40,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b832f50b8ad4124cec37c8 HTTP/1.1" 200 None 2026-03-16 16:44:40,769 - lava_callback - DEBUG - Processing node 69b832f50b8ad4124cec37c8: baseline-x86 2026-03-16 16:44:41,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:44:41,699 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:44:41,701 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69b832f50b8ad4124cec37c8/log.txt.gz 2026-03-16 16:44:42,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:44:42,675 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:44:42,678 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69b832f50b8ad4124cec37c8/lava-logs.yaml 2026-03-16 16:44:42,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:44:43,235 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:44:43,237 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69b832f50b8ad4124cec37c8/lava_callback.json.gz 2026-03-16 16:44:43,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:44:43,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b832f50b8ad4124cec37c8 HTTP/1.1" 200 None 2026-03-16 16:44:43,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:44:43,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d700b8ad4124cec3582 HTTP/1.1" 200 None 2026-03-16 16:44:43,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:44:43,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b832f50b8ad4124cec37c8 HTTP/1.1" 200 None 2026-03-16 16:44:43,394 - lava_callback - INFO - Completed processing callback for node 69b832f50b8ad4124cec37c8 INFO: 172.19.0.1:44642 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35802 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34136 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:45:11,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:45:11,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-16 16:45:12,386 - lava_callback - INFO - Received callback for node 69b8338c0b8ad4124cec382c INFO: 172.19.0.1:34018 - "POST /node/69b8338c0b8ad4124cec382c HTTP/1.0" 202 Accepted 2026-03-16 16:45:12,399 - lava_callback - INFO - Starting async job submit for node 69b8338c0b8ad4124cec382c 2026-03-16 16:45:12,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:45:12,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8338c0b8ad4124cec382c HTTP/1.1" 200 None 2026-03-16 16:45:12,435 - lava_callback - DEBUG - Processing node 69b8338c0b8ad4124cec382c: baseline-arm 2026-03-16 16:45:12,445 - lava_callback - WARNING - Failed to upload log 2026-03-16 16:45:12,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:45:12,707 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:45:12,709 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b8338c0b8ad4124cec382c/lava-logs.yaml 2026-03-16 16:45:12,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:45:13,069 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:45:13,071 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b8338c0b8ad4124cec382c/lava_callback.json.gz 2026-03-16 16:45:13,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:45:13,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8338c0b8ad4124cec382c HTTP/1.1" 200 None 2026-03-16 16:45:13,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:45:13,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None 2026-03-16 16:45:13,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:45:13,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8338c0b8ad4124cec382c HTTP/1.1" 200 None 2026-03-16 16:45:13,182 - lava_callback - INFO - Completed processing callback for node 69b8338c0b8ad4124cec382c INFO: 172.19.0.1:34026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34036 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45538 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45552 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:45:32,365 - lava_callback - INFO - Received callback for node 69b590a71727ff69d6f263dd INFO: 172.19.0.1:49526 - "POST /node/69b590a71727ff69d6f263dd HTTP/1.0" 202 Accepted 2026-03-16 16:45:32,380 - lava_callback - INFO - Starting async job submit for node 69b590a71727ff69d6f263dd 2026-03-16 16:45:32,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:45:32,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b590a71727ff69d6f263dd HTTP/1.1" 200 None 2026-03-16 16:45:32,421 - lava_callback - DEBUG - Processing node 69b590a71727ff69d6f263dd: baseline-arm64-clabbe 2026-03-16 16:45:32,421 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b590a71727ff69d6f263dd 2026-03-16 16:45:32,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:45:32,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b590a71727ff69d6f263dd HTTP/1.1" 200 None 2026-03-16 16:45:32,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:45:32,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-16 16:45:32,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:45:32,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b590a71727ff69d6f263dd HTTP/1.1" 200 None 2026-03-16 16:45:32,523 - lava_callback - ERROR - Error processing callback for node 69b590a71727ff69d6f263dd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:49536 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:45:38,134 - lava_callback - INFO - Received callback for node 69b8336d0b8ad4124cec381f INFO: 172.19.0.1:49544 - "POST /node/69b8336d0b8ad4124cec381f HTTP/1.0" 202 Accepted 2026-03-16 16:45:38,140 - lava_callback - INFO - Starting async job submit for node 69b8336d0b8ad4124cec381f 2026-03-16 16:45:38,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:45:38,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8336d0b8ad4124cec381f HTTP/1.1" 200 None 2026-03-16 16:45:38,185 - lava_callback - DEBUG - Processing node 69b8336d0b8ad4124cec381f: baseline-arm-pengutronix 2026-03-16 16:45:38,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:45:38,468 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:45:38,470 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b8336d0b8ad4124cec381f/log.txt.gz 2026-03-16 16:45:38,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:45:38,758 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:45:38,760 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b8336d0b8ad4124cec381f/lava-logs.yaml 2026-03-16 16:45:38,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:45:38,881 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:45:38,883 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b8336d0b8ad4124cec381f/lava_callback.json.gz 2026-03-16 16:45:38,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:45:38,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8336d0b8ad4124cec381f HTTP/1.1" 200 None 2026-03-16 16:45:38,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:45:38,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None 2026-03-16 16:45:38,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:45:38,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8336d0b8ad4124cec381f HTTP/1.1" 200 None 2026-03-16 16:45:38,961 - lava_callback - INFO - Completed processing callback for node 69b8336d0b8ad4124cec381f 2026-03-16 16:45:41,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:45:41,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:33804 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39782 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52656 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39694 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53854 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53864 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34222 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44780 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:46:52,383 - lava_callback - INFO - Received callback for node 69b590f41727ff69d6f263eb INFO: 172.19.0.1:44560 - "POST /node/69b590f41727ff69d6f263eb HTTP/1.0" 202 Accepted 2026-03-16 16:46:52,388 - lava_callback - INFO - Starting async job submit for node 69b590f41727ff69d6f263eb 2026-03-16 16:46:52,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:46:52,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b590f41727ff69d6f263eb HTTP/1.1" 200 None 2026-03-16 16:46:52,408 - lava_callback - DEBUG - Processing node 69b590f41727ff69d6f263eb: baseline-arm64-clabbe 2026-03-16 16:46:52,409 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b590f41727ff69d6f263eb 2026-03-16 16:46:52,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:46:52,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b590f41727ff69d6f263eb HTTP/1.1" 200 None 2026-03-16 16:46:52,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:46:52,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-16 16:46:52,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:46:52,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b590f41727ff69d6f263eb HTTP/1.1" 200 None 2026-03-16 16:46:52,463 - lava_callback - ERROR - Error processing callback for node 69b590f41727ff69d6f263eb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:44564 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:47:04,922 - lava_callback - INFO - Received callback for node 69b82f5a0b8ad4124cec35ce INFO: 172.19.0.1:35114 - "POST /node/69b82f5a0b8ad4124cec35ce HTTP/1.0" 202 Accepted 2026-03-16 16:47:04,929 - lava_callback - INFO - Starting async job submit for node 69b82f5a0b8ad4124cec35ce 2026-03-16 16:47:04,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:47:05,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82f5a0b8ad4124cec35ce HTTP/1.1" 200 None 2026-03-16 16:47:05,003 - lava_callback - DEBUG - Processing node 69b82f5a0b8ad4124cec35ce: ltp-smoke 2026-03-16 16:47:05,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:47:05,676 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:47:05,678 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69b82f5a0b8ad4124cec35ce/log.txt.gz 2026-03-16 16:47:05,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:47:06,166 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:47:06,168 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69b82f5a0b8ad4124cec35ce/lava-logs.yaml 2026-03-16 16:47:06,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:47:06,328 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:47:06,329 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69b82f5a0b8ad4124cec35ce/lava_callback.json.gz 2026-03-16 16:47:06,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:47:06,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82f5a0b8ad4124cec35ce HTTP/1.1" 200 None 2026-03-16 16:47:06,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:47:06,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d3d0b8ad4124cec355d HTTP/1.1" 200 None 2026-03-16 16:47:06,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:47:06,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b82f5a0b8ad4124cec35ce HTTP/1.1" 200 None INFO: 172.19.0.1:35116 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:47:06,642 - lava_callback - INFO - Completed processing callback for node 69b82f5a0b8ad4124cec35ce 2026-03-16 16:47:11,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:47:11,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:44180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44182 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46730 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46742 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51508 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46140 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:47:54,862 - lava_callback - INFO - Received callback for node 69b5912e1727ff69d6f263f0 INFO: 172.19.0.1:42746 - "POST /node/69b5912e1727ff69d6f263f0 HTTP/1.0" 202 Accepted 2026-03-16 16:47:54,868 - lava_callback - INFO - Starting async job submit for node 69b5912e1727ff69d6f263f0 2026-03-16 16:47:54,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:47:54,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5912e1727ff69d6f263f0 HTTP/1.1" 200 None 2026-03-16 16:47:54,889 - lava_callback - DEBUG - Processing node 69b5912e1727ff69d6f263f0: baseline-arm-baylibre 2026-03-16 16:47:54,889 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5912e1727ff69d6f263f0 2026-03-16 16:47:54,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:47:54,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5912e1727ff69d6f263f0 HTTP/1.1" 200 None 2026-03-16 16:47:54,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:47:54,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd826ae557f2600f0f036 HTTP/1.1" 200 None 2026-03-16 16:47:54,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:47:54,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5912e1727ff69d6f263f0 HTTP/1.1" 200 None 2026-03-16 16:47:54,942 - lava_callback - ERROR - Error processing callback for node 69b5912e1727ff69d6f263f0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:42760 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53140 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44618 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47808 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47818 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:48:34,787 - lava_callback - INFO - Received callback for node 69b591521727ff69d6f263f9 INFO: 172.19.0.1:58480 - "POST /node/69b591521727ff69d6f263f9 HTTP/1.0" 202 Accepted 2026-03-16 16:48:34,792 - lava_callback - INFO - Starting async job submit for node 69b591521727ff69d6f263f9 2026-03-16 16:48:34,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:48:34,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b591521727ff69d6f263f9 HTTP/1.1" 200 None 2026-03-16 16:48:34,825 - lava_callback - DEBUG - Processing node 69b591521727ff69d6f263f9: baseline-arm-baylibre 2026-03-16 16:48:34,825 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b591521727ff69d6f263f9 2026-03-16 16:48:34,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:48:34,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b591521727ff69d6f263f9 HTTP/1.1" 200 None 2026-03-16 16:48:34,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:48:34,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd826ae557f2600f0f036 HTTP/1.1" 200 None 2026-03-16 16:48:34,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:48:34,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b591521727ff69d6f263f9 HTTP/1.1" 200 None 2026-03-16 16:48:34,886 - lava_callback - ERROR - Error processing callback for node 69b591521727ff69d6f263f9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:58484 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57330 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45188 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35730 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:49:14,854 - lava_callback - INFO - Received callback for node 69b591751727ff69d6f26402 INFO: 172.19.0.1:33614 - "POST /node/69b591751727ff69d6f26402 HTTP/1.0" 202 Accepted 2026-03-16 16:49:14,859 - lava_callback - INFO - Starting async job submit for node 69b591751727ff69d6f26402 2026-03-16 16:49:14,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:49:14,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b591751727ff69d6f26402 HTTP/1.1" 200 None 2026-03-16 16:49:14,895 - lava_callback - DEBUG - Processing node 69b591751727ff69d6f26402: baseline-arm-baylibre 2026-03-16 16:49:14,895 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b591751727ff69d6f26402 2026-03-16 16:49:14,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:49:14,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b591751727ff69d6f26402 HTTP/1.1" 200 None 2026-03-16 16:49:14,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:49:14,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd826ae557f2600f0f036 HTTP/1.1" 200 None 2026-03-16 16:49:14,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:49:14,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b591751727ff69d6f26402 HTTP/1.1" 200 None 2026-03-16 16:49:14,947 - lava_callback - ERROR - Error processing callback for node 69b591751727ff69d6f26402: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:33616 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33624 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48522 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48536 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43750 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42012 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:49:47,146 - lava_callback - INFO - Received callback for node 69b81956113612b7716bca2e INFO: 172.19.0.1:42020 - "POST /node/69b81956113612b7716bca2e HTTP/1.0" 202 Accepted 2026-03-16 16:49:47,154 - lava_callback - INFO - Starting async job submit for node 69b81956113612b7716bca2e 2026-03-16 16:49:47,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:49:47,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81956113612b7716bca2e HTTP/1.1" 200 None 2026-03-16 16:49:47,233 - lava_callback - DEBUG - Processing node 69b81956113612b7716bca2e: baseline-nfs-arm64 2026-03-16 16:49:48,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:49:48,591 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:49:48,593 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b81956113612b7716bca2e/log.txt.gz 2026-03-16 16:49:49,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:49:49,491 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:49:49,494 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b81956113612b7716bca2e/lava-logs.yaml 2026-03-16 16:49:49,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:49:49,681 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:49:49,683 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b81956113612b7716bca2e/lava_callback.json.gz DEBUG: Setup failed for 69b81956113612b7716bca2e. Transitting job node result: incomplete -> fail 2026-03-16 16:49:49,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:49:49,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81956113612b7716bca2e HTTP/1.1" 200 None 2026-03-16 16:49:49,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:49:49,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 16:49:49,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:49:49,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b81956113612b7716bca2e HTTP/1.1" 200 None 2026-03-16 16:49:49,927 - lava_callback - INFO - Completed processing callback for node 69b81956113612b7716bca2e 2026-03-16 16:49:54,867 - lava_callback - INFO - Received callback for node 69b591a11727ff69d6f26414 INFO: 172.19.0.1:43530 - "POST /node/69b591a11727ff69d6f26414 HTTP/1.0" 202 Accepted 2026-03-16 16:49:54,873 - lava_callback - INFO - Starting async job submit for node 69b591a11727ff69d6f26414 2026-03-16 16:49:54,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:49:54,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b591a11727ff69d6f26414 HTTP/1.1" 200 None 2026-03-16 16:49:54,889 - lava_callback - DEBUG - Processing node 69b591a11727ff69d6f26414: baseline-arm64-baylibre 2026-03-16 16:49:54,889 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b591a11727ff69d6f26414 2026-03-16 16:49:54,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:49:54,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b591a11727ff69d6f26414 HTTP/1.1" 200 None 2026-03-16 16:49:54,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:49:54,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-16 16:49:54,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:49:54,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b591a11727ff69d6f26414 HTTP/1.1" 200 None 2026-03-16 16:49:54,955 - lava_callback - ERROR - Error processing callback for node 69b591a11727ff69d6f26414: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:43532 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34254 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:50:11,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:50:11,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:53362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53374 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59012 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59028 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59624 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57240 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54338 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46666 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:51:14,980 - lava_callback - INFO - Received callback for node 69b591f01727ff69d6f26428 INFO: 172.19.0.1:38814 - "POST /node/69b591f01727ff69d6f26428 HTTP/1.0" 202 Accepted 2026-03-16 16:51:14,985 - lava_callback - INFO - Starting async job submit for node 69b591f01727ff69d6f26428 2026-03-16 16:51:14,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:51:15,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b591f01727ff69d6f26428 HTTP/1.1" 200 None 2026-03-16 16:51:15,002 - lava_callback - DEBUG - Processing node 69b591f01727ff69d6f26428: baseline-arm64-baylibre 2026-03-16 16:51:15,002 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b591f01727ff69d6f26428 2026-03-16 16:51:15,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:51:15,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b591f01727ff69d6f26428 HTTP/1.1" 200 None 2026-03-16 16:51:15,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:51:15,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-16 16:51:15,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:51:15,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b591f01727ff69d6f26428 HTTP/1.1" 200 None 2026-03-16 16:51:15,084 - lava_callback - ERROR - Error processing callback for node 69b591f01727ff69d6f26428: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:38820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38828 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:51:21,914 - lava_callback - INFO - Received callback for node 69b834de0b8ad4124cec388f INFO: 172.19.0.1:45080 - "POST /node/69b834de0b8ad4124cec388f HTTP/1.0" 202 Accepted 2026-03-16 16:51:21,920 - lava_callback - INFO - Starting async job submit for node 69b834de0b8ad4124cec388f 2026-03-16 16:51:21,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:51:21,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b834de0b8ad4124cec388f HTTP/1.1" 200 None 2026-03-16 16:51:21,952 - lava_callback - DEBUG - Processing node 69b834de0b8ad4124cec388f: baseline-x86 2026-03-16 16:51:22,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:51:22,302 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:51:22,304 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69b834de0b8ad4124cec388f/log.txt.gz 2026-03-16 16:51:22,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:51:22,630 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:51:22,632 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69b834de0b8ad4124cec388f/lava-logs.yaml 2026-03-16 16:51:22,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:51:22,803 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:51:22,805 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69b834de0b8ad4124cec388f/lava_callback.json.gz 2026-03-16 16:51:22,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:51:22,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b834de0b8ad4124cec388f HTTP/1.1" 200 None 2026-03-16 16:51:22,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:51:22,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d700b8ad4124cec3582 HTTP/1.1" 200 None 2026-03-16 16:51:22,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:51:22,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b834de0b8ad4124cec388f HTTP/1.1" 200 None 2026-03-16 16:51:22,887 - lava_callback - INFO - Completed processing callback for node 69b834de0b8ad4124cec388f 2026-03-16 16:51:24,487 - lava_callback - INFO - Received callback for node 69b834dd0b8ad4124cec388c INFO: 172.19.0.1:45082 - "POST /node/69b834dd0b8ad4124cec388c HTTP/1.0" 202 Accepted 2026-03-16 16:51:24,493 - lava_callback - INFO - Starting async job submit for node 69b834dd0b8ad4124cec388c 2026-03-16 16:51:24,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:51:24,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b834dd0b8ad4124cec388c HTTP/1.1" 200 None 2026-03-16 16:51:24,526 - lava_callback - DEBUG - Processing node 69b834dd0b8ad4124cec388c: baseline-x86 2026-03-16 16:51:24,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:51:25,212 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:51:25,214 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69b834dd0b8ad4124cec388c/log.txt.gz 2026-03-16 16:51:25,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:51:25,841 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:51:25,843 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69b834dd0b8ad4124cec388c/lava-logs.yaml 2026-03-16 16:51:25,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:51:26,189 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:51:26,192 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69b834dd0b8ad4124cec388c/lava_callback.json.gz 2026-03-16 16:51:26,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:51:26,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b834dd0b8ad4124cec388c HTTP/1.1" 200 None 2026-03-16 16:51:26,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:51:26,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d700b8ad4124cec3582 HTTP/1.1" 200 None 2026-03-16 16:51:26,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:51:26,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b834dd0b8ad4124cec388c HTTP/1.1" 200 None 2026-03-16 16:51:26,338 - lava_callback - INFO - Completed processing callback for node 69b834dd0b8ad4124cec388c INFO: 172.19.0.1:45090 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45104 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33566 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:51:41,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:51:41,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:37898 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45858 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52100 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49468 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49484 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38606 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38622 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:52:32,675 - lava_callback - INFO - Received callback for node 69b592431727ff69d6f26434 INFO: 172.19.0.1:54154 - "POST /node/69b592431727ff69d6f26434 HTTP/1.0" 202 Accepted 2026-03-16 16:52:32,683 - lava_callback - INFO - Starting async job submit for node 69b592431727ff69d6f26434 2026-03-16 16:52:32,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:52:32,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b592431727ff69d6f26434 HTTP/1.1" 200 None 2026-03-16 16:52:32,725 - lava_callback - DEBUG - Processing node 69b592431727ff69d6f26434: baseline-arm64-clabbe 2026-03-16 16:52:32,725 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b592431727ff69d6f26434 2026-03-16 16:52:32,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:52:32,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b592431727ff69d6f26434 HTTP/1.1" 200 None 2026-03-16 16:52:32,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:52:32,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-16 16:52:32,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:52:32,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b592431727ff69d6f26434 HTTP/1.1" 200 None 2026-03-16 16:52:32,827 - lava_callback - ERROR - Error processing callback for node 69b592431727ff69d6f26434: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:54170 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55058 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46170 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45940 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42956 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33242 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33254 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38380 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56852 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:53:52,722 - lava_callback - INFO - Received callback for node 69b592901727ff69d6f2643a INFO: 172.19.0.1:52690 - "POST /node/69b592901727ff69d6f2643a HTTP/1.0" 202 Accepted 2026-03-16 16:53:52,729 - lava_callback - INFO - Starting async job submit for node 69b592901727ff69d6f2643a 2026-03-16 16:53:52,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:53:52,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b592901727ff69d6f2643a HTTP/1.1" 200 None 2026-03-16 16:53:52,749 - lava_callback - DEBUG - Processing node 69b592901727ff69d6f2643a: baseline-arm64-clabbe 2026-03-16 16:53:52,750 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b592901727ff69d6f2643a 2026-03-16 16:53:52,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:53:52,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b592901727ff69d6f2643a HTTP/1.1" 200 None 2026-03-16 16:53:52,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:53:52,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-16 16:53:52,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:53:52,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b592901727ff69d6f2643a HTTP/1.1" 200 None 2026-03-16 16:53:52,827 - lava_callback - ERROR - Error processing callback for node 69b592901727ff69d6f2643a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:52694 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54880 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41010 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34608 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34618 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:54:32,920 - lava_callback - INFO - Received callback for node 69b835b10b8ad4124cec38ef INFO: 172.19.0.1:48766 - "POST /node/69b835b10b8ad4124cec38ef HTTP/1.0" 202 Accepted 2026-03-16 16:54:32,927 - lava_callback - INFO - Starting async job submit for node 69b835b10b8ad4124cec38ef 2026-03-16 16:54:32,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:54:32,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835b10b8ad4124cec38ef HTTP/1.1" 200 None 2026-03-16 16:54:32,963 - lava_callback - DEBUG - Processing node 69b835b10b8ad4124cec38ef: baseline-arm64 2026-03-16 16:54:33,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:54:33,254 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:54:33,256 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b835b10b8ad4124cec38ef/log.txt.gz 2026-03-16 16:54:33,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:54:33,603 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:54:33,605 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b835b10b8ad4124cec38ef/lava-logs.yaml 2026-03-16 16:54:33,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:54:33,751 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:54:33,753 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b835b10b8ad4124cec38ef/lava_callback.json.gz 2026-03-16 16:54:33,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:54:33,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835b10b8ad4124cec38ef HTTP/1.1" 200 None 2026-03-16 16:54:33,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:54:33,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 16:54:33,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:54:33,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b835b10b8ad4124cec38ef HTTP/1.1" 200 None 2026-03-16 16:54:33,836 - lava_callback - INFO - Completed processing callback for node 69b835b10b8ad4124cec38ef INFO: 172.19.0.1:48778 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:54:41,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:54:41,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:47662 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:54:50,701 - lava_callback - INFO - Received callback for node 69b831910b8ad4124cec3607 INFO: 172.19.0.1:36620 - "POST /node/69b831910b8ad4124cec3607 HTTP/1.0" 202 Accepted 2026-03-16 16:54:50,709 - lava_callback - INFO - Starting async job submit for node 69b831910b8ad4124cec3607 2026-03-16 16:54:50,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:54:50,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831910b8ad4124cec3607 HTTP/1.1" 200 None 2026-03-16 16:54:50,790 - lava_callback - DEBUG - Processing node 69b831910b8ad4124cec3607: baseline-arm 2026-03-16 16:54:51,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:54:51,646 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:54:51,648 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b831910b8ad4124cec3607/log.txt.gz 2026-03-16 16:54:52,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:54:52,497 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:54:52,500 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b831910b8ad4124cec3607/lava-logs.yaml 2026-03-16 16:54:52,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:54:52,673 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:54:52,676 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b831910b8ad4124cec3607/lava_callback.json.gz DEBUG: Setup failed for 69b831910b8ad4124cec3607. Transitting job node result: incomplete -> fail 2026-03-16 16:54:52,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:54:52,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831910b8ad4124cec3607 HTTP/1.1" 200 None 2026-03-16 16:54:52,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:54:52,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None 2026-03-16 16:54:52,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:54:52,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b831910b8ad4124cec3607 HTTP/1.1" 200 None 2026-03-16 16:54:53,131 - lava_callback - INFO - Completed processing callback for node 69b831910b8ad4124cec3607 INFO: 172.19.0.1:36632 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:55:04,376 - lava_callback - INFO - Received callback for node 69b835bd0b8ad4124cec3910 INFO: 172.19.0.1:45394 - "POST /node/69b835bd0b8ad4124cec3910 HTTP/1.0" 202 Accepted 2026-03-16 16:55:04,383 - lava_callback - INFO - Starting async job submit for node 69b835bd0b8ad4124cec3910 2026-03-16 16:55:04,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:55:04,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835bd0b8ad4124cec3910 HTTP/1.1" 200 None 2026-03-16 16:55:04,418 - lava_callback - DEBUG - Processing node 69b835bd0b8ad4124cec3910: baseline-arm64 2026-03-16 16:55:04,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:55:04,745 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:55:04,747 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b835bd0b8ad4124cec3910/log.txt.gz 2026-03-16 16:55:04,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:55:05,040 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:55:05,042 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b835bd0b8ad4124cec3910/lava-logs.yaml 2026-03-16 16:55:05,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:55:05,188 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:55:05,190 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b835bd0b8ad4124cec3910/lava_callback.json.gz 2026-03-16 16:55:05,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:55:05,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835bd0b8ad4124cec3910 HTTP/1.1" 200 None 2026-03-16 16:55:05,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:55:05,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 16:55:05,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:55:05,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b835bd0b8ad4124cec3910 HTTP/1.1" 200 None 2026-03-16 16:55:05,274 - lava_callback - INFO - Completed processing callback for node 69b835bd0b8ad4124cec3910 INFO: 172.19.0.1:45398 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:55:08,939 - lava_callback - INFO - Received callback for node 69b835ce0b8ad4124cec3955 INFO: 172.19.0.1:45406 - "POST /node/69b835ce0b8ad4124cec3955 HTTP/1.0" 202 Accepted 2026-03-16 16:55:08,950 - lava_callback - INFO - Starting async job submit for node 69b835ce0b8ad4124cec3955 2026-03-16 16:55:08,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:55:08,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835ce0b8ad4124cec3955 HTTP/1.1" 200 None 2026-03-16 16:55:08,979 - lava_callback - DEBUG - Processing node 69b835ce0b8ad4124cec3955: baseline-nfs-arm64 2026-03-16 16:55:08,981 - lava_callback - WARNING - Failed to upload log 2026-03-16 16:55:08,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:55:09,123 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:55:09,125 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b835ce0b8ad4124cec3955/lava-logs.yaml 2026-03-16 16:55:09,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:55:09,238 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:55:09,240 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b835ce0b8ad4124cec3955/lava_callback.json.gz 2026-03-16 16:55:09,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:55:09,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835ce0b8ad4124cec3955 HTTP/1.1" 200 None 2026-03-16 16:55:09,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:55:09,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 16:55:09,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:55:09,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b835ce0b8ad4124cec3955 HTTP/1.1" 200 None 2026-03-16 16:55:09,310 - lava_callback - INFO - Completed processing callback for node 69b835ce0b8ad4124cec3955 2026-03-16 16:55:11,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:55:11,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-16 16:55:12,813 - lava_callback - INFO - Received callback for node 69b592df1727ff69d6f26446 INFO: 172.19.0.1:58098 - "POST /node/69b592df1727ff69d6f26446 HTTP/1.0" 202 Accepted 2026-03-16 16:55:12,823 - lava_callback - INFO - Starting async job submit for node 69b592df1727ff69d6f26446 2026-03-16 16:55:12,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:55:12,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b592df1727ff69d6f26446 HTTP/1.1" 200 None 2026-03-16 16:55:12,847 - lava_callback - DEBUG - Processing node 69b592df1727ff69d6f26446: baseline-arm64-clabbe 2026-03-16 16:55:12,848 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b592df1727ff69d6f26446 2026-03-16 16:55:12,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:55:12,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b592df1727ff69d6f26446 HTTP/1.1" 200 None 2026-03-16 16:55:12,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:55:12,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-16 16:55:12,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:55:12,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b592df1727ff69d6f26446 HTTP/1.1" 200 None 2026-03-16 16:55:12,916 - lava_callback - ERROR - Error processing callback for node 69b592df1727ff69d6f26446: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:58110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58124 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:55:16,692 - lava_callback - INFO - Received callback for node 69b835b20b8ad4124cec38f5 INFO: 172.19.0.1:58140 - "POST /node/69b835b20b8ad4124cec38f5 HTTP/1.0" 202 Accepted 2026-03-16 16:55:16,699 - lava_callback - INFO - Starting async job submit for node 69b835b20b8ad4124cec38f5 2026-03-16 16:55:16,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:55:16,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835b20b8ad4124cec38f5 HTTP/1.1" 200 None 2026-03-16 16:55:16,763 - lava_callback - DEBUG - Processing node 69b835b20b8ad4124cec38f5: baseline-arm64 2026-03-16 16:55:17,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:55:17,245 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:55:17,248 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b835b20b8ad4124cec38f5/log.txt.gz 2026-03-16 16:55:17,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:55:17,775 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:55:17,777 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b835b20b8ad4124cec38f5/lava-logs.yaml 2026-03-16 16:55:17,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:55:17,917 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:55:17,919 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b835b20b8ad4124cec38f5/lava_callback.json.gz 2026-03-16 16:55:17,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:55:17,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835b20b8ad4124cec38f5 HTTP/1.1" 200 None 2026-03-16 16:55:17,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:55:17,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 16:55:17,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:55:18,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b835b20b8ad4124cec38f5 HTTP/1.1" 200 None 2026-03-16 16:55:18,036 - lava_callback - INFO - Completed processing callback for node 69b835b20b8ad4124cec38f5 INFO: 172.19.0.1:49426 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:55:27,990 - lava_callback - INFO - Received callback for node 69b835b90b8ad4124cec3904 INFO: 172.19.0.1:49438 - "POST /node/69b835b90b8ad4124cec3904 HTTP/1.0" 202 Accepted 2026-03-16 16:55:27,997 - lava_callback - INFO - Starting async job submit for node 69b835b90b8ad4124cec3904 2026-03-16 16:55:28,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:55:28,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835b90b8ad4124cec3904 HTTP/1.1" 200 None 2026-03-16 16:55:28,038 - lava_callback - DEBUG - Processing node 69b835b90b8ad4124cec3904: baseline-arm64 2026-03-16 16:55:28,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:55:28,430 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:55:28,432 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b835b90b8ad4124cec3904/log.txt.gz 2026-03-16 16:55:28,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:55:28,838 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:55:28,840 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b835b90b8ad4124cec3904/lava-logs.yaml 2026-03-16 16:55:28,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.19.0.1:49446 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:55:28,982 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:55:28,984 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b835b90b8ad4124cec3904/lava_callback.json.gz 2026-03-16 16:55:29,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:55:29,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835b90b8ad4124cec3904 HTTP/1.1" 200 None 2026-03-16 16:55:29,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:55:29,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 16:55:29,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:55:29,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b835b90b8ad4124cec3904 HTTP/1.1" 200 None 2026-03-16 16:55:29,069 - lava_callback - INFO - Completed processing callback for node 69b835b90b8ad4124cec3904 2026-03-16 16:55:29,795 - lava_callback - INFO - Received callback for node 69b835b50b8ad4124cec38fb INFO: 172.19.0.1:57712 - "POST /node/69b835b50b8ad4124cec38fb HTTP/1.0" 202 Accepted 2026-03-16 16:55:29,802 - lava_callback - INFO - Starting async job submit for node 69b835b50b8ad4124cec38fb 2026-03-16 16:55:29,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:55:29,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835b50b8ad4124cec38fb HTTP/1.1" 200 None 2026-03-16 16:55:29,848 - lava_callback - DEBUG - Processing node 69b835b50b8ad4124cec38fb: baseline-arm64 2026-03-16 16:55:30,057 - lava_callback - WARNING - Failed to upload log 2026-03-16 16:55:30,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:55:30,284 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:55:30,286 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b835b50b8ad4124cec38fb/lava-logs.yaml 2026-03-16 16:55:30,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:55:30,446 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:55:30,448 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b835b50b8ad4124cec38fb/lava_callback.json.gz 2026-03-16 16:55:30,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:55:30,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835b50b8ad4124cec38fb HTTP/1.1" 200 None 2026-03-16 16:55:30,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:55:30,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 16:55:30,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:55:30,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b835b50b8ad4124cec38fb HTTP/1.1" 200 None 2026-03-16 16:55:30,599 - lava_callback - INFO - Completed processing callback for node 69b835b50b8ad4124cec38fb INFO: 172.19.0.1:57720 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:55:37,120 - lava_callback - INFO - Received callback for node 69b835b10b8ad4124cec38f2 INFO: 172.19.0.1:57734 - "POST /node/69b835b10b8ad4124cec38f2 HTTP/1.0" 202 Accepted 2026-03-16 16:55:37,127 - lava_callback - INFO - Starting async job submit for node 69b835b10b8ad4124cec38f2 2026-03-16 16:55:37,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:55:37,151 - lava_callback - INFO - Received callback for node 69b835c10b8ad4124cec3919 INFO: 172.19.0.1:57750 - "POST /node/69b835c10b8ad4124cec3919 HTTP/1.0" 202 Accepted 2026-03-16 16:55:37,158 - lava_callback - INFO - Starting async job submit for node 69b835c10b8ad4124cec3919 2026-03-16 16:55:37,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:55:37,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835b10b8ad4124cec38f2 HTTP/1.1" 200 None 2026-03-16 16:55:37,187 - lava_callback - DEBUG - Processing node 69b835b10b8ad4124cec38f2: baseline-arm64 2026-03-16 16:55:37,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835c10b8ad4124cec3919 HTTP/1.1" 200 None 2026-03-16 16:55:37,254 - lava_callback - DEBUG - Processing node 69b835c10b8ad4124cec3919: baseline-arm64 2026-03-16 16:55:37,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:55:37,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:55:37,823 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:55:37,825 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b835b10b8ad4124cec38f2/log.txt.gz 2026-03-16 16:55:37,882 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:55:37,918 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b835c10b8ad4124cec3919/log.txt.gz 2026-03-16 16:55:38,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:55:38,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:55:38,318 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:55:38,320 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b835b10b8ad4124cec38f2/lava-logs.yaml 2026-03-16 16:55:38,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:55:38,422 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:55:38,425 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b835c10b8ad4124cec3919/lava-logs.yaml 2026-03-16 16:55:38,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:55:38,476 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:55:38,478 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b835b10b8ad4124cec38f2/lava_callback.json.gz 2026-03-16 16:55:38,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:55:38,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835b10b8ad4124cec38f2 HTTP/1.1" 200 None 2026-03-16 16:55:38,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:55:38,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 16:55:38,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:55:38,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b835b10b8ad4124cec38f2 HTTP/1.1" 200 None 2026-03-16 16:55:38,623 - lava_callback - INFO - Completed processing callback for node 69b835b10b8ad4124cec38f2 2026-03-16 16:55:38,674 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:55:38,676 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b835c10b8ad4124cec3919/lava_callback.json.gz 2026-03-16 16:55:38,717 - lava_callback - INFO - Received callback for node 69b835b30b8ad4124cec38f8 2026-03-16 16:55:38,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:55:38,733 - lava_callback - INFO - Starting async job submit for node 69b835b30b8ad4124cec38f8 INFO: 172.19.0.1:57756 - "POST /node/69b835b30b8ad4124cec38f8 HTTP/1.0" 202 Accepted 2026-03-16 16:55:38,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:55:38,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835c10b8ad4124cec3919 HTTP/1.1" 200 None 2026-03-16 16:55:38,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:55:38,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835b30b8ad4124cec38f8 HTTP/1.1" 200 None 2026-03-16 16:55:38,818 - lava_callback - DEBUG - Processing node 69b835b30b8ad4124cec38f8: baseline-arm64 2026-03-16 16:55:38,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 16:55:38,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:55:39,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b835c10b8ad4124cec3919 HTTP/1.1" 200 None 2026-03-16 16:55:39,017 - lava_callback - INFO - Completed processing callback for node 69b835c10b8ad4124cec3919 2026-03-16 16:55:39,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:55:39,314 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:55:39,316 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b835b30b8ad4124cec38f8/log.txt.gz 2026-03-16 16:55:39,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:55:39,641 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:55:39,643 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b835b30b8ad4124cec38f8/lava-logs.yaml 2026-03-16 16:55:39,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:55:39,799 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:55:39,800 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b835b30b8ad4124cec38f8/lava_callback.json.gz 2026-03-16 16:55:39,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:55:39,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835b30b8ad4124cec38f8 HTTP/1.1" 200 None 2026-03-16 16:55:39,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:55:39,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 16:55:39,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:55:39,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b835b30b8ad4124cec38f8 HTTP/1.1" 200 None 2026-03-16 16:55:39,889 - lava_callback - INFO - Completed processing callback for node 69b835b30b8ad4124cec38f8 2026-03-16 16:55:41,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:55:41,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-16 16:55:42,678 - lava_callback - INFO - Received callback for node 69b835c40b8ad4124cec391f INFO: 172.19.0.1:38694 - "POST /node/69b835c40b8ad4124cec391f HTTP/1.0" 202 Accepted 2026-03-16 16:55:42,684 - lava_callback - INFO - Starting async job submit for node 69b835c40b8ad4124cec391f 2026-03-16 16:55:42,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:55:42,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835c40b8ad4124cec391f HTTP/1.1" 200 None 2026-03-16 16:55:42,737 - lava_callback - DEBUG - Processing node 69b835c40b8ad4124cec391f: baseline-arm64 2026-03-16 16:55:43,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:55:43,227 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:55:43,228 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b835c40b8ad4124cec391f/log.txt.gz 2026-03-16 16:55:43,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:55:43,653 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:55:43,656 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b835c40b8ad4124cec391f/lava-logs.yaml 2026-03-16 16:55:43,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:55:43,810 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:55:43,812 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b835c40b8ad4124cec391f/lava_callback.json.gz 2026-03-16 16:55:43,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:55:43,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835c40b8ad4124cec391f HTTP/1.1" 200 None 2026-03-16 16:55:43,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:55:43,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 16:55:43,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:55:43,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b835c40b8ad4124cec391f HTTP/1.1" 200 None 2026-03-16 16:55:43,912 - lava_callback - INFO - Completed processing callback for node 69b835c40b8ad4124cec391f 2026-03-16 16:55:45,587 - lava_callback - INFO - Received callback for node 69b835bf0b8ad4124cec3913 INFO: 172.19.0.1:38710 - "POST /node/69b835bf0b8ad4124cec3913 HTTP/1.0" 202 Accepted 2026-03-16 16:55:45,593 - lava_callback - INFO - Starting async job submit for node 69b835bf0b8ad4124cec3913 2026-03-16 16:55:45,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:55:45,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835bf0b8ad4124cec3913 HTTP/1.1" 200 None 2026-03-16 16:55:45,632 - lava_callback - DEBUG - Processing node 69b835bf0b8ad4124cec3913: baseline-arm64 2026-03-16 16:55:45,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:55:45,993 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:55:45,994 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b835bf0b8ad4124cec3913/log.txt.gz 2026-03-16 16:55:46,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:55:46,312 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:55:46,314 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b835bf0b8ad4124cec3913/lava-logs.yaml 2026-03-16 16:55:46,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:55:46,462 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:55:46,464 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b835bf0b8ad4124cec3913/lava_callback.json.gz 2026-03-16 16:55:46,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:55:46,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835bf0b8ad4124cec3913 HTTP/1.1" 200 None 2026-03-16 16:55:46,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.19.0.1:38726 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:55:46,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 16:55:46,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:55:46,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b835bf0b8ad4124cec3913 HTTP/1.1" 200 None 2026-03-16 16:55:46,544 - lava_callback - INFO - Completed processing callback for node 69b835bf0b8ad4124cec3913 2026-03-16 16:55:55,988 - lava_callback - INFO - Received callback for node 69b835bb0b8ad4124cec390a INFO: 172.19.0.1:36044 - "POST /node/69b835bb0b8ad4124cec390a HTTP/1.0" 202 Accepted 2026-03-16 16:55:55,995 - lava_callback - INFO - Starting async job submit for node 69b835bb0b8ad4124cec390a 2026-03-16 16:55:56,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:55:56,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835bb0b8ad4124cec390a HTTP/1.1" 200 None 2026-03-16 16:55:56,032 - lava_callback - DEBUG - Processing node 69b835bb0b8ad4124cec390a: baseline-arm64 2026-03-16 16:55:56,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.19.0.1:36048 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:55:56,553 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:55:56,555 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b835bb0b8ad4124cec390a/log.txt.gz 2026-03-16 16:55:56,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:55:57,035 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:55:57,037 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b835bb0b8ad4124cec390a/lava-logs.yaml 2026-03-16 16:55:57,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:55:57,196 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:55:57,198 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b835bb0b8ad4124cec390a/lava_callback.json.gz 2026-03-16 16:55:57,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:55:57,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835bb0b8ad4124cec390a HTTP/1.1" 200 None 2026-03-16 16:55:57,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:55:57,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 16:55:57,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:55:57,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b835bb0b8ad4124cec390a HTTP/1.1" 200 None 2026-03-16 16:55:57,286 - lava_callback - INFO - Completed processing callback for node 69b835bb0b8ad4124cec390a 2026-03-16 16:56:01,708 - lava_callback - INFO - Received callback for node 69b835ba0b8ad4124cec3907 INFO: 172.19.0.1:41196 - "POST /node/69b835ba0b8ad4124cec3907 HTTP/1.0" 202 Accepted 2026-03-16 16:56:01,721 - lava_callback - INFO - Starting async job submit for node 69b835ba0b8ad4124cec3907 2026-03-16 16:56:01,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:01,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835ba0b8ad4124cec3907 HTTP/1.1" 200 None 2026-03-16 16:56:01,867 - lava_callback - DEBUG - Processing node 69b835ba0b8ad4124cec3907: baseline-arm64 2026-03-16 16:56:02,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:56:02,879 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:56:02,882 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b835ba0b8ad4124cec3907/log.txt.gz 2026-03-16 16:56:03,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:56:03,388 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:56:03,390 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b835ba0b8ad4124cec3907/lava-logs.yaml 2026-03-16 16:56:03,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:56:03,536 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:56:03,538 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b835ba0b8ad4124cec3907/lava_callback.json.gz 2026-03-16 16:56:03,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:03,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835ba0b8ad4124cec3907 HTTP/1.1" 200 None 2026-03-16 16:56:03,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:03,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 16:56:03,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:03,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b835ba0b8ad4124cec3907 HTTP/1.1" 200 None 2026-03-16 16:56:03,647 - lava_callback - INFO - Completed processing callback for node 69b835ba0b8ad4124cec3907 2026-03-16 16:56:05,189 - lava_callback - INFO - Received callback for node 69b835c60b8ad4124cec3925 INFO: 172.19.0.1:41200 - "POST /node/69b835c60b8ad4124cec3925 HTTP/1.0" 202 Accepted 2026-03-16 16:56:05,196 - lava_callback - INFO - Starting async job submit for node 69b835c60b8ad4124cec3925 2026-03-16 16:56:05,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:05,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835c60b8ad4124cec3925 HTTP/1.1" 200 None 2026-03-16 16:56:05,234 - lava_callback - DEBUG - Processing node 69b835c60b8ad4124cec3925: baseline-nfs-arm64 2026-03-16 16:56:05,512 - lava_callback - INFO - Received callback for node 69b835b60b8ad4124cec38fe INFO: 172.19.0.1:41212 - "POST /node/69b835b60b8ad4124cec38fe HTTP/1.0" 202 Accepted 2026-03-16 16:56:05,540 - lava_callback - INFO - Starting async job submit for node 69b835b60b8ad4124cec38fe 2026-03-16 16:56:05,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:05,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:56:05,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835b60b8ad4124cec38fe HTTP/1.1" 200 None 2026-03-16 16:56:05,639 - lava_callback - DEBUG - Processing node 69b835b60b8ad4124cec38fe: baseline-arm64 2026-03-16 16:56:05,771 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:56:05,808 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b835c60b8ad4124cec3925/log.txt.gz 2026-03-16 16:56:05,934 - lava_callback - WARNING - Failed to upload log 2026-03-16 16:56:06,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:56:06,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:56:06,370 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:56:06,372 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b835b60b8ad4124cec38fe/lava-logs.yaml 2026-03-16 16:56:06,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:56:06,401 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:56:06,404 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b835c60b8ad4124cec3925/lava-logs.yaml 2026-03-16 16:56:06,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.19.0.1:41214 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:56:06,532 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:56:06,534 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b835b60b8ad4124cec38fe/lava_callback.json.gz 2026-03-16 16:56:06,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:06,569 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:56:06,570 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b835c60b8ad4124cec3925/lava_callback.json.gz 2026-03-16 16:56:06,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:06,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835b60b8ad4124cec38fe HTTP/1.1" 200 None 2026-03-16 16:56:06,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:06,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835c60b8ad4124cec3925 HTTP/1.1" 200 None 2026-03-16 16:56:06,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:06,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 16:56:06,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:06,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 16:56:06,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:06,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b835b60b8ad4124cec38fe HTTP/1.1" 200 None 2026-03-16 16:56:06,718 - lava_callback - INFO - Completed processing callback for node 69b835b60b8ad4124cec38fe 2026-03-16 16:56:06,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b835c60b8ad4124cec3925 HTTP/1.1" 200 None 2026-03-16 16:56:06,741 - lava_callback - INFO - Completed processing callback for node 69b835c60b8ad4124cec3925 2026-03-16 16:56:07,560 - lava_callback - INFO - Received callback for node 69b835d50b8ad4124cec3967 INFO: 172.19.0.1:41228 - "POST /node/69b835d50b8ad4124cec3967 HTTP/1.0" 202 Accepted 2026-03-16 16:56:07,567 - lava_callback - INFO - Starting async job submit for node 69b835d50b8ad4124cec3967 2026-03-16 16:56:07,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:07,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835d50b8ad4124cec3967 HTTP/1.1" 200 None 2026-03-16 16:56:07,616 - lava_callback - DEBUG - Processing node 69b835d50b8ad4124cec3967: baseline-nfs-arm64 2026-03-16 16:56:07,958 - lava_callback - INFO - Received callback for node 69b835c90b8ad4124cec3945 INFO: 172.19.0.1:41238 - "POST /node/69b835c90b8ad4124cec3945 HTTP/1.0" 202 Accepted 2026-03-16 16:56:07,984 - lava_callback - INFO - Starting async job submit for node 69b835c90b8ad4124cec3945 2026-03-16 16:56:08,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:08,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835c90b8ad4124cec3945 HTTP/1.1" 200 None 2026-03-16 16:56:08,125 - lava_callback - DEBUG - Processing node 69b835c90b8ad4124cec3945: baseline-nfs-arm64 2026-03-16 16:56:08,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:56:08,443 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:56:08,476 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b835d50b8ad4124cec3967/log.txt.gz 2026-03-16 16:56:08,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:56:08,721 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:56:08,750 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b835c90b8ad4124cec3945/log.txt.gz 2026-03-16 16:56:08,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:56:08,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:56:09,026 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:56:09,028 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b835d50b8ad4124cec3967/lava-logs.yaml 2026-03-16 16:56:09,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:56:09,181 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:56:09,183 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b835d50b8ad4124cec3967/lava_callback.json.gz 2026-03-16 16:56:09,194 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:56:09,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:09,217 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b835c90b8ad4124cec3945/lava-logs.yaml 2026-03-16 16:56:09,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:56:09,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835d50b8ad4124cec3967 HTTP/1.1" 200 None 2026-03-16 16:56:09,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:09,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 16:56:09,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:09,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b835d50b8ad4124cec3967 HTTP/1.1" 200 None 2026-03-16 16:56:09,283 - lava_callback - INFO - Completed processing callback for node 69b835d50b8ad4124cec3967 2026-03-16 16:56:09,351 - lava_callback - INFO - Received callback for node 69b835d20b8ad4124cec3961 INFO: 172.19.0.1:41254 - "POST /node/69b835d20b8ad4124cec3961 HTTP/1.0" 202 Accepted 2026-03-16 16:56:09,361 - lava_callback - INFO - Starting async job submit for node 69b835d20b8ad4124cec3961 2026-03-16 16:56:09,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:09,416 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:56:09,419 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b835c90b8ad4124cec3945/lava_callback.json.gz 2026-03-16 16:56:09,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835d20b8ad4124cec3961 HTTP/1.1" 200 None 2026-03-16 16:56:09,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:09,447 - lava_callback - DEBUG - Processing node 69b835d20b8ad4124cec3961: baseline-nfs-arm64 2026-03-16 16:56:09,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835c90b8ad4124cec3945 HTTP/1.1" 200 None 2026-03-16 16:56:09,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:09,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 16:56:09,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:09,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b835c90b8ad4124cec3945 HTTP/1.1" 200 None 2026-03-16 16:56:09,765 - lava_callback - INFO - Completed processing callback for node 69b835c90b8ad4124cec3945 2026-03-16 16:56:09,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:56:10,107 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:56:10,108 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b835d20b8ad4124cec3961/log.txt.gz 2026-03-16 16:56:10,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:56:10,528 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:56:10,530 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b835d20b8ad4124cec3961/lava-logs.yaml 2026-03-16 16:56:10,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:56:10,717 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:56:10,719 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b835d20b8ad4124cec3961/lava_callback.json.gz 2026-03-16 16:56:10,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:10,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835d20b8ad4124cec3961 HTTP/1.1" 200 None 2026-03-16 16:56:10,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:10,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 16:56:10,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:10,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b835d20b8ad4124cec3961 HTTP/1.1" 200 None 2026-03-16 16:56:10,802 - lava_callback - INFO - Completed processing callback for node 69b835d20b8ad4124cec3961 2026-03-16 16:56:11,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:11,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-16 16:56:14,454 - lava_callback - INFO - Received callback for node 69b835d30b8ad4124cec3964 INFO: 172.19.0.1:46050 - "POST /node/69b835d30b8ad4124cec3964 HTTP/1.0" 202 Accepted 2026-03-16 16:56:14,461 - lava_callback - INFO - Starting async job submit for node 69b835d30b8ad4124cec3964 2026-03-16 16:56:14,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:14,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835d30b8ad4124cec3964 HTTP/1.1" 200 None 2026-03-16 16:56:14,500 - lava_callback - DEBUG - Processing node 69b835d30b8ad4124cec3964: baseline-nfs-arm64 2026-03-16 16:56:14,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:56:14,963 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:56:14,965 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b835d30b8ad4124cec3964/log.txt.gz INFO: 172.19.0.1:46066 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-16 16:56:15,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:56:15,384 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:56:15,386 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b835d30b8ad4124cec3964/lava-logs.yaml 2026-03-16 16:56:15,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:56:15,540 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:56:15,542 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b835d30b8ad4124cec3964/lava_callback.json.gz 2026-03-16 16:56:15,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:15,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835d30b8ad4124cec3964 HTTP/1.1" 200 None 2026-03-16 16:56:15,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:15,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 16:56:15,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:15,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b835d30b8ad4124cec3964 HTTP/1.1" 200 None 2026-03-16 16:56:15,629 - lava_callback - INFO - Completed processing callback for node 69b835d30b8ad4124cec3964 INFO: 172.19.0.1:46076 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:56:18,630 - lava_callback - INFO - Received callback for node 69b835fb0b8ad4124cec39f0 INFO: 172.19.0.1:46080 - "POST /node/69b835fb0b8ad4124cec39f0 HTTP/1.0" 202 Accepted 2026-03-16 16:56:18,638 - lava_callback - INFO - Starting async job submit for node 69b835fb0b8ad4124cec39f0 2026-03-16 16:56:18,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:18,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835fb0b8ad4124cec39f0 HTTP/1.1" 200 None 2026-03-16 16:56:18,678 - lava_callback - DEBUG - Processing node 69b835fb0b8ad4124cec39f0: baseline-arm64-foundriesio 2026-03-16 16:56:18,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:56:19,071 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:56:19,073 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b835fb0b8ad4124cec39f0/log.txt.gz 2026-03-16 16:56:19,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:56:19,426 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:56:19,428 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b835fb0b8ad4124cec39f0/lava-logs.yaml 2026-03-16 16:56:19,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:56:19,593 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:56:19,595 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b835fb0b8ad4124cec39f0/lava_callback.json.gz 2026-03-16 16:56:19,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:19,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835fb0b8ad4124cec39f0 HTTP/1.1" 200 None 2026-03-16 16:56:19,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:19,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 16:56:19,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:19,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b835fb0b8ad4124cec39f0 HTTP/1.1" 200 None 2026-03-16 16:56:19,689 - lava_callback - INFO - Completed processing callback for node 69b835fb0b8ad4124cec39f0 2026-03-16 16:56:20,864 - lava_callback - INFO - Received callback for node 69b835bc0b8ad4124cec390d INFO: 172.19.0.1:51786 - "POST /node/69b835bc0b8ad4124cec390d HTTP/1.0" 202 Accepted 2026-03-16 16:56:20,871 - lava_callback - INFO - Starting async job submit for node 69b835bc0b8ad4124cec390d 2026-03-16 16:56:20,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:20,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835bc0b8ad4124cec390d HTTP/1.1" 200 None 2026-03-16 16:56:20,909 - lava_callback - DEBUG - Processing node 69b835bc0b8ad4124cec390d: baseline-arm64 2026-03-16 16:56:21,410 - lava_callback - INFO - Received callback for node 69b835c20b8ad4124cec391c INFO: 172.19.0.1:51798 - "POST /node/69b835c20b8ad4124cec391c HTTP/1.0" 202 Accepted 2026-03-16 16:56:21,416 - lava_callback - INFO - Starting async job submit for node 69b835c20b8ad4124cec391c 2026-03-16 16:56:21,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:21,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:56:21,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835c20b8ad4124cec391c HTTP/1.1" 200 None 2026-03-16 16:56:21,472 - lava_callback - DEBUG - Processing node 69b835c20b8ad4124cec391c: baseline-arm64 2026-03-16 16:56:21,672 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:56:21,725 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b835bc0b8ad4124cec390d/log.txt.gz 2026-03-16 16:56:21,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:56:21,988 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:56:22,032 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b835c20b8ad4124cec391c/log.txt.gz 2026-03-16 16:56:22,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:56:22,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:56:22,370 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:56:22,373 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b835bc0b8ad4124cec390d/lava-logs.yaml 2026-03-16 16:56:22,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:56:22,395 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:56:22,398 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b835c20b8ad4124cec391c/lava-logs.yaml 2026-03-16 16:56:22,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:56:22,528 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:56:22,530 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b835bc0b8ad4124cec390d/lava_callback.json.gz 2026-03-16 16:56:22,578 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:56:22,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:22,580 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b835c20b8ad4124cec391c/lava_callback.json.gz 2026-03-16 16:56:22,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:22,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835bc0b8ad4124cec390d HTTP/1.1" 200 None 2026-03-16 16:56:22,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835c20b8ad4124cec391c HTTP/1.1" 200 None 2026-03-16 16:56:22,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:22,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:22,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 16:56:22,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:22,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 16:56:22,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:22,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b835c20b8ad4124cec391c HTTP/1.1" 200 None 2026-03-16 16:56:22,675 - lava_callback - INFO - Completed processing callback for node 69b835c20b8ad4124cec391c 2026-03-16 16:56:22,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b835bc0b8ad4124cec390d HTTP/1.1" 200 None 2026-03-16 16:56:22,748 - lava_callback - INFO - Completed processing callback for node 69b835bc0b8ad4124cec390d 2026-03-16 16:56:24,802 - lava_callback - INFO - Received callback for node 69b835f90b8ad4124cec39ea INFO: 172.19.0.1:51814 - "POST /node/69b835f90b8ad4124cec39ea HTTP/1.0" 202 Accepted 2026-03-16 16:56:24,808 - lava_callback - INFO - Starting async job submit for node 69b835f90b8ad4124cec39ea 2026-03-16 16:56:24,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:24,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835f90b8ad4124cec39ea HTTP/1.1" 200 None 2026-03-16 16:56:24,848 - lava_callback - DEBUG - Processing node 69b835f90b8ad4124cec39ea: baseline-arm64-pengutronix 2026-03-16 16:56:25,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:56:25,148 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:56:25,150 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b835f90b8ad4124cec39ea/log.txt.gz 2026-03-16 16:56:25,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:56:25,451 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:56:25,453 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b835f90b8ad4124cec39ea/lava-logs.yaml 2026-03-16 16:56:25,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:56:25,583 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:56:25,585 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b835f90b8ad4124cec39ea/lava_callback.json.gz 2026-03-16 16:56:25,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:25,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835f90b8ad4124cec39ea HTTP/1.1" 200 None 2026-03-16 16:56:25,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:25,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 16:56:25,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:25,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b835f90b8ad4124cec39ea HTTP/1.1" 200 None 2026-03-16 16:56:25,667 - lava_callback - INFO - Completed processing callback for node 69b835f90b8ad4124cec39ea 2026-03-16 16:56:26,283 - lava_callback - INFO - Received callback for node 69b835fa0b8ad4124cec39ed INFO: 172.19.0.1:51824 - "POST /node/69b835fa0b8ad4124cec39ed HTTP/1.0" 202 Accepted 2026-03-16 16:56:26,289 - lava_callback - INFO - Starting async job submit for node 69b835fa0b8ad4124cec39ed 2026-03-16 16:56:26,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:26,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835fa0b8ad4124cec39ed HTTP/1.1" 200 None 2026-03-16 16:56:26,332 - lava_callback - DEBUG - Processing node 69b835fa0b8ad4124cec39ed: baseline-arm64-pengutronix 2026-03-16 16:56:26,368 - lava_callback - INFO - Received callback for node 69b835e10b8ad4124cec3985 INFO: 172.19.0.1:51830 - "POST /node/69b835e10b8ad4124cec3985 HTTP/1.0" 202 Accepted 2026-03-16 16:56:26,384 - lava_callback - INFO - Starting async job submit for node 69b835e10b8ad4124cec3985 2026-03-16 16:56:26,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:26,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835e10b8ad4124cec3985 HTTP/1.1" 200 None INFO: 172.19.0.1:51834 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:56:26,537 - lava_callback - DEBUG - Processing node 69b835e10b8ad4124cec3985: baseline-arm64-broonie 2026-03-16 16:56:26,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:56:26,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:56:26,847 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:56:26,849 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b835fa0b8ad4124cec39ed/log.txt.gz 2026-03-16 16:56:26,949 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:56:26,983 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b835e10b8ad4124cec3985/log.txt.gz 2026-03-16 16:56:27,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:56:27,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:56:27,261 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:56:27,263 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b835fa0b8ad4124cec39ed/lava-logs.yaml 2026-03-16 16:56:27,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:56:27,287 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:56:27,289 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b835e10b8ad4124cec3985/lava-logs.yaml 2026-03-16 16:56:27,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:56:27,410 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:56:27,411 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b835fa0b8ad4124cec39ed/lava_callback.json.gz 2026-03-16 16:56:27,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:27,440 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:56:27,442 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b835e10b8ad4124cec3985/lava_callback.json.gz 2026-03-16 16:56:27,465 - lava_callback - INFO - Received callback for node 69b835d00b8ad4124cec3958 2026-03-16 16:56:27,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:27,474 - lava_callback - INFO - Starting async job submit for node 69b835d00b8ad4124cec3958 INFO: 172.19.0.1:51846 - "POST /node/69b835d00b8ad4124cec3958 HTTP/1.0" 202 Accepted 2026-03-16 16:56:27,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:27,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835fa0b8ad4124cec39ed HTTP/1.1" 200 None 2026-03-16 16:56:27,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:27,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835e10b8ad4124cec3985 HTTP/1.1" 200 None 2026-03-16 16:56:27,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:27,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835d00b8ad4124cec3958 HTTP/1.1" 200 None 2026-03-16 16:56:27,536 - lava_callback - DEBUG - Processing node 69b835d00b8ad4124cec3958: baseline-nfs-arm64 2026-03-16 16:56:27,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 16:56:27,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 16:56:27,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:27,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:27,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b835fa0b8ad4124cec39ed HTTP/1.1" 200 None 2026-03-16 16:56:27,736 - lava_callback - INFO - Completed processing callback for node 69b835fa0b8ad4124cec39ed 2026-03-16 16:56:27,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b835e10b8ad4124cec3985 HTTP/1.1" 200 None 2026-03-16 16:56:27,819 - lava_callback - INFO - Completed processing callback for node 69b835e10b8ad4124cec3985 2026-03-16 16:56:28,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:56:28,234 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:56:28,236 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b835d00b8ad4124cec3958/log.txt.gz 2026-03-16 16:56:28,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:56:28,613 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:56:28,615 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b835d00b8ad4124cec3958/lava-logs.yaml 2026-03-16 16:56:28,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:56:28,754 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:56:28,755 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b835d00b8ad4124cec3958/lava_callback.json.gz 2026-03-16 16:56:28,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:28,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835d00b8ad4124cec3958 HTTP/1.1" 200 None 2026-03-16 16:56:28,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:28,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 16:56:28,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:28,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b835d00b8ad4124cec3958 HTTP/1.1" 200 None 2026-03-16 16:56:28,841 - lava_callback - INFO - Completed processing callback for node 69b835d00b8ad4124cec3958 INFO: 172.19.0.1:51858 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:56:29,464 - lava_callback - INFO - Received callback for node 69b835cb0b8ad4124cec394f INFO: 172.19.0.1:51864 - "POST /node/69b835cb0b8ad4124cec394f HTTP/1.0" 202 Accepted 2026-03-16 16:56:29,471 - lava_callback - INFO - Starting async job submit for node 69b835cb0b8ad4124cec394f 2026-03-16 16:56:29,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:29,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835cb0b8ad4124cec394f HTTP/1.1" 200 None 2026-03-16 16:56:29,511 - lava_callback - DEBUG - Processing node 69b835cb0b8ad4124cec394f: baseline-nfs-arm64 2026-03-16 16:56:30,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:56:30,178 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:56:30,179 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b835cb0b8ad4124cec394f/log.txt.gz 2026-03-16 16:56:30,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:56:30,683 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:56:30,686 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b835cb0b8ad4124cec394f/lava-logs.yaml 2026-03-16 16:56:30,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:56:30,847 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:56:30,849 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b835cb0b8ad4124cec394f/lava_callback.json.gz 2026-03-16 16:56:30,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:30,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835cb0b8ad4124cec394f HTTP/1.1" 200 None 2026-03-16 16:56:30,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:30,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 16:56:30,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:30,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b835cb0b8ad4124cec394f HTTP/1.1" 200 None 2026-03-16 16:56:30,954 - lava_callback - INFO - Completed processing callback for node 69b835cb0b8ad4124cec394f 2026-03-16 16:56:34,028 - lava_callback - INFO - Received callback for node 69b835cd0b8ad4124cec3952 INFO: 172.19.0.1:60920 - "POST /node/69b835cd0b8ad4124cec3952 HTTP/1.0" 202 Accepted 2026-03-16 16:56:34,035 - lava_callback - INFO - Starting async job submit for node 69b835cd0b8ad4124cec3952 2026-03-16 16:56:34,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:34,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835cd0b8ad4124cec3952 HTTP/1.1" 200 None 2026-03-16 16:56:34,074 - lava_callback - DEBUG - Processing node 69b835cd0b8ad4124cec3952: baseline-nfs-arm64 2026-03-16 16:56:34,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:56:34,771 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:56:34,773 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b835cd0b8ad4124cec3952/log.txt.gz 2026-03-16 16:56:35,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:56:35,341 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:56:35,343 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b835cd0b8ad4124cec3952/lava-logs.yaml 2026-03-16 16:56:35,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:56:35,497 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:56:35,499 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b835cd0b8ad4124cec3952/lava_callback.json.gz 2026-03-16 16:56:35,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:35,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835cd0b8ad4124cec3952 HTTP/1.1" 200 None 2026-03-16 16:56:35,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:35,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 16:56:35,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:35,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b835cd0b8ad4124cec3952 HTTP/1.1" 200 None 2026-03-16 16:56:35,585 - lava_callback - INFO - Completed processing callback for node 69b835cd0b8ad4124cec3952 INFO: 172.19.0.1:60922 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:56:37,290 - lava_callback - INFO - Received callback for node 69b5932c1727ff69d6f26451 INFO: 172.19.0.1:60936 - "POST /node/69b5932c1727ff69d6f26451 HTTP/1.0" 202 Accepted 2026-03-16 16:56:37,296 - lava_callback - INFO - Starting async job submit for node 69b5932c1727ff69d6f26451 2026-03-16 16:56:37,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:37,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5932c1727ff69d6f26451 HTTP/1.1" 200 None 2026-03-16 16:56:37,315 - lava_callback - DEBUG - Processing node 69b5932c1727ff69d6f26451: baseline-arm64-clabbe 2026-03-16 16:56:37,316 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5932c1727ff69d6f26451 2026-03-16 16:56:37,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:37,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5932c1727ff69d6f26451 HTTP/1.1" 200 None 2026-03-16 16:56:37,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:37,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-16 16:56:37,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:37,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5932c1727ff69d6f26451 HTTP/1.1" 200 None 2026-03-16 16:56:37,382 - lava_callback - ERROR - Error processing callback for node 69b5932c1727ff69d6f26451: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-16 16:56:41,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:41,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.19.0.1:37700 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:56:46,531 - lava_callback - INFO - Received callback for node 69b835e90b8ad4124cec39b7 INFO: 172.19.0.1:37712 - "POST /node/69b835e90b8ad4124cec39b7 HTTP/1.0" 202 Accepted 2026-03-16 16:56:46,537 - lava_callback - INFO - Starting async job submit for node 69b835e90b8ad4124cec39b7 2026-03-16 16:56:46,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:46,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835e90b8ad4124cec39b7 HTTP/1.1" 200 None 2026-03-16 16:56:46,576 - lava_callback - DEBUG - Processing node 69b835e90b8ad4124cec39b7: baseline-arm64-broonie 2026-03-16 16:56:46,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:56:46,936 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:56:46,938 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b835e90b8ad4124cec39b7/log.txt.gz 2026-03-16 16:56:47,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:56:47,291 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:56:47,293 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b835e90b8ad4124cec39b7/lava-logs.yaml 2026-03-16 16:56:47,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:56:47,424 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:56:47,426 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b835e90b8ad4124cec39b7/lava_callback.json.gz 2026-03-16 16:56:47,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:47,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835e90b8ad4124cec39b7 HTTP/1.1" 200 None 2026-03-16 16:56:47,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:47,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 16:56:47,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:56:47,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b835e90b8ad4124cec39b7 HTTP/1.1" 200 None 2026-03-16 16:56:47,519 - lava_callback - INFO - Completed processing callback for node 69b835e90b8ad4124cec39b7 INFO: 172.19.0.1:51896 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:57:01,780 - lava_callback - INFO - Received callback for node 69b835e70b8ad4124cec39ad INFO: 172.19.0.1:40458 - "POST /node/69b835e70b8ad4124cec39ad HTTP/1.0" 202 Accepted 2026-03-16 16:57:01,787 - lava_callback - INFO - Starting async job submit for node 69b835e70b8ad4124cec39ad 2026-03-16 16:57:01,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:57:01,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835e70b8ad4124cec39ad HTTP/1.1" 200 None 2026-03-16 16:57:01,824 - lava_callback - DEBUG - Processing node 69b835e70b8ad4124cec39ad: baseline-arm64-broonie 2026-03-16 16:57:02,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:57:02,247 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:57:02,248 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b835e70b8ad4124cec39ad/log.txt.gz 2026-03-16 16:57:02,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:57:02,602 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:57:02,604 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b835e70b8ad4124cec39ad/lava-logs.yaml 2026-03-16 16:57:02,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:57:02,758 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:57:02,760 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b835e70b8ad4124cec39ad/lava_callback.json.gz 2026-03-16 16:57:02,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:57:02,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835e70b8ad4124cec39ad HTTP/1.1" 200 None 2026-03-16 16:57:02,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:57:02,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 16:57:02,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:57:02,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b835e70b8ad4124cec39ad HTTP/1.1" 200 None 2026-03-16 16:57:02,901 - lava_callback - INFO - Completed processing callback for node 69b835e70b8ad4124cec39ad 2026-03-16 16:57:03,165 - lava_callback - INFO - Received callback for node 69b835ed0b8ad4124cec39bf INFO: 172.19.0.1:40462 - "POST /node/69b835ed0b8ad4124cec39bf HTTP/1.0" 202 Accepted 2026-03-16 16:57:03,176 - lava_callback - INFO - Starting async job submit for node 69b835ed0b8ad4124cec39bf 2026-03-16 16:57:03,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:57:03,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835ed0b8ad4124cec39bf HTTP/1.1" 200 None 2026-03-16 16:57:03,218 - lava_callback - DEBUG - Processing node 69b835ed0b8ad4124cec39bf: baseline-arm64-broonie 2026-03-16 16:57:03,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:57:03,619 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:57:03,620 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b835ed0b8ad4124cec39bf/log.txt.gz 2026-03-16 16:57:03,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:57:03,946 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:57:03,948 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b835ed0b8ad4124cec39bf/lava-logs.yaml 2026-03-16 16:57:03,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:57:04,085 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:57:04,087 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b835ed0b8ad4124cec39bf/lava_callback.json.gz 2026-03-16 16:57:04,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:57:04,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835ed0b8ad4124cec39bf HTTP/1.1" 200 None 2026-03-16 16:57:04,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:57:04,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 16:57:04,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:57:04,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b835ed0b8ad4124cec39bf HTTP/1.1" 200 None 2026-03-16 16:57:04,190 - lava_callback - INFO - Completed processing callback for node 69b835ed0b8ad4124cec39bf INFO: 172.19.0.1:40464 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:57:11,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:57:11,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:38516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38518 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:57:25,252 - lava_callback - INFO - Received callback for node 69b835ef0b8ad4124cec39c2 INFO: 172.19.0.1:50798 - "POST /node/69b835ef0b8ad4124cec39c2 HTTP/1.0" 202 Accepted 2026-03-16 16:57:25,262 - lava_callback - INFO - Starting async job submit for node 69b835ef0b8ad4124cec39c2 2026-03-16 16:57:25,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:57:25,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835ef0b8ad4124cec39c2 HTTP/1.1" 200 None 2026-03-16 16:57:25,347 - lava_callback - DEBUG - Processing node 69b835ef0b8ad4124cec39c2: baseline-arm64-broonie 2026-03-16 16:57:25,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:57:26,140 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:57:26,143 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b835ef0b8ad4124cec39c2/log.txt.gz 2026-03-16 16:57:26,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.19.0.1:50812 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:57:26,853 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:57:26,856 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b835ef0b8ad4124cec39c2/lava-logs.yaml 2026-03-16 16:57:26,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:57:27,230 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:57:27,232 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b835ef0b8ad4124cec39c2/lava_callback.json.gz 2026-03-16 16:57:27,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:57:27,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835ef0b8ad4124cec39c2 HTTP/1.1" 200 None 2026-03-16 16:57:27,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:57:27,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 16:57:27,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:57:27,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b835ef0b8ad4124cec39c2 HTTP/1.1" 200 None 2026-03-16 16:57:27,373 - lava_callback - INFO - Completed processing callback for node 69b835ef0b8ad4124cec39c2 INFO: 172.19.0.1:50822 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:57:32,868 - lava_callback - INFO - Received callback for node 69b5937a1727ff69d6f26456 INFO: 172.19.0.1:43570 - "POST /node/69b5937a1727ff69d6f26456 HTTP/1.0" 202 Accepted 2026-03-16 16:57:32,877 - lava_callback - INFO - Starting async job submit for node 69b5937a1727ff69d6f26456 2026-03-16 16:57:32,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:57:32,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5937a1727ff69d6f26456 HTTP/1.1" 200 None 2026-03-16 16:57:32,911 - lava_callback - DEBUG - Processing node 69b5937a1727ff69d6f26456: baseline-arm64-clabbe 2026-03-16 16:57:32,911 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5937a1727ff69d6f26456 2026-03-16 16:57:32,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:57:32,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5937a1727ff69d6f26456 HTTP/1.1" 200 None 2026-03-16 16:57:32,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:57:32,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-16 16:57:32,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:57:33,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5937a1727ff69d6f26456 HTTP/1.1" 200 None 2026-03-16 16:57:33,014 - lava_callback - ERROR - Error processing callback for node 69b5937a1727ff69d6f26456: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:43580 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:57:41,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:57:41,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-16 16:57:45,089 - lava_callback - INFO - Received callback for node 69b835e30b8ad4124cec3988 INFO: 172.19.0.1:36478 - "POST /node/69b835e30b8ad4124cec3988 HTTP/1.0" 202 Accepted 2026-03-16 16:57:45,099 - lava_callback - INFO - Starting async job submit for node 69b835e30b8ad4124cec3988 2026-03-16 16:57:45,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:57:45,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835e30b8ad4124cec3988 HTTP/1.1" 200 None 2026-03-16 16:57:45,172 - lava_callback - DEBUG - Processing node 69b835e30b8ad4124cec3988: baseline-arm64-broonie 2026-03-16 16:57:45,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:57:45,877 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:57:45,879 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b835e30b8ad4124cec3988/log.txt.gz 2026-03-16 16:57:46,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.19.0.1:36482 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:57:46,666 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:57:46,669 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b835e30b8ad4124cec3988/lava-logs.yaml 2026-03-16 16:57:46,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:57:47,173 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:57:47,175 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b835e30b8ad4124cec3988/lava_callback.json.gz 2026-03-16 16:57:47,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:57:47,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835e30b8ad4124cec3988 HTTP/1.1" 200 None 2026-03-16 16:57:47,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:57:47,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 16:57:47,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:57:47,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b835e30b8ad4124cec3988 HTTP/1.1" 200 None 2026-03-16 16:57:47,327 - lava_callback - INFO - Completed processing callback for node 69b835e30b8ad4124cec3988 INFO: 172.19.0.1:42094 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:58:05,889 - lava_callback - INFO - Received callback for node 69b835e40b8ad4124cec398b INFO: 172.19.0.1:49132 - "POST /node/69b835e40b8ad4124cec398b HTTP/1.0" 202 Accepted 2026-03-16 16:58:05,900 - lava_callback - INFO - Starting async job submit for node 69b835e40b8ad4124cec398b 2026-03-16 16:58:05,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:58:05,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835e40b8ad4124cec398b HTTP/1.1" 200 None 2026-03-16 16:58:05,969 - lava_callback - DEBUG - Processing node 69b835e40b8ad4124cec398b: baseline-arm64-broonie INFO: 172.19.0.1:49134 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:58:06,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:58:06,968 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:58:06,970 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b835e40b8ad4124cec398b/log.txt.gz 2026-03-16 16:58:07,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:58:07,841 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:58:07,843 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b835e40b8ad4124cec398b/lava-logs.yaml 2026-03-16 16:58:07,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:58:08,229 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:58:08,232 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b835e40b8ad4124cec398b/lava_callback.json.gz 2026-03-16 16:58:08,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:58:08,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835e40b8ad4124cec398b HTTP/1.1" 200 None 2026-03-16 16:58:08,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:58:08,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 16:58:08,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:58:08,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b835e40b8ad4124cec398b HTTP/1.1" 200 None 2026-03-16 16:58:08,431 - lava_callback - INFO - Completed processing callback for node 69b835e40b8ad4124cec398b 2026-03-16 16:58:11,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:58:11,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:59954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59962 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45520 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45528 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47492 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:58:44,870 - lava_callback - INFO - Received callback for node 69b835e80b8ad4124cec39b0 INFO: 172.19.0.1:34810 - "POST /node/69b835e80b8ad4124cec39b0 HTTP/1.0" 202 Accepted 2026-03-16 16:58:44,880 - lava_callback - INFO - Starting async job submit for node 69b835e80b8ad4124cec39b0 2026-03-16 16:58:44,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:58:44,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835e80b8ad4124cec39b0 HTTP/1.1" 200 None 2026-03-16 16:58:44,951 - lava_callback - DEBUG - Processing node 69b835e80b8ad4124cec39b0: baseline-arm64-broonie 2026-03-16 16:58:45,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:58:45,898 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:58:45,900 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b835e80b8ad4124cec39b0/log.txt.gz 2026-03-16 16:58:46,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.19.0.1:34812 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:58:46,775 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:58:46,778 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b835e80b8ad4124cec39b0/lava-logs.yaml 2026-03-16 16:58:46,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 16:58:47,232 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 16:58:47,234 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b835e80b8ad4124cec39b0/lava_callback.json.gz 2026-03-16 16:58:47,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:58:47,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835e80b8ad4124cec39b0 HTTP/1.1" 200 None 2026-03-16 16:58:47,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:58:47,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 16:58:47,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:58:47,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b835e80b8ad4124cec39b0 HTTP/1.1" 200 None 2026-03-16 16:58:47,385 - lava_callback - INFO - Completed processing callback for node 69b835e80b8ad4124cec39b0 2026-03-16 16:58:52,931 - lava_callback - INFO - Received callback for node 69b593c71727ff69d6f26463 INFO: 172.19.0.1:37522 - "POST /node/69b593c71727ff69d6f26463 HTTP/1.0" 202 Accepted 2026-03-16 16:58:52,942 - lava_callback - INFO - Starting async job submit for node 69b593c71727ff69d6f26463 2026-03-16 16:58:52,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:58:52,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b593c71727ff69d6f26463 HTTP/1.1" 200 None 2026-03-16 16:58:52,975 - lava_callback - DEBUG - Processing node 69b593c71727ff69d6f26463: baseline-arm64-clabbe 2026-03-16 16:58:52,975 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b593c71727ff69d6f26463 2026-03-16 16:58:52,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:58:53,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b593c71727ff69d6f26463 HTTP/1.1" 200 None 2026-03-16 16:58:53,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:58:53,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-16 16:58:53,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:58:53,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b593c71727ff69d6f26463 HTTP/1.1" 200 None 2026-03-16 16:58:53,083 - lava_callback - ERROR - Error processing callback for node 69b593c71727ff69d6f26463: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:37538 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48378 - "GET / HTTP/1.0" 200 OK 2026-03-16 16:59:11,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 16:59:11,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:33944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33954 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51596 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51600 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33486 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34842 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50764 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37112 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41618 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-16 17:00:15,528 - lava_callback - INFO - Received callback for node 69b5940b1727ff69d6f26469 INFO: 172.19.0.1:41634 - "POST /node/69b5940b1727ff69d6f26469 HTTP/1.0" 202 Accepted 2026-03-16 17:00:15,534 - lava_callback - INFO - Starting async job submit for node 69b5940b1727ff69d6f26469 2026-03-16 17:00:15,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:00:15,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5940b1727ff69d6f26469 HTTP/1.1" 200 None 2026-03-16 17:00:15,552 - lava_callback - DEBUG - Processing node 69b5940b1727ff69d6f26469: baseline-arm64-baylibre 2026-03-16 17:00:15,552 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5940b1727ff69d6f26469 2026-03-16 17:00:15,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:00:15,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5940b1727ff69d6f26469 HTTP/1.1" 200 None 2026-03-16 17:00:15,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:00:15,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-16 17:00:15,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:00:15,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5940b1727ff69d6f26469 HTTP/1.1" 200 None 2026-03-16 17:00:15,632 - lava_callback - ERROR - Error processing callback for node 69b5940b1727ff69d6f26469: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:41642 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:00:22,934 - lava_callback - INFO - Received callback for node 69b835c50b8ad4124cec3922 INFO: 172.19.0.1:46998 - "POST /node/69b835c50b8ad4124cec3922 HTTP/1.0" 202 Accepted 2026-03-16 17:00:22,942 - lava_callback - INFO - Starting async job submit for node 69b835c50b8ad4124cec3922 2026-03-16 17:00:22,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:00:22,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835c50b8ad4124cec3922 HTTP/1.1" 200 None 2026-03-16 17:00:22,993 - lava_callback - DEBUG - Processing node 69b835c50b8ad4124cec3922: baseline-arm64 2026-03-16 17:00:23,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:00:23,507 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:00:23,509 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b835c50b8ad4124cec3922/log.txt.gz 2026-03-16 17:00:23,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:00:23,936 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:00:23,938 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b835c50b8ad4124cec3922/lava-logs.yaml 2026-03-16 17:00:23,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:00:24,125 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:00:24,127 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b835c50b8ad4124cec3922/lava_callback.json.gz DEBUG: Setup failed for 69b835c50b8ad4124cec3922. Transitting job node result: incomplete -> fail 2026-03-16 17:00:24,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:00:24,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835c50b8ad4124cec3922 HTTP/1.1" 200 None 2026-03-16 17:00:24,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:00:24,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 17:00:24,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:00:24,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b835c50b8ad4124cec3922 HTTP/1.1" 200 None 2026-03-16 17:00:24,372 - lava_callback - INFO - Completed processing callback for node 69b835c50b8ad4124cec3922 INFO: 172.19.0.1:47004 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47020 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41194 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:00:41,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:00:41,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:53696 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44594 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51764 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:01:09,532 - lava_callback - INFO - Received callback for node 69b835fc0b8ad4124cec39f3 INFO: 172.19.0.1:51768 - "POST /node/69b835fc0b8ad4124cec39f3 HTTP/1.0" 202 Accepted 2026-03-16 17:01:09,541 - lava_callback - INFO - Starting async job submit for node 69b835fc0b8ad4124cec39f3 2026-03-16 17:01:09,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:01:09,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835fc0b8ad4124cec39f3 HTTP/1.1" 200 None 2026-03-16 17:01:09,623 - lava_callback - DEBUG - Processing node 69b835fc0b8ad4124cec39f3: baseline-arm64-foundriesio 2026-03-16 17:01:10,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:01:10,968 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:01:10,970 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b835fc0b8ad4124cec39f3/log.txt.gz 2026-03-16 17:01:11,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:01:11,955 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:01:11,958 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b835fc0b8ad4124cec39f3/lava-logs.yaml 2026-03-16 17:01:11,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:01:12,171 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:01:12,173 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b835fc0b8ad4124cec39f3/lava_callback.json.gz DEBUG: Setup failed for 69b835fc0b8ad4124cec39f3. Transitting job node result: incomplete -> fail 2026-03-16 17:01:12,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:01:12,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835fc0b8ad4124cec39f3 HTTP/1.1" 200 None 2026-03-16 17:01:12,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:01:12,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 17:01:12,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:01:12,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b835fc0b8ad4124cec39f3 HTTP/1.1" 200 None 2026-03-16 17:01:12,482 - lava_callback - INFO - Completed processing callback for node 69b835fc0b8ad4124cec39f3 INFO: 172.19.0.1:44408 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-16 17:01:15,445 - lava_callback - INFO - Received callback for node 69b594571727ff69d6f26475 INFO: 172.19.0.1:44414 - "POST /node/69b594571727ff69d6f26475 HTTP/1.0" 202 Accepted 2026-03-16 17:01:15,450 - lava_callback - INFO - Starting async job submit for node 69b594571727ff69d6f26475 2026-03-16 17:01:15,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:01:15,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b594571727ff69d6f26475 HTTP/1.1" 200 None 2026-03-16 17:01:15,467 - lava_callback - DEBUG - Processing node 69b594571727ff69d6f26475: baseline-arm64-baylibre 2026-03-16 17:01:15,467 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b594571727ff69d6f26475 2026-03-16 17:01:15,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:01:15,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b594571727ff69d6f26475 HTTP/1.1" 200 None 2026-03-16 17:01:15,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:01:15,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-16 17:01:15,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:01:15,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b594571727ff69d6f26475 HTTP/1.1" 200 None 2026-03-16 17:01:15,542 - lava_callback - ERROR - Error processing callback for node 69b594571727ff69d6f26475: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:44426 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48702 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48718 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46362 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:01:41,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:01:41,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:54926 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42484 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35588 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47866 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39386 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39402 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:02:35,555 - lava_callback - INFO - Received callback for node 69b594a51727ff69d6f2647c INFO: 172.19.0.1:56776 - "POST /node/69b594a51727ff69d6f2647c HTTP/1.0" 202 Accepted 2026-03-16 17:02:35,561 - lava_callback - INFO - Starting async job submit for node 69b594a51727ff69d6f2647c 2026-03-16 17:02:35,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:02:35,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b594a51727ff69d6f2647c HTTP/1.1" 200 None 2026-03-16 17:02:35,590 - lava_callback - DEBUG - Processing node 69b594a51727ff69d6f2647c: baseline-arm64-baylibre 2026-03-16 17:02:35,591 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b594a51727ff69d6f2647c 2026-03-16 17:02:35,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:02:35,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b594a51727ff69d6f2647c HTTP/1.1" 200 None 2026-03-16 17:02:35,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:02:35,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-16 17:02:35,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:02:35,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b594a51727ff69d6f2647c HTTP/1.1" 200 None 2026-03-16 17:02:35,643 - lava_callback - ERROR - Error processing callback for node 69b594a51727ff69d6f2647c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:56778 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42910 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56100 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59926 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:03:09,863 - lava_callback - INFO - Received callback for node 69b837af0b8ad4124cec3b66 INFO: 172.19.0.1:34332 - "POST /node/69b837af0b8ad4124cec3b66 HTTP/1.0" 202 Accepted 2026-03-16 17:03:09,869 - lava_callback - INFO - Starting async job submit for node 69b837af0b8ad4124cec3b66 2026-03-16 17:03:09,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:03:09,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b837af0b8ad4124cec3b66 HTTP/1.1" 200 None 2026-03-16 17:03:09,886 - lava_callback - DEBUG - Processing node 69b837af0b8ad4124cec3b66: baseline-nfs-arm64 2026-03-16 17:03:09,888 - lava_callback - WARNING - Failed to upload log 2026-03-16 17:03:09,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:03:10,018 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:03:10,020 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b837af0b8ad4124cec3b66/lava-logs.yaml 2026-03-16 17:03:10,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:03:10,139 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:03:10,141 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b837af0b8ad4124cec3b66/lava_callback.json.gz 2026-03-16 17:03:10,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:03:10,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b837af0b8ad4124cec3b66 HTTP/1.1" 200 None 2026-03-16 17:03:10,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:03:10,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 17:03:10,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:03:10,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b837af0b8ad4124cec3b66 HTTP/1.1" 200 None 2026-03-16 17:03:10,205 - lava_callback - INFO - Completed processing callback for node 69b837af0b8ad4124cec3b66 2026-03-16 17:03:11,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:03:11,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:34334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34350 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50176 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50188 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38300 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40766 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:03:55,162 - lava_callback - INFO - Received callback for node 69b835f40b8ad4124cec39d9 INFO: 172.19.0.1:36384 - "POST /node/69b835f40b8ad4124cec39d9 HTTP/1.0" 202 Accepted 2026-03-16 17:03:55,169 - lava_callback - INFO - Starting async job submit for node 69b835f40b8ad4124cec39d9 2026-03-16 17:03:55,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:03:55,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835f40b8ad4124cec39d9 HTTP/1.1" 200 None 2026-03-16 17:03:55,213 - lava_callback - DEBUG - Processing node 69b835f40b8ad4124cec39d9: baseline-arm64-clabbe 2026-03-16 17:03:55,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:03:55,724 - lava_callback - INFO - Received callback for node 69b594f31727ff69d6f26488 INFO: 172.19.0.1:36400 - "POST /node/69b594f31727ff69d6f26488 HTTP/1.0" 202 Accepted 2026-03-16 17:03:55,730 - lava_callback - INFO - Starting async job submit for node 69b594f31727ff69d6f26488 2026-03-16 17:03:55,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:03:55,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b594f31727ff69d6f26488 HTTP/1.1" 200 None 2026-03-16 17:03:55,747 - lava_callback - DEBUG - Processing node 69b594f31727ff69d6f26488: baseline-arm64-baylibre 2026-03-16 17:03:55,747 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b594f31727ff69d6f26488 2026-03-16 17:03:55,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:03:55,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b594f31727ff69d6f26488 HTTP/1.1" 200 None 2026-03-16 17:03:55,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:03:55,776 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:03:55,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-16 17:03:55,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:03:55,780 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69b835f40b8ad4124cec39d9/log.txt.gz 2026-03-16 17:03:55,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b594f31727ff69d6f26488 HTTP/1.1" 200 None 2026-03-16 17:03:55,898 - lava_callback - ERROR - Error processing callback for node 69b594f31727ff69d6f26488: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-16 17:03:56,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:03:56,333 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:03:56,336 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69b835f40b8ad4124cec39d9/lava-logs.yaml 2026-03-16 17:03:56,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.19.0.1:36410 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:03:56,541 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:03:56,544 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69b835f40b8ad4124cec39d9/lava_callback.json.gz 2026-03-16 17:03:56,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:03:56,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835f40b8ad4124cec39d9 HTTP/1.1" 200 None 2026-03-16 17:03:56,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:03:56,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 17:03:56,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:03:56,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b835f40b8ad4124cec39d9 HTTP/1.1" 200 None 2026-03-16 17:03:56,647 - lava_callback - INFO - Completed processing callback for node 69b835f40b8ad4124cec39d9 INFO: 172.19.0.1:55738 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:04:11,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:04:11,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:57270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57286 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60280 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60288 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59314 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39768 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33468 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38372 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:05:13,240 - lava_callback - INFO - Received callback for node 69b595451727ff69d6f26496 INFO: 172.19.0.1:46242 - "POST /node/69b595451727ff69d6f26496 HTTP/1.0" 202 Accepted 2026-03-16 17:05:13,246 - lava_callback - INFO - Starting async job submit for node 69b595451727ff69d6f26496 2026-03-16 17:05:13,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:05:13,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b595451727ff69d6f26496 HTTP/1.1" 200 None 2026-03-16 17:05:13,263 - lava_callback - DEBUG - Processing node 69b595451727ff69d6f26496: baseline-arm64-clabbe 2026-03-16 17:05:13,264 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b595451727ff69d6f26496 2026-03-16 17:05:13,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:05:13,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b595451727ff69d6f26496 HTTP/1.1" 200 None 2026-03-16 17:05:13,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:05:13,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-16 17:05:13,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:05:13,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b595451727ff69d6f26496 HTTP/1.1" 200 None 2026-03-16 17:05:13,340 - lava_callback - ERROR - Error processing callback for node 69b595451727ff69d6f26496: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:46258 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46272 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35512 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35514 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:05:29,414 - lava_callback - INFO - Received callback for node 69b835d10b8ad4124cec395b INFO: 172.19.0.1:35518 - "POST /node/69b835d10b8ad4124cec395b HTTP/1.0" 202 Accepted 2026-03-16 17:05:29,420 - lava_callback - INFO - Starting async job submit for node 69b835d10b8ad4124cec395b 2026-03-16 17:05:29,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:05:29,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835d10b8ad4124cec395b HTTP/1.1" 200 None 2026-03-16 17:05:29,462 - lava_callback - DEBUG - Processing node 69b835d10b8ad4124cec395b: baseline-nfs-arm64 2026-03-16 17:05:29,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:05:30,152 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:05:30,154 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b835d10b8ad4124cec395b/log.txt.gz 2026-03-16 17:05:30,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:05:30,547 - lava_callback - INFO - Received callback for node 69b835c00b8ad4124cec3916 INFO: 172.19.0.1:54068 - "POST /node/69b835c00b8ad4124cec3916 HTTP/1.0" 202 Accepted 2026-03-16 17:05:30,554 - lava_callback - INFO - Starting async job submit for node 69b835c00b8ad4124cec3916 2026-03-16 17:05:30,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:05:30,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835c00b8ad4124cec3916 HTTP/1.1" 200 None 2026-03-16 17:05:30,623 - lava_callback - DEBUG - Processing node 69b835c00b8ad4124cec3916: baseline-arm64 2026-03-16 17:05:30,680 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:05:30,738 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b835d10b8ad4124cec395b/lava-logs.yaml 2026-03-16 17:05:30,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:05:31,136 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:05:31,186 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b835d10b8ad4124cec395b/lava_callback.json.gz 2026-03-16 17:05:31,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:05:31,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:05:31,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835d10b8ad4124cec395b HTTP/1.1" 200 None 2026-03-16 17:05:31,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:05:31,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 17:05:31,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:05:31,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b835d10b8ad4124cec395b HTTP/1.1" 200 None 2026-03-16 17:05:31,363 - lava_callback - INFO - Completed processing callback for node 69b835d10b8ad4124cec395b 2026-03-16 17:05:31,404 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:05:31,407 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b835c00b8ad4124cec3916/log.txt.gz 2026-03-16 17:05:31,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:05:31,937 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:05:31,939 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b835c00b8ad4124cec3916/lava-logs.yaml 2026-03-16 17:05:31,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:05:32,130 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:05:32,132 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b835c00b8ad4124cec3916/lava_callback.json.gz 2026-03-16 17:05:32,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:05:32,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835c00b8ad4124cec3916 HTTP/1.1" 200 None 2026-03-16 17:05:32,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:05:32,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 17:05:32,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:05:32,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b835c00b8ad4124cec3916 HTTP/1.1" 200 None 2026-03-16 17:05:32,251 - lava_callback - INFO - Completed processing callback for node 69b835c00b8ad4124cec3916 INFO: 172.19.0.1:54080 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:05:41,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:05:41,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:43712 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:05:49,794 - lava_callback - INFO - Received callback for node 69b838320b8ad4124cec3b7e INFO: 172.19.0.1:35246 - "POST /node/69b838320b8ad4124cec3b7e HTTP/1.0" 202 Accepted 2026-03-16 17:05:49,801 - lava_callback - INFO - Starting async job submit for node 69b838320b8ad4124cec3b7e 2026-03-16 17:05:49,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:05:49,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b838320b8ad4124cec3b7e HTTP/1.1" 200 None 2026-03-16 17:05:49,877 - lava_callback - DEBUG - Processing node 69b838320b8ad4124cec3b7e: baseline-arm64 2026-03-16 17:05:50,033 - lava_callback - WARNING - Failed to upload log 2026-03-16 17:05:50,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:05:50,290 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:05:50,292 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b838320b8ad4124cec3b7e/lava-logs.yaml 2026-03-16 17:05:50,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:05:50,426 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:05:50,428 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b838320b8ad4124cec3b7e/lava_callback.json.gz 2026-03-16 17:05:50,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:05:50,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b838320b8ad4124cec3b7e HTTP/1.1" 200 None 2026-03-16 17:05:50,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:05:50,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 17:05:50,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:05:50,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b838320b8ad4124cec3b7e HTTP/1.1" 200 None 2026-03-16 17:05:50,595 - lava_callback - INFO - Completed processing callback for node 69b838320b8ad4124cec3b7e INFO: 172.19.0.1:35254 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57274 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:06:11,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:06:11,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:40308 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40312 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48076 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48082 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:06:33,333 - lava_callback - INFO - Received callback for node 69b595921727ff69d6f2649c INFO: 172.19.0.1:33246 - "POST /node/69b595921727ff69d6f2649c HTTP/1.0" 202 Accepted 2026-03-16 17:06:33,338 - lava_callback - INFO - Starting async job submit for node 69b595921727ff69d6f2649c 2026-03-16 17:06:33,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:06:33,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b595921727ff69d6f2649c HTTP/1.1" 200 None 2026-03-16 17:06:33,354 - lava_callback - DEBUG - Processing node 69b595921727ff69d6f2649c: baseline-arm64-clabbe 2026-03-16 17:06:33,354 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b595921727ff69d6f2649c 2026-03-16 17:06:33,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:06:33,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b595921727ff69d6f2649c HTTP/1.1" 200 None 2026-03-16 17:06:33,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:06:33,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-16 17:06:33,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:06:33,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b595921727ff69d6f2649c HTTP/1.1" 200 None 2026-03-16 17:06:33,413 - lava_callback - ERROR - Error processing callback for node 69b595921727ff69d6f2649c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:33262 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48760 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32776 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33126 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54868 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48652 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48666 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37406 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40700 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:07:53,311 - lava_callback - INFO - Received callback for node 69b595e01727ff69d6f264b2 INFO: 172.19.0.1:39422 - "POST /node/69b595e01727ff69d6f264b2 HTTP/1.0" 202 Accepted 2026-03-16 17:07:53,320 - lava_callback - INFO - Starting async job submit for node 69b595e01727ff69d6f264b2 2026-03-16 17:07:53,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:07:53,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b595e01727ff69d6f264b2 HTTP/1.1" 200 None 2026-03-16 17:07:53,344 - lava_callback - DEBUG - Processing node 69b595e01727ff69d6f264b2: baseline-arm64-clabbe 2026-03-16 17:07:53,344 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b595e01727ff69d6f264b2 2026-03-16 17:07:53,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:07:53,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b595e01727ff69d6f264b2 HTTP/1.1" 200 None 2026-03-16 17:07:53,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:07:53,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-16 17:07:53,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:07:53,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b595e01727ff69d6f264b2 HTTP/1.1" 200 None 2026-03-16 17:07:53,403 - lava_callback - ERROR - Error processing callback for node 69b595e01727ff69d6f264b2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:39432 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:08:02,054 - lava_callback - INFO - Received callback for node 69b835e50b8ad4124cec39aa INFO: 172.19.0.1:43542 - "POST /node/69b835e50b8ad4124cec39aa HTTP/1.0" 202 Accepted 2026-03-16 17:08:02,060 - lava_callback - INFO - Starting async job submit for node 69b835e50b8ad4124cec39aa 2026-03-16 17:08:02,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:08:02,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835e50b8ad4124cec39aa HTTP/1.1" 200 None 2026-03-16 17:08:02,098 - lava_callback - DEBUG - Processing node 69b835e50b8ad4124cec39aa: baseline-arm64-broonie 2026-03-16 17:08:02,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:08:02,525 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:08:02,527 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b835e50b8ad4124cec39aa/log.txt.gz 2026-03-16 17:08:02,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:08:02,927 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:08:02,929 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b835e50b8ad4124cec39aa/lava-logs.yaml 2026-03-16 17:08:02,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:08:03,089 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:08:03,090 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b835e50b8ad4124cec39aa/lava_callback.json.gz 2026-03-16 17:08:03,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:08:03,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835e50b8ad4124cec39aa HTTP/1.1" 200 None 2026-03-16 17:08:03,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:08:03,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 17:08:03,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:08:03,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b835e50b8ad4124cec39aa HTTP/1.1" 200 None 2026-03-16 17:08:03,190 - lava_callback - INFO - Completed processing callback for node 69b835e50b8ad4124cec39aa INFO: 172.19.0.1:43556 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:08:11,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:08:11,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:48818 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48830 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59076 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59090 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34334 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57672 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45966 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50750 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:09:13,382 - lava_callback - INFO - Received callback for node 69b5962d1727ff69d6f264b9 INFO: 172.19.0.1:58336 - "POST /node/69b5962d1727ff69d6f264b9 HTTP/1.0" 202 Accepted 2026-03-16 17:09:13,388 - lava_callback - INFO - Starting async job submit for node 69b5962d1727ff69d6f264b9 2026-03-16 17:09:13,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:09:13,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5962d1727ff69d6f264b9 HTTP/1.1" 200 None 2026-03-16 17:09:13,406 - lava_callback - DEBUG - Processing node 69b5962d1727ff69d6f264b9: baseline-arm64-clabbe 2026-03-16 17:09:13,406 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5962d1727ff69d6f264b9 2026-03-16 17:09:13,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:09:13,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5962d1727ff69d6f264b9 HTTP/1.1" 200 None 2026-03-16 17:09:13,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:09:13,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-16 17:09:13,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:09:13,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5962d1727ff69d6f264b9 HTTP/1.1" 200 None 2026-03-16 17:09:13,475 - lava_callback - ERROR - Error processing callback for node 69b5962d1727ff69d6f264b9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:58344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58354 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40664 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40676 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50474 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46066 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48194 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41422 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37216 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48296 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48304 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:10:33,492 - lava_callback - INFO - Received callback for node 69b5967a1727ff69d6f264c6 INFO: 172.19.0.1:36158 - "POST /node/69b5967a1727ff69d6f264c6 HTTP/1.0" 202 Accepted 2026-03-16 17:10:33,498 - lava_callback - INFO - Starting async job submit for node 69b5967a1727ff69d6f264c6 2026-03-16 17:10:33,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:10:33,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5967a1727ff69d6f264c6 HTTP/1.1" 200 None 2026-03-16 17:10:33,515 - lava_callback - DEBUG - Processing node 69b5967a1727ff69d6f264c6: baseline-arm64-clabbe 2026-03-16 17:10:33,515 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5967a1727ff69d6f264c6 2026-03-16 17:10:33,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:10:33,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5967a1727ff69d6f264c6 HTTP/1.1" 200 None 2026-03-16 17:10:33,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:10:33,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-16 17:10:33,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:10:33,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5967a1727ff69d6f264c6 HTTP/1.1" 200 None 2026-03-16 17:10:33,574 - lava_callback - ERROR - Error processing callback for node 69b5967a1727ff69d6f264c6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:36164 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34570 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57716 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49688 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53354 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:11:26,063 - lava_callback - INFO - Received callback for node 69b8358b0b8ad4124cec38ce INFO: 172.19.0.1:44414 - "POST /node/69b8358b0b8ad4124cec38ce HTTP/1.0" 202 Accepted 2026-03-16 17:11:26,070 - lava_callback - INFO - Starting async job submit for node 69b8358b0b8ad4124cec38ce 2026-03-16 17:11:26,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:11:26,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8358b0b8ad4124cec38ce HTTP/1.1" 200 None 2026-03-16 17:11:26,145 - lava_callback - DEBUG - Processing node 69b8358b0b8ad4124cec38ce: ltp-smoke INFO: 172.19.0.1:44418 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:11:26,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:11:26,793 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:11:26,795 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69b8358b0b8ad4124cec38ce/log.txt.gz 2026-03-16 17:11:27,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:11:27,300 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:11:27,302 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69b8358b0b8ad4124cec38ce/lava-logs.yaml 2026-03-16 17:11:27,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:11:27,481 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:11:27,483 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69b8358b0b8ad4124cec38ce/lava_callback.json.gz 2026-03-16 17:11:27,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:11:27,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8358b0b8ad4124cec38ce HTTP/1.1" 200 None 2026-03-16 17:11:27,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:11:27,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d3d0b8ad4124cec355d HTTP/1.1" 200 None 2026-03-16 17:11:27,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:11:27,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8358b0b8ad4124cec38ce HTTP/1.1" 200 None 2026-03-16 17:11:27,819 - lava_callback - INFO - Completed processing callback for node 69b8358b0b8ad4124cec38ce INFO: 172.19.0.1:44430 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48682 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:11:41,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:11:42,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:42422 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:11:53,521 - lava_callback - INFO - Received callback for node 69b596c61727ff69d6f264d1 INFO: 172.19.0.1:53598 - "POST /node/69b596c61727ff69d6f264d1 HTTP/1.0" 202 Accepted 2026-03-16 17:11:53,526 - lava_callback - INFO - Starting async job submit for node 69b596c61727ff69d6f264d1 2026-03-16 17:11:53,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:11:53,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b596c61727ff69d6f264d1 HTTP/1.1" 200 None 2026-03-16 17:11:53,543 - lava_callback - DEBUG - Processing node 69b596c61727ff69d6f264d1: baseline-arm64-clabbe 2026-03-16 17:11:53,544 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b596c61727ff69d6f264d1 2026-03-16 17:11:53,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:11:53,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b596c61727ff69d6f264d1 HTTP/1.1" 200 None 2026-03-16 17:11:53,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:11:53,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-16 17:11:53,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:11:53,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b596c61727ff69d6f264d1 HTTP/1.1" 200 None 2026-03-16 17:11:53,626 - lava_callback - ERROR - Error processing callback for node 69b596c61727ff69d6f264d1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:53604 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51632 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43064 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43072 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40138 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40144 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:12:36,149 - lava_callback - INFO - Received callback for node 69b597001727ff69d6f264da INFO: 172.19.0.1:53892 - "POST /node/69b597001727ff69d6f264da HTTP/1.0" 202 Accepted 2026-03-16 17:12:36,155 - lava_callback - INFO - Starting async job submit for node 69b597001727ff69d6f264da 2026-03-16 17:12:36,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:12:36,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b597001727ff69d6f264da HTTP/1.1" 200 None 2026-03-16 17:12:36,199 - lava_callback - DEBUG - Processing node 69b597001727ff69d6f264da: baseline-arm-baylibre 2026-03-16 17:12:36,200 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b597001727ff69d6f264da 2026-03-16 17:12:36,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:12:36,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b597001727ff69d6f264da HTTP/1.1" 200 None 2026-03-16 17:12:36,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:12:36,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-16 17:12:36,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:12:36,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b597001727ff69d6f264da HTTP/1.1" 200 None 2026-03-16 17:12:36,334 - lava_callback - ERROR - Error processing callback for node 69b597001727ff69d6f264da: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:53904 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49094 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58872 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57090 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58566 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-16 17:13:16,070 - lava_callback - INFO - Received callback for node 69b597241727ff69d6f264e8 INFO: 172.19.0.1:58570 - "POST /node/69b597241727ff69d6f264e8 HTTP/1.0" 202 Accepted 2026-03-16 17:13:16,076 - lava_callback - INFO - Starting async job submit for node 69b597241727ff69d6f264e8 2026-03-16 17:13:16,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:13:16,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b597241727ff69d6f264e8 HTTP/1.1" 200 None 2026-03-16 17:13:16,092 - lava_callback - DEBUG - Processing node 69b597241727ff69d6f264e8: baseline-arm-baylibre 2026-03-16 17:13:16,093 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b597241727ff69d6f264e8 2026-03-16 17:13:16,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:13:16,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b597241727ff69d6f264e8 HTTP/1.1" 200 None 2026-03-16 17:13:16,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:13:16,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-16 17:13:16,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:13:16,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b597241727ff69d6f264e8 HTTP/1.1" 200 None 2026-03-16 17:13:16,144 - lava_callback - ERROR - Error processing callback for node 69b597241727ff69d6f264e8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:58586 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54966 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54980 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60180 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48154 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:13:56,244 - lava_callback - INFO - Received callback for node 69b597471727ff69d6f264f1 INFO: 172.19.0.1:56502 - "POST /node/69b597471727ff69d6f264f1 HTTP/1.0" 202 Accepted 2026-03-16 17:13:56,250 - lava_callback - INFO - Starting async job submit for node 69b597471727ff69d6f264f1 2026-03-16 17:13:56,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:13:56,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b597471727ff69d6f264f1 HTTP/1.1" 200 None 2026-03-16 17:13:56,266 - lava_callback - DEBUG - Processing node 69b597471727ff69d6f264f1: baseline-arm-baylibre 2026-03-16 17:13:56,267 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b597471727ff69d6f264f1 2026-03-16 17:13:56,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:13:56,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b597471727ff69d6f264f1 HTTP/1.1" 200 None 2026-03-16 17:13:56,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:13:56,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-16 17:13:56,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:13:56,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b597471727ff69d6f264f1 HTTP/1.1" 200 None 2026-03-16 17:13:56,347 - lava_callback - ERROR - Error processing callback for node 69b597471727ff69d6f264f1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:56508 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56580 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36912 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36922 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54786 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54792 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:14:36,167 - lava_callback - INFO - Received callback for node 69b5976b1727ff69d6f264fc INFO: 172.19.0.1:38916 - "POST /node/69b5976b1727ff69d6f264fc HTTP/1.0" 202 Accepted 2026-03-16 17:14:36,172 - lava_callback - INFO - Starting async job submit for node 69b5976b1727ff69d6f264fc 2026-03-16 17:14:36,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:14:36,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5976b1727ff69d6f264fc HTTP/1.1" 200 None 2026-03-16 17:14:36,196 - lava_callback - DEBUG - Processing node 69b5976b1727ff69d6f264fc: baseline-arm-baylibre 2026-03-16 17:14:36,196 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5976b1727ff69d6f264fc 2026-03-16 17:14:36,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:14:36,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5976b1727ff69d6f264fc HTTP/1.1" 200 None 2026-03-16 17:14:36,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:14:36,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-16 17:14:36,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:14:36,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5976b1727ff69d6f264fc HTTP/1.1" 200 None 2026-03-16 17:14:36,257 - lava_callback - ERROR - Error processing callback for node 69b5976b1727ff69d6f264fc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:38918 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:14:44,868 - lava_callback - INFO - Received callback for node 69b836920b8ad4124cec3b0e INFO: 172.19.0.1:56304 - "POST /node/69b836920b8ad4124cec3b0e HTTP/1.0" 202 Accepted 2026-03-16 17:14:44,875 - lava_callback - INFO - Starting async job submit for node 69b836920b8ad4124cec3b0e 2026-03-16 17:14:44,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:14:44,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b836920b8ad4124cec3b0e HTTP/1.1" 200 None 2026-03-16 17:14:44,947 - lava_callback - DEBUG - Processing node 69b836920b8ad4124cec3b0e: baseline-arm 2026-03-16 17:14:45,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:14:45,688 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:14:45,689 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b836920b8ad4124cec3b0e/log.txt.gz 2026-03-16 17:14:46,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:14:46,286 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:14:46,289 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b836920b8ad4124cec3b0e/lava-logs.yaml 2026-03-16 17:14:46,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:14:46,469 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:14:46,471 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b836920b8ad4124cec3b0e/lava_callback.json.gz INFO: 172.19.0.1:56320 - "GET / HTTP/1.0" 200 OK DEBUG: Setup failed for 69b836920b8ad4124cec3b0e. Transitting job node result: incomplete -> fail 2026-03-16 17:14:46,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:14:46,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b836920b8ad4124cec3b0e HTTP/1.1" 200 None 2026-03-16 17:14:46,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:14:46,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None 2026-03-16 17:14:46,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:14:46,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b836920b8ad4124cec3b0e HTTP/1.1" 200 None 2026-03-16 17:14:46,754 - lava_callback - INFO - Completed processing callback for node 69b836920b8ad4124cec3b0e INFO: 172.19.0.1:48544 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:15:05,241 - lava_callback - INFO - Received callback for node 69b835ca0b8ad4124cec394c INFO: 172.19.0.1:42854 - "POST /node/69b835ca0b8ad4124cec394c HTTP/1.0" 202 Accepted 2026-03-16 17:15:05,249 - lava_callback - INFO - Starting async job submit for node 69b835ca0b8ad4124cec394c 2026-03-16 17:15:05,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:15:05,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835ca0b8ad4124cec394c HTTP/1.1" 200 None 2026-03-16 17:15:05,315 - lava_callback - DEBUG - Processing node 69b835ca0b8ad4124cec394c: baseline-nfs-arm64 2026-03-16 17:15:06,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.19.0.1:42862 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:15:06,649 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:15:06,651 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b835ca0b8ad4124cec394c/log.txt.gz 2026-03-16 17:15:07,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:15:07,535 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:15:07,538 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b835ca0b8ad4124cec394c/lava-logs.yaml 2026-03-16 17:15:07,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:15:07,766 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:15:07,768 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b835ca0b8ad4124cec394c/lava_callback.json.gz DEBUG: Setup failed for 69b835ca0b8ad4124cec394c. Transitting job node result: incomplete -> fail 2026-03-16 17:15:07,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:15:07,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835ca0b8ad4124cec394c HTTP/1.1" 200 None 2026-03-16 17:15:07,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:15:07,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 17:15:07,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:15:07,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b835ca0b8ad4124cec394c HTTP/1.1" 200 None 2026-03-16 17:15:08,021 - lava_callback - INFO - Completed processing callback for node 69b835ca0b8ad4124cec394c 2026-03-16 17:15:12,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:15:12,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:35816 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-16 17:15:16,218 - lava_callback - INFO - Received callback for node 69b597901727ff69d6f26507 INFO: 172.19.0.1:35828 - "POST /node/69b597901727ff69d6f26507 HTTP/1.0" 202 Accepted 2026-03-16 17:15:16,224 - lava_callback - INFO - Starting async job submit for node 69b597901727ff69d6f26507 2026-03-16 17:15:16,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:15:16,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b597901727ff69d6f26507 HTTP/1.1" 200 None 2026-03-16 17:15:16,240 - lava_callback - DEBUG - Processing node 69b597901727ff69d6f26507: baseline-arm-baylibre 2026-03-16 17:15:16,240 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b597901727ff69d6f26507 2026-03-16 17:15:16,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:15:16,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b597901727ff69d6f26507 HTTP/1.1" 200 None 2026-03-16 17:15:16,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:15:16,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-16 17:15:16,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:15:16,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b597901727ff69d6f26507 HTTP/1.1" 200 None 2026-03-16 17:15:16,300 - lava_callback - ERROR - Error processing callback for node 69b597901727ff69d6f26507: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:35832 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36478 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36490 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:15:29,860 - lava_callback - INFO - Received callback for node 69b836010b8ad4124cec39fd INFO: 172.19.0.1:56450 - "POST /node/69b836010b8ad4124cec39fd HTTP/1.0" 202 Accepted 2026-03-16 17:15:29,868 - lava_callback - INFO - Starting async job submit for node 69b836010b8ad4124cec39fd 2026-03-16 17:15:29,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:15:29,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b836010b8ad4124cec39fd HTTP/1.1" 200 None 2026-03-16 17:15:29,928 - lava_callback - DEBUG - Processing node 69b836010b8ad4124cec39fd: baseline-nfs-arm64 2026-03-16 17:15:31,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:15:31,266 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:15:31,267 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b836010b8ad4124cec39fd/log.txt.gz 2026-03-16 17:15:31,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:15:32,110 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:15:32,113 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b836010b8ad4124cec39fd/lava-logs.yaml 2026-03-16 17:15:32,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:15:32,385 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:15:32,387 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b836010b8ad4124cec39fd/lava_callback.json.gz DEBUG: Setup failed for 69b836010b8ad4124cec39fd. Transitting job node result: incomplete -> fail 2026-03-16 17:15:32,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:15:32,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b836010b8ad4124cec39fd HTTP/1.1" 200 None 2026-03-16 17:15:32,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:15:32,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 17:15:32,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:15:32,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b836010b8ad4124cec39fd HTTP/1.1" 200 None 2026-03-16 17:15:32,656 - lava_callback - INFO - Completed processing callback for node 69b836010b8ad4124cec39fd 2026-03-16 17:15:36,238 - lava_callback - INFO - Received callback for node 69b597b51727ff69d6f26512 INFO: 172.19.0.1:56466 - "POST /node/69b597b51727ff69d6f26512 HTTP/1.0" 202 Accepted 2026-03-16 17:15:36,244 - lava_callback - INFO - Starting async job submit for node 69b597b51727ff69d6f26512 2026-03-16 17:15:36,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:15:36,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b597b51727ff69d6f26512 HTTP/1.1" 200 None 2026-03-16 17:15:36,268 - lava_callback - DEBUG - Processing node 69b597b51727ff69d6f26512: baseline-arm-baylibre 2026-03-16 17:15:36,268 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b597b51727ff69d6f26512 2026-03-16 17:15:36,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:15:36,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b597b51727ff69d6f26512 HTTP/1.1" 200 None 2026-03-16 17:15:36,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:15:36,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-16 17:15:36,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:15:36,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b597b51727ff69d6f26512 HTTP/1.1" 200 None 2026-03-16 17:15:36,327 - lava_callback - ERROR - Error processing callback for node 69b597b51727ff69d6f26512: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:56470 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:15:42,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:15:42,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:45230 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53074 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37708 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:16:13,657 - lava_callback - INFO - Received callback for node 69b597da1727ff69d6f2651d INFO: 172.19.0.1:37100 - "POST /node/69b597da1727ff69d6f2651d HTTP/1.0" 202 Accepted 2026-03-16 17:16:13,663 - lava_callback - INFO - Starting async job submit for node 69b597da1727ff69d6f2651d 2026-03-16 17:16:13,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:16:13,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b597da1727ff69d6f2651d HTTP/1.1" 200 None 2026-03-16 17:16:13,679 - lava_callback - DEBUG - Processing node 69b597da1727ff69d6f2651d: baseline-arm-clabbe 2026-03-16 17:16:13,679 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b597da1727ff69d6f2651d 2026-03-16 17:16:13,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:16:13,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b597da1727ff69d6f2651d HTTP/1.1" 200 None 2026-03-16 17:16:13,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:16:13,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-16 17:16:13,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:16:13,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b597da1727ff69d6f2651d HTTP/1.1" 200 None 2026-03-16 17:16:13,739 - lava_callback - ERROR - Error processing callback for node 69b597da1727ff69d6f2651d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:37112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37116 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43336 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43346 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40454 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55798 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:16:53,652 - lava_callback - INFO - Received callback for node 69b597fe1727ff69d6f26524 INFO: 172.19.0.1:47034 - "POST /node/69b597fe1727ff69d6f26524 HTTP/1.0" 202 Accepted 2026-03-16 17:16:53,658 - lava_callback - INFO - Starting async job submit for node 69b597fe1727ff69d6f26524 2026-03-16 17:16:53,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:16:53,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b597fe1727ff69d6f26524 HTTP/1.1" 200 None 2026-03-16 17:16:53,682 - lava_callback - DEBUG - Processing node 69b597fe1727ff69d6f26524: baseline-arm-clabbe 2026-03-16 17:16:53,682 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b597fe1727ff69d6f26524 2026-03-16 17:16:53,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:16:53,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b597fe1727ff69d6f26524 HTTP/1.1" 200 None 2026-03-16 17:16:53,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:16:53,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-16 17:16:53,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:16:53,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b597fe1727ff69d6f26524 HTTP/1.1" 200 None 2026-03-16 17:16:53,736 - lava_callback - ERROR - Error processing callback for node 69b597fe1727ff69d6f26524: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:47038 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48956 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45372 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36752 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36754 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:17:33,686 - lava_callback - INFO - Received callback for node 69b598231727ff69d6f2652d INFO: 172.19.0.1:57116 - "POST /node/69b598231727ff69d6f2652d HTTP/1.0" 202 Accepted 2026-03-16 17:17:33,691 - lava_callback - INFO - Starting async job submit for node 69b598231727ff69d6f2652d 2026-03-16 17:17:33,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:17:33,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b598231727ff69d6f2652d HTTP/1.1" 200 None 2026-03-16 17:17:33,708 - lava_callback - DEBUG - Processing node 69b598231727ff69d6f2652d: baseline-arm-clabbe 2026-03-16 17:17:33,708 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b598231727ff69d6f2652d 2026-03-16 17:17:33,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:17:33,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b598231727ff69d6f2652d HTTP/1.1" 200 None 2026-03-16 17:17:33,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:17:33,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-16 17:17:33,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:17:33,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b598231727ff69d6f2652d HTTP/1.1" 200 None 2026-03-16 17:17:33,765 - lava_callback - ERROR - Error processing callback for node 69b598231727ff69d6f2652d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:57130 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33692 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37606 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44852 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:18:13,675 - lava_callback - INFO - Received callback for node 69b598481727ff69d6f26536 INFO: 172.19.0.1:39382 - "POST /node/69b598481727ff69d6f26536 HTTP/1.0" 202 Accepted 2026-03-16 17:18:13,680 - lava_callback - INFO - Starting async job submit for node 69b598481727ff69d6f26536 2026-03-16 17:18:13,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:18:13,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b598481727ff69d6f26536 HTTP/1.1" 200 None 2026-03-16 17:18:13,696 - lava_callback - DEBUG - Processing node 69b598481727ff69d6f26536: baseline-arm-clabbe 2026-03-16 17:18:13,697 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b598481727ff69d6f26536 2026-03-16 17:18:13,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:18:13,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b598481727ff69d6f26536 HTTP/1.1" 200 None 2026-03-16 17:18:13,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:18:13,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-16 17:18:13,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:18:13,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b598481727ff69d6f26536 HTTP/1.1" 200 None 2026-03-16 17:18:13,778 - lava_callback - ERROR - Error processing callback for node 69b598481727ff69d6f26536: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:39396 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39398 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51694 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51710 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56888 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35302 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:18:53,762 - lava_callback - INFO - Received callback for node 69b5986e1727ff69d6f26546 INFO: 172.19.0.1:44190 - "POST /node/69b5986e1727ff69d6f26546 HTTP/1.0" 202 Accepted 2026-03-16 17:18:53,768 - lava_callback - INFO - Starting async job submit for node 69b5986e1727ff69d6f26546 2026-03-16 17:18:53,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:18:53,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5986e1727ff69d6f26546 HTTP/1.1" 200 None 2026-03-16 17:18:53,786 - lava_callback - DEBUG - Processing node 69b5986e1727ff69d6f26546: baseline-arm-clabbe 2026-03-16 17:18:53,786 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5986e1727ff69d6f26546 2026-03-16 17:18:53,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:18:53,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5986e1727ff69d6f26546 HTTP/1.1" 200 None 2026-03-16 17:18:53,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:18:53,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-16 17:18:53,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:18:53,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5986e1727ff69d6f26546 HTTP/1.1" 200 None 2026-03-16 17:18:53,838 - lava_callback - ERROR - Error processing callback for node 69b5986e1727ff69d6f26546: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:44200 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41342 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51254 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51260 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:19:25,588 - lava_callback - INFO - Received callback for node 69b81970113612b7716bca8b INFO: 172.19.0.1:48322 - "POST /node/69b81970113612b7716bca8b HTTP/1.0" 202 Accepted 2026-03-16 17:19:25,595 - lava_callback - INFO - Starting async job submit for node 69b81970113612b7716bca8b 2026-03-16 17:19:25,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:19:25,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81970113612b7716bca8b HTTP/1.1" 200 None 2026-03-16 17:19:25,640 - lava_callback - DEBUG - Processing node 69b81970113612b7716bca8b: baseline-arm64-broonie 2026-03-16 17:19:25,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:19:26,010 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:19:26,012 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b81970113612b7716bca8b/log.txt.gz 2026-03-16 17:19:26,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:19:26,369 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:19:26,371 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b81970113612b7716bca8b/lava-logs.yaml 2026-03-16 17:19:26,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:19:26,507 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:19:26,508 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b81970113612b7716bca8b/lava_callback.json.gz 2026-03-16 17:19:26,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.19.0.1:48328 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:19:26,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81970113612b7716bca8b HTTP/1.1" 200 None 2026-03-16 17:19:26,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:19:26,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 17:19:26,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:19:26,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b81970113612b7716bca8b HTTP/1.1" 200 None 2026-03-16 17:19:26,647 - lava_callback - INFO - Completed processing callback for node 69b81970113612b7716bca8b INFO: 172.19.0.1:48338 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:19:36,494 - lava_callback - INFO - Received callback for node 69b598971727ff69d6f2654c INFO: 172.19.0.1:50188 - "POST /node/69b598971727ff69d6f2654c HTTP/1.0" 202 Accepted 2026-03-16 17:19:36,500 - lava_callback - INFO - Starting async job submit for node 69b598971727ff69d6f2654c 2026-03-16 17:19:36,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:19:36,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b598971727ff69d6f2654c HTTP/1.1" 200 None 2026-03-16 17:19:36,516 - lava_callback - DEBUG - Processing node 69b598971727ff69d6f2654c: baseline-arm64-baylibre 2026-03-16 17:19:36,516 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b598971727ff69d6f2654c 2026-03-16 17:19:36,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.19.0.1:50200 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:19:36,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b598971727ff69d6f2654c HTTP/1.1" 200 None 2026-03-16 17:19:36,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:19:36,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada1488fc97e5ba07d4d8d HTTP/1.1" 200 None 2026-03-16 17:19:36,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:19:36,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b598971727ff69d6f2654c HTTP/1.1" 200 None 2026-03-16 17:19:36,601 - lava_callback - ERROR - Error processing callback for node 69b598971727ff69d6f2654c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-16 17:19:42,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:19:42,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-16 17:19:42,667 - lava_callback - INFO - Received callback for node 69b81977113612b7716bcaa0 INFO: 172.19.0.1:48766 - "POST /node/69b81977113612b7716bcaa0 HTTP/1.0" 202 Accepted 2026-03-16 17:19:42,673 - lava_callback - INFO - Starting async job submit for node 69b81977113612b7716bcaa0 2026-03-16 17:19:42,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:19:42,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81977113612b7716bcaa0 HTTP/1.1" 200 None 2026-03-16 17:19:42,713 - lava_callback - DEBUG - Processing node 69b81977113612b7716bcaa0: baseline-arm64-broonie 2026-03-16 17:19:42,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:19:43,108 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:19:43,110 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b81977113612b7716bcaa0/log.txt.gz 2026-03-16 17:19:43,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:19:43,469 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:19:43,471 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b81977113612b7716bcaa0/lava-logs.yaml 2026-03-16 17:19:43,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:19:43,607 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:19:43,609 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b81977113612b7716bcaa0/lava_callback.json.gz 2026-03-16 17:19:43,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:19:43,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81977113612b7716bcaa0 HTTP/1.1" 200 None 2026-03-16 17:19:43,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:19:43,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 17:19:43,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:19:43,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b81977113612b7716bcaa0 HTTP/1.1" 200 None 2026-03-16 17:19:43,688 - lava_callback - INFO - Completed processing callback for node 69b81977113612b7716bcaa0 INFO: 172.19.0.1:48776 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55466 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40202 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:20:12,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:20:12,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:43492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43498 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:20:22,490 - lava_callback - INFO - Received callback for node 69b835eb0b8ad4124cec39ba INFO: 172.19.0.1:57938 - "POST /node/69b835eb0b8ad4124cec39ba HTTP/1.0" 202 Accepted 2026-03-16 17:20:22,497 - lava_callback - INFO - Starting async job submit for node 69b835eb0b8ad4124cec39ba 2026-03-16 17:20:22,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:20:22,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835eb0b8ad4124cec39ba HTTP/1.1" 200 None 2026-03-16 17:20:22,536 - lava_callback - DEBUG - Processing node 69b835eb0b8ad4124cec39ba: baseline-arm64-broonie 2026-03-16 17:20:22,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:20:22,927 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:20:22,929 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b835eb0b8ad4124cec39ba/log.txt.gz 2026-03-16 17:20:23,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:20:23,283 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:20:23,285 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b835eb0b8ad4124cec39ba/lava-logs.yaml 2026-03-16 17:20:23,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:20:23,424 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:20:23,426 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b835eb0b8ad4124cec39ba/lava_callback.json.gz 2026-03-16 17:20:23,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:20:23,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835eb0b8ad4124cec39ba HTTP/1.1" 200 None 2026-03-16 17:20:23,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:20:23,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 17:20:23,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:20:23,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b835eb0b8ad4124cec39ba HTTP/1.1" 200 None 2026-03-16 17:20:23,511 - lava_callback - INFO - Completed processing callback for node 69b835eb0b8ad4124cec39ba INFO: 172.19.0.1:57950 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57966 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53888 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:20:42,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:20:42,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:54908 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52798 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:20:56,684 - lava_callback - INFO - Received callback for node 69b598f51727ff69d6f26557 INFO: 172.19.0.1:52806 - "POST /node/69b598f51727ff69d6f26557 HTTP/1.0" 202 Accepted 2026-03-16 17:20:56,690 - lava_callback - INFO - Starting async job submit for node 69b598f51727ff69d6f26557 2026-03-16 17:20:56,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:20:56,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b598f51727ff69d6f26557 HTTP/1.1" 200 None 2026-03-16 17:20:56,706 - lava_callback - DEBUG - Processing node 69b598f51727ff69d6f26557: baseline-arm64-baylibre 2026-03-16 17:20:56,706 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b598f51727ff69d6f26557 2026-03-16 17:20:56,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:20:56,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b598f51727ff69d6f26557 HTTP/1.1" 200 None 2026-03-16 17:20:56,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:20:56,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada1488fc97e5ba07d4d8d HTTP/1.1" 200 None 2026-03-16 17:20:56,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:20:56,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b598f51727ff69d6f26557 HTTP/1.1" 200 None 2026-03-16 17:20:56,768 - lava_callback - ERROR - Error processing callback for node 69b598f51727ff69d6f26557: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:42978 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55772 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44742 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44758 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46842 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50864 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56050 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40906 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46742 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:22:16,670 - lava_callback - INFO - Received callback for node 69b599451727ff69d6f26564 INFO: 172.19.0.1:46744 - "POST /node/69b599451727ff69d6f26564 HTTP/1.0" 202 Accepted 2026-03-16 17:22:16,675 - lava_callback - INFO - Starting async job submit for node 69b599451727ff69d6f26564 2026-03-16 17:22:16,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:22:16,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b599451727ff69d6f26564 HTTP/1.1" 200 None 2026-03-16 17:22:16,696 - lava_callback - DEBUG - Processing node 69b599451727ff69d6f26564: baseline-arm64-baylibre 2026-03-16 17:22:16,697 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b599451727ff69d6f26564 2026-03-16 17:22:16,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:22:16,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b599451727ff69d6f26564 HTTP/1.1" 200 None 2026-03-16 17:22:16,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:22:16,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada1488fc97e5ba07d4d8d HTTP/1.1" 200 None 2026-03-16 17:22:16,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:22:16,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b599451727ff69d6f26564 HTTP/1.1" 200 None 2026-03-16 17:22:16,766 - lava_callback - ERROR - Error processing callback for node 69b599451727ff69d6f26564: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:47320 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47324 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58742 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41662 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:22:51,460 - lava_callback - INFO - Received callback for node 69b83c070b8ad4124cec3c4e INFO: 172.19.0.1:55050 - "POST /node/69b83c070b8ad4124cec3c4e HTTP/1.0" 202 Accepted 2026-03-16 17:22:51,466 - lava_callback - INFO - Starting async job submit for node 69b83c070b8ad4124cec3c4e 2026-03-16 17:22:51,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:22:51,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b83c070b8ad4124cec3c4e HTTP/1.1" 200 None 2026-03-16 17:22:51,539 - lava_callback - DEBUG - Processing node 69b83c070b8ad4124cec3c4e: baseline-arm64 2026-03-16 17:22:51,744 - lava_callback - WARNING - Failed to upload log 2026-03-16 17:22:51,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:22:52,076 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:22:52,078 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b83c070b8ad4124cec3c4e/lava-logs.yaml 2026-03-16 17:22:52,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:22:52,232 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:22:52,234 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b83c070b8ad4124cec3c4e/lava_callback.json.gz 2026-03-16 17:22:52,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:22:52,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b83c070b8ad4124cec3c4e HTTP/1.1" 200 None 2026-03-16 17:22:52,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:22:52,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 17:22:52,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:22:52,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b83c070b8ad4124cec3c4e HTTP/1.1" 200 None 2026-03-16 17:22:52,415 - lava_callback - INFO - Completed processing callback for node 69b83c070b8ad4124cec3c4e INFO: 172.19.0.1:55064 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34050 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:23:12,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:23:12,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:52508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52510 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55312 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55320 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:23:36,169 - lava_callback - INFO - Received callback for node 69b83c520b8ad4124cec3c56 INFO: 172.19.0.1:33560 - "POST /node/69b83c520b8ad4124cec3c56 HTTP/1.0" 202 Accepted 2026-03-16 17:23:36,176 - lava_callback - INFO - Starting async job submit for node 69b83c520b8ad4124cec3c56 2026-03-16 17:23:36,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:23:36,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b83c520b8ad4124cec3c56 HTTP/1.1" 200 None 2026-03-16 17:23:36,213 - lava_callback - DEBUG - Processing node 69b83c520b8ad4124cec3c56: baseline-arm64 INFO: 172.19.0.1:33564 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:23:36,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:23:36,794 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:23:36,796 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b83c520b8ad4124cec3c56/log.txt.gz 2026-03-16 17:23:36,879 - lava_callback - INFO - Received callback for node 69b599961727ff69d6f2656d INFO: 172.19.0.1:33570 - "POST /node/69b599961727ff69d6f2656d HTTP/1.0" 202 Accepted 2026-03-16 17:23:36,891 - lava_callback - INFO - Starting async job submit for node 69b599961727ff69d6f2656d 2026-03-16 17:23:36,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:23:36,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b599961727ff69d6f2656d HTTP/1.1" 200 None 2026-03-16 17:23:36,984 - lava_callback - DEBUG - Processing node 69b599961727ff69d6f2656d: baseline-arm64-baylibre 2026-03-16 17:23:36,985 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b599961727ff69d6f2656d 2026-03-16 17:23:36,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:23:37,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b599961727ff69d6f2656d HTTP/1.1" 200 None 2026-03-16 17:23:37,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:23:37,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:23:37,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada1488fc97e5ba07d4d8d HTTP/1.1" 200 None 2026-03-16 17:23:37,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:23:37,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b599961727ff69d6f2656d HTTP/1.1" 200 None 2026-03-16 17:23:37,136 - lava_callback - ERROR - Error processing callback for node 69b599961727ff69d6f2656d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-16 17:23:37,396 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:23:37,398 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b83c520b8ad4124cec3c56/lava-logs.yaml 2026-03-16 17:23:37,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:23:37,573 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:23:37,575 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b83c520b8ad4124cec3c56/lava_callback.json.gz 2026-03-16 17:23:37,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:23:37,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b83c520b8ad4124cec3c56 HTTP/1.1" 200 None 2026-03-16 17:23:37,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:23:37,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 17:23:37,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:23:37,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b83c520b8ad4124cec3c56 HTTP/1.1" 200 None 2026-03-16 17:23:37,675 - lava_callback - INFO - Completed processing callback for node 69b83c520b8ad4124cec3c56 2026-03-16 17:23:42,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:23:42,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:36916 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49058 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43734 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56968 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50936 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50942 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59460 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49278 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42040 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39756 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58468 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58476 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37616 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37618 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47392 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42888 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40638 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:25:56,973 - lava_callback - INFO - Received callback for node 69b59a231727ff69d6f26579 INFO: 172.19.0.1:40640 - "POST /node/69b59a231727ff69d6f26579 HTTP/1.0" 202 Accepted 2026-03-16 17:25:56,979 - lava_callback - INFO - Starting async job submit for node 69b59a231727ff69d6f26579 2026-03-16 17:25:56,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:25:56,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b59a231727ff69d6f26579 HTTP/1.1" 200 None 2026-03-16 17:25:56,996 - lava_callback - DEBUG - Processing node 69b59a231727ff69d6f26579: baseline-arm64-baylibre 2026-03-16 17:25:56,996 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b59a231727ff69d6f26579 2026-03-16 17:25:56,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:25:57,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b59a231727ff69d6f26579 HTTP/1.1" 200 None 2026-03-16 17:25:57,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:25:57,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada1488fc97e5ba07d4d8d HTTP/1.1" 200 None 2026-03-16 17:25:57,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:25:57,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b59a231727ff69d6f26579 HTTP/1.1" 200 None 2026-03-16 17:25:57,072 - lava_callback - ERROR - Error processing callback for node 69b59a231727ff69d6f26579: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:53246 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34380 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56004 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56016 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49286 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52364 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53190 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38190 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36564 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45150 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45154 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54610 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:27:36,969 - lava_callback - INFO - Received callback for node 69b59a741727ff69d6f26587 INFO: 172.19.0.1:54622 - "POST /node/69b59a741727ff69d6f26587 HTTP/1.0" 202 Accepted 2026-03-16 17:27:36,978 - lava_callback - INFO - Starting async job submit for node 69b59a741727ff69d6f26587 2026-03-16 17:27:36,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:27:36,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b59a741727ff69d6f26587 HTTP/1.1" 200 None 2026-03-16 17:27:36,995 - lava_callback - DEBUG - Processing node 69b59a741727ff69d6f26587: baseline-arm64-baylibre 2026-03-16 17:27:36,995 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b59a741727ff69d6f26587 2026-03-16 17:27:36,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:27:37,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b59a741727ff69d6f26587 HTTP/1.1" 200 None 2026-03-16 17:27:37,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:27:37,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada1488fc97e5ba07d4d8d HTTP/1.1" 200 None 2026-03-16 17:27:37,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:27:37,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b59a741727ff69d6f26587 HTTP/1.1" 200 None 2026-03-16 17:27:37,057 - lava_callback - ERROR - Error processing callback for node 69b59a741727ff69d6f26587: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:49970 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51422 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59942 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49604 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44994 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45010 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53896 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36264 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38524 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55540 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60838 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33402 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33414 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59528 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51204 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58706 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42730 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:30:11,614 - lava_callback - INFO - Received callback for node 69b83dd70b8ad4124cec3c92 INFO: 172.19.0.1:49878 - "POST /node/69b83dd70b8ad4124cec3c92 HTTP/1.0" 202 Accepted 2026-03-16 17:30:11,622 - lava_callback - INFO - Starting async job submit for node 69b83dd70b8ad4124cec3c92 2026-03-16 17:30:11,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:30:11,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b83dd70b8ad4124cec3c92 HTTP/1.1" 200 None 2026-03-16 17:30:11,665 - lava_callback - DEBUG - Processing node 69b83dd70b8ad4124cec3c92: baseline-arm64-foundriesio 2026-03-16 17:30:12,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:30:12,250 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:30:12,252 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b83dd70b8ad4124cec3c92/log.txt.gz 2026-03-16 17:30:12,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:30:12,745 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:30:12,748 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b83dd70b8ad4124cec3c92/lava-logs.yaml 2026-03-16 17:30:12,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:30:12,935 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:30:12,936 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b83dd70b8ad4124cec3c92/lava_callback.json.gz 2026-03-16 17:30:12,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:30:12,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b83dd70b8ad4124cec3c92 HTTP/1.1" 200 None 2026-03-16 17:30:12,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:30:13,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 17:30:13,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:30:13,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b83dd70b8ad4124cec3c92 HTTP/1.1" 200 None 2026-03-16 17:30:13,031 - lava_callback - INFO - Completed processing callback for node 69b83dd70b8ad4124cec3c92 2026-03-16 17:30:14,223 - lava_callback - INFO - Received callback for node 69b59b0f1727ff69d6f26593 INFO: 172.19.0.1:49888 - "POST /node/69b59b0f1727ff69d6f26593 HTTP/1.0" 202 Accepted 2026-03-16 17:30:14,229 - lava_callback - INFO - Starting async job submit for node 69b59b0f1727ff69d6f26593 2026-03-16 17:30:14,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:30:14,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b59b0f1727ff69d6f26593 HTTP/1.1" 200 None 2026-03-16 17:30:14,248 - lava_callback - DEBUG - Processing node 69b59b0f1727ff69d6f26593: baseline-arm64-clabbe 2026-03-16 17:30:14,248 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b59b0f1727ff69d6f26593 2026-03-16 17:30:14,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:30:14,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b59b0f1727ff69d6f26593 HTTP/1.1" 200 None 2026-03-16 17:30:14,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:30:14,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada1488fc97e5ba07d4d8d HTTP/1.1" 200 None 2026-03-16 17:30:14,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:30:14,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b59b0f1727ff69d6f26593 HTTP/1.1" 200 None 2026-03-16 17:30:14,332 - lava_callback - ERROR - Error processing callback for node 69b59b0f1727ff69d6f26593: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:49892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49900 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40984 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40992 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47214 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:30:42,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:30:42,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:51640 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50732 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46682 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57340 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57346 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42264 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42272 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54352 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34760 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60452 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54362 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43590 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47656 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47658 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54482 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36952 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:32:47,790 - lava_callback - INFO - Received callback for node 69b83eab0b8ad4124cec3cc1 INFO: 172.19.0.1:36956 - "POST /node/69b83eab0b8ad4124cec3cc1 HTTP/1.0" 202 Accepted 2026-03-16 17:32:47,796 - lava_callback - INFO - Starting async job submit for node 69b83eab0b8ad4124cec3cc1 2026-03-16 17:32:47,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:32:47,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b83eab0b8ad4124cec3cc1 HTTP/1.1" 200 None 2026-03-16 17:32:47,812 - lava_callback - DEBUG - Processing node 69b83eab0b8ad4124cec3cc1: baseline-nfs-arm64 2026-03-16 17:32:47,814 - lava_callback - WARNING - Failed to upload log 2026-03-16 17:32:47,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:32:47,968 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:32:47,970 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b83eab0b8ad4124cec3cc1/lava-logs.yaml 2026-03-16 17:32:47,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:32:48,115 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:32:48,117 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b83eab0b8ad4124cec3cc1/lava_callback.json.gz 2026-03-16 17:32:48,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:32:48,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b83eab0b8ad4124cec3cc1 HTTP/1.1" 200 None 2026-03-16 17:32:48,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:32:48,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 17:32:48,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:32:48,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b83eab0b8ad4124cec3cc1 HTTP/1.1" 200 None 2026-03-16 17:32:48,180 - lava_callback - INFO - Completed processing callback for node 69b83eab0b8ad4124cec3cc1 INFO: 172.19.0.1:33314 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38990 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:33:12,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:33:12,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:44116 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44124 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60566 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60576 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34100 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44534 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48598 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38906 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59040 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41484 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41488 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45774 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33262 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:34:49,363 - lava_callback - INFO - Received callback for node 69b83d7a0b8ad4124cec3c85 INFO: 172.19.0.1:33268 - "POST /node/69b83d7a0b8ad4124cec3c85 HTTP/1.0" 202 Accepted 2026-03-16 17:34:49,371 - lava_callback - INFO - Starting async job submit for node 69b83d7a0b8ad4124cec3c85 2026-03-16 17:34:49,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:34:49,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b83d7a0b8ad4124cec3c85 HTTP/1.1" 200 None 2026-03-16 17:34:49,424 - lava_callback - DEBUG - Processing node 69b83d7a0b8ad4124cec3c85: baseline-arm64 2026-03-16 17:34:49,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:34:49,981 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:34:49,983 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b83d7a0b8ad4124cec3c85/log.txt.gz 2026-03-16 17:34:50,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:34:50,412 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:34:50,414 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b83d7a0b8ad4124cec3c85/lava-logs.yaml 2026-03-16 17:34:50,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:34:50,583 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:34:50,586 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b83d7a0b8ad4124cec3c85/lava_callback.json.gz DEBUG: Setup failed for 69b83d7a0b8ad4124cec3c85. Transitting job node result: incomplete -> fail 2026-03-16 17:34:50,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:34:50,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b83d7a0b8ad4124cec3c85 HTTP/1.1" 200 None 2026-03-16 17:34:50,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:34:50,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 17:34:50,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:34:50,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b83d7a0b8ad4124cec3c85 HTTP/1.1" 200 None 2026-03-16 17:34:50,830 - lava_callback - INFO - Completed processing callback for node 69b83d7a0b8ad4124cec3c85 INFO: 172.19.0.1:45516 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47738 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:35:12,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:35:12,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:58880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58896 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34796 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34800 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42960 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58504 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54466 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45890 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49946 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60036 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60048 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41326 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43414 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38284 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45366 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40108 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40124 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59582 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59588 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58604 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52828 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:37:54,560 - lava_callback - INFO - Received callback for node 69b59cdd1727ff69d6f265a2 INFO: 172.19.0.1:57508 - "POST /node/69b59cdd1727ff69d6f265a2 HTTP/1.0" 202 Accepted 2026-03-16 17:37:54,568 - lava_callback - INFO - Starting async job submit for node 69b59cdd1727ff69d6f265a2 2026-03-16 17:37:54,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:37:54,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b59cdd1727ff69d6f265a2 HTTP/1.1" 200 None 2026-03-16 17:37:54,593 - lava_callback - DEBUG - Processing node 69b59cdd1727ff69d6f265a2: baseline-arm64-clabbe 2026-03-16 17:37:54,593 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b59cdd1727ff69d6f265a2 2026-03-16 17:37:54,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:37:54,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b59cdd1727ff69d6f265a2 HTTP/1.1" 200 None 2026-03-16 17:37:54,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:37:54,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada1488fc97e5ba07d4d8d HTTP/1.1" 200 None 2026-03-16 17:37:54,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:37:54,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b59cdd1727ff69d6f265a2 HTTP/1.1" 200 None 2026-03-16 17:37:54,689 - lava_callback - ERROR - Error processing callback for node 69b59cdd1727ff69d6f265a2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:57510 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57778 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33570 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47698 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47706 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35344 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37772 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44962 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49734 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59130 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43324 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43328 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43084 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:39:42,856 - lava_callback - INFO - Received callback for node 69b840210b8ad4124cec3cf8 INFO: 172.19.0.1:49392 - "POST /node/69b840210b8ad4124cec3cf8 HTTP/1.0" 202 Accepted 2026-03-16 17:39:42,863 - lava_callback - INFO - Starting async job submit for node 69b840210b8ad4124cec3cf8 2026-03-16 17:39:42,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:39:42,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b840210b8ad4124cec3cf8 HTTP/1.1" 200 None 2026-03-16 17:39:42,910 - lava_callback - DEBUG - Processing node 69b840210b8ad4124cec3cf8: baseline-arm64 2026-03-16 17:39:43,046 - lava_callback - WARNING - Failed to upload log 2026-03-16 17:39:43,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:39:43,334 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:39:43,335 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b840210b8ad4124cec3cf8/lava-logs.yaml 2026-03-16 17:39:43,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:39:43,481 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:39:43,483 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b840210b8ad4124cec3cf8/lava_callback.json.gz 2026-03-16 17:39:43,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:39:43,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b840210b8ad4124cec3cf8 HTTP/1.1" 200 None 2026-03-16 17:39:43,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:39:43,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 17:39:43,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:39:43,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b840210b8ad4124cec3cf8 HTTP/1.1" 200 None 2026-03-16 17:39:43,679 - lava_callback - INFO - Completed processing callback for node 69b840210b8ad4124cec3cf8 INFO: 172.19.0.1:49396 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44918 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46686 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:40:12,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:40:12,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:35532 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35538 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33412 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33416 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42916 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43156 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38736 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53496 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53502 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41582 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41596 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50048 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37388 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48882 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55174 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40844 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59252 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59268 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49940 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53042 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46690 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55086 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40878 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33336 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33346 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55146 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38742 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36688 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44222 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52670 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51994 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37608 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37624 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33566 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46268 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60426 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55792 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35318 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34276 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34282 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42560 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42574 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39074 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60238 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41750 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58002 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58004 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46916 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51870 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52186 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35546 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41256 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53404 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53406 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39944 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34424 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38030 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33750 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46546 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42188 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42196 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58754 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42072 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35326 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47650 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49306 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39256 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39258 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45472 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41522 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54484 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44236 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35504 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40028 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40032 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:50:38,275 - lava_callback - INFO - Received callback for node 69b59fe21727ff69d6f265b0 INFO: 172.19.0.1:40036 - "POST /node/69b59fe21727ff69d6f265b0 HTTP/1.0" 202 Accepted 2026-03-16 17:50:38,280 - lava_callback - INFO - Starting async job submit for node 69b59fe21727ff69d6f265b0 2026-03-16 17:50:38,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:50:38,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b59fe21727ff69d6f265b0 HTTP/1.1" 200 None 2026-03-16 17:50:38,302 - lava_callback - DEBUG - Processing node 69b59fe21727ff69d6f265b0: baseline-arm-baylibre 2026-03-16 17:50:38,302 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b59fe21727ff69d6f265b0 2026-03-16 17:50:38,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:50:38,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b59fe21727ff69d6f265b0 HTTP/1.1" 200 None 2026-03-16 17:50:38,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:50:38,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None 2026-03-16 17:50:38,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:50:38,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b59fe21727ff69d6f265b0 HTTP/1.1" 200 None 2026-03-16 17:50:38,400 - lava_callback - ERROR - Error processing callback for node 69b59fe21727ff69d6f265b0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:52574 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58902 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41664 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33084 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33090 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:51:18,253 - lava_callback - INFO - Received callback for node 69b5a0091727ff69d6f265c3 INFO: 172.19.0.1:33094 - "POST /node/69b5a0091727ff69d6f265c3 HTTP/1.0" 202 Accepted 2026-03-16 17:51:18,258 - lava_callback - INFO - Starting async job submit for node 69b5a0091727ff69d6f265c3 2026-03-16 17:51:18,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:51:18,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5a0091727ff69d6f265c3 HTTP/1.1" 200 None 2026-03-16 17:51:18,289 - lava_callback - DEBUG - Processing node 69b5a0091727ff69d6f265c3: baseline-arm-baylibre 2026-03-16 17:51:18,289 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5a0091727ff69d6f265c3 2026-03-16 17:51:18,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:51:18,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5a0091727ff69d6f265c3 HTTP/1.1" 200 None 2026-03-16 17:51:18,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:51:18,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None 2026-03-16 17:51:18,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:51:18,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5a0091727ff69d6f265c3 HTTP/1.1" 200 None 2026-03-16 17:51:18,345 - lava_callback - ERROR - Error processing callback for node 69b5a0091727ff69d6f265c3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:41068 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52364 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52378 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50638 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:51:50,130 - lava_callback - INFO - Received callback for node 69b842f60b8ad4124cec3d59 INFO: 172.19.0.1:42936 - "POST /node/69b842f60b8ad4124cec3d59 HTTP/1.0" 202 Accepted 2026-03-16 17:51:50,137 - lava_callback - INFO - Starting async job submit for node 69b842f60b8ad4124cec3d59 2026-03-16 17:51:50,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:51:50,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b842f60b8ad4124cec3d59 HTTP/1.1" 200 None 2026-03-16 17:51:50,185 - lava_callback - DEBUG - Processing node 69b842f60b8ad4124cec3d59: baseline-arm64 2026-03-16 17:51:50,332 - lava_callback - WARNING - Failed to upload log 2026-03-16 17:51:50,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:51:50,579 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:51:50,581 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b842f60b8ad4124cec3d59/lava-logs.yaml 2026-03-16 17:51:50,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:51:50,751 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:51:50,752 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b842f60b8ad4124cec3d59/lava_callback.json.gz 2026-03-16 17:51:50,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:51:50,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b842f60b8ad4124cec3d59 HTTP/1.1" 200 None 2026-03-16 17:51:50,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:51:50,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 17:51:50,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:51:50,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b842f60b8ad4124cec3d59 HTTP/1.1" 200 None 2026-03-16 17:51:50,906 - lava_callback - INFO - Completed processing callback for node 69b842f60b8ad4124cec3d59 2026-03-16 17:51:55,112 - lava_callback - INFO - Received callback for node 69b5a02e1727ff69d6f265cc INFO: 172.19.0.1:42952 - "POST /node/69b5a02e1727ff69d6f265cc HTTP/1.0" 202 Accepted 2026-03-16 17:51:55,117 - lava_callback - INFO - Starting async job submit for node 69b5a02e1727ff69d6f265cc 2026-03-16 17:51:55,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:51:55,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5a02e1727ff69d6f265cc HTTP/1.1" 200 None 2026-03-16 17:51:55,133 - lava_callback - DEBUG - Processing node 69b5a02e1727ff69d6f265cc: baseline-arm-clabbe 2026-03-16 17:51:55,133 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5a02e1727ff69d6f265cc 2026-03-16 17:51:55,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:51:55,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5a02e1727ff69d6f265cc HTTP/1.1" 200 None 2026-03-16 17:51:55,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:51:55,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None 2026-03-16 17:51:55,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:51:55,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5a02e1727ff69d6f265cc HTTP/1.1" 200 None 2026-03-16 17:51:55,191 - lava_callback - ERROR - Error processing callback for node 69b5a02e1727ff69d6f265cc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:42954 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35904 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:52:12,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:52:12,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:40670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40674 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41034 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59992 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:52:35,141 - lava_callback - INFO - Received callback for node 69b5a0531727ff69d6f265d5 INFO: 172.19.0.1:60002 - "POST /node/69b5a0531727ff69d6f265d5 HTTP/1.0" 202 Accepted 2026-03-16 17:52:35,146 - lava_callback - INFO - Starting async job submit for node 69b5a0531727ff69d6f265d5 2026-03-16 17:52:35,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:52:35,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5a0531727ff69d6f265d5 HTTP/1.1" 200 None 2026-03-16 17:52:35,162 - lava_callback - DEBUG - Processing node 69b5a0531727ff69d6f265d5: baseline-arm-clabbe 2026-03-16 17:52:35,162 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5a0531727ff69d6f265d5 2026-03-16 17:52:35,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:52:35,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5a0531727ff69d6f265d5 HTTP/1.1" 200 None 2026-03-16 17:52:35,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:52:35,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None 2026-03-16 17:52:35,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:52:35,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5a0531727ff69d6f265d5 HTTP/1.1" 200 None 2026-03-16 17:52:35,222 - lava_callback - ERROR - Error processing callback for node 69b5a0531727ff69d6f265d5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:60010 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53224 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50812 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:53:07,187 - lava_callback - INFO - Received callback for node 69b842bd0b8ad4124cec3d51 INFO: 172.19.0.1:50822 - "POST /node/69b842bd0b8ad4124cec3d51 HTTP/1.0" 202 Accepted 2026-03-16 17:53:07,192 - lava_callback - INFO - Starting async job submit for node 69b842bd0b8ad4124cec3d51 2026-03-16 17:53:07,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:53:07,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b842bd0b8ad4124cec3d51 HTTP/1.1" 200 None 2026-03-16 17:53:07,228 - lava_callback - DEBUG - Processing node 69b842bd0b8ad4124cec3d51: baseline-arm64-broonie 2026-03-16 17:53:07,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:53:07,701 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:53:07,702 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b842bd0b8ad4124cec3d51/log.txt.gz 2026-03-16 17:53:07,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:53:08,103 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:53:08,105 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b842bd0b8ad4124cec3d51/lava-logs.yaml 2026-03-16 17:53:08,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:53:08,271 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:53:08,273 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b842bd0b8ad4124cec3d51/lava_callback.json.gz 2026-03-16 17:53:08,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:53:08,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b842bd0b8ad4124cec3d51 HTTP/1.1" 200 None 2026-03-16 17:53:08,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:53:08,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 17:53:08,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:53:08,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b842bd0b8ad4124cec3d51 HTTP/1.1" 200 None 2026-03-16 17:53:08,419 - lava_callback - INFO - Completed processing callback for node 69b842bd0b8ad4124cec3d51 2026-03-16 17:53:12,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:53:12,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:33702 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-16 17:53:15,187 - lava_callback - INFO - Received callback for node 69b5a0781727ff69d6f265de INFO: 172.19.0.1:33706 - "POST /node/69b5a0781727ff69d6f265de HTTP/1.0" 202 Accepted 2026-03-16 17:53:15,193 - lava_callback - INFO - Starting async job submit for node 69b5a0781727ff69d6f265de 2026-03-16 17:53:15,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:53:15,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5a0781727ff69d6f265de HTTP/1.1" 200 None 2026-03-16 17:53:15,208 - lava_callback - DEBUG - Processing node 69b5a0781727ff69d6f265de: baseline-arm-clabbe 2026-03-16 17:53:15,209 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5a0781727ff69d6f265de 2026-03-16 17:53:15,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:53:15,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5a0781727ff69d6f265de HTTP/1.1" 200 None 2026-03-16 17:53:15,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:53:15,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None 2026-03-16 17:53:15,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:53:15,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5a0781727ff69d6f265de HTTP/1.1" 200 None 2026-03-16 17:53:15,269 - lava_callback - ERROR - Error processing callback for node 69b5a0781727ff69d6f265de: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:33722 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55150 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44960 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44972 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49794 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:53:51,486 - lava_callback - INFO - Received callback for node 69b843960b8ad4124cec3d7c INFO: 172.19.0.1:34570 - "POST /node/69b843960b8ad4124cec3d7c HTTP/1.0" 202 Accepted 2026-03-16 17:53:51,492 - lava_callback - INFO - Starting async job submit for node 69b843960b8ad4124cec3d7c 2026-03-16 17:53:51,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:53:51,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b843960b8ad4124cec3d7c HTTP/1.1" 200 None 2026-03-16 17:53:51,517 - lava_callback - DEBUG - Processing node 69b843960b8ad4124cec3d7c: baseline-nfs-arm64 2026-03-16 17:53:51,518 - lava_callback - WARNING - Failed to upload log 2026-03-16 17:53:51,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:53:51,663 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:53:51,665 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b843960b8ad4124cec3d7c/lava-logs.yaml 2026-03-16 17:53:51,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:53:51,787 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:53:51,789 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b843960b8ad4124cec3d7c/lava_callback.json.gz 2026-03-16 17:53:51,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:53:51,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b843960b8ad4124cec3d7c HTTP/1.1" 200 None 2026-03-16 17:53:51,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:53:51,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 17:53:51,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:53:51,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b843960b8ad4124cec3d7c HTTP/1.1" 200 None 2026-03-16 17:53:51,846 - lava_callback - INFO - Completed processing callback for node 69b843960b8ad4124cec3d7c 2026-03-16 17:53:55,205 - lava_callback - INFO - Received callback for node 69b5a09d1727ff69d6f265e8 INFO: 172.19.0.1:34572 - "POST /node/69b5a09d1727ff69d6f265e8 HTTP/1.0" 202 Accepted 2026-03-16 17:53:55,210 - lava_callback - INFO - Starting async job submit for node 69b5a09d1727ff69d6f265e8 2026-03-16 17:53:55,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:53:55,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5a09d1727ff69d6f265e8 HTTP/1.1" 200 None 2026-03-16 17:53:55,227 - lava_callback - DEBUG - Processing node 69b5a09d1727ff69d6f265e8: baseline-arm-clabbe 2026-03-16 17:53:55,227 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5a09d1727ff69d6f265e8 2026-03-16 17:53:55,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:53:55,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5a09d1727ff69d6f265e8 HTTP/1.1" 200 None 2026-03-16 17:53:55,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:53:55,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None 2026-03-16 17:53:55,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:53:55,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5a09d1727ff69d6f265e8 HTTP/1.1" 200 None 2026-03-16 17:53:55,294 - lava_callback - ERROR - Error processing callback for node 69b5a09d1727ff69d6f265e8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:34580 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53002 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:54:12,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:54:12,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:53164 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-16 17:54:15,226 - lava_callback - INFO - Received callback for node 69b5a0c11727ff69d6f265f0 INFO: 172.19.0.1:53180 - "POST /node/69b5a0c11727ff69d6f265f0 HTTP/1.0" 202 Accepted 2026-03-16 17:54:15,232 - lava_callback - INFO - Starting async job submit for node 69b5a0c11727ff69d6f265f0 2026-03-16 17:54:15,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:54:15,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5a0c11727ff69d6f265f0 HTTP/1.1" 200 None 2026-03-16 17:54:15,248 - lava_callback - DEBUG - Processing node 69b5a0c11727ff69d6f265f0: baseline-arm-clabbe 2026-03-16 17:54:15,248 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5a0c11727ff69d6f265f0 2026-03-16 17:54:15,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:54:15,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5a0c11727ff69d6f265f0 HTTP/1.1" 200 None 2026-03-16 17:54:15,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:54:15,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None 2026-03-16 17:54:15,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:54:15,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5a0c11727ff69d6f265f0 HTTP/1.1" 200 None 2026-03-16 17:54:15,324 - lava_callback - ERROR - Error processing callback for node 69b5a0c11727ff69d6f265f0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:53184 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59940 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43422 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43438 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52814 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46618 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55762 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51772 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49884 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35824 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35836 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32774 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35746 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50654 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41288 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47412 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44770 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44774 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:56:44,366 - lava_callback - INFO - Received callback for node 69b844220b8ad4124cec3d92 INFO: 172.19.0.1:48674 - "POST /node/69b844220b8ad4124cec3d92 HTTP/1.0" 202 Accepted 2026-03-16 17:56:44,373 - lava_callback - INFO - Starting async job submit for node 69b844220b8ad4124cec3d92 2026-03-16 17:56:44,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:56:44,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b844220b8ad4124cec3d92 HTTP/1.1" 200 None 2026-03-16 17:56:44,424 - lava_callback - DEBUG - Processing node 69b844220b8ad4124cec3d92: baseline-arm64 2026-03-16 17:56:44,573 - lava_callback - WARNING - Failed to upload log 2026-03-16 17:56:44,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:56:44,841 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:56:44,843 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b844220b8ad4124cec3d92/lava-logs.yaml 2026-03-16 17:56:44,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:56:44,977 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:56:44,979 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b844220b8ad4124cec3d92/lava_callback.json.gz 2026-03-16 17:56:45,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:56:45,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b844220b8ad4124cec3d92 HTTP/1.1" 200 None 2026-03-16 17:56:45,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:56:45,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 17:56:45,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:56:45,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b844220b8ad4124cec3d92 HTTP/1.1" 200 None 2026-03-16 17:56:45,129 - lava_callback - INFO - Completed processing callback for node 69b844220b8ad4124cec3d92 INFO: 172.19.0.1:48690 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41766 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36304 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:57:12,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:57:12,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:42404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42408 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58050 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:57:27,365 - lava_callback - INFO - Received callback for node 69b83cf00b8ad4124cec3c78 INFO: 172.19.0.1:58060 - "POST /node/69b83cf00b8ad4124cec3c78 HTTP/1.0" 202 Accepted 2026-03-16 17:57:27,372 - lava_callback - INFO - Starting async job submit for node 69b83cf00b8ad4124cec3c78 2026-03-16 17:57:27,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:57:27,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b83cf00b8ad4124cec3c78 HTTP/1.1" 200 None 2026-03-16 17:57:27,406 - lava_callback - DEBUG - Processing node 69b83cf00b8ad4124cec3c78: baseline-arm64-broonie 2026-03-16 17:57:27,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:57:27,749 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:57:27,751 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b83cf00b8ad4124cec3c78/log.txt.gz 2026-03-16 17:57:27,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:57:28,166 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:57:28,168 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b83cf00b8ad4124cec3c78/lava-logs.yaml 2026-03-16 17:57:28,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 17:57:28,288 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 17:57:28,289 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b83cf00b8ad4124cec3c78/lava_callback.json.gz 2026-03-16 17:57:28,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:57:28,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b83cf00b8ad4124cec3c78 HTTP/1.1" 200 None 2026-03-16 17:57:28,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:57:28,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 17:57:28,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:57:28,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b83cf00b8ad4124cec3c78 HTTP/1.1" 200 None 2026-03-16 17:57:28,480 - lava_callback - INFO - Completed processing callback for node 69b83cf00b8ad4124cec3c78 INFO: 172.19.0.1:49494 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49510 - "GET / HTTP/1.0" 200 OK 2026-03-16 17:57:42,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 17:57:42,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:58650 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35064 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45076 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36516 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36306 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41436 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41446 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51812 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57372 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45248 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47318 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38654 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47314 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47318 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46504 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43942 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43210 - "GET / HTTP/1.0" 200 OK 2026-03-16 18:00:10,455 - lava_callback - INFO - Received callback for node 69b843dd0b8ad4124cec3d8c INFO: 172.19.0.1:49302 - "POST /node/69b843dd0b8ad4124cec3d8c HTTP/1.0" 202 Accepted 2026-03-16 18:00:10,462 - lava_callback - INFO - Starting async job submit for node 69b843dd0b8ad4124cec3d8c 2026-03-16 18:00:10,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:00:10,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b843dd0b8ad4124cec3d8c HTTP/1.1" 200 None 2026-03-16 18:00:10,553 - lava_callback - DEBUG - Processing node 69b843dd0b8ad4124cec3d8c: baseline-arm64 2026-03-16 18:00:10,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 18:00:11,087 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:00:11,089 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b843dd0b8ad4124cec3d8c/log.txt.gz 2026-03-16 18:00:11,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 18:00:11,522 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:00:11,525 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b843dd0b8ad4124cec3d8c/lava-logs.yaml 2026-03-16 18:00:11,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 18:00:11,723 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:00:11,725 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b843dd0b8ad4124cec3d8c/lava_callback.json.gz DEBUG: Setup failed for 69b843dd0b8ad4124cec3d8c. Transitting job node result: incomplete -> fail 2026-03-16 18:00:11,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:00:11,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b843dd0b8ad4124cec3d8c HTTP/1.1" 200 None 2026-03-16 18:00:11,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:00:11,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 18:00:11,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:00:11,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b843dd0b8ad4124cec3d8c HTTP/1.1" 200 None 2026-03-16 18:00:11,942 - lava_callback - INFO - Completed processing callback for node 69b843dd0b8ad4124cec3d8c 2026-03-16 18:00:12,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:00:12,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:49316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49332 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42470 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43704 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43716 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41528 - "GET / HTTP/1.0" 200 OK 2026-03-16 18:00:50,651 - lava_callback - INFO - Received callback for node 69b844fd0b8ad4124cec3dba INFO: 172.19.0.1:34892 - "POST /node/69b844fd0b8ad4124cec3dba HTTP/1.0" 202 Accepted 2026-03-16 18:00:50,657 - lava_callback - INFO - Starting async job submit for node 69b844fd0b8ad4124cec3dba 2026-03-16 18:00:50,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:00:50,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b844fd0b8ad4124cec3dba HTTP/1.1" 200 None 2026-03-16 18:00:50,708 - lava_callback - DEBUG - Processing node 69b844fd0b8ad4124cec3dba: baseline-arm64 2026-03-16 18:00:50,911 - lava_callback - WARNING - Failed to upload log 2026-03-16 18:00:51,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 18:00:51,202 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:00:51,204 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b844fd0b8ad4124cec3dba/lava-logs.yaml 2026-03-16 18:00:51,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 18:00:51,346 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:00:51,348 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b844fd0b8ad4124cec3dba/lava_callback.json.gz 2026-03-16 18:00:51,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:00:51,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b844fd0b8ad4124cec3dba HTTP/1.1" 200 None 2026-03-16 18:00:51,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:00:51,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 18:00:51,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:00:51,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b844fd0b8ad4124cec3dba HTTP/1.1" 200 None 2026-03-16 18:00:51,524 - lava_callback - INFO - Completed processing callback for node 69b844fd0b8ad4124cec3dba INFO: 172.19.0.1:34902 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49634 - "GET / HTTP/1.0" 200 OK 2026-03-16 18:01:12,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:01:12,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:35020 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35032 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37946 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38232 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38246 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52994 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38072 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52922 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52358 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52366 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60058 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60228 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60244 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45650 - "GET / HTTP/1.0" 200 OK 2026-03-16 18:02:47,869 - lava_callback - INFO - Received callback for node 69b8419f0b8ad4124cec3d25 INFO: 172.19.0.1:45656 - "POST /node/69b8419f0b8ad4124cec3d25 HTTP/1.0" 202 Accepted 2026-03-16 18:02:47,876 - lava_callback - INFO - Starting async job submit for node 69b8419f0b8ad4124cec3d25 2026-03-16 18:02:47,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:02:47,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8419f0b8ad4124cec3d25 HTTP/1.1" 200 None 2026-03-16 18:02:47,951 - lava_callback - DEBUG - Processing node 69b8419f0b8ad4124cec3d25: ltp-smoke 2026-03-16 18:02:48,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 18:02:48,613 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:02:48,615 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69b8419f0b8ad4124cec3d25/log.txt.gz 2026-03-16 18:02:48,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 18:02:49,183 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:02:49,185 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69b8419f0b8ad4124cec3d25/lava-logs.yaml 2026-03-16 18:02:49,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 18:02:49,372 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:02:49,374 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69b8419f0b8ad4124cec3d25/lava_callback.json.gz 2026-03-16 18:02:49,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:02:49,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8419f0b8ad4124cec3d25 HTTP/1.1" 200 None 2026-03-16 18:02:49,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:02:49,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d3d0b8ad4124cec355d HTTP/1.1" 200 None 2026-03-16 18:02:49,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:02:49,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8419f0b8ad4124cec3d25 HTTP/1.1" 200 None 2026-03-16 18:02:49,712 - lava_callback - INFO - Completed processing callback for node 69b8419f0b8ad4124cec3d25 INFO: 172.19.0.1:33338 - "GET / HTTP/1.0" 200 OK 2026-03-16 18:03:04,266 - lava_callback - INFO - Received callback for node 69b841ee0b8ad4124cec3d31 INFO: 172.19.0.1:52294 - "POST /node/69b841ee0b8ad4124cec3d31 HTTP/1.0" 202 Accepted 2026-03-16 18:03:04,275 - lava_callback - INFO - Starting async job submit for node 69b841ee0b8ad4124cec3d31 2026-03-16 18:03:04,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:03:04,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b841ee0b8ad4124cec3d31 HTTP/1.1" 200 None 2026-03-16 18:03:04,384 - lava_callback - DEBUG - Processing node 69b841ee0b8ad4124cec3d31: baseline-arm 2026-03-16 18:03:05,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 18:03:05,279 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:03:05,281 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b841ee0b8ad4124cec3d31/log.txt.gz 2026-03-16 18:03:05,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 18:03:05,965 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:03:05,967 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b841ee0b8ad4124cec3d31/lava-logs.yaml 2026-03-16 18:03:05,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 18:03:06,195 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:03:06,197 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b841ee0b8ad4124cec3d31/lava_callback.json.gz DEBUG: Setup failed for 69b841ee0b8ad4124cec3d31. Transitting job node result: incomplete -> fail 2026-03-16 18:03:06,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:03:06,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b841ee0b8ad4124cec3d31 HTTP/1.1" 200 None 2026-03-16 18:03:06,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:03:06,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None 2026-03-16 18:03:06,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:03:06,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b841ee0b8ad4124cec3d31 HTTP/1.1" 200 None INFO: 172.19.0.1:52298 - "GET / HTTP/1.0" 200 OK 2026-03-16 18:03:06,558 - lava_callback - INFO - Completed processing callback for node 69b841ee0b8ad4124cec3d31 2026-03-16 18:03:12,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:03:12,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:60296 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60300 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56290 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33708 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33710 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37118 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58184 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38288 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42444 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44782 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44794 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33932 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40240 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45216 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42854 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40472 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55730 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55738 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51756 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36606 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39726 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49086 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49096 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50590 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39412 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39428 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42974 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52070 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44080 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34402 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47590 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56772 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56786 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42732 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43838 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38652 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38396 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52074 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49282 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49284 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37048 - "GET / HTTP/1.0" 200 OK 2026-03-16 18:08:48,076 - lava_callback - INFO - Received callback for node 69b846760b8ad4124cec63f2 INFO: 172.19.0.1:37050 - "POST /node/69b846760b8ad4124cec63f2 HTTP/1.0" 202 Accepted 2026-03-16 18:08:48,082 - lava_callback - INFO - Starting async job submit for node 69b846760b8ad4124cec63f2 2026-03-16 18:08:48,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:08:48,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b846760b8ad4124cec63f2 HTTP/1.1" 200 None 2026-03-16 18:08:48,117 - lava_callback - DEBUG - Processing node 69b846760b8ad4124cec63f2: baseline-arm64-broonie 2026-03-16 18:08:48,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 18:08:48,605 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:08:48,607 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b846760b8ad4124cec63f2/log.txt.gz 2026-03-16 18:08:48,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 18:08:49,008 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:08:49,010 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b846760b8ad4124cec63f2/lava-logs.yaml 2026-03-16 18:08:49,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 18:08:49,174 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:08:49,176 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b846760b8ad4124cec63f2/lava_callback.json.gz 2026-03-16 18:08:49,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:08:49,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b846760b8ad4124cec63f2 HTTP/1.1" 200 None 2026-03-16 18:08:49,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:08:49,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 18:08:49,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:08:49,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b846760b8ad4124cec63f2 HTTP/1.1" 200 None 2026-03-16 18:08:49,360 - lava_callback - INFO - Completed processing callback for node 69b846760b8ad4124cec63f2 INFO: 172.19.0.1:55610 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45918 - "GET / HTTP/1.0" 200 OK 2026-03-16 18:09:12,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:09:12,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:52612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52620 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54430 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41894 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41898 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51796 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50014 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37372 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38114 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38128 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46124 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43104 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43112 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53532 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51796 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59244 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36992 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57826 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56258 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56260 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57946 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45382 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55282 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51268 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51278 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41878 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58688 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58698 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50576 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57928 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50990 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46882 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46886 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51202 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56220 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56230 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50772 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47236 - "GET / HTTP/1.0" 200 OK 2026-03-16 18:14:04,481 - lava_callback - INFO - Received callback for node 69b83f910b8ad4124cec3ce3 INFO: 172.19.0.1:57784 - "POST /node/69b83f910b8ad4124cec3ce3 HTTP/1.0" 202 Accepted 2026-03-16 18:14:04,488 - lava_callback - INFO - Starting async job submit for node 69b83f910b8ad4124cec3ce3 2026-03-16 18:14:04,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:14:04,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b83f910b8ad4124cec3ce3 HTTP/1.1" 200 None 2026-03-16 18:14:04,529 - lava_callback - DEBUG - Processing node 69b83f910b8ad4124cec3ce3: baseline-nfs-arm64 2026-03-16 18:14:05,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 18:14:05,237 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:14:05,239 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b83f910b8ad4124cec3ce3/log.txt.gz 2026-03-16 18:14:05,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 18:14:05,720 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:14:05,722 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b83f910b8ad4124cec3ce3/lava-logs.yaml 2026-03-16 18:14:05,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 18:14:05,905 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:14:05,907 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b83f910b8ad4124cec3ce3/lava_callback.json.gz 2026-03-16 18:14:05,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:14:05,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b83f910b8ad4124cec3ce3 HTTP/1.1" 200 None 2026-03-16 18:14:05,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:14:05,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 18:14:05,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:14:06,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b83f910b8ad4124cec3ce3 HTTP/1.1" 200 None 2026-03-16 18:14:06,078 - lava_callback - INFO - Completed processing callback for node 69b83f910b8ad4124cec3ce3 INFO: 172.19.0.1:57792 - "GET / HTTP/1.0" 200 OK 2026-03-16 18:14:12,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:14:12,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:57796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57806 - "GET / HTTP/1.0" 200 OK 2026-03-16 18:14:23,011 - lava_callback - INFO - Received callback for node 69b846b40b8ad4124cec63f7 INFO: 172.19.0.1:40602 - "POST /node/69b846b40b8ad4124cec63f7 HTTP/1.0" 202 Accepted 2026-03-16 18:14:23,019 - lava_callback - INFO - Starting async job submit for node 69b846b40b8ad4124cec63f7 2026-03-16 18:14:23,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:14:23,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b846b40b8ad4124cec63f7 HTTP/1.1" 200 None 2026-03-16 18:14:23,095 - lava_callback - DEBUG - Processing node 69b846b40b8ad4124cec63f7: baseline-arm64 2026-03-16 18:14:23,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 18:14:23,629 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:14:23,630 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b846b40b8ad4124cec63f7/log.txt.gz 2026-03-16 18:14:23,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 18:14:24,093 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:14:24,095 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b846b40b8ad4124cec63f7/lava-logs.yaml 2026-03-16 18:14:24,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 18:14:24,266 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:14:24,268 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b846b40b8ad4124cec63f7/lava_callback.json.gz DEBUG: Setup failed for 69b846b40b8ad4124cec63f7. Transitting job node result: incomplete -> fail 2026-03-16 18:14:24,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:14:24,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b846b40b8ad4124cec63f7 HTTP/1.1" 200 None 2026-03-16 18:14:24,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:14:24,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 18:14:24,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:14:24,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b846b40b8ad4124cec63f7 HTTP/1.1" 200 None 2026-03-16 18:14:24,495 - lava_callback - INFO - Completed processing callback for node 69b846b40b8ad4124cec63f7 INFO: 172.19.0.1:40610 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49364 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49374 - "GET / HTTP/1.0" 200 OK 2026-03-16 18:14:42,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:14:42,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:55348 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47060 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49748 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34642 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34654 - "GET / HTTP/1.0" 200 OK 2026-03-16 18:15:17,988 - lava_callback - INFO - Received callback for node 69b83fd80b8ad4124cec3cea INFO: 172.19.0.1:34656 - "POST /node/69b83fd80b8ad4124cec3cea HTTP/1.0" 202 Accepted 2026-03-16 18:15:17,995 - lava_callback - INFO - Starting async job submit for node 69b83fd80b8ad4124cec3cea 2026-03-16 18:15:18,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:15:18,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b83fd80b8ad4124cec3cea HTTP/1.1" 200 None 2026-03-16 18:15:18,043 - lava_callback - DEBUG - Processing node 69b83fd80b8ad4124cec3cea: baseline-arm64 2026-03-16 18:15:18,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 18:15:18,706 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:15:18,708 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b83fd80b8ad4124cec3cea/log.txt.gz 2026-03-16 18:15:18,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 18:15:19,185 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:15:19,187 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b83fd80b8ad4124cec3cea/lava-logs.yaml 2026-03-16 18:15:19,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 18:15:19,343 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:15:19,345 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b83fd80b8ad4124cec3cea/lava_callback.json.gz 2026-03-16 18:15:19,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:15:19,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b83fd80b8ad4124cec3cea HTTP/1.1" 200 None 2026-03-16 18:15:19,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:15:19,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 18:15:19,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:15:19,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b83fd80b8ad4124cec3cea HTTP/1.1" 200 None 2026-03-16 18:15:19,513 - lava_callback - INFO - Completed processing callback for node 69b83fd80b8ad4124cec3cea INFO: 172.19.0.1:38978 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49940 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49950 - "GET / HTTP/1.0" 200 OK 2026-03-16 18:15:42,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:15:42,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:50620 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59096 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33438 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34558 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39596 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33558 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33568 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50920 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35052 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43380 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39434 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54980 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51670 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51674 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52604 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51818 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54462 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50632 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53078 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59834 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59836 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60074 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50210 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58344 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59764 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58576 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44198 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44210 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37740 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52386 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36000 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37440 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36038 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56034 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56038 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38054 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37116 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47850 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33740 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41136 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55182 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55190 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46168 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47642 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57716 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55922 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33516 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51678 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51694 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51324 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34834 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59888 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51262 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46752 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45162 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45178 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40306 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47592 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39826 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48022 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48030 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41558 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48954 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48962 - "GET / HTTP/1.0" 200 OK 2026-03-16 18:24:39,779 - lava_callback - INFO - Received callback for node 69b846fa0b8ad4124cec6401 INFO: 172.19.0.1:44714 - "POST /node/69b846fa0b8ad4124cec6401 HTTP/1.0" 202 Accepted 2026-03-16 18:24:39,786 - lava_callback - INFO - Starting async job submit for node 69b846fa0b8ad4124cec6401 2026-03-16 18:24:39,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:24:39,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b846fa0b8ad4124cec6401 HTTP/1.1" 200 None 2026-03-16 18:24:39,854 - lava_callback - DEBUG - Processing node 69b846fa0b8ad4124cec6401: baseline-arm 2026-03-16 18:24:40,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 18:24:40,565 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:24:40,566 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b846fa0b8ad4124cec6401/log.txt.gz 2026-03-16 18:24:40,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 18:24:41,175 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:24:41,177 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b846fa0b8ad4124cec6401/lava-logs.yaml 2026-03-16 18:24:41,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 18:24:41,359 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:24:41,360 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b846fa0b8ad4124cec6401/lava_callback.json.gz DEBUG: Setup failed for 69b846fa0b8ad4124cec6401. Transitting job node result: incomplete -> fail 2026-03-16 18:24:41,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:24:41,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b846fa0b8ad4124cec6401 HTTP/1.1" 200 None 2026-03-16 18:24:41,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:24:41,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None 2026-03-16 18:24:41,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:24:41,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b846fa0b8ad4124cec6401 HTTP/1.1" 200 None 2026-03-16 18:24:41,670 - lava_callback - INFO - Completed processing callback for node 69b846fa0b8ad4124cec6401 2026-03-16 18:24:42,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:24:42,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:44716 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49294 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38574 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47036 - "GET / HTTP/1.0" 200 OK 2026-03-16 18:25:22,021 - lava_callback - INFO - Received callback for node 69b848790b8ad4124cec6421 INFO: 172.19.0.1:35386 - "POST /node/69b848790b8ad4124cec6421 HTTP/1.0" 202 Accepted 2026-03-16 18:25:22,027 - lava_callback - INFO - Starting async job submit for node 69b848790b8ad4124cec6421 2026-03-16 18:25:22,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:25:22,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b848790b8ad4124cec6421 HTTP/1.1" 200 None 2026-03-16 18:25:22,069 - lava_callback - DEBUG - Processing node 69b848790b8ad4124cec6421: baseline-nfs-arm64 2026-03-16 18:25:22,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 18:25:22,725 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:25:22,727 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b848790b8ad4124cec6421/log.txt.gz 2026-03-16 18:25:23,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 18:25:23,247 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:25:23,249 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b848790b8ad4124cec6421/lava-logs.yaml 2026-03-16 18:25:23,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 18:25:23,409 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:25:23,410 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b848790b8ad4124cec6421/lava_callback.json.gz 2026-03-16 18:25:23,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:25:23,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b848790b8ad4124cec6421 HTTP/1.1" 200 None 2026-03-16 18:25:23,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:25:23,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 18:25:23,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:25:23,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b848790b8ad4124cec6421 HTTP/1.1" 200 None 2026-03-16 18:25:23,553 - lava_callback - INFO - Completed processing callback for node 69b848790b8ad4124cec6421 INFO: 172.19.0.1:35398 - "GET / HTTP/1.0" 200 OK 2026-03-16 18:25:28,948 - lava_callback - INFO - Received callback for node 69b845ae0b8ad4124cec3ddd INFO: 172.19.0.1:35400 - "POST /node/69b845ae0b8ad4124cec3ddd HTTP/1.0" 202 Accepted 2026-03-16 18:25:28,954 - lava_callback - INFO - Starting async job submit for node 69b845ae0b8ad4124cec3ddd 2026-03-16 18:25:28,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:25:28,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b845ae0b8ad4124cec3ddd HTTP/1.1" 200 None 2026-03-16 18:25:28,993 - lava_callback - DEBUG - Processing node 69b845ae0b8ad4124cec3ddd: baseline-arm64-broonie 2026-03-16 18:25:29,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 18:25:29,507 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:25:29,509 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b845ae0b8ad4124cec3ddd/log.txt.gz 2026-03-16 18:25:29,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 18:25:29,917 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:25:29,920 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b845ae0b8ad4124cec3ddd/lava-logs.yaml 2026-03-16 18:25:29,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 18:25:30,079 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:25:30,080 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b845ae0b8ad4124cec3ddd/lava_callback.json.gz 2026-03-16 18:25:30,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:25:30,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b845ae0b8ad4124cec3ddd HTTP/1.1" 200 None 2026-03-16 18:25:30,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:25:30,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 18:25:30,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:25:30,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b845ae0b8ad4124cec3ddd HTTP/1.1" 200 None 2026-03-16 18:25:30,248 - lava_callback - INFO - Completed processing callback for node 69b845ae0b8ad4124cec3ddd INFO: 172.19.0.1:47908 - "GET / HTTP/1.0" 200 OK 2026-03-16 18:25:30,632 - lava_callback - INFO - Received callback for node 69b846f80b8ad4124cec63fe INFO: 172.19.0.1:47912 - "POST /node/69b846f80b8ad4124cec63fe HTTP/1.0" 202 Accepted 2026-03-16 18:25:30,638 - lava_callback - INFO - Starting async job submit for node 69b846f80b8ad4124cec63fe 2026-03-16 18:25:30,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:25:30,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b846f80b8ad4124cec63fe HTTP/1.1" 200 None 2026-03-16 18:25:30,712 - lava_callback - DEBUG - Processing node 69b846f80b8ad4124cec63fe: ltp-smoke 2026-03-16 18:25:31,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 18:25:31,336 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:25:31,338 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69b846f80b8ad4124cec63fe/log.txt.gz 2026-03-16 18:25:31,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 18:25:31,810 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:25:31,812 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69b846f80b8ad4124cec63fe/lava-logs.yaml 2026-03-16 18:25:31,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 18:25:31,976 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:25:31,979 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69b846f80b8ad4124cec63fe/lava_callback.json.gz 2026-03-16 18:25:32,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:25:32,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b846f80b8ad4124cec63fe HTTP/1.1" 200 None 2026-03-16 18:25:32,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:25:32,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d3d0b8ad4124cec355d HTTP/1.1" 200 None 2026-03-16 18:25:32,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:25:32,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b846f80b8ad4124cec63fe HTTP/1.1" 200 None 2026-03-16 18:25:32,273 - lava_callback - INFO - Completed processing callback for node 69b846f80b8ad4124cec63fe INFO: 172.19.0.1:47916 - "GET / HTTP/1.0" 200 OK 2026-03-16 18:25:42,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:25:42,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:44568 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36134 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58634 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37490 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34858 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34868 - "GET / HTTP/1.0" 200 OK 2026-03-16 18:26:45,224 - lava_callback - INFO - Received callback for node 69b848c30b8ad4124cec642f INFO: 172.19.0.1:59426 - "POST /node/69b848c30b8ad4124cec642f HTTP/1.0" 202 Accepted 2026-03-16 18:26:45,231 - lava_callback - INFO - Starting async job submit for node 69b848c30b8ad4124cec642f 2026-03-16 18:26:45,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:26:45,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b848c30b8ad4124cec642f HTTP/1.1" 200 None 2026-03-16 18:26:45,274 - lava_callback - DEBUG - Processing node 69b848c30b8ad4124cec642f: baseline-arm64 2026-03-16 18:26:45,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 18:26:45,988 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:26:45,990 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b848c30b8ad4124cec642f/log.txt.gz 2026-03-16 18:26:46,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 18:26:46,457 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:26:46,459 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b848c30b8ad4124cec642f/lava-logs.yaml 2026-03-16 18:26:46,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.19.0.1:59440 - "GET / HTTP/1.0" 200 OK 2026-03-16 18:26:46,648 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:26:46,650 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b848c30b8ad4124cec642f/lava_callback.json.gz 2026-03-16 18:26:46,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:26:46,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b848c30b8ad4124cec642f HTTP/1.1" 200 None 2026-03-16 18:26:46,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:26:46,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 18:26:46,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:26:46,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b848c30b8ad4124cec642f HTTP/1.1" 200 None 2026-03-16 18:26:46,783 - lava_callback - INFO - Completed processing callback for node 69b848c30b8ad4124cec642f INFO: 172.19.0.1:37034 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59920 - "GET / HTTP/1.0" 200 OK 2026-03-16 18:27:12,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:27:12,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:55256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55260 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36490 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45620 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45630 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60226 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52826 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39572 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56284 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44790 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55304 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55318 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51862 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58410 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36484 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50200 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48416 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50254 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50262 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34698 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53196 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56764 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56502 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58546 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52132 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52138 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49794 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38888 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44354 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49658 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37572 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34804 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34808 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39830 - "GET / HTTP/1.0" 200 OK 2026-03-16 18:31:49,957 - lava_callback - INFO - Received callback for node 69b842690b8ad4124cec3d45 INFO: 172.19.0.1:36314 - "POST /node/69b842690b8ad4124cec3d45 HTTP/1.0" 202 Accepted 2026-03-16 18:31:49,965 - lava_callback - INFO - Starting async job submit for node 69b842690b8ad4124cec3d45 2026-03-16 18:31:50,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:31:50,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b842690b8ad4124cec3d45 HTTP/1.1" 200 None 2026-03-16 18:31:50,029 - lava_callback - DEBUG - Processing node 69b842690b8ad4124cec3d45: baseline-nfs-arm64 2026-03-16 18:31:51,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 18:31:51,381 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:31:51,383 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b842690b8ad4124cec3d45/log.txt.gz 2026-03-16 18:31:52,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 18:31:52,287 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:31:52,289 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b842690b8ad4124cec3d45/lava-logs.yaml 2026-03-16 18:31:52,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 18:31:52,513 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:31:52,515 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b842690b8ad4124cec3d45/lava_callback.json.gz DEBUG: Setup failed for 69b842690b8ad4124cec3d45. Transitting job node result: incomplete -> fail 2026-03-16 18:31:52,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:31:52,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b842690b8ad4124cec3d45 HTTP/1.1" 200 None 2026-03-16 18:31:52,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:31:52,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 18:31:52,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:31:52,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b842690b8ad4124cec3d45 HTTP/1.1" 200 None 2026-03-16 18:31:52,784 - lava_callback - INFO - Completed processing callback for node 69b842690b8ad4124cec3d45 INFO: 172.19.0.1:36330 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34004 - "GET / HTTP/1.0" 200 OK 2026-03-16 18:32:12,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:32:12,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-16 18:32:14,287 - lava_callback - INFO - Received callback for node 69b8421f0b8ad4124cec3d3e INFO: 172.19.0.1:60350 - "POST /node/69b8421f0b8ad4124cec3d3e HTTP/1.0" 202 Accepted 2026-03-16 18:32:14,296 - lava_callback - INFO - Starting async job submit for node 69b8421f0b8ad4124cec3d3e 2026-03-16 18:32:14,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:32:14,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8421f0b8ad4124cec3d3e HTTP/1.1" 200 None 2026-03-16 18:32:14,369 - lava_callback - DEBUG - Processing node 69b8421f0b8ad4124cec3d3e: baseline-nfs-arm64 INFO: 172.19.0.1:60364 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-16 18:32:15,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 18:32:15,724 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:32:15,726 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8421f0b8ad4124cec3d3e/log.txt.gz 2026-03-16 18:32:16,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.19.0.1:60366 - "GET / HTTP/1.0" 200 OK 2026-03-16 18:32:16,587 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:32:16,589 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8421f0b8ad4124cec3d3e/lava-logs.yaml 2026-03-16 18:32:16,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 18:32:16,777 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:32:16,779 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b8421f0b8ad4124cec3d3e/lava_callback.json.gz DEBUG: Setup failed for 69b8421f0b8ad4124cec3d3e. Transitting job node result: incomplete -> fail 2026-03-16 18:32:16,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:32:16,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8421f0b8ad4124cec3d3e HTTP/1.1" 200 None 2026-03-16 18:32:16,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:32:16,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 18:32:16,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:32:16,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8421f0b8ad4124cec3d3e HTTP/1.1" 200 None 2026-03-16 18:32:17,040 - lava_callback - INFO - Completed processing callback for node 69b8421f0b8ad4124cec3d3e INFO: 172.19.0.1:58866 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50922 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50938 - "GET / HTTP/1.0" 200 OK 2026-03-16 18:32:42,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:32:42,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:55978 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57814 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39840 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39002 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33822 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57106 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57120 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45418 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50456 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57828 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44212 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44226 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43078 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38672 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38682 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40210 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45704 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53732 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53526 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38430 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44800 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44812 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43456 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60860 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35060 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34722 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34734 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57898 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44174 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44178 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53120 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38658 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40906 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51384 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38680 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38656 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38672 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42942 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45966 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55874 - "GET / HTTP/1.0" 200 OK 2026-03-16 18:38:10,838 - lava_callback - INFO - Received callback for node 69b84b1e0b8ad4124cec6450 INFO: 172.19.0.1:39710 - "POST /node/69b84b1e0b8ad4124cec6450 HTTP/1.0" 202 Accepted 2026-03-16 18:38:10,845 - lava_callback - INFO - Starting async job submit for node 69b84b1e0b8ad4124cec6450 2026-03-16 18:38:10,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:38:10,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b84b1e0b8ad4124cec6450 HTTP/1.1" 200 None 2026-03-16 18:38:10,912 - lava_callback - DEBUG - Processing node 69b84b1e0b8ad4124cec6450: baseline-nfs-arm64 2026-03-16 18:38:11,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 18:38:11,600 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:38:11,602 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b84b1e0b8ad4124cec6450/log.txt.gz 2026-03-16 18:38:11,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 18:38:12,097 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:38:12,099 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b84b1e0b8ad4124cec6450/lava-logs.yaml 2026-03-16 18:38:12,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 18:38:12,277 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:38:12,278 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b84b1e0b8ad4124cec6450/lava_callback.json.gz 2026-03-16 18:38:12,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:38:12,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b84b1e0b8ad4124cec6450 HTTP/1.1" 200 None 2026-03-16 18:38:12,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:38:12,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 18:38:12,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:38:12,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b84b1e0b8ad4124cec6450 HTTP/1.1" 200 None 2026-03-16 18:38:12,430 - lava_callback - INFO - Completed processing callback for node 69b84b1e0b8ad4124cec6450 2026-03-16 18:38:12,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:38:12,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:39712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39720 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42652 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46000 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46010 - "GET / HTTP/1.0" 200 OK 2026-03-16 18:38:39,699 - lava_callback - INFO - Received callback for node 69b84ba80b8ad4124cec6466 INFO: 172.19.0.1:55924 - "POST /node/69b84ba80b8ad4124cec6466 HTTP/1.0" 202 Accepted 2026-03-16 18:38:39,706 - lava_callback - INFO - Starting async job submit for node 69b84ba80b8ad4124cec6466 2026-03-16 18:38:39,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:38:39,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b84ba80b8ad4124cec6466 HTTP/1.1" 200 None 2026-03-16 18:38:39,746 - lava_callback - DEBUG - Processing node 69b84ba80b8ad4124cec6466: baseline-arm64 2026-03-16 18:38:40,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 18:38:40,373 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:38:40,375 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b84ba80b8ad4124cec6466/log.txt.gz 2026-03-16 18:38:40,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 18:38:40,821 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:38:40,823 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b84ba80b8ad4124cec6466/lava-logs.yaml 2026-03-16 18:38:40,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 18:38:41,041 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:38:41,043 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b84ba80b8ad4124cec6466/lava_callback.json.gz 2026-03-16 18:38:41,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:38:41,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b84ba80b8ad4124cec6466 HTTP/1.1" 200 None 2026-03-16 18:38:41,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:38:41,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 18:38:41,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:38:41,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b84ba80b8ad4124cec6466 HTTP/1.1" 200 None 2026-03-16 18:38:41,217 - lava_callback - INFO - Completed processing callback for node 69b84ba80b8ad4124cec6466 2026-03-16 18:38:42,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:38:42,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:55932 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57134 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48914 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47012 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47018 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48778 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50060 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50076 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41314 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58152 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37980 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59162 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58766 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55230 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55244 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43816 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58398 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34466 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42456 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42468 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42704 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60156 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60164 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40650 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49182 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36210 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41214 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60558 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37534 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37536 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38258 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53612 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56594 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57232 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38078 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55646 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55656 - "GET / HTTP/1.0" 200 OK 2026-03-16 18:43:45,970 - lava_callback - INFO - Received callback for node 69b81942113612b7716bc9e9 INFO: 172.19.0.1:54824 - "POST /node/69b81942113612b7716bc9e9 HTTP/1.0" 202 Accepted 2026-03-16 18:43:45,976 - lava_callback - INFO - Starting async job submit for node 69b81942113612b7716bc9e9 2026-03-16 18:43:45,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:43:46,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81942113612b7716bc9e9 HTTP/1.1" 200 None 2026-03-16 18:43:46,033 - lava_callback - DEBUG - Processing node 69b81942113612b7716bc9e9: baseline-arm64 2026-03-16 18:43:46,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.19.0.1:54840 - "GET / HTTP/1.0" 200 OK 2026-03-16 18:43:46,547 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:43:46,549 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b81942113612b7716bc9e9/log.txt.gz 2026-03-16 18:43:46,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 18:43:46,966 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:43:46,968 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b81942113612b7716bc9e9/lava-logs.yaml 2026-03-16 18:43:46,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 18:43:47,131 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:43:47,133 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b81942113612b7716bc9e9/lava_callback.json.gz 2026-03-16 18:43:47,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:43:47,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81942113612b7716bc9e9 HTTP/1.1" 200 None 2026-03-16 18:43:47,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:43:47,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 18:43:47,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:43:47,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b81942113612b7716bc9e9 HTTP/1.1" 200 None 2026-03-16 18:43:47,238 - lava_callback - INFO - Completed processing callback for node 69b81942113612b7716bc9e9 INFO: 172.19.0.1:44772 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41060 - "GET / HTTP/1.0" 200 OK 2026-03-16 18:44:12,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:44:12,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:34752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34754 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38512 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56068 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56082 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38040 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43222 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50918 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39192 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39200 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40794 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35824 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35826 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38718 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53016 - "GET / HTTP/1.0" 200 OK 2026-03-16 18:46:01,756 - lava_callback - INFO - Received callback for node 69b81953113612b7716bca28 INFO: 172.19.0.1:45158 - "POST /node/69b81953113612b7716bca28 HTTP/1.0" 202 Accepted 2026-03-16 18:46:01,763 - lava_callback - INFO - Starting async job submit for node 69b81953113612b7716bca28 2026-03-16 18:46:01,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:46:01,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81953113612b7716bca28 HTTP/1.1" 200 None 2026-03-16 18:46:01,797 - lava_callback - DEBUG - Processing node 69b81953113612b7716bca28: baseline-nfs-arm64 2026-03-16 18:46:02,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 18:46:02,350 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:46:02,352 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b81953113612b7716bca28/log.txt.gz 2026-03-16 18:46:02,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 18:46:02,856 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:46:02,858 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b81953113612b7716bca28/lava-logs.yaml 2026-03-16 18:46:02,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 18:46:03,042 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:46:03,044 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b81953113612b7716bca28/lava_callback.json.gz 2026-03-16 18:46:03,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:46:03,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81953113612b7716bca28 HTTP/1.1" 200 None 2026-03-16 18:46:03,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:46:03,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 18:46:03,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:46:03,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b81953113612b7716bca28 HTTP/1.1" 200 None 2026-03-16 18:46:03,192 - lava_callback - INFO - Completed processing callback for node 69b81953113612b7716bca28 INFO: 172.19.0.1:45170 - "GET / HTTP/1.0" 200 OK 2026-03-16 18:46:12,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:46:12,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:60354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60366 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53978 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38850 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38858 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47086 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60588 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41008 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56322 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58330 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41524 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41534 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57706 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40592 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60360 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39508 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54858 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34110 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34112 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48476 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48120 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58822 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41710 - "GET / HTTP/1.0" 200 OK 2026-03-16 18:49:22,782 - lava_callback - INFO - Received callback for node 69b835b70b8ad4124cec3901 INFO: 172.19.0.1:35730 - "POST /node/69b835b70b8ad4124cec3901 HTTP/1.0" 202 Accepted 2026-03-16 18:49:22,789 - lava_callback - INFO - Starting async job submit for node 69b835b70b8ad4124cec3901 2026-03-16 18:49:22,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:49:22,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835b70b8ad4124cec3901 HTTP/1.1" 200 None 2026-03-16 18:49:22,826 - lava_callback - DEBUG - Processing node 69b835b70b8ad4124cec3901: baseline-arm64 2026-03-16 18:49:23,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 18:49:23,339 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:49:23,341 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b835b70b8ad4124cec3901/log.txt.gz 2026-03-16 18:49:23,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 18:49:23,746 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:49:23,748 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b835b70b8ad4124cec3901/lava-logs.yaml 2026-03-16 18:49:23,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 18:49:23,892 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:49:23,894 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b835b70b8ad4124cec3901/lava_callback.json.gz 2026-03-16 18:49:23,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:49:23,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835b70b8ad4124cec3901 HTTP/1.1" 200 None 2026-03-16 18:49:23,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:49:23,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 18:49:23,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:49:23,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b835b70b8ad4124cec3901 HTTP/1.1" 200 None 2026-03-16 18:49:23,992 - lava_callback - INFO - Completed processing callback for node 69b835b70b8ad4124cec3901 INFO: 172.19.0.1:35734 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36692 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36698 - "GET / HTTP/1.0" 200 OK 2026-03-16 18:49:42,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:49:42,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:56328 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41104 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34642 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46488 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53516 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53198 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53208 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48022 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37504 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51840 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56812 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35556 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38034 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38050 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43426 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48086 - "GET / HTTP/1.0" 200 OK 2026-03-16 18:52:06,064 - lava_callback - INFO - Received callback for node 69b835c80b8ad4124cec3942 INFO: 172.19.0.1:43524 - "POST /node/69b835c80b8ad4124cec3942 HTTP/1.0" 202 Accepted 2026-03-16 18:52:06,070 - lava_callback - INFO - Starting async job submit for node 69b835c80b8ad4124cec3942 2026-03-16 18:52:06,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:52:06,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835c80b8ad4124cec3942 HTTP/1.1" 200 None 2026-03-16 18:52:06,104 - lava_callback - DEBUG - Processing node 69b835c80b8ad4124cec3942: baseline-nfs-arm64 2026-03-16 18:52:06,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.19.0.1:43534 - "GET / HTTP/1.0" 200 OK 2026-03-16 18:52:06,633 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:52:06,634 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b835c80b8ad4124cec3942/log.txt.gz 2026-03-16 18:52:06,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 18:52:07,100 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:52:07,102 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b835c80b8ad4124cec3942/lava-logs.yaml 2026-03-16 18:52:07,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 18:52:07,296 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:52:07,298 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b835c80b8ad4124cec3942/lava_callback.json.gz 2026-03-16 18:52:07,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:52:07,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b835c80b8ad4124cec3942 HTTP/1.1" 200 None 2026-03-16 18:52:07,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:52:07,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 18:52:07,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:52:07,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b835c80b8ad4124cec3942 HTTP/1.1" 200 None 2026-03-16 18:52:07,384 - lava_callback - INFO - Completed processing callback for node 69b835c80b8ad4124cec3942 2026-03-16 18:52:12,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:52:12,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-16 18:52:13,231 - lava_callback - INFO - Received callback for node 69b84ca10b8ad4124cec6473 INFO: 172.19.0.1:52768 - "POST /node/69b84ca10b8ad4124cec6473 HTTP/1.0" 202 Accepted 2026-03-16 18:52:13,239 - lava_callback - INFO - Starting async job submit for node 69b84ca10b8ad4124cec6473 2026-03-16 18:52:13,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:52:13,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b84ca10b8ad4124cec6473 HTTP/1.1" 200 None 2026-03-16 18:52:13,300 - lava_callback - DEBUG - Processing node 69b84ca10b8ad4124cec6473: baseline-nfs-arm64 2026-03-16 18:52:14,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 18:52:14,678 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:52:14,680 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b84ca10b8ad4124cec6473/log.txt.gz INFO: 172.19.0.1:52778 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-16 18:52:15,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 18:52:15,607 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:52:15,610 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b84ca10b8ad4124cec6473/lava-logs.yaml 2026-03-16 18:52:15,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 18:52:15,795 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:52:15,797 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b84ca10b8ad4124cec6473/lava_callback.json.gz DEBUG: Setup failed for 69b84ca10b8ad4124cec6473. Transitting job node result: incomplete -> fail 2026-03-16 18:52:15,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:52:15,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b84ca10b8ad4124cec6473 HTTP/1.1" 200 None 2026-03-16 18:52:15,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:52:15,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-16 18:52:15,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:52:15,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b84ca10b8ad4124cec6473 HTTP/1.1" 200 None 2026-03-16 18:52:16,070 - lava_callback - INFO - Completed processing callback for node 69b84ca10b8ad4124cec6473 INFO: 172.19.0.1:52782 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39944 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51864 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51868 - "GET / HTTP/1.0" 200 OK 2026-03-16 18:52:42,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:52:42,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:47534 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39830 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36678 - "GET / HTTP/1.0" 200 OK 2026-03-16 18:53:10,472 - lava_callback - INFO - Received callback for node 69b84cf20b8ad4124cec6483 INFO: 172.19.0.1:50428 - "POST /node/69b84cf20b8ad4124cec6483 HTTP/1.0" 202 Accepted 2026-03-16 18:53:10,480 - lava_callback - INFO - Starting async job submit for node 69b84cf20b8ad4124cec6483 2026-03-16 18:53:10,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:53:10,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b84cf20b8ad4124cec6483 HTTP/1.1" 200 None 2026-03-16 18:53:10,573 - lava_callback - DEBUG - Processing node 69b84cf20b8ad4124cec6483: baseline-nfs-arm64 2026-03-16 18:53:11,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 18:53:11,895 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:53:11,896 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b84cf20b8ad4124cec6483/log.txt.gz 2026-03-16 18:53:12,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 18:53:12,798 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:53:12,800 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b84cf20b8ad4124cec6483/lava-logs.yaml 2026-03-16 18:53:12,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 18:53:13,031 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 18:53:13,033 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b84cf20b8ad4124cec6483/lava_callback.json.gz DEBUG: Setup failed for 69b84cf20b8ad4124cec6483. Transitting job node result: incomplete -> fail 2026-03-16 18:53:13,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:53:13,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b84cf20b8ad4124cec6483 HTTP/1.1" 200 None 2026-03-16 18:53:13,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:53:13,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 18:53:13,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:53:13,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b84cf20b8ad4124cec6483 HTTP/1.1" 200 None 2026-03-16 18:53:13,304 - lava_callback - INFO - Completed processing callback for node 69b84cf20b8ad4124cec6483 INFO: 172.19.0.1:50442 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50458 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57010 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43892 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43894 - "GET / HTTP/1.0" 200 OK 2026-03-16 18:53:42,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 18:53:42,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:52468 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57102 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52314 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53290 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43040 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55230 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55246 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34618 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53056 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49382 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59296 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35648 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58694 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58698 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42104 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60646 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39954 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55976 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55992 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44436 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60414 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60428 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56744 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52062 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57892 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37778 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35258 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49236 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49240 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47368 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59984 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41204 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35556 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35926 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35930 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36438 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38664 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57560 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56056 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56070 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33774 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36104 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36116 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48540 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38534 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40426 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34248 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46748 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50346 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50354 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45034 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55058 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53058 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40144 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59246 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40210 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40216 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57740 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37868 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42516 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47474 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47490 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53110 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35880 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35892 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42604 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55584 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33214 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58442 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58458 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45914 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48308 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48312 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46308 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46364 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48640 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46644 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38580 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47232 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47246 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35450 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50156 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55622 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53360 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41248 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48378 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48388 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35754 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41154 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58514 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37234 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42720 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37892 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37906 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35456 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37738 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55174 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52018 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46534 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59072 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59084 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33214 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33376 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52516 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41734 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54100 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54262 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54272 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59646 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42062 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56100 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52650 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52666 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55174 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38700 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38708 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57146 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33016 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51100 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54922 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56468 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40466 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40470 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57760 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45830 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33508 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55752 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33770 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33784 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35080 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53724 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50586 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36038 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36780 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35606 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35614 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53484 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57202 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53132 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42572 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38330 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40014 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40030 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38656 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57042 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49110 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40566 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35598 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60900 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60912 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37894 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47494 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55270 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49634 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39242 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40040 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40046 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48320 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46200 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43922 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50874 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45308 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49830 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49842 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59892 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60962 - "GET / HTTP/1.0" 200 OK 2026-03-16 19:17:04,659 - lava_callback - INFO - Received callback for node 69b800cf113612b7716bc866 INFO: 172.19.0.1:41336 - "POST /node/69b800cf113612b7716bc866 HTTP/1.0" 202 Accepted 2026-03-16 19:17:04,705 - lava_callback - INFO - Starting async job submit for node 69b800cf113612b7716bc866 2026-03-16 19:17:04,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 19:17:04,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b800cf113612b7716bc866 HTTP/1.1" 200 None 2026-03-16 19:17:04,746 - lava_callback - DEBUG - Processing node 69b800cf113612b7716bc866: baseline-arm-pengutronix 2026-03-16 19:17:04,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 19:17:04,998 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 19:17:04,999 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b800cf113612b7716bc866/log.txt.gz 2026-03-16 19:17:05,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 19:17:05,247 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 19:17:05,248 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b800cf113612b7716bc866/lava-logs.yaml 2026-03-16 19:17:05,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 19:17:05,400 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 19:17:05,402 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b800cf113612b7716bc866/lava_callback.json.gz DEBUG: Setup failed for 69b800cf113612b7716bc866. Transitting job node result: incomplete -> fail 2026-03-16 19:17:05,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 19:17:05,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b800cf113612b7716bc866 HTTP/1.1" 200 None 2026-03-16 19:17:05,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 19:17:05,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-16 19:17:05,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 19:17:05,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b800cf113612b7716bc866 HTTP/1.1" 200 None 2026-03-16 19:17:05,564 - lava_callback - INFO - Completed processing callback for node 69b800cf113612b7716bc866 INFO: 172.19.0.1:41346 - "GET / HTTP/1.0" 200 OK 2026-03-16 19:17:12,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 19:17:12,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:36898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36908 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56380 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44456 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44460 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35872 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47436 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46244 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39948 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39504 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46312 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46322 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50756 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36800 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36518 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36244 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36258 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58206 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51180 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51184 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60636 - "GET / HTTP/1.0" 200 OK 2026-03-16 19:19:53,120 - lava_callback - INFO - Received callback for node 69b853270b8ad4124cec656a INFO: 172.19.0.1:38038 - "POST /node/69b853270b8ad4124cec656a HTTP/1.0" 202 Accepted 2026-03-16 19:19:53,129 - lava_callback - INFO - Starting async job submit for node 69b853270b8ad4124cec656a 2026-03-16 19:19:53,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 19:19:53,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b853270b8ad4124cec656a HTTP/1.1" 200 None 2026-03-16 19:19:53,188 - lava_callback - DEBUG - Processing node 69b853270b8ad4124cec656a: baseline-nfs-arm64 2026-03-16 19:19:54,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 19:19:54,485 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 19:19:54,486 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b853270b8ad4124cec656a/log.txt.gz 2026-03-16 19:19:55,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 19:19:55,390 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 19:19:55,393 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b853270b8ad4124cec656a/lava-logs.yaml 2026-03-16 19:19:55,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 19:19:55,607 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 19:19:55,609 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b853270b8ad4124cec656a/lava_callback.json.gz DEBUG: Setup failed for 69b853270b8ad4124cec656a. Transitting job node result: incomplete -> fail 2026-03-16 19:19:55,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 19:19:55,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b853270b8ad4124cec656a HTTP/1.1" 200 None 2026-03-16 19:19:55,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 19:19:55,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-16 19:19:55,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 19:19:55,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b853270b8ad4124cec656a HTTP/1.1" 200 None 2026-03-16 19:19:55,859 - lava_callback - INFO - Completed processing callback for node 69b853270b8ad4124cec656a INFO: 172.19.0.1:38054 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47644 - "GET / HTTP/1.0" 200 OK 2026-03-16 19:20:12,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 19:20:12,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:44184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44190 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56984 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32878 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32880 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41322 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50740 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42964 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48774 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40802 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40118 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40124 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58592 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34698 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50682 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36826 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47034 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46224 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46230 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56706 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34092 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52088 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46096 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37570 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36708 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36724 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42168 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39234 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37668 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47108 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58252 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35082 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35086 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42552 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59992 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43056 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42974 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57084 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51766 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51770 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38766 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38540 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42218 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56606 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51478 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56932 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56942 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43678 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39726 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56198 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35028 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49042 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57892 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57904 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59880 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54830 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40754 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35438 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37326 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57142 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57148 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38164 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47352 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54912 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35870 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55102 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33992 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33998 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45474 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53880 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33542 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36780 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37920 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35372 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35380 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35996 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40058 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39938 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50530 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59532 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36334 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36336 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49262 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39916 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38574 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36760 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52060 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38680 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38692 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44634 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35438 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52832 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36180 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59104 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51886 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51902 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50834 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60976 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44738 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58878 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60928 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45684 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45698 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37224 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33246 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45212 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54252 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54256 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58298 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49638 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49652 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56034 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42184 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44104 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57462 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57472 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44656 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59534 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59544 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54630 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51288 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38014 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58860 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48330 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35904 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35920 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46008 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56896 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51694 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39710 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39722 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55216 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35988 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35994 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48278 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32922 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60846 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46458 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50458 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42094 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42108 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43908 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39670 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33896 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35906 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59048 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35740 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35756 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59474 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48754 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52840 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41806 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51538 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54528 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54536 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47152 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50740 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59116 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47322 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46844 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42864 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42866 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52654 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34036 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50930 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56554 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46676 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44340 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44350 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40236 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56894 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49068 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42790 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44044 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54600 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54608 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58060 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58736 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40954 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41646 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41650 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36978 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54956 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54972 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38210 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47738 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51818 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55596 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37552 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39658 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39668 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49570 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42622 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33754 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54684 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45360 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60546 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60562 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34180 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41252 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36700 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46770 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35892 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55204 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55208 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39212 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53476 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38014 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46598 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46602 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57032 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50806 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50808 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42424 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55694 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48966 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55566 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50974 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52582 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52590 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36376 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56298 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53596 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60686 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41810 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41346 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41352 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44828 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39816 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39570 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34936 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48776 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36066 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36078 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60418 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43506 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58526 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50268 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60186 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58052 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58054 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51002 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47452 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48144 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56254 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55498 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33550 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33558 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43184 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52688 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57790 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57396 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57410 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60046 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42408 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42416 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53170 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47920 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57950 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48708 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57590 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57596 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53504 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46448 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45854 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53264 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53268 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57906 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41026 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41036 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42630 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54070 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42464 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44516 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34986 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47942 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47950 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58574 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52972 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37540 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35468 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35484 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42562 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42922 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42936 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41948 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34896 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56128 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51072 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37784 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56206 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56212 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49926 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56018 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44840 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51930 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41828 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38864 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38874 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36222 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51774 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39270 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43314 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43352 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49872 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49878 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56654 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53164 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54040 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57458 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47038 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47042 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54974 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54978 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46844 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50522 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43508 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37862 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39290 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47526 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47532 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40262 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49436 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50264 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41910 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39914 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51666 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51674 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36228 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59354 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59594 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58860 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59006 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55008 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55016 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42972 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50124 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35210 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35630 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56168 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40504 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40510 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35066 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36342 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52858 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41090 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41092 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53382 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43060 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43062 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55344 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47412 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47932 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38830 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45534 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47170 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47178 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59610 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58902 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35344 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58594 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46694 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50930 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50940 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57316 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48478 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49916 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58828 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58838 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52054 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35314 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35318 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51164 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48212 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37594 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38942 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38956 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45270 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37934 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37942 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46304 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37212 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34006 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34274 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54670 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35822 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35836 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52572 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59456 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53716 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39876 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39022 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60338 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60350 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60544 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43068 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48668 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57268 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51252 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52776 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52778 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45200 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43724 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35088 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58962 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48228 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60612 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60616 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38880 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36030 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39974 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51732 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34174 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35188 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35200 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57248 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43444 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52546 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44212 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42254 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47792 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47804 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60830 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57106 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45558 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36996 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37010 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34286 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42174 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42184 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35486 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49858 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54536 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59258 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59262 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47258 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39010 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39012 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46752 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40942 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33796 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39994 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44510 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38142 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38146 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42554 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46746 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49832 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41632 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56686 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43348 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43352 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39326 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46616 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54094 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58022 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58026 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42622 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49832 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49844 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36248 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59030 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32878 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51638 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43328 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56094 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56096 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42010 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47020 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47906 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39662 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58140 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58008 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58010 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53674 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50592 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42804 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52986 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36470 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39262 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39264 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48640 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42380 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60284 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34626 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34980 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40346 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40356 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44924 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51942 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42996 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43008 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37160 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54328 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54340 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42444 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43176 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38850 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55186 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46090 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38394 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38398 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37908 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40834 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49586 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37584 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33860 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34664 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34678 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44648 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50086 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44996 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55642 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55646 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33920 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44954 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44970 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41904 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35740 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33330 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56052 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59326 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33326 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33336 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37144 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48226 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48252 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45838 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49238 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42134 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42144 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36370 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44108 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38004 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40910 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33292 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49490 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49494 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51894 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58736 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47956 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60698 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49888 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48004 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48006 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38754 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49308 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51902 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39754 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36856 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41118 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41132 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45316 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58996 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58030 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54078 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54094 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57692 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58154 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58160 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60580 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48822 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48698 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40112 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56964 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49808 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49822 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52174 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52840 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40378 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41442 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54160 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59870 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59876 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51000 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55364 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49412 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36360 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36372 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47392 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43904 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43910 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43686 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52342 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49142 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48602 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52544 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60696 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60700 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60878 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45596 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50750 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42596 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37530 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48856 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48860 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34588 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49150 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36978 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48938 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48944 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56158 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44072 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44088 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45680 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59362 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36790 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57744 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58030 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37940 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37950 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40592 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60018 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57784 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56410 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34180 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48986 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40920 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49136 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46492 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38710 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55242 - "GET / HTTP/1.0" 200 OK 2026-03-16 20:46:28,245 - lava_callback - INFO - Received callback for node 69b5c9211727ff69d6f266ee INFO: 172.19.0.1:55252 - "POST /node/69b5c9211727ff69d6f266ee HTTP/1.0" 202 Accepted 2026-03-16 20:46:28,251 - lava_callback - INFO - Starting async job submit for node 69b5c9211727ff69d6f266ee 2026-03-16 20:46:28,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:46:28,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5c9211727ff69d6f266ee HTTP/1.1" 200 None 2026-03-16 20:46:28,272 - lava_callback - DEBUG - Processing node 69b5c9211727ff69d6f266ee: baseline-arm-baylibre 2026-03-16 20:46:28,272 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5c9211727ff69d6f266ee 2026-03-16 20:46:28,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:46:28,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5c9211727ff69d6f266ee HTTP/1.1" 200 None 2026-03-16 20:46:28,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:46:28,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-16 20:46:28,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:46:28,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5c9211727ff69d6f266ee HTTP/1.1" 200 None 2026-03-16 20:46:28,334 - lava_callback - ERROR - Error processing callback for node 69b5c9211727ff69d6f266ee: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:47320 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47326 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60840 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56794 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58132 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37340 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58874 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35058 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35062 - "GET / HTTP/1.0" 200 OK 2026-03-16 20:47:42,547 - lava_callback - INFO - Received callback for node 69b5c95f1727ff69d6f266fa INFO: 172.19.0.1:43512 - "POST /node/69b5c95f1727ff69d6f266fa HTTP/1.0" 202 Accepted 2026-03-16 20:47:42,553 - lava_callback - INFO - Starting async job submit for node 69b5c95f1727ff69d6f266fa 2026-03-16 20:47:42,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:47:42,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5c95f1727ff69d6f266fa HTTP/1.1" 200 None 2026-03-16 20:47:42,570 - lava_callback - DEBUG - Processing node 69b5c95f1727ff69d6f266fa: baseline-arm-clabbe 2026-03-16 20:47:42,570 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5c95f1727ff69d6f266fa 2026-03-16 20:47:42,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:47:42,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5c95f1727ff69d6f266fa HTTP/1.1" 200 None 2026-03-16 20:47:42,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:47:42,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-16 20:47:42,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:47:42,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5c95f1727ff69d6f266fa HTTP/1.1" 200 None 2026-03-16 20:47:42,670 - lava_callback - ERROR - Error processing callback for node 69b5c95f1727ff69d6f266fa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:43518 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52406 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35678 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34138 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57806 - "GET / HTTP/1.0" 200 OK 2026-03-16 20:48:28,080 - lava_callback - INFO - Received callback for node 69b5c9911727ff69d6f26706 INFO: 172.19.0.1:57808 - "POST /node/69b5c9911727ff69d6f26706 HTTP/1.0" 202 Accepted 2026-03-16 20:48:28,086 - lava_callback - INFO - Starting async job submit for node 69b5c9911727ff69d6f26706 2026-03-16 20:48:28,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:48:28,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5c9911727ff69d6f26706 HTTP/1.1" 200 None 2026-03-16 20:48:28,102 - lava_callback - DEBUG - Processing node 69b5c9911727ff69d6f26706: baseline-arm-baylibre 2026-03-16 20:48:28,102 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5c9911727ff69d6f26706 2026-03-16 20:48:28,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:48:28,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5c9911727ff69d6f26706 HTTP/1.1" 200 None 2026-03-16 20:48:28,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:48:28,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-16 20:48:28,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:48:28,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5c9911727ff69d6f26706 HTTP/1.1" 200 None 2026-03-16 20:48:28,188 - lava_callback - ERROR - Error processing callback for node 69b5c9911727ff69d6f26706: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:34684 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34694 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37364 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51888 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59952 - "GET / HTTP/1.0" 200 OK 2026-03-16 20:49:08,098 - lava_callback - INFO - Received callback for node 69b5c9b41727ff69d6f26715 INFO: 172.19.0.1:59962 - "POST /node/69b5c9b41727ff69d6f26715 HTTP/1.0" 202 Accepted 2026-03-16 20:49:08,103 - lava_callback - INFO - Starting async job submit for node 69b5c9b41727ff69d6f26715 2026-03-16 20:49:08,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:49:08,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5c9b41727ff69d6f26715 HTTP/1.1" 200 None 2026-03-16 20:49:08,124 - lava_callback - DEBUG - Processing node 69b5c9b41727ff69d6f26715: baseline-arm-baylibre 2026-03-16 20:49:08,124 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5c9b41727ff69d6f26715 2026-03-16 20:49:08,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:49:08,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5c9b41727ff69d6f26715 HTTP/1.1" 200 None 2026-03-16 20:49:08,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:49:08,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-16 20:49:08,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:49:08,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5c9b41727ff69d6f26715 HTTP/1.1" 200 None 2026-03-16 20:49:08,185 - lava_callback - ERROR - Error processing callback for node 69b5c9b41727ff69d6f26715: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:39652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39660 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33226 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41314 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41322 - "GET / HTTP/1.0" 200 OK 2026-03-16 20:49:42,601 - lava_callback - INFO - Received callback for node 69b5c9da1727ff69d6f26723 INFO: 172.19.0.1:56558 - "POST /node/69b5c9da1727ff69d6f26723 HTTP/1.0" 202 Accepted 2026-03-16 20:49:42,606 - lava_callback - INFO - Starting async job submit for node 69b5c9da1727ff69d6f26723 2026-03-16 20:49:42,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:49:42,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5c9da1727ff69d6f26723 HTTP/1.1" 200 None 2026-03-16 20:49:42,633 - lava_callback - DEBUG - Processing node 69b5c9da1727ff69d6f26723: baseline-arm-clabbe 2026-03-16 20:49:42,633 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5c9da1727ff69d6f26723 2026-03-16 20:49:42,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:49:42,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5c9da1727ff69d6f26723 HTTP/1.1" 200 None 2026-03-16 20:49:42,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:49:42,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-16 20:49:42,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:49:42,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5c9da1727ff69d6f26723 HTTP/1.1" 200 None 2026-03-16 20:49:42,738 - lava_callback - ERROR - Error processing callback for node 69b5c9da1727ff69d6f26723: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:56568 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33916 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50460 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51672 - "GET / HTTP/1.0" 200 OK 2026-03-16 20:50:22,609 - lava_callback - INFO - Received callback for node 69b5c9ff1727ff69d6f2672d INFO: 172.19.0.1:45830 - "POST /node/69b5c9ff1727ff69d6f2672d HTTP/1.0" 202 Accepted 2026-03-16 20:50:22,615 - lava_callback - INFO - Starting async job submit for node 69b5c9ff1727ff69d6f2672d 2026-03-16 20:50:22,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:50:22,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5c9ff1727ff69d6f2672d HTTP/1.1" 200 None 2026-03-16 20:50:22,650 - lava_callback - DEBUG - Processing node 69b5c9ff1727ff69d6f2672d: baseline-arm-clabbe 2026-03-16 20:50:22,650 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5c9ff1727ff69d6f2672d 2026-03-16 20:50:22,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:50:22,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5c9ff1727ff69d6f2672d HTTP/1.1" 200 None 2026-03-16 20:50:22,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:50:22,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-16 20:50:22,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:50:22,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5c9ff1727ff69d6f2672d HTTP/1.1" 200 None 2026-03-16 20:50:22,726 - lava_callback - ERROR - Error processing callback for node 69b5c9ff1727ff69d6f2672d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:45842 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56780 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56782 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56786 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46740 - "GET / HTTP/1.0" 200 OK 2026-03-16 20:51:02,673 - lava_callback - INFO - Received callback for node 69b5ca241727ff69d6f2673d INFO: 172.19.0.1:48722 - "POST /node/69b5ca241727ff69d6f2673d HTTP/1.0" 202 Accepted 2026-03-16 20:51:02,679 - lava_callback - INFO - Starting async job submit for node 69b5ca241727ff69d6f2673d 2026-03-16 20:51:02,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:51:02,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5ca241727ff69d6f2673d HTTP/1.1" 200 None 2026-03-16 20:51:02,721 - lava_callback - DEBUG - Processing node 69b5ca241727ff69d6f2673d: baseline-arm-clabbe 2026-03-16 20:51:02,721 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5ca241727ff69d6f2673d 2026-03-16 20:51:02,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:51:02,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5ca241727ff69d6f2673d HTTP/1.1" 200 None 2026-03-16 20:51:02,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:51:02,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-16 20:51:02,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:51:02,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5ca241727ff69d6f2673d HTTP/1.1" 200 None 2026-03-16 20:51:02,812 - lava_callback - ERROR - Error processing callback for node 69b5ca241727ff69d6f2673d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:48730 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47626 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36584 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41470 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41482 - "GET / HTTP/1.0" 200 OK 2026-03-16 20:51:42,671 - lava_callback - INFO - Received callback for node 69b5ca481727ff69d6f2674c INFO: 172.19.0.1:43504 - "POST /node/69b5ca481727ff69d6f2674c HTTP/1.0" 202 Accepted 2026-03-16 20:51:42,677 - lava_callback - INFO - Starting async job submit for node 69b5ca481727ff69d6f2674c 2026-03-16 20:51:42,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:51:42,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5ca481727ff69d6f2674c HTTP/1.1" 200 None 2026-03-16 20:51:42,697 - lava_callback - DEBUG - Processing node 69b5ca481727ff69d6f2674c: baseline-arm-clabbe 2026-03-16 20:51:42,697 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5ca481727ff69d6f2674c 2026-03-16 20:51:42,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:51:42,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5ca481727ff69d6f2674c HTTP/1.1" 200 None 2026-03-16 20:51:42,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:51:42,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-16 20:51:42,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:51:42,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5ca481727ff69d6f2674c HTTP/1.1" 200 None 2026-03-16 20:51:42,754 - lava_callback - ERROR - Error processing callback for node 69b5ca481727ff69d6f2674c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:43508 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32832 - "GET / HTTP/1.0" 200 OK 2026-03-16 20:52:02,668 - lava_callback - INFO - Received callback for node 69b5ca6c1727ff69d6f26758 INFO: 172.19.0.1:53074 - "POST /node/69b5ca6c1727ff69d6f26758 HTTP/1.0" 202 Accepted 2026-03-16 20:52:02,674 - lava_callback - INFO - Starting async job submit for node 69b5ca6c1727ff69d6f26758 2026-03-16 20:52:02,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:52:02,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5ca6c1727ff69d6f26758 HTTP/1.1" 200 None 2026-03-16 20:52:02,694 - lava_callback - DEBUG - Processing node 69b5ca6c1727ff69d6f26758: baseline-arm-clabbe 2026-03-16 20:52:02,694 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5ca6c1727ff69d6f26758 2026-03-16 20:52:02,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:52:02,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5ca6c1727ff69d6f26758 HTTP/1.1" 200 None 2026-03-16 20:52:02,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:52:02,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-16 20:52:02,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:52:02,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5ca6c1727ff69d6f26758 HTTP/1.1" 200 None 2026-03-16 20:52:02,754 - lava_callback - ERROR - Error processing callback for node 69b5ca6c1727ff69d6f26758: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:53076 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59990 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41532 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52778 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52784 - "GET / HTTP/1.0" 200 OK 2026-03-16 20:52:42,703 - lava_callback - INFO - Received callback for node 69b5ca911727ff69d6f26769 INFO: 172.19.0.1:38956 - "POST /node/69b5ca911727ff69d6f26769 HTTP/1.0" 202 Accepted 2026-03-16 20:52:42,708 - lava_callback - INFO - Starting async job submit for node 69b5ca911727ff69d6f26769 2026-03-16 20:52:42,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:52:42,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5ca911727ff69d6f26769 HTTP/1.1" 200 None 2026-03-16 20:52:42,726 - lava_callback - DEBUG - Processing node 69b5ca911727ff69d6f26769: baseline-arm-clabbe 2026-03-16 20:52:42,726 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5ca911727ff69d6f26769 2026-03-16 20:52:42,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:52:42,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5ca911727ff69d6f26769 HTTP/1.1" 200 None 2026-03-16 20:52:42,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:52:42,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-16 20:52:42,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:52:42,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5ca911727ff69d6f26769 HTTP/1.1" 200 None 2026-03-16 20:52:42,805 - lava_callback - ERROR - Error processing callback for node 69b5ca911727ff69d6f26769: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:38970 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60326 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40944 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34510 - "GET / HTTP/1.0" 200 OK 2026-03-16 20:53:22,756 - lava_callback - INFO - Received callback for node 69b5cab51727ff69d6f26773 INFO: 172.19.0.1:36438 - "POST /node/69b5cab51727ff69d6f26773 HTTP/1.0" 202 Accepted 2026-03-16 20:53:22,762 - lava_callback - INFO - Starting async job submit for node 69b5cab51727ff69d6f26773 2026-03-16 20:53:22,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:53:22,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5cab51727ff69d6f26773 HTTP/1.1" 200 None 2026-03-16 20:53:22,778 - lava_callback - DEBUG - Processing node 69b5cab51727ff69d6f26773: baseline-arm-clabbe 2026-03-16 20:53:22,778 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5cab51727ff69d6f26773 2026-03-16 20:53:22,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:53:22,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5cab51727ff69d6f26773 HTTP/1.1" 200 None 2026-03-16 20:53:22,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:53:22,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-16 20:53:22,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:53:22,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5cab51727ff69d6f26773 HTTP/1.1" 200 None 2026-03-16 20:53:22,858 - lava_callback - ERROR - Error processing callback for node 69b5cab51727ff69d6f26773: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:36452 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44104 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44120 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44130 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33536 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33544 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.19.0.1:33556 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46778 - "GET / HTTP/1.0" 200 OK 2026-03-16 20:54:02,742 - lava_callback - INFO - Received callback for node 69b5cada1727ff69d6f26785 INFO: 172.19.0.1:49820 - "POST /node/69b5cada1727ff69d6f26785 HTTP/1.0" 202 Accepted 2026-03-16 20:54:02,748 - lava_callback - INFO - Starting async job submit for node 69b5cada1727ff69d6f26785 2026-03-16 20:54:02,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:54:02,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5cada1727ff69d6f26785 HTTP/1.1" 200 None 2026-03-16 20:54:02,764 - lava_callback - DEBUG - Processing node 69b5cada1727ff69d6f26785: baseline-arm-clabbe 2026-03-16 20:54:02,764 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5cada1727ff69d6f26785 2026-03-16 20:54:02,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:54:02,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5cada1727ff69d6f26785 HTTP/1.1" 200 None 2026-03-16 20:54:02,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:54:02,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-16 20:54:02,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:54:02,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5cada1727ff69d6f26785 HTTP/1.1" 200 None 2026-03-16 20:54:02,829 - lava_callback - ERROR - Error processing callback for node 69b5cada1727ff69d6f26785: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:49834 - "GET /security.txt HTTP/1.0" 404 Not Found INFO: 172.19.0.1:49836 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33478 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53816 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35668 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35680 - "GET / HTTP/1.0" 200 OK 2026-03-16 20:54:42,810 - lava_callback - INFO - Received callback for node 69b5cafe1727ff69d6f26790 INFO: 172.19.0.1:57550 - "POST /node/69b5cafe1727ff69d6f26790 HTTP/1.0" 202 Accepted 2026-03-16 20:54:42,816 - lava_callback - INFO - Starting async job submit for node 69b5cafe1727ff69d6f26790 2026-03-16 20:54:42,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:54:42,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5cafe1727ff69d6f26790 HTTP/1.1" 200 None 2026-03-16 20:54:42,832 - lava_callback - DEBUG - Processing node 69b5cafe1727ff69d6f26790: baseline-arm-clabbe 2026-03-16 20:54:42,832 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5cafe1727ff69d6f26790 2026-03-16 20:54:42,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:54:42,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5cafe1727ff69d6f26790 HTTP/1.1" 200 None 2026-03-16 20:54:42,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:54:42,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-16 20:54:42,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:54:42,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5cafe1727ff69d6f26790 HTTP/1.1" 200 None 2026-03-16 20:54:42,898 - lava_callback - ERROR - Error processing callback for node 69b5cafe1727ff69d6f26790: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:57558 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43216 - "GET / HTTP/1.0" 200 OK 2026-03-16 20:55:02,869 - lava_callback - INFO - Received callback for node 69b5cb221727ff69d6f2679d INFO: 172.19.0.1:53090 - "POST /node/69b5cb221727ff69d6f2679d HTTP/1.0" 202 Accepted 2026-03-16 20:55:02,875 - lava_callback - INFO - Starting async job submit for node 69b5cb221727ff69d6f2679d 2026-03-16 20:55:02,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:55:02,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5cb221727ff69d6f2679d HTTP/1.1" 200 None 2026-03-16 20:55:02,914 - lava_callback - DEBUG - Processing node 69b5cb221727ff69d6f2679d: baseline-arm-clabbe 2026-03-16 20:55:02,915 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5cb221727ff69d6f2679d 2026-03-16 20:55:02,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:55:02,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5cb221727ff69d6f2679d HTTP/1.1" 200 None 2026-03-16 20:55:02,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:55:02,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-16 20:55:02,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:55:02,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5cb221727ff69d6f2679d HTTP/1.1" 200 None 2026-03-16 20:55:02,987 - lava_callback - ERROR - Error processing callback for node 69b5cb221727ff69d6f2679d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:53100 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47924 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48122 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48064 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48068 - "GET / HTTP/1.0" 200 OK 2026-03-16 20:55:42,849 - lava_callback - INFO - Received callback for node 69b5cb461727ff69d6f267a8 INFO: 172.19.0.1:47386 - "POST /node/69b5cb461727ff69d6f267a8 HTTP/1.0" 202 Accepted 2026-03-16 20:55:42,857 - lava_callback - INFO - Starting async job submit for node 69b5cb461727ff69d6f267a8 2026-03-16 20:55:42,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:55:42,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5cb461727ff69d6f267a8 HTTP/1.1" 200 None 2026-03-16 20:55:42,875 - lava_callback - DEBUG - Processing node 69b5cb461727ff69d6f267a8: baseline-arm-clabbe 2026-03-16 20:55:42,875 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5cb461727ff69d6f267a8 2026-03-16 20:55:42,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:55:42,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5cb461727ff69d6f267a8 HTTP/1.1" 200 None 2026-03-16 20:55:42,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:55:42,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-16 20:55:42,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:55:42,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5cb461727ff69d6f267a8 HTTP/1.1" 200 None 2026-03-16 20:55:42,927 - lava_callback - ERROR - Error processing callback for node 69b5cb461727ff69d6f267a8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:47400 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37074 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48478 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49966 - "GET / HTTP/1.0" 200 OK 2026-03-16 20:56:22,838 - lava_callback - INFO - Received callback for node 69b5cb6a1727ff69d6f267b0 INFO: 172.19.0.1:41878 - "POST /node/69b5cb6a1727ff69d6f267b0 HTTP/1.0" 202 Accepted 2026-03-16 20:56:22,844 - lava_callback - INFO - Starting async job submit for node 69b5cb6a1727ff69d6f267b0 2026-03-16 20:56:22,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:56:22,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5cb6a1727ff69d6f267b0 HTTP/1.1" 200 None 2026-03-16 20:56:22,860 - lava_callback - DEBUG - Processing node 69b5cb6a1727ff69d6f267b0: baseline-arm-clabbe 2026-03-16 20:56:22,860 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5cb6a1727ff69d6f267b0 2026-03-16 20:56:22,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:56:22,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5cb6a1727ff69d6f267b0 HTTP/1.1" 200 None 2026-03-16 20:56:22,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:56:22,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-16 20:56:22,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:56:22,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5cb6a1727ff69d6f267b0 HTTP/1.1" 200 None 2026-03-16 20:56:22,942 - lava_callback - ERROR - Error processing callback for node 69b5cb6a1727ff69d6f267b0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:41884 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60204 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60206 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35554 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45556 - "GET / HTTP/1.0" 200 OK 2026-03-16 20:57:02,879 - lava_callback - INFO - Received callback for node 69b5cb8f1727ff69d6f267bb INFO: 172.19.0.1:52296 - "POST /node/69b5cb8f1727ff69d6f267bb HTTP/1.0" 202 Accepted 2026-03-16 20:57:02,885 - lava_callback - INFO - Starting async job submit for node 69b5cb8f1727ff69d6f267bb 2026-03-16 20:57:02,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:57:02,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5cb8f1727ff69d6f267bb HTTP/1.1" 200 None 2026-03-16 20:57:02,901 - lava_callback - DEBUG - Processing node 69b5cb8f1727ff69d6f267bb: baseline-arm-clabbe 2026-03-16 20:57:02,901 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5cb8f1727ff69d6f267bb 2026-03-16 20:57:02,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:57:02,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5cb8f1727ff69d6f267bb HTTP/1.1" 200 None 2026-03-16 20:57:02,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:57:02,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-16 20:57:02,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:57:02,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5cb8f1727ff69d6f267bb HTTP/1.1" 200 None 2026-03-16 20:57:02,973 - lava_callback - ERROR - Error processing callback for node 69b5cb8f1727ff69d6f267bb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:52306 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49984 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49994 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59282 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.19.0.1:59292 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52452 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52460 - "GET / HTTP/1.0" 200 OK 2026-03-16 20:57:42,880 - lava_callback - INFO - Received callback for node 69b5cbb41727ff69d6f267c5 INFO: 172.19.0.1:54458 - "POST /node/69b5cbb41727ff69d6f267c5 HTTP/1.0" 202 Accepted 2026-03-16 20:57:42,885 - lava_callback - INFO - Starting async job submit for node 69b5cbb41727ff69d6f267c5 2026-03-16 20:57:42,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:57:42,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5cbb41727ff69d6f267c5 HTTP/1.1" 200 None 2026-03-16 20:57:42,902 - lava_callback - DEBUG - Processing node 69b5cbb41727ff69d6f267c5: baseline-arm-clabbe 2026-03-16 20:57:42,902 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5cbb41727ff69d6f267c5 2026-03-16 20:57:42,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:57:42,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5cbb41727ff69d6f267c5 HTTP/1.1" 200 None 2026-03-16 20:57:42,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:57:42,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-16 20:57:42,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 20:57:42,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5cbb41727ff69d6f267c5 HTTP/1.1" 200 None 2026-03-16 20:57:42,966 - lava_callback - ERROR - Error processing callback for node 69b5cbb41727ff69d6f267c5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:54466 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46430 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47488 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47498 - "GET /robots.txt HTTP/1.0" 404 Not Found INFO: 172.19.0.1:53688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53700 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37962 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45666 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45672 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44188 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53238 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54550 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53846 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53128 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40372 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40386 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56470 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34140 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41952 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58840 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60106 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55584 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55600 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53078 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58802 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53222 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38000 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38006 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49018 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53560 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53576 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49598 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54710 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55154 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39608 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51252 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51006 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51008 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59740 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54440 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55144 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46756 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57144 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38672 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38688 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54614 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60514 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34726 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49750 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49766 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39132 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51374 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51388 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53628 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54228 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52882 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34432 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34444 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32856 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50112 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50126 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37610 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36568 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54108 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60922 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44068 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60600 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60606 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43084 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57846 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41110 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41756 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48774 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43990 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44006 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36260 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40600 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33134 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47216 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57694 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56114 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56124 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41534 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58620 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56592 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57976 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57986 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59132 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39440 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39450 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58524 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47074 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40974 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40152 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39296 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40688 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40698 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41000 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41770 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41776 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43662 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35264 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55066 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55080 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56550 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40560 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54408 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56952 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50768 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41054 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41062 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59942 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54412 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54162 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36772 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36284 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40778 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40792 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52086 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33432 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44524 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54782 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35508 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44496 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44504 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54060 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37370 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54708 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52330 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52562 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56108 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56110 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40756 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36668 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60972 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59748 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50744 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37190 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37192 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34666 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55388 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60008 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58022 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58036 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45054 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57282 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57288 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51628 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35394 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48496 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52608 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53036 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41658 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41660 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35942 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37200 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55800 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52842 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49522 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39050 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39066 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50270 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56310 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56044 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40442 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40444 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57276 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53406 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53408 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45680 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48124 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45846 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41880 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49702 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54110 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54112 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33802 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56346 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39618 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41816 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58940 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34458 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34466 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47990 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37662 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56660 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37002 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33084 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36646 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36650 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36200 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55640 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58772 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36162 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51404 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47438 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47444 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43048 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44890 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35542 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54278 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46304 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35612 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35622 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49946 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35880 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36016 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49536 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49538 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52112 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45672 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45684 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43210 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38230 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52600 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52078 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53450 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32900 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32904 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42868 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37424 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47372 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57814 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44780 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52908 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52922 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37680 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37606 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42820 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39006 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39022 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38378 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59496 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59512 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45878 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51534 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52078 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42524 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42536 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35902 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48884 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48890 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51594 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38724 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33538 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51976 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51988 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42644 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35904 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35906 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38442 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54516 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32802 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50856 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56218 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49744 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49750 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39476 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45682 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33572 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54986 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54004 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46032 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46044 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41802 - "GET / HTTP/1.0" 200 OK 2026-03-16 21:33:50,702 - lava_callback - INFO - Received callback for node 69b5d4331727ff69d6f2681c INFO: 172.19.0.1:48880 - "POST /node/69b5d4331727ff69d6f2681c HTTP/1.0" 202 Accepted 2026-03-16 21:33:50,708 - lava_callback - INFO - Starting async job submit for node 69b5d4331727ff69d6f2681c 2026-03-16 21:33:50,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 21:33:50,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5d4331727ff69d6f2681c HTTP/1.1" 200 None 2026-03-16 21:33:50,734 - lava_callback - DEBUG - Processing node 69b5d4331727ff69d6f2681c: baseline-arm64-baylibre 2026-03-16 21:33:50,734 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5d4331727ff69d6f2681c 2026-03-16 21:33:50,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 21:33:50,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5d4331727ff69d6f2681c HTTP/1.1" 200 None 2026-03-16 21:33:50,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 21:33:50,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-16 21:33:50,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 21:33:50,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5d4331727ff69d6f2681c HTTP/1.1" 200 None 2026-03-16 21:33:50,821 - lava_callback - ERROR - Error processing callback for node 69b5d4331727ff69d6f2681c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:48886 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60888 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50990 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58612 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55538 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55544 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37408 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57382 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53602 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52284 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52298 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55038 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45678 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45682 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47422 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44538 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53118 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50442 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38722 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53182 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53198 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55506 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43900 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57854 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38774 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47758 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33742 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33754 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33830 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43364 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52072 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47266 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47280 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42438 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42452 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46398 - "GET / HTTP/1.0" 200 OK 2026-03-16 21:38:50,924 - lava_callback - INFO - Received callback for node 69b5d55f1727ff69d6f26832 INFO: 172.19.0.1:57826 - "POST /node/69b5d55f1727ff69d6f26832 HTTP/1.0" 202 Accepted 2026-03-16 21:38:50,930 - lava_callback - INFO - Starting async job submit for node 69b5d55f1727ff69d6f26832 2026-03-16 21:38:50,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 21:38:50,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5d55f1727ff69d6f26832 HTTP/1.1" 200 None 2026-03-16 21:38:50,947 - lava_callback - DEBUG - Processing node 69b5d55f1727ff69d6f26832: baseline-arm64-baylibre 2026-03-16 21:38:50,947 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5d55f1727ff69d6f26832 2026-03-16 21:38:50,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 21:38:50,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5d55f1727ff69d6f26832 HTTP/1.1" 200 None 2026-03-16 21:38:50,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 21:38:50,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-16 21:38:50,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 21:38:51,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5d55f1727ff69d6f26832 HTTP/1.1" 200 None 2026-03-16 21:38:51,010 - lava_callback - ERROR - Error processing callback for node 69b5d55f1727ff69d6f26832: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:57842 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51416 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33818 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39286 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53130 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53146 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42970 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35346 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58238 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57810 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57818 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41232 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50914 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50926 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38726 - "GET / HTTP/1.0" 200 OK 2026-03-16 21:40:51,188 - lava_callback - INFO - Received callback for node 69b5d5d81727ff69d6f26841 INFO: 172.19.0.1:41186 - "POST /node/69b5d5d81727ff69d6f26841 HTTP/1.0" 202 Accepted 2026-03-16 21:40:51,194 - lava_callback - INFO - Starting async job submit for node 69b5d5d81727ff69d6f26841 2026-03-16 21:40:51,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 21:40:51,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5d5d81727ff69d6f26841 HTTP/1.1" 200 None 2026-03-16 21:40:51,219 - lava_callback - DEBUG - Processing node 69b5d5d81727ff69d6f26841: baseline-arm64-baylibre 2026-03-16 21:40:51,220 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5d5d81727ff69d6f26841 2026-03-16 21:40:51,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 21:40:51,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5d5d81727ff69d6f26841 HTTP/1.1" 200 None 2026-03-16 21:40:51,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 21:40:51,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-16 21:40:51,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 21:40:51,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5d5d81727ff69d6f26841 HTTP/1.1" 200 None 2026-03-16 21:40:51,275 - lava_callback - ERROR - Error processing callback for node 69b5d5d81727ff69d6f26841: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:41192 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35498 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36808 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55238 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37980 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37988 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55748 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52462 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34424 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59430 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33666 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56152 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56160 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53600 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39124 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35490 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42738 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53384 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46516 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46532 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58262 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43366 - "GET / HTTP/1.0" 200 OK 2026-03-16 21:44:04,905 - lava_callback - INFO - Received callback for node 69b5d6921727ff69d6f26852 INFO: 172.19.0.1:58888 - "POST /node/69b5d6921727ff69d6f26852 HTTP/1.0" 202 Accepted 2026-03-16 21:44:04,911 - lava_callback - INFO - Starting async job submit for node 69b5d6921727ff69d6f26852 2026-03-16 21:44:04,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 21:44:04,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5d6921727ff69d6f26852 HTTP/1.1" 200 None 2026-03-16 21:44:04,928 - lava_callback - DEBUG - Processing node 69b5d6921727ff69d6f26852: baseline-arm64-clabbe 2026-03-16 21:44:04,928 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5d6921727ff69d6f26852 2026-03-16 21:44:04,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 21:44:04,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5d6921727ff69d6f26852 HTTP/1.1" 200 None 2026-03-16 21:44:04,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 21:44:04,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-16 21:44:04,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 21:44:04,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5d6921727ff69d6f26852 HTTP/1.1" 200 None 2026-03-16 21:44:04,982 - lava_callback - ERROR - Error processing callback for node 69b5d6921727ff69d6f26852: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:58892 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59252 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59254 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59980 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48504 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48512 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35846 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58810 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53078 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34114 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44144 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48466 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48476 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37138 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42860 - "GET / HTTP/1.0" 200 OK 2026-03-16 21:46:04,932 - lava_callback - INFO - Received callback for node 69b5d70a1727ff69d6f26861 INFO: 172.19.0.1:39382 - "POST /node/69b5d70a1727ff69d6f26861 HTTP/1.0" 202 Accepted 2026-03-16 21:46:04,938 - lava_callback - INFO - Starting async job submit for node 69b5d70a1727ff69d6f26861 2026-03-16 21:46:04,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 21:46:04,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5d70a1727ff69d6f26861 HTTP/1.1" 200 None 2026-03-16 21:46:04,954 - lava_callback - DEBUG - Processing node 69b5d70a1727ff69d6f26861: baseline-arm64-clabbe 2026-03-16 21:46:04,954 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5d70a1727ff69d6f26861 2026-03-16 21:46:04,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 21:46:05,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5d70a1727ff69d6f26861 HTTP/1.1" 200 None 2026-03-16 21:46:05,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 21:46:05,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-16 21:46:05,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 21:46:05,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5d70a1727ff69d6f26861 HTTP/1.1" 200 None 2026-03-16 21:46:05,066 - lava_callback - ERROR - Error processing callback for node 69b5d70a1727ff69d6f26861: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:39398 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46486 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40318 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50446 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50458 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54054 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34580 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57670 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48396 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48404 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33352 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60892 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60896 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35316 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54598 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47376 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36434 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43360 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54964 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54974 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38322 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51524 - "GET / HTTP/1.0" 200 OK 2026-03-16 21:49:05,184 - lava_callback - INFO - Received callback for node 69b5d7bf1727ff69d6f26870 INFO: 172.19.0.1:41730 - "POST /node/69b5d7bf1727ff69d6f26870 HTTP/1.0" 202 Accepted 2026-03-16 21:49:05,189 - lava_callback - INFO - Starting async job submit for node 69b5d7bf1727ff69d6f26870 2026-03-16 21:49:05,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 21:49:05,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5d7bf1727ff69d6f26870 HTTP/1.1" 200 None 2026-03-16 21:49:05,239 - lava_callback - DEBUG - Processing node 69b5d7bf1727ff69d6f26870: baseline-arm64-clabbe 2026-03-16 21:49:05,239 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5d7bf1727ff69d6f26870 2026-03-16 21:49:05,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 21:49:05,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5d7bf1727ff69d6f26870 HTTP/1.1" 200 None 2026-03-16 21:49:05,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 21:49:05,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-16 21:49:05,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 21:49:05,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5d7bf1727ff69d6f26870 HTTP/1.1" 200 None 2026-03-16 21:49:05,309 - lava_callback - ERROR - Error processing callback for node 69b5d7bf1727ff69d6f26870: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:41740 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44324 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51376 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39880 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39882 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58818 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48202 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58630 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55228 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55242 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50556 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50986 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51002 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40450 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56520 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41880 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44166 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58382 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37636 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37642 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39866 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40618 - "GET / HTTP/1.0" 200 OK 2026-03-16 21:52:05,231 - lava_callback - INFO - Received callback for node 69b5d8721727ff69d6f26880 INFO: 172.19.0.1:34484 - "POST /node/69b5d8721727ff69d6f26880 HTTP/1.0" 202 Accepted 2026-03-16 21:52:05,236 - lava_callback - INFO - Starting async job submit for node 69b5d8721727ff69d6f26880 2026-03-16 21:52:05,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 21:52:05,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5d8721727ff69d6f26880 HTTP/1.1" 200 None 2026-03-16 21:52:05,254 - lava_callback - DEBUG - Processing node 69b5d8721727ff69d6f26880: baseline-arm64-clabbe 2026-03-16 21:52:05,254 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5d8721727ff69d6f26880 2026-03-16 21:52:05,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 21:52:05,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5d8721727ff69d6f26880 HTTP/1.1" 200 None 2026-03-16 21:52:05,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 21:52:05,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-16 21:52:05,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 21:52:05,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5d8721727ff69d6f26880 HTTP/1.1" 200 None 2026-03-16 21:52:05,306 - lava_callback - ERROR - Error processing callback for node 69b5d8721727ff69d6f26880: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:34492 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48254 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39188 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45332 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45344 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39910 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35144 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33860 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52716 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43252 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34940 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34948 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34028 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45394 - "GET / HTTP/1.0" 200 OK 2026-03-16 21:54:05,293 - lava_callback - INFO - Received callback for node 69b5d8eb1727ff69d6f26890 INFO: 172.19.0.1:46036 - "POST /node/69b5d8eb1727ff69d6f26890 HTTP/1.0" 202 Accepted 2026-03-16 21:54:05,298 - lava_callback - INFO - Starting async job submit for node 69b5d8eb1727ff69d6f26890 2026-03-16 21:54:05,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 21:54:05,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5d8eb1727ff69d6f26890 HTTP/1.1" 200 None 2026-03-16 21:54:05,317 - lava_callback - DEBUG - Processing node 69b5d8eb1727ff69d6f26890: baseline-arm64-clabbe 2026-03-16 21:54:05,317 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5d8eb1727ff69d6f26890 2026-03-16 21:54:05,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 21:54:05,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5d8eb1727ff69d6f26890 HTTP/1.1" 200 None 2026-03-16 21:54:05,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 21:54:05,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-16 21:54:05,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 21:54:05,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5d8eb1727ff69d6f26890 HTTP/1.1" 200 None 2026-03-16 21:54:05,409 - lava_callback - ERROR - Error processing callback for node 69b5d8eb1727ff69d6f26890: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:46052 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60676 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47150 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37662 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37672 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51006 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57718 - "GET / HTTP/1.0" 200 OK 2026-03-16 21:55:05,422 - lava_callback - INFO - Received callback for node 69b5d9351727ff69d6f2689d INFO: 172.19.0.1:58856 - "POST /node/69b5d9351727ff69d6f2689d HTTP/1.0" 202 Accepted 2026-03-16 21:55:05,427 - lava_callback - INFO - Starting async job submit for node 69b5d9351727ff69d6f2689d 2026-03-16 21:55:05,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 21:55:05,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5d9351727ff69d6f2689d HTTP/1.1" 200 None 2026-03-16 21:55:05,444 - lava_callback - DEBUG - Processing node 69b5d9351727ff69d6f2689d: baseline-arm64-clabbe 2026-03-16 21:55:05,444 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5d9351727ff69d6f2689d 2026-03-16 21:55:05,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 21:55:05,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5d9351727ff69d6f2689d HTTP/1.1" 200 None 2026-03-16 21:55:05,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 21:55:05,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-16 21:55:05,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 21:55:05,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5d9351727ff69d6f2689d HTTP/1.1" 200 None 2026-03-16 21:55:05,509 - lava_callback - ERROR - Error processing callback for node 69b5d9351727ff69d6f2689d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:58872 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37518 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57470 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37166 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37172 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39266 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60950 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41196 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54222 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54230 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36116 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53544 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53560 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38732 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34906 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56412 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58788 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45482 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58788 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58796 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51018 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51144 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42208 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57252 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56224 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43042 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43050 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58332 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35566 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51352 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54940 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42226 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55232 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55240 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35450 - "GET / HTTP/1.0" 200 OK 2026-03-16 21:59:52,368 - lava_callback - INFO - Received callback for node 69b5da4b1727ff69d6f268b3 INFO: 172.19.0.1:60488 - "POST /node/69b5da4b1727ff69d6f268b3 HTTP/1.0" 202 Accepted 2026-03-16 21:59:52,373 - lava_callback - INFO - Starting async job submit for node 69b5da4b1727ff69d6f268b3 2026-03-16 21:59:52,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 21:59:52,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5da4b1727ff69d6f268b3 HTTP/1.1" 200 None 2026-03-16 21:59:52,388 - lava_callback - DEBUG - Processing node 69b5da4b1727ff69d6f268b3: baseline-arm64-baylibre 2026-03-16 21:59:52,389 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5da4b1727ff69d6f268b3 2026-03-16 21:59:52,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 21:59:52,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5da4b1727ff69d6f268b3 HTTP/1.1" 200 None 2026-03-16 21:59:52,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 21:59:52,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-16 21:59:52,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 21:59:52,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5da4b1727ff69d6f268b3 HTTP/1.1" 200 None 2026-03-16 21:59:52,444 - lava_callback - ERROR - Error processing callback for node 69b5da4b1727ff69d6f268b3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:60500 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60378 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51932 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43072 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54464 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54472 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50336 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54208 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42680 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47268 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47276 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50828 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47708 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47722 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50972 - "GET / HTTP/1.0" 200 OK 2026-03-16 22:01:52,239 - lava_callback - INFO - Received callback for node 69b5dabb1727ff69d6f268c5 INFO: 172.19.0.1:43942 - "POST /node/69b5dabb1727ff69d6f268c5 HTTP/1.0" 202 Accepted 2026-03-16 22:01:52,245 - lava_callback - INFO - Starting async job submit for node 69b5dabb1727ff69d6f268c5 2026-03-16 22:01:52,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:01:52,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5dabb1727ff69d6f268c5 HTTP/1.1" 200 None 2026-03-16 22:01:52,261 - lava_callback - DEBUG - Processing node 69b5dabb1727ff69d6f268c5: baseline-arm64-baylibre 2026-03-16 22:01:52,261 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5dabb1727ff69d6f268c5 2026-03-16 22:01:52,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:01:52,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5dabb1727ff69d6f268c5 HTTP/1.1" 200 None 2026-03-16 22:01:52,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:01:52,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-16 22:01:52,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:01:52,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5dabb1727ff69d6f268c5 HTTP/1.1" 200 None 2026-03-16 22:01:52,316 - lava_callback - ERROR - Error processing callback for node 69b5dabb1727ff69d6f268c5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:43944 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38514 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52638 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60398 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49770 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49786 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47740 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58894 - "GET / HTTP/1.0" 200 OK 2026-03-16 22:03:05,717 - lava_callback - INFO - Received callback for node 69b5db171727ff69d6f268d3 INFO: 172.19.0.1:43226 - "POST /node/69b5db171727ff69d6f268d3 HTTP/1.0" 202 Accepted 2026-03-16 22:03:05,722 - lava_callback - INFO - Starting async job submit for node 69b5db171727ff69d6f268d3 2026-03-16 22:03:05,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:03:05,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5db171727ff69d6f268d3 HTTP/1.1" 200 None 2026-03-16 22:03:05,769 - lava_callback - DEBUG - Processing node 69b5db171727ff69d6f268d3: baseline-arm64-clabbe 2026-03-16 22:03:05,769 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5db171727ff69d6f268d3 2026-03-16 22:03:05,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:03:05,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5db171727ff69d6f268d3 HTTP/1.1" 200 None 2026-03-16 22:03:05,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:03:05,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-16 22:03:05,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:03:05,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5db171727ff69d6f268d3 HTTP/1.1" 200 None 2026-03-16 22:03:05,836 - lava_callback - ERROR - Error processing callback for node 69b5db171727ff69d6f268d3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:43236 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33618 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51724 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34700 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34708 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42922 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43906 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39376 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33906 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33918 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53188 - "GET / HTTP/1.0" 200 OK 2026-03-16 22:04:32,373 - lava_callback - INFO - Received callback for node 69b5db5c1727ff69d6f268de INFO: 172.19.0.1:59396 - "POST /node/69b5db5c1727ff69d6f268de HTTP/1.0" 202 Accepted 2026-03-16 22:04:32,382 - lava_callback - INFO - Starting async job submit for node 69b5db5c1727ff69d6f268de 2026-03-16 22:04:32,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:04:32,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5db5c1727ff69d6f268de HTTP/1.1" 200 None 2026-03-16 22:04:32,413 - lava_callback - DEBUG - Processing node 69b5db5c1727ff69d6f268de: baseline-arm64-baylibre 2026-03-16 22:04:32,413 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5db5c1727ff69d6f268de 2026-03-16 22:04:32,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:04:32,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5db5c1727ff69d6f268de HTTP/1.1" 200 None 2026-03-16 22:04:32,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:04:32,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-16 22:04:32,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:04:32,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5db5c1727ff69d6f268de HTTP/1.1" 200 None 2026-03-16 22:04:32,519 - lava_callback - ERROR - Error processing callback for node 69b5db5c1727ff69d6f268de: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:59410 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59414 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51156 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50176 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44008 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33006 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47432 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43776 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43778 - "GET / HTTP/1.0" 200 OK 2026-03-16 22:05:45,816 - lava_callback - INFO - Received callback for node 69b5dbad1727ff69d6f268ed INFO: 172.19.0.1:33176 - "POST /node/69b5dbad1727ff69d6f268ed HTTP/1.0" 202 Accepted 2026-03-16 22:05:45,822 - lava_callback - INFO - Starting async job submit for node 69b5dbad1727ff69d6f268ed 2026-03-16 22:05:45,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:05:45,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5dbad1727ff69d6f268ed HTTP/1.1" 200 None 2026-03-16 22:05:45,839 - lava_callback - DEBUG - Processing node 69b5dbad1727ff69d6f268ed: baseline-arm64-clabbe 2026-03-16 22:05:45,839 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5dbad1727ff69d6f268ed 2026-03-16 22:05:45,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:05:45,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5dbad1727ff69d6f268ed HTTP/1.1" 200 None 2026-03-16 22:05:45,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:05:45,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-16 22:05:45,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:05:45,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5dbad1727ff69d6f268ed HTTP/1.1" 200 None 2026-03-16 22:05:45,901 - lava_callback - ERROR - Error processing callback for node 69b5dbad1727ff69d6f268ed: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:33178 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34094 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52448 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40190 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36314 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58056 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58072 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54948 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42880 - "GET / HTTP/1.0" 200 OK 2026-03-16 22:07:05,875 - lava_callback - INFO - Received callback for node 69b5dbf71727ff69d6f268f8 INFO: 172.19.0.1:56040 - "POST /node/69b5dbf71727ff69d6f268f8 HTTP/1.0" 202 Accepted 2026-03-16 22:07:05,881 - lava_callback - INFO - Starting async job submit for node 69b5dbf71727ff69d6f268f8 2026-03-16 22:07:05,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:07:05,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5dbf71727ff69d6f268f8 HTTP/1.1" 200 None 2026-03-16 22:07:05,915 - lava_callback - DEBUG - Processing node 69b5dbf71727ff69d6f268f8: baseline-arm64-clabbe 2026-03-16 22:07:05,916 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5dbf71727ff69d6f268f8 2026-03-16 22:07:05,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:07:05,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5dbf71727ff69d6f268f8 HTTP/1.1" 200 None 2026-03-16 22:07:05,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:07:05,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-16 22:07:05,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:07:05,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5dbf71727ff69d6f268f8 HTTP/1.1" 200 None 2026-03-16 22:07:05,988 - lava_callback - ERROR - Error processing callback for node 69b5dbf71727ff69d6f268f8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:56046 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43524 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43528 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49754 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36014 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36024 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54880 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52292 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40350 - "GET / HTTP/1.0" 200 OK 2026-03-16 22:08:12,956 - lava_callback - INFO - Received callback for node 69b5dc3b1727ff69d6f26900 INFO: 172.19.0.1:39896 - "POST /node/69b5dc3b1727ff69d6f26900 HTTP/1.0" 202 Accepted 2026-03-16 22:08:12,961 - lava_callback - INFO - Starting async job submit for node 69b5dc3b1727ff69d6f26900 2026-03-16 22:08:12,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:08:13,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5dc3b1727ff69d6f26900 HTTP/1.1" 200 None 2026-03-16 22:08:13,018 - lava_callback - DEBUG - Processing node 69b5dc3b1727ff69d6f26900: baseline-arm64-baylibre 2026-03-16 22:08:13,018 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5dc3b1727ff69d6f26900 2026-03-16 22:08:13,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:08:13,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5dc3b1727ff69d6f26900 HTTP/1.1" 200 None 2026-03-16 22:08:13,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:08:13,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-16 22:08:13,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:08:13,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5dc3b1727ff69d6f26900 HTTP/1.1" 200 None 2026-03-16 22:08:13,102 - lava_callback - ERROR - Error processing callback for node 69b5dc3b1727ff69d6f26900: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:39898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39902 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49802 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42904 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42920 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34244 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33426 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36840 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55106 - "GET / HTTP/1.0" 200 OK 2026-03-16 22:09:25,943 - lava_callback - INFO - Received callback for node 69b5dc8a1727ff69d6f26912 INFO: 172.19.0.1:47590 - "POST /node/69b5dc8a1727ff69d6f26912 HTTP/1.0" 202 Accepted 2026-03-16 22:09:25,948 - lava_callback - INFO - Starting async job submit for node 69b5dc8a1727ff69d6f26912 2026-03-16 22:09:25,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:09:25,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5dc8a1727ff69d6f26912 HTTP/1.1" 200 None 2026-03-16 22:09:25,988 - lava_callback - DEBUG - Processing node 69b5dc8a1727ff69d6f26912: baseline-arm64-clabbe 2026-03-16 22:09:25,988 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5dc8a1727ff69d6f26912 2026-03-16 22:09:25,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:09:26,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5dc8a1727ff69d6f26912 HTTP/1.1" 200 None 2026-03-16 22:09:26,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:09:26,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-16 22:09:26,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:09:26,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5dc8a1727ff69d6f26912 HTTP/1.1" 200 None 2026-03-16 22:09:26,100 - lava_callback - ERROR - Error processing callback for node 69b5dc8a1727ff69d6f26912: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:47594 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38148 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38156 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33076 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53482 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51320 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45098 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41130 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54270 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54286 - "GET / HTTP/1.0" 200 OK 2026-03-16 22:10:46,007 - lava_callback - INFO - Received callback for node 69b5dcd51727ff69d6f26922 INFO: 172.19.0.1:49284 - "POST /node/69b5dcd51727ff69d6f26922 HTTP/1.0" 202 Accepted 2026-03-16 22:10:46,013 - lava_callback - INFO - Starting async job submit for node 69b5dcd51727ff69d6f26922 2026-03-16 22:10:46,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:10:46,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5dcd51727ff69d6f26922 HTTP/1.1" 200 None 2026-03-16 22:10:46,029 - lava_callback - DEBUG - Processing node 69b5dcd51727ff69d6f26922: baseline-arm64-clabbe 2026-03-16 22:10:46,030 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5dcd51727ff69d6f26922 2026-03-16 22:10:46,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:10:46,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5dcd51727ff69d6f26922 HTTP/1.1" 200 None 2026-03-16 22:10:46,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:10:46,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-16 22:10:46,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:10:46,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5dcd51727ff69d6f26922 HTTP/1.1" 200 None 2026-03-16 22:10:46,082 - lava_callback - ERROR - Error processing callback for node 69b5dcd51727ff69d6f26922: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:49292 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58668 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47300 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56622 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48902 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48282 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48284 - "GET / HTTP/1.0" 200 OK 2026-03-16 22:11:46,022 - lava_callback - INFO - Received callback for node 69b5dd1f1727ff69d6f2692e INFO: 172.19.0.1:35410 - "POST /node/69b5dd1f1727ff69d6f2692e HTTP/1.0" 202 Accepted 2026-03-16 22:11:46,028 - lava_callback - INFO - Starting async job submit for node 69b5dd1f1727ff69d6f2692e 2026-03-16 22:11:46,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:11:46,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5dd1f1727ff69d6f2692e HTTP/1.1" 200 None 2026-03-16 22:11:46,044 - lava_callback - DEBUG - Processing node 69b5dd1f1727ff69d6f2692e: baseline-arm64-clabbe 2026-03-16 22:11:46,044 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5dd1f1727ff69d6f2692e 2026-03-16 22:11:46,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:11:46,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5dd1f1727ff69d6f2692e HTTP/1.1" 200 None 2026-03-16 22:11:46,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:11:46,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-16 22:11:46,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:11:46,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5dd1f1727ff69d6f2692e HTTP/1.1" 200 None 2026-03-16 22:11:46,136 - lava_callback - ERROR - Error processing callback for node 69b5dd1f1727ff69d6f2692e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:35416 - "GET / HTTP/1.0" 200 OK 2026-03-16 22:11:52,160 - lava_callback - INFO - Received callback for node 69b831b60b8ad4124cec3696 INFO: 172.19.0.1:35176 - "POST /node/69b831b60b8ad4124cec3696 HTTP/1.0" 202 Accepted 2026-03-16 22:11:52,213 - lava_callback - INFO - Starting async job submit for node 69b831b60b8ad4124cec3696 2026-03-16 22:11:52,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:11:52,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831b60b8ad4124cec3696 HTTP/1.1" 200 None 2026-03-16 22:11:52,260 - lava_callback - DEBUG - Processing node 69b831b60b8ad4124cec3696: baseline-arm-pengutronix 2026-03-16 22:11:52,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 22:11:52,575 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 22:11:52,577 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b831b60b8ad4124cec3696/log.txt.gz 2026-03-16 22:11:52,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 22:11:52,845 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 22:11:52,847 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b831b60b8ad4124cec3696/lava-logs.yaml 2026-03-16 22:11:52,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 22:11:52,986 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 22:11:52,988 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b831b60b8ad4124cec3696/lava_callback.json.gz DEBUG: Setup failed for 69b831b60b8ad4124cec3696. Transitting job node result: incomplete -> fail 2026-03-16 22:11:53,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:11:53,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831b60b8ad4124cec3696 HTTP/1.1" 200 None 2026-03-16 22:11:53,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:11:53,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None 2026-03-16 22:11:53,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:11:53,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b831b60b8ad4124cec3696 HTTP/1.1" 200 None 2026-03-16 22:11:53,177 - lava_callback - INFO - Completed processing callback for node 69b831b60b8ad4124cec3696 INFO: 172.19.0.1:35178 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60362 - "GET / HTTP/1.0" 200 OK 2026-03-16 22:12:12,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:12:13,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:37128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37138 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51822 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54508 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54514 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37568 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37210 - "GET / HTTP/1.0" 200 OK 2026-03-16 22:13:06,093 - lava_callback - INFO - Received callback for node 69b5dd691727ff69d6f26938 INFO: 172.19.0.1:35862 - "POST /node/69b5dd691727ff69d6f26938 HTTP/1.0" 202 Accepted 2026-03-16 22:13:06,099 - lava_callback - INFO - Starting async job submit for node 69b5dd691727ff69d6f26938 2026-03-16 22:13:06,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:13:06,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5dd691727ff69d6f26938 HTTP/1.1" 200 None 2026-03-16 22:13:06,140 - lava_callback - DEBUG - Processing node 69b5dd691727ff69d6f26938: baseline-arm64-clabbe 2026-03-16 22:13:06,140 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5dd691727ff69d6f26938 2026-03-16 22:13:06,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:13:06,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5dd691727ff69d6f26938 HTTP/1.1" 200 None 2026-03-16 22:13:06,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:13:06,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-16 22:13:06,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:13:06,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5dd691727ff69d6f26938 HTTP/1.1" 200 None 2026-03-16 22:13:06,210 - lava_callback - ERROR - Error processing callback for node 69b5dd691727ff69d6f26938: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:35868 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39200 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33332 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59302 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59316 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49024 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56320 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43592 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57416 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57418 - "GET / HTTP/1.0" 200 OK 2026-03-16 22:14:26,150 - lava_callback - INFO - Received callback for node 69b5ddb31727ff69d6f26949 INFO: 172.19.0.1:39482 - "POST /node/69b5ddb31727ff69d6f26949 HTTP/1.0" 202 Accepted 2026-03-16 22:14:26,155 - lava_callback - INFO - Starting async job submit for node 69b5ddb31727ff69d6f26949 2026-03-16 22:14:26,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:14:26,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5ddb31727ff69d6f26949 HTTP/1.1" 200 None 2026-03-16 22:14:26,195 - lava_callback - DEBUG - Processing node 69b5ddb31727ff69d6f26949: baseline-arm64-clabbe 2026-03-16 22:14:26,195 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5ddb31727ff69d6f26949 2026-03-16 22:14:26,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:14:26,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5ddb31727ff69d6f26949 HTTP/1.1" 200 None 2026-03-16 22:14:26,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:14:26,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-16 22:14:26,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:14:26,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5ddb31727ff69d6f26949 HTTP/1.1" 200 None 2026-03-16 22:14:26,282 - lava_callback - ERROR - Error processing callback for node 69b5ddb31727ff69d6f26949: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:39492 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41294 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41304 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42076 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49432 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34442 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34564 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44874 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57042 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57048 - "GET / HTTP/1.0" 200 OK 2026-03-16 22:15:46,190 - lava_callback - INFO - Received callback for node 69b5ddfe1727ff69d6f26953 INFO: 172.19.0.1:36036 - "POST /node/69b5ddfe1727ff69d6f26953 HTTP/1.0" 202 Accepted 2026-03-16 22:15:46,196 - lava_callback - INFO - Starting async job submit for node 69b5ddfe1727ff69d6f26953 2026-03-16 22:15:46,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:15:46,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5ddfe1727ff69d6f26953 HTTP/1.1" 200 None 2026-03-16 22:15:46,216 - lava_callback - DEBUG - Processing node 69b5ddfe1727ff69d6f26953: baseline-arm64-clabbe 2026-03-16 22:15:46,216 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5ddfe1727ff69d6f26953 2026-03-16 22:15:46,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:15:46,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5ddfe1727ff69d6f26953 HTTP/1.1" 200 None 2026-03-16 22:15:46,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:15:46,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-16 22:15:46,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:15:46,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5ddfe1727ff69d6f26953 HTTP/1.1" 200 None 2026-03-16 22:15:46,285 - lava_callback - ERROR - Error processing callback for node 69b5ddfe1727ff69d6f26953: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:36044 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58762 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34964 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40514 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35202 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36892 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36908 - "GET / HTTP/1.0" 200 OK 2026-03-16 22:16:46,259 - lava_callback - INFO - Received callback for node 69b5de491727ff69d6f26965 INFO: 172.19.0.1:51430 - "POST /node/69b5de491727ff69d6f26965 HTTP/1.0" 202 Accepted 2026-03-16 22:16:46,264 - lava_callback - INFO - Starting async job submit for node 69b5de491727ff69d6f26965 2026-03-16 22:16:46,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:16:46,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5de491727ff69d6f26965 HTTP/1.1" 200 None 2026-03-16 22:16:46,292 - lava_callback - DEBUG - Processing node 69b5de491727ff69d6f26965: baseline-arm64-clabbe 2026-03-16 22:16:46,292 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5de491727ff69d6f26965 2026-03-16 22:16:46,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:16:46,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5de491727ff69d6f26965 HTTP/1.1" 200 None 2026-03-16 22:16:46,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:16:46,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-16 22:16:46,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:16:46,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5de491727ff69d6f26965 HTTP/1.1" 200 None 2026-03-16 22:16:46,406 - lava_callback - ERROR - Error processing callback for node 69b5de491727ff69d6f26965: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:51436 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53648 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41360 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38602 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58536 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41206 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41220 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57786 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45152 - "GET / HTTP/1.0" 200 OK 2026-03-16 22:18:06,335 - lava_callback - INFO - Received callback for node 69b5de931727ff69d6f2696e INFO: 172.19.0.1:55288 - "POST /node/69b5de931727ff69d6f2696e HTTP/1.0" 202 Accepted 2026-03-16 22:18:06,341 - lava_callback - INFO - Starting async job submit for node 69b5de931727ff69d6f2696e 2026-03-16 22:18:06,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:18:06,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5de931727ff69d6f2696e HTTP/1.1" 200 None 2026-03-16 22:18:06,380 - lava_callback - DEBUG - Processing node 69b5de931727ff69d6f2696e: baseline-arm64-clabbe 2026-03-16 22:18:06,381 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5de931727ff69d6f2696e 2026-03-16 22:18:06,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:18:06,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5de931727ff69d6f2696e HTTP/1.1" 200 None 2026-03-16 22:18:06,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:18:06,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-16 22:18:06,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:18:06,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5de931727ff69d6f2696e HTTP/1.1" 200 None 2026-03-16 22:18:06,440 - lava_callback - ERROR - Error processing callback for node 69b5de931727ff69d6f2696e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:55296 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36626 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39802 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44430 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44436 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49114 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36252 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41726 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44006 - "GET / HTTP/1.0" 200 OK 2026-03-16 22:19:26,352 - lava_callback - INFO - Received callback for node 69b5dedd1727ff69d6f2697f INFO: 172.19.0.1:59170 - "POST /node/69b5dedd1727ff69d6f2697f HTTP/1.0" 202 Accepted 2026-03-16 22:19:26,358 - lava_callback - INFO - Starting async job submit for node 69b5dedd1727ff69d6f2697f 2026-03-16 22:19:26,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:19:26,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5dedd1727ff69d6f2697f HTTP/1.1" 200 None 2026-03-16 22:19:26,388 - lava_callback - DEBUG - Processing node 69b5dedd1727ff69d6f2697f: baseline-arm64-clabbe 2026-03-16 22:19:26,388 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5dedd1727ff69d6f2697f 2026-03-16 22:19:26,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:19:26,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5dedd1727ff69d6f2697f HTTP/1.1" 200 None 2026-03-16 22:19:26,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:19:26,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-16 22:19:26,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:19:26,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5dedd1727ff69d6f2697f HTTP/1.1" 200 None 2026-03-16 22:19:26,460 - lava_callback - ERROR - Error processing callback for node 69b5dedd1727ff69d6f2697f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:59176 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51602 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51616 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54104 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55680 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50118 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44034 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43010 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59020 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59028 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53270 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53032 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45600 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39124 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39138 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44184 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35330 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35340 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48586 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43934 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48074 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37964 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41586 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58140 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58146 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40866 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35086 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33736 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35750 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-16 22:23:16,454 - lava_callback - INFO - Received callback for node 69b831a00b8ad4124cec362f INFO: 172.19.0.1:35762 - "POST /node/69b831a00b8ad4124cec362f HTTP/1.0" 202 Accepted 2026-03-16 22:23:16,460 - lava_callback - INFO - Starting async job submit for node 69b831a00b8ad4124cec362f 2026-03-16 22:23:16,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:23:16,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831a00b8ad4124cec362f HTTP/1.1" 200 None 2026-03-16 22:23:16,508 - lava_callback - DEBUG - Processing node 69b831a00b8ad4124cec362f: baseline-arm-broonie INFO: 172.19.0.1:35766 - "GET / HTTP/1.0" 200 OK 2026-03-16 22:23:16,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 22:23:16,879 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 22:23:16,881 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b831a00b8ad4124cec362f/log.txt.gz 2026-03-16 22:23:17,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 22:23:17,212 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 22:23:17,215 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b831a00b8ad4124cec362f/lava-logs.yaml 2026-03-16 22:23:17,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 22:23:17,398 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 22:23:17,400 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b831a00b8ad4124cec362f/lava_callback.json.gz 2026-03-16 22:23:17,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:23:17,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831a00b8ad4124cec362f HTTP/1.1" 200 None 2026-03-16 22:23:17,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:23:17,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None 2026-03-16 22:23:17,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:23:17,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b831a00b8ad4124cec362f HTTP/1.1" 200 None 2026-03-16 22:23:17,491 - lava_callback - INFO - Completed processing callback for node 69b831a00b8ad4124cec362f INFO: 172.19.0.1:56410 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60062 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60078 - "GET / HTTP/1.0" 200 OK 2026-03-16 22:23:43,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:23:43,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:47230 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47026 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35734 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41028 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57560 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41988 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41990 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44358 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38214 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58154 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33584 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37122 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36968 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36980 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47160 - "GET / HTTP/1.0" 200 OK 2026-03-16 22:25:54,361 - lava_callback - INFO - Received callback for node 69b831ca0b8ad4124cec36af INFO: 172.19.0.1:49414 - "POST /node/69b831ca0b8ad4124cec36af HTTP/1.0" 202 Accepted 2026-03-16 22:25:54,367 - lava_callback - INFO - Starting async job submit for node 69b831ca0b8ad4124cec36af 2026-03-16 22:25:54,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:25:54,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831ca0b8ad4124cec36af HTTP/1.1" 200 None 2026-03-16 22:25:54,437 - lava_callback - DEBUG - Processing node 69b831ca0b8ad4124cec36af: ltp-cap_bounds 2026-03-16 22:25:54,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 22:25:54,920 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 22:25:54,922 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69b831ca0b8ad4124cec36af/log.txt.gz 2026-03-16 22:25:55,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 22:25:55,344 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 22:25:55,346 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69b831ca0b8ad4124cec36af/lava-logs.yaml 2026-03-16 22:25:55,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 22:25:55,528 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 22:25:55,530 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69b831ca0b8ad4124cec36af/lava_callback.json.gz 2026-03-16 22:25:55,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:25:55,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831ca0b8ad4124cec36af HTTP/1.1" 200 None 2026-03-16 22:25:55,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:25:55,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None 2026-03-16 22:25:55,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:25:55,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b831ca0b8ad4124cec36af HTTP/1.1" 200 None 2026-03-16 22:25:55,686 - lava_callback - INFO - Completed processing callback for node 69b831ca0b8ad4124cec36af INFO: 172.19.0.1:49426 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48000 - "GET / HTTP/1.0" 200 OK 2026-03-16 22:26:13,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:26:13,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:43854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43858 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39038 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39954 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39962 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48612 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46456 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56528 - "GET / HTTP/1.0" 200 OK 2026-03-16 22:27:14,334 - lava_callback - INFO - Received callback for node 69b831cc0b8ad4124cec36c3 INFO: 172.19.0.1:51356 - "POST /node/69b831cc0b8ad4124cec36c3 HTTP/1.0" 202 Accepted 2026-03-16 22:27:14,341 - lava_callback - INFO - Starting async job submit for node 69b831cc0b8ad4124cec36c3 2026-03-16 22:27:14,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:27:14,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831cc0b8ad4124cec36c3 HTTP/1.1" 200 None 2026-03-16 22:27:14,401 - lava_callback - DEBUG - Processing node 69b831cc0b8ad4124cec36c3: ltp-containers 2026-03-16 22:27:14,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 22:27:14,965 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 22:27:14,966 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-containers-69b831cc0b8ad4124cec36c3/log.txt.gz INFO: 172.19.0.1:51368 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-16 22:27:15,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 22:27:15,407 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 22:27:15,409 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-containers-69b831cc0b8ad4124cec36c3/lava-logs.yaml 2026-03-16 22:27:15,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 22:27:15,590 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 22:27:15,591 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-containers-69b831cc0b8ad4124cec36c3/lava_callback.json.gz 2026-03-16 22:27:15,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:27:15,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831cc0b8ad4124cec36c3 HTTP/1.1" 200 None 2026-03-16 22:27:15,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:27:15,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None 2026-03-16 22:27:15,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:27:15,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b831cc0b8ad4124cec36c3 HTTP/1.1" 200 None 2026-03-16 22:27:15,883 - lava_callback - INFO - Completed processing callback for node 69b831cc0b8ad4124cec36c3 INFO: 172.19.0.1:51372 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39558 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39566 - "GET / HTTP/1.0" 200 OK 2026-03-16 22:27:37,104 - lava_callback - INFO - Received callback for node 69b831d00b8ad4124cec36c9 INFO: 172.19.0.1:39574 - "POST /node/69b831d00b8ad4124cec36c9 HTTP/1.0" 202 Accepted 2026-03-16 22:27:37,111 - lava_callback - INFO - Starting async job submit for node 69b831d00b8ad4124cec36c9 2026-03-16 22:27:37,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:27:37,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831d00b8ad4124cec36c9 HTTP/1.1" 200 None 2026-03-16 22:27:37,156 - lava_callback - DEBUG - Processing node 69b831d00b8ad4124cec36c9: ltp-cve 2026-03-16 22:27:37,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 22:27:37,680 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 22:27:37,682 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cve-69b831d00b8ad4124cec36c9/log.txt.gz 2026-03-16 22:27:37,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 22:27:38,100 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 22:27:38,103 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cve-69b831d00b8ad4124cec36c9/lava-logs.yaml 2026-03-16 22:27:38,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 22:27:38,280 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 22:27:38,282 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cve-69b831d00b8ad4124cec36c9/lava_callback.json.gz 2026-03-16 22:27:38,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:27:38,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831d00b8ad4124cec36c9 HTTP/1.1" 200 None 2026-03-16 22:27:38,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:27:38,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None 2026-03-16 22:27:38,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:27:38,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b831d00b8ad4124cec36c9 HTTP/1.1" 200 None 2026-03-16 22:27:38,374 - lava_callback - INFO - Completed processing callback for node 69b831d00b8ad4124cec36c9 2026-03-16 22:27:43,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:27:43,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:44488 - "GET / HTTP/1.0" 200 OK 2026-03-16 22:27:54,188 - lava_callback - INFO - Received callback for node 69b831ce0b8ad4124cec36c6 INFO: 172.19.0.1:33020 - "POST /node/69b831ce0b8ad4124cec36c6 HTTP/1.0" 202 Accepted 2026-03-16 22:27:54,195 - lava_callback - INFO - Starting async job submit for node 69b831ce0b8ad4124cec36c6 2026-03-16 22:27:54,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:27:54,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831ce0b8ad4124cec36c6 HTTP/1.1" 200 None 2026-03-16 22:27:54,237 - lava_callback - DEBUG - Processing node 69b831ce0b8ad4124cec36c6: ltp-controllers 2026-03-16 22:27:54,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 22:27:54,880 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 22:27:54,882 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-controllers-69b831ce0b8ad4124cec36c6/log.txt.gz 2026-03-16 22:27:55,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 22:27:55,349 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 22:27:55,351 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-controllers-69b831ce0b8ad4124cec36c6/lava-logs.yaml 2026-03-16 22:27:55,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 22:27:55,500 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 22:27:55,502 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-controllers-69b831ce0b8ad4124cec36c6/lava_callback.json.gz 2026-03-16 22:27:55,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:27:55,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831ce0b8ad4124cec36c6 HTTP/1.1" 200 None 2026-03-16 22:27:55,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:27:55,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None 2026-03-16 22:27:55,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:27:55,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b831ce0b8ad4124cec36c6 HTTP/1.1" 200 None 2026-03-16 22:27:55,729 - lava_callback - INFO - Completed processing callback for node 69b831ce0b8ad4124cec36c6 INFO: 172.19.0.1:33032 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56204 - "GET / HTTP/1.0" 200 OK 2026-03-16 22:28:13,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:28:13,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:42054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42070 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36076 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51332 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51340 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37072 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44970 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53026 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56338 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56342 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52718 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49282 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49298 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39870 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45336 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37492 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54056 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37254 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37092 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37104 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44634 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58468 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33862 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48714 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52944 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59762 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59772 - "GET / HTTP/1.0" 200 OK 2026-03-16 22:31:37,632 - lava_callback - INFO - Received callback for node 69b831d40b8ad4124cec36cf INFO: 172.19.0.1:59782 - "POST /node/69b831d40b8ad4124cec36cf HTTP/1.0" 202 Accepted 2026-03-16 22:31:37,638 - lava_callback - INFO - Starting async job submit for node 69b831d40b8ad4124cec36cf 2026-03-16 22:31:37,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:31:37,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831d40b8ad4124cec36cf HTTP/1.1" 200 None 2026-03-16 22:31:37,689 - lava_callback - DEBUG - Processing node 69b831d40b8ad4124cec36cf: ltp-fs_bind 2026-03-16 22:31:38,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 22:31:38,237 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 22:31:38,239 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69b831d40b8ad4124cec36cf/log.txt.gz 2026-03-16 22:31:38,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 22:31:38,681 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 22:31:38,683 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69b831d40b8ad4124cec36cf/lava-logs.yaml 2026-03-16 22:31:38,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 22:31:38,852 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 22:31:38,854 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69b831d40b8ad4124cec36cf/lava_callback.json.gz 2026-03-16 22:31:38,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:31:38,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831d40b8ad4124cec36cf HTTP/1.1" 200 None 2026-03-16 22:31:38,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:31:38,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None 2026-03-16 22:31:38,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:31:39,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b831d40b8ad4124cec36cf HTTP/1.1" 200 None 2026-03-16 22:31:39,005 - lava_callback - INFO - Completed processing callback for node 69b831d40b8ad4124cec36cf 2026-03-16 22:31:43,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:31:43,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:42908 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50354 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52768 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57924 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56078 - "GET / HTTP/1.0" 200 OK 2026-03-16 22:32:34,297 - lava_callback - INFO - Received callback for node 69b831d60b8ad4124cec36d8 INFO: 172.19.0.1:56086 - "POST /node/69b831d60b8ad4124cec36d8 HTTP/1.0" 202 Accepted 2026-03-16 22:32:34,304 - lava_callback - INFO - Starting async job submit for node 69b831d60b8ad4124cec36d8 2026-03-16 22:32:34,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:32:34,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831d60b8ad4124cec36d8 HTTP/1.1" 200 None 2026-03-16 22:32:34,368 - lava_callback - DEBUG - Processing node 69b831d60b8ad4124cec36d8: ltp-fsx 2026-03-16 22:32:34,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 22:32:34,912 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 22:32:34,914 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fsx-69b831d60b8ad4124cec36d8/log.txt.gz 2026-03-16 22:32:35,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 22:32:35,336 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 22:32:35,338 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fsx-69b831d60b8ad4124cec36d8/lava-logs.yaml 2026-03-16 22:32:35,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 22:32:35,541 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 22:32:35,543 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fsx-69b831d60b8ad4124cec36d8/lava_callback.json.gz 2026-03-16 22:32:35,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:32:35,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831d60b8ad4124cec36d8 HTTP/1.1" 200 None 2026-03-16 22:32:35,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:32:35,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None 2026-03-16 22:32:35,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:32:35,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b831d60b8ad4124cec36d8 HTTP/1.1" 200 None 2026-03-16 22:32:35,626 - lava_callback - INFO - Completed processing callback for node 69b831d60b8ad4124cec36d8 INFO: 172.19.0.1:56088 - "GET / HTTP/1.0" 200 OK 2026-03-16 22:32:43,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:32:43,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:58734 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59362 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59056 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38896 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51802 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59922 - "GET / HTTP/1.0" 200 OK 2026-03-16 22:33:34,431 - lava_callback - INFO - Received callback for node 69b831d70b8ad4124cec36db INFO: 172.19.0.1:59936 - "POST /node/69b831d70b8ad4124cec36db HTTP/1.0" 202 Accepted 2026-03-16 22:33:34,437 - lava_callback - INFO - Starting async job submit for node 69b831d70b8ad4124cec36db 2026-03-16 22:33:34,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:33:34,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831d70b8ad4124cec36db HTTP/1.1" 200 None 2026-03-16 22:33:34,478 - lava_callback - DEBUG - Processing node 69b831d70b8ad4124cec36db: ltp-input 2026-03-16 22:33:34,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 22:33:34,992 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 22:33:34,993 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-input-69b831d70b8ad4124cec36db/log.txt.gz 2026-03-16 22:33:35,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 22:33:35,417 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 22:33:35,419 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-input-69b831d70b8ad4124cec36db/lava-logs.yaml 2026-03-16 22:33:35,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 22:33:35,596 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 22:33:35,598 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-input-69b831d70b8ad4124cec36db/lava_callback.json.gz 2026-03-16 22:33:35,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:33:35,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831d70b8ad4124cec36db HTTP/1.1" 200 None 2026-03-16 22:33:35,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:33:35,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None 2026-03-16 22:33:35,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:33:35,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b831d70b8ad4124cec36db HTTP/1.1" 200 None 2026-03-16 22:33:35,698 - lava_callback - INFO - Completed processing callback for node 69b831d70b8ad4124cec36db INFO: 172.19.0.1:59942 - "GET / HTTP/1.0" 200 OK 2026-03-16 22:33:43,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:33:43,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:48714 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45126 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49638 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58418 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58420 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42000 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46616 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46618 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47192 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35658 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39688 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47406 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38200 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58784 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58798 - "GET / HTTP/1.0" 200 OK 2026-03-16 22:35:37,672 - lava_callback - INFO - Received callback for node 69b831d90b8ad4124cec36de INFO: 172.19.0.1:58802 - "POST /node/69b831d90b8ad4124cec36de HTTP/1.0" 202 Accepted 2026-03-16 22:35:37,679 - lava_callback - INFO - Starting async job submit for node 69b831d90b8ad4124cec36de 2026-03-16 22:35:37,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:35:37,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831d90b8ad4124cec36de HTTP/1.1" 200 None 2026-03-16 22:35:37,726 - lava_callback - DEBUG - Processing node 69b831d90b8ad4124cec36de: ltp-ipc 2026-03-16 22:35:38,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 22:35:38,255 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 22:35:38,257 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-ipc-69b831d90b8ad4124cec36de/log.txt.gz 2026-03-16 22:35:38,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 22:35:38,665 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 22:35:38,667 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-ipc-69b831d90b8ad4124cec36de/lava-logs.yaml 2026-03-16 22:35:38,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 22:35:38,844 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 22:35:38,846 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-ipc-69b831d90b8ad4124cec36de/lava_callback.json.gz 2026-03-16 22:35:38,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:35:38,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831d90b8ad4124cec36de HTTP/1.1" 200 None 2026-03-16 22:35:38,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:35:38,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None 2026-03-16 22:35:38,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:35:38,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b831d90b8ad4124cec36de HTTP/1.1" 200 None 2026-03-16 22:35:38,940 - lava_callback - INFO - Completed processing callback for node 69b831d90b8ad4124cec36de 2026-03-16 22:35:43,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:35:43,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:45092 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50178 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60838 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52536 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52542 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45206 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34600 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34612 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36428 - "GET / HTTP/1.0" 200 OK 2026-03-16 22:36:54,750 - lava_callback - INFO - Received callback for node 69b831dc0b8ad4124cec36e4 INFO: 172.19.0.1:47480 - "POST /node/69b831dc0b8ad4124cec36e4 HTTP/1.0" 202 Accepted 2026-03-16 22:36:54,757 - lava_callback - INFO - Starting async job submit for node 69b831dc0b8ad4124cec36e4 2026-03-16 22:36:54,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:36:54,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831dc0b8ad4124cec36e4 HTTP/1.1" 200 None 2026-03-16 22:36:54,798 - lava_callback - DEBUG - Processing node 69b831dc0b8ad4124cec36e4: ltp-sched 2026-03-16 22:36:55,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 22:36:55,293 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 22:36:55,295 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-sched-69b831dc0b8ad4124cec36e4/log.txt.gz 2026-03-16 22:36:55,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 22:36:55,718 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 22:36:55,720 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-sched-69b831dc0b8ad4124cec36e4/lava-logs.yaml 2026-03-16 22:36:55,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 22:36:55,901 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 22:36:55,902 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-sched-69b831dc0b8ad4124cec36e4/lava_callback.json.gz 2026-03-16 22:36:55,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:36:55,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831dc0b8ad4124cec36e4 HTTP/1.1" 200 None 2026-03-16 22:36:55,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:36:55,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None 2026-03-16 22:36:55,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:36:55,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b831dc0b8ad4124cec36e4 HTTP/1.1" 200 None 2026-03-16 22:36:55,986 - lava_callback - INFO - Completed processing callback for node 69b831dc0b8ad4124cec36e4 INFO: 172.19.0.1:47486 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40506 - "GET / HTTP/1.0" 200 OK 2026-03-16 22:37:13,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:37:13,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-16 22:37:14,907 - lava_callback - INFO - Received callback for node 69b831da0b8ad4124cec36e1 INFO: 172.19.0.1:54854 - "POST /node/69b831da0b8ad4124cec36e1 HTTP/1.0" 202 Accepted 2026-03-16 22:37:14,914 - lava_callback - INFO - Starting async job submit for node 69b831da0b8ad4124cec36e1 2026-03-16 22:37:14,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:37:14,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831da0b8ad4124cec36e1 HTTP/1.1" 200 None 2026-03-16 22:37:14,956 - lava_callback - DEBUG - Processing node 69b831da0b8ad4124cec36e1: ltp-pty INFO: 172.19.0.1:54868 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-16 22:37:15,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 22:37:15,517 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 22:37:15,519 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-pty-69b831da0b8ad4124cec36e1/log.txt.gz 2026-03-16 22:37:15,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 22:37:15,947 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 22:37:15,949 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-pty-69b831da0b8ad4124cec36e1/lava-logs.yaml 2026-03-16 22:37:15,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 22:37:16,103 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 22:37:16,105 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-pty-69b831da0b8ad4124cec36e1/lava_callback.json.gz 2026-03-16 22:37:16,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:37:16,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831da0b8ad4124cec36e1 HTTP/1.1" 200 None 2026-03-16 22:37:16,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:37:16,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None 2026-03-16 22:37:16,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:37:16,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b831da0b8ad4124cec36e1 HTTP/1.1" 200 None 2026-03-16 22:37:16,203 - lava_callback - INFO - Completed processing callback for node 69b831da0b8ad4124cec36e1 INFO: 172.19.0.1:54880 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39526 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48214 - "GET / HTTP/1.0" 200 OK 2026-03-16 22:37:34,701 - lava_callback - INFO - Received callback for node 69b831dd0b8ad4124cec36e7 INFO: 172.19.0.1:48230 - "POST /node/69b831dd0b8ad4124cec36e7 HTTP/1.0" 202 Accepted 2026-03-16 22:37:34,707 - lava_callback - INFO - Starting async job submit for node 69b831dd0b8ad4124cec36e7 2026-03-16 22:37:34,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:37:34,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831dd0b8ad4124cec36e7 HTTP/1.1" 200 None 2026-03-16 22:37:34,748 - lava_callback - DEBUG - Processing node 69b831dd0b8ad4124cec36e7: ltp-smoke 2026-03-16 22:37:35,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 22:37:35,206 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 22:37:35,207 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69b831dd0b8ad4124cec36e7/log.txt.gz 2026-03-16 22:37:35,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 22:37:35,893 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 22:37:35,896 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69b831dd0b8ad4124cec36e7/lava-logs.yaml 2026-03-16 22:37:35,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 22:37:36,263 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 22:37:36,266 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69b831dd0b8ad4124cec36e7/lava_callback.json.gz 2026-03-16 22:37:36,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:37:36,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831dd0b8ad4124cec36e7 HTTP/1.1" 200 None 2026-03-16 22:37:36,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:37:36,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None 2026-03-16 22:37:36,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.19.0.1:48232 - "GET / HTTP/1.0" 200 OK 2026-03-16 22:37:36,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b831dd0b8ad4124cec36e7 HTTP/1.1" 200 None 2026-03-16 22:37:36,560 - lava_callback - INFO - Completed processing callback for node 69b831dd0b8ad4124cec36e7 2026-03-16 22:37:43,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:37:43,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:59286 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39344 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35756 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44604 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34366 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50664 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50672 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38256 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58954 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40416 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47744 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49936 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53856 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53868 - "GET / HTTP/1.0" 200 OK 2026-03-16 22:39:38,401 - lava_callback - INFO - Received callback for node 69b831e10b8ad4124cec36ee INFO: 172.19.0.1:53878 - "POST /node/69b831e10b8ad4124cec36ee HTTP/1.0" 202 Accepted 2026-03-16 22:39:38,407 - lava_callback - INFO - Starting async job submit for node 69b831e10b8ad4124cec36ee 2026-03-16 22:39:38,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:39:38,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831e10b8ad4124cec36ee HTTP/1.1" 200 None 2026-03-16 22:39:38,456 - lava_callback - DEBUG - Processing node 69b831e10b8ad4124cec36ee: ltp-syscalls-ipc 2026-03-16 22:39:38,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 22:39:38,969 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 22:39:38,971 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69b831e10b8ad4124cec36ee/log.txt.gz 2026-03-16 22:39:39,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 22:39:39,428 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 22:39:39,430 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69b831e10b8ad4124cec36ee/lava-logs.yaml 2026-03-16 22:39:39,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 22:39:39,612 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 22:39:39,614 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69b831e10b8ad4124cec36ee/lava_callback.json.gz 2026-03-16 22:39:39,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:39:39,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831e10b8ad4124cec36ee HTTP/1.1" 200 None 2026-03-16 22:39:39,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:39:39,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None 2026-03-16 22:39:39,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:39:39,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b831e10b8ad4124cec36ee HTTP/1.1" 200 None 2026-03-16 22:39:39,740 - lava_callback - INFO - Completed processing callback for node 69b831e10b8ad4124cec36ee 2026-03-16 22:39:43,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:39:43,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:57434 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40032 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36364 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51892 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36680 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60766 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60770 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54442 - "GET / HTTP/1.0" 200 OK 2026-03-16 22:40:54,818 - lava_callback - INFO - Received callback for node 69b831e20b8ad4124cec36f1 INFO: 172.19.0.1:42904 - "POST /node/69b831e20b8ad4124cec36f1 HTTP/1.0" 202 Accepted 2026-03-16 22:40:54,824 - lava_callback - INFO - Starting async job submit for node 69b831e20b8ad4124cec36f1 2026-03-16 22:40:54,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:40:54,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831e20b8ad4124cec36f1 HTTP/1.1" 200 None 2026-03-16 22:40:54,865 - lava_callback - DEBUG - Processing node 69b831e20b8ad4124cec36f1: ltp-timers 2026-03-16 22:40:55,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 22:40:55,385 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 22:40:55,387 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-timers-69b831e20b8ad4124cec36f1/log.txt.gz 2026-03-16 22:40:55,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 22:40:55,900 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 22:40:55,903 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-timers-69b831e20b8ad4124cec36f1/lava-logs.yaml 2026-03-16 22:40:55,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 22:40:56,068 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 22:40:56,070 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-timers-69b831e20b8ad4124cec36f1/lava_callback.json.gz 2026-03-16 22:40:56,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:40:56,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831e20b8ad4124cec36f1 HTTP/1.1" 200 None 2026-03-16 22:40:56,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:40:56,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None 2026-03-16 22:40:56,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:40:56,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b831e20b8ad4124cec36f1 HTTP/1.1" 200 None 2026-03-16 22:40:56,171 - lava_callback - INFO - Completed processing callback for node 69b831e20b8ad4124cec36f1 INFO: 172.19.0.1:42916 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55954 - "GET / HTTP/1.0" 200 OK 2026-03-16 22:41:13,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:41:13,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:41708 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41712 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42880 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49318 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49328 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59906 - "GET / HTTP/1.0" 200 OK 2026-03-16 22:41:55,002 - lava_callback - INFO - Received callback for node 69b831e40b8ad4124cec36f8 INFO: 172.19.0.1:36158 - "POST /node/69b831e40b8ad4124cec36f8 HTTP/1.0" 202 Accepted 2026-03-16 22:41:55,009 - lava_callback - INFO - Starting async job submit for node 69b831e40b8ad4124cec36f8 2026-03-16 22:41:55,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:41:55,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831e40b8ad4124cec36f8 HTTP/1.1" 200 None 2026-03-16 22:41:55,049 - lava_callback - DEBUG - Processing node 69b831e40b8ad4124cec36f8: ltp-watchqueue 2026-03-16 22:41:55,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 22:41:55,581 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 22:41:55,583 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69b831e40b8ad4124cec36f8/log.txt.gz 2026-03-16 22:41:55,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 22:41:56,044 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 22:41:56,046 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69b831e40b8ad4124cec36f8/lava-logs.yaml 2026-03-16 22:41:56,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 22:41:56,250 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 22:41:56,252 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69b831e40b8ad4124cec36f8/lava_callback.json.gz 2026-03-16 22:41:56,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:41:56,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b831e40b8ad4124cec36f8 HTTP/1.1" 200 None 2026-03-16 22:41:56,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:41:56,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None 2026-03-16 22:41:56,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:41:56,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b831e40b8ad4124cec36f8 HTTP/1.1" 200 None 2026-03-16 22:41:56,372 - lava_callback - INFO - Completed processing callback for node 69b831e40b8ad4124cec36f8 INFO: 172.19.0.1:36164 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33618 - "GET / HTTP/1.0" 200 OK 2026-03-16 22:42:13,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:42:13,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:51904 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51920 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37684 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56946 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56962 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44792 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41904 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54882 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48870 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43878 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58262 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58270 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33046 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53340 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42962 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57156 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35574 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40752 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40766 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49582 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53106 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46454 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53510 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46136 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44126 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44132 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57536 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57172 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33034 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49254 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41898 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38972 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38986 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49350 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49748 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41510 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45124 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45140 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52992 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55604 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55620 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40378 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34998 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48998 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39570 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44680 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38026 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38040 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43002 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47394 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50832 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35598 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35608 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34286 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35434 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35444 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57270 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50368 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55274 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42116 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46128 - "GET / HTTP/1.0" 200 OK 2026-03-16 22:50:34,122 - lava_callback - INFO - Received callback for node 69b8556a0b8ad4124cec6575 INFO: 172.19.0.1:43962 - "POST /node/69b8556a0b8ad4124cec6575 HTTP/1.0" 202 Accepted 2026-03-16 22:50:34,169 - lava_callback - INFO - Starting async job submit for node 69b8556a0b8ad4124cec6575 2026-03-16 22:50:34,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:50:34,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8556a0b8ad4124cec6575 HTTP/1.1" 200 None 2026-03-16 22:50:34,214 - lava_callback - DEBUG - Processing node 69b8556a0b8ad4124cec6575: baseline-arm-pengutronix 2026-03-16 22:50:34,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.19.0.1:43970 - "GET / HTTP/1.0" 200 OK 2026-03-16 22:50:34,497 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 22:50:34,499 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b8556a0b8ad4124cec6575/log.txt.gz 2026-03-16 22:50:34,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 22:50:34,759 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 22:50:34,761 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b8556a0b8ad4124cec6575/lava-logs.yaml 2026-03-16 22:50:34,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 22:50:34,921 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 22:50:34,922 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b8556a0b8ad4124cec6575/lava_callback.json.gz DEBUG: Setup failed for 69b8556a0b8ad4124cec6575. Transitting job node result: incomplete -> fail 2026-03-16 22:50:34,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:50:34,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8556a0b8ad4124cec6575 HTTP/1.1" 200 None 2026-03-16 22:50:34,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:50:35,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-16 22:50:35,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:50:35,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8556a0b8ad4124cec6575 HTTP/1.1" 200 None 2026-03-16 22:50:35,115 - lava_callback - INFO - Completed processing callback for node 69b8556a0b8ad4124cec6575 INFO: 172.19.0.1:43980 - "GET / HTTP/1.0" 200 OK 2026-03-16 22:50:43,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 22:50:43,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:55680 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53562 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38558 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33810 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33816 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45760 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40098 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40104 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54050 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39284 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45368 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53258 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51300 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46060 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46074 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50102 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43610 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37426 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39190 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35668 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53244 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53254 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48794 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56376 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40138 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41020 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41024 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37820 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55464 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55470 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60644 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45556 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34408 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49484 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33044 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46444 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46454 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42092 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58412 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55266 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43710 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44442 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50552 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50568 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57916 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38014 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40888 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36990 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36994 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45416 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38788 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38796 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40132 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49630 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37364 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58222 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58234 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53148 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53094 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53106 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52628 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51636 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50718 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50242 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50254 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40638 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45362 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45366 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51012 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44640 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60632 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42790 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39272 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43940 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43948 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55918 - "GET / HTTP/1.0" 200 OK 2026-03-16 23:00:55,486 - lava_callback - INFO - Received callback for node 69b5e89e1727ff69d6f269ff INFO: 172.19.0.1:36836 - "POST /node/69b5e89e1727ff69d6f269ff HTTP/1.0" 202 Accepted 2026-03-16 23:00:55,491 - lava_callback - INFO - Starting async job submit for node 69b5e89e1727ff69d6f269ff 2026-03-16 23:00:55,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:00:55,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5e89e1727ff69d6f269ff HTTP/1.1" 200 None 2026-03-16 23:00:55,508 - lava_callback - DEBUG - Processing node 69b5e89e1727ff69d6f269ff: baseline-arm64-baylibre 2026-03-16 23:00:55,508 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5e89e1727ff69d6f269ff 2026-03-16 23:00:55,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:00:55,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5e89e1727ff69d6f269ff HTTP/1.1" 200 None 2026-03-16 23:00:55,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:00:55,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-16 23:00:55,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:00:55,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5e89e1727ff69d6f269ff HTTP/1.1" 200 None 2026-03-16 23:00:55,565 - lava_callback - ERROR - Error processing callback for node 69b5e89e1727ff69d6f269ff: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:36848 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41320 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59536 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59550 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43658 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60970 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56848 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44264 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37566 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53318 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-16 23:02:15,709 - lava_callback - INFO - Received callback for node 69b5e8eb1727ff69d6f26a10 INFO: 172.19.0.1:53330 - "POST /node/69b5e8eb1727ff69d6f26a10 HTTP/1.0" 202 Accepted 2026-03-16 23:02:15,715 - lava_callback - INFO - Starting async job submit for node 69b5e8eb1727ff69d6f26a10 2026-03-16 23:02:15,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:02:15,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5e8eb1727ff69d6f26a10 HTTP/1.1" 200 None 2026-03-16 23:02:15,734 - lava_callback - DEBUG - Processing node 69b5e8eb1727ff69d6f26a10: baseline-arm64-baylibre 2026-03-16 23:02:15,735 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5e8eb1727ff69d6f26a10 2026-03-16 23:02:15,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:02:15,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5e8eb1727ff69d6f26a10 HTTP/1.1" 200 None 2026-03-16 23:02:15,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:02:15,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-16 23:02:15,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:02:15,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5e8eb1727ff69d6f26a10 HTTP/1.1" 200 None 2026-03-16 23:02:15,786 - lava_callback - ERROR - Error processing callback for node 69b5e8eb1727ff69d6f26a10: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:53344 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49618 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57986 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57994 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42872 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56834 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55754 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54512 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54514 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47754 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58992 - "GET / HTTP/1.0" 200 OK 2026-03-16 23:03:35,553 - lava_callback - INFO - Received callback for node 69b5e9391727ff69d6f26a19 INFO: 172.19.0.1:59008 - "POST /node/69b5e9391727ff69d6f26a19 HTTP/1.0" 202 Accepted 2026-03-16 23:03:35,558 - lava_callback - INFO - Starting async job submit for node 69b5e9391727ff69d6f26a19 2026-03-16 23:03:35,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:03:35,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5e9391727ff69d6f26a19 HTTP/1.1" 200 None 2026-03-16 23:03:35,576 - lava_callback - DEBUG - Processing node 69b5e9391727ff69d6f26a19: baseline-arm64-baylibre 2026-03-16 23:03:35,576 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5e9391727ff69d6f26a19 2026-03-16 23:03:35,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:03:35,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5e9391727ff69d6f26a19 HTTP/1.1" 200 None 2026-03-16 23:03:35,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:03:35,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-16 23:03:35,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:03:35,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5e9391727ff69d6f26a19 HTTP/1.1" 200 None 2026-03-16 23:03:35,638 - lava_callback - ERROR - Error processing callback for node 69b5e9391727ff69d6f26a19: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:59024 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47718 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43402 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42680 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38774 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40776 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58098 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58112 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51016 - "GET / HTTP/1.0" 200 OK 2026-03-16 23:04:55,733 - lava_callback - INFO - Received callback for node 69b5e9851727ff69d6f26a28 INFO: 172.19.0.1:47170 - "POST /node/69b5e9851727ff69d6f26a28 HTTP/1.0" 202 Accepted 2026-03-16 23:04:55,739 - lava_callback - INFO - Starting async job submit for node 69b5e9851727ff69d6f26a28 2026-03-16 23:04:55,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:04:55,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5e9851727ff69d6f26a28 HTTP/1.1" 200 None 2026-03-16 23:04:55,755 - lava_callback - DEBUG - Processing node 69b5e9851727ff69d6f26a28: baseline-arm64-baylibre 2026-03-16 23:04:55,755 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5e9851727ff69d6f26a28 2026-03-16 23:04:55,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:04:55,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5e9851727ff69d6f26a28 HTTP/1.1" 200 None 2026-03-16 23:04:55,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:04:55,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-16 23:04:55,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:04:55,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5e9851727ff69d6f26a28 HTTP/1.1" 200 None 2026-03-16 23:04:55,816 - lava_callback - ERROR - Error processing callback for node 69b5e9851727ff69d6f26a28: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:47184 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37006 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53508 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36676 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47314 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47322 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56506 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59468 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46278 - "GET / HTTP/1.0" 200 OK 2026-03-16 23:06:08,506 - lava_callback - INFO - Received callback for node 69b5e9d51727ff69d6f26a34 INFO: 172.19.0.1:46292 - "POST /node/69b5e9d51727ff69d6f26a34 HTTP/1.0" 202 Accepted 2026-03-16 23:06:08,511 - lava_callback - INFO - Starting async job submit for node 69b5e9d51727ff69d6f26a34 2026-03-16 23:06:08,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:06:08,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5e9d51727ff69d6f26a34 HTTP/1.1" 200 None 2026-03-16 23:06:08,528 - lava_callback - DEBUG - Processing node 69b5e9d51727ff69d6f26a34: baseline-arm64-clabbe 2026-03-16 23:06:08,528 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5e9d51727ff69d6f26a34 2026-03-16 23:06:08,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:06:08,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5e9d51727ff69d6f26a34 HTTP/1.1" 200 None 2026-03-16 23:06:08,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:06:08,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-16 23:06:08,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:06:08,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5e9d51727ff69d6f26a34 HTTP/1.1" 200 None 2026-03-16 23:06:08,585 - lava_callback - ERROR - Error processing callback for node 69b5e9d51727ff69d6f26a34: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:51776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51792 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57424 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50164 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50178 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49574 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47936 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38110 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53404 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-16 23:07:15,726 - lava_callback - INFO - Received callback for node 69b5ea191727ff69d6f26a46 INFO: 172.19.0.1:53410 - "POST /node/69b5ea191727ff69d6f26a46 HTTP/1.0" 202 Accepted 2026-03-16 23:07:15,731 - lava_callback - INFO - Starting async job submit for node 69b5ea191727ff69d6f26a46 2026-03-16 23:07:15,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:07:15,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5ea191727ff69d6f26a46 HTTP/1.1" 200 None 2026-03-16 23:07:15,770 - lava_callback - DEBUG - Processing node 69b5ea191727ff69d6f26a46: baseline-arm64-baylibre 2026-03-16 23:07:15,770 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5ea191727ff69d6f26a46 2026-03-16 23:07:15,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:07:15,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5ea191727ff69d6f26a46 HTTP/1.1" 200 None 2026-03-16 23:07:15,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:07:15,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-16 23:07:15,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:07:15,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5ea191727ff69d6f26a46 HTTP/1.1" 200 None 2026-03-16 23:07:15,831 - lava_callback - ERROR - Error processing callback for node 69b5ea191727ff69d6f26a46: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:53418 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47072 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60528 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60540 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54978 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42728 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37486 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50524 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53398 - "GET / HTTP/1.0" 200 OK 2026-03-16 23:08:28,546 - lava_callback - INFO - Received callback for node 69b5ea691727ff69d6f26a4e INFO: 172.19.0.1:53412 - "POST /node/69b5ea691727ff69d6f26a4e HTTP/1.0" 202 Accepted 2026-03-16 23:08:28,552 - lava_callback - INFO - Starting async job submit for node 69b5ea691727ff69d6f26a4e 2026-03-16 23:08:28,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:08:28,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5ea691727ff69d6f26a4e HTTP/1.1" 200 None 2026-03-16 23:08:28,571 - lava_callback - DEBUG - Processing node 69b5ea691727ff69d6f26a4e: baseline-arm64-clabbe 2026-03-16 23:08:28,571 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5ea691727ff69d6f26a4e 2026-03-16 23:08:28,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:08:28,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5ea691727ff69d6f26a4e HTTP/1.1" 200 None 2026-03-16 23:08:28,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:08:28,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-16 23:08:28,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:08:28,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5ea691727ff69d6f26a4e HTTP/1.1" 200 None 2026-03-16 23:08:28,637 - lava_callback - ERROR - Error processing callback for node 69b5ea691727ff69d6f26a4e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:57924 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57926 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37648 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43292 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40838 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50502 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37910 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41660 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41670 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43442 - "GET / HTTP/1.0" 200 OK 2026-03-16 23:09:48,566 - lava_callback - INFO - Received callback for node 69b5eab31727ff69d6f26a61 INFO: 172.19.0.1:43454 - "POST /node/69b5eab31727ff69d6f26a61 HTTP/1.0" 202 Accepted 2026-03-16 23:09:48,572 - lava_callback - INFO - Starting async job submit for node 69b5eab31727ff69d6f26a61 2026-03-16 23:09:48,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:09:48,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5eab31727ff69d6f26a61 HTTP/1.1" 200 None 2026-03-16 23:09:48,588 - lava_callback - DEBUG - Processing node 69b5eab31727ff69d6f26a61: baseline-arm64-clabbe 2026-03-16 23:09:48,588 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5eab31727ff69d6f26a61 2026-03-16 23:09:48,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:09:48,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5eab31727ff69d6f26a61 HTTP/1.1" 200 None 2026-03-16 23:09:48,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:09:48,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-16 23:09:48,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:09:48,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5eab31727ff69d6f26a61 HTTP/1.1" 200 None 2026-03-16 23:09:48,645 - lava_callback - ERROR - Error processing callback for node 69b5eab31727ff69d6f26a61: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-16 23:09:54,877 - lava_callback - INFO - Received callback for node 69b8573f0b8ad4124cec6585 INFO: 172.19.0.1:35822 - "POST /node/69b8573f0b8ad4124cec6585 HTTP/1.0" 202 Accepted 2026-03-16 23:09:54,925 - lava_callback - INFO - Starting async job submit for node 69b8573f0b8ad4124cec6585 2026-03-16 23:09:54,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:09:55,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8573f0b8ad4124cec6585 HTTP/1.1" 200 None 2026-03-16 23:09:55,020 - lava_callback - DEBUG - Processing node 69b8573f0b8ad4124cec6585: baseline-arm-pengutronix 2026-03-16 23:09:55,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 23:09:55,301 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 23:09:55,302 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b8573f0b8ad4124cec6585/log.txt.gz 2026-03-16 23:09:55,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 23:09:55,543 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 23:09:55,544 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b8573f0b8ad4124cec6585/lava-logs.yaml 2026-03-16 23:09:55,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-16 23:09:55,658 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-16 23:09:55,660 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b8573f0b8ad4124cec6585/lava_callback.json.gz DEBUG: Setup failed for 69b8573f0b8ad4124cec6585. Transitting job node result: incomplete -> fail 2026-03-16 23:09:55,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:09:55,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8573f0b8ad4124cec6585 HTTP/1.1" 200 None 2026-03-16 23:09:55,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:09:55,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-16 23:09:55,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:09:55,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8573f0b8ad4124cec6585 HTTP/1.1" 200 None 2026-03-16 23:09:55,840 - lava_callback - INFO - Completed processing callback for node 69b8573f0b8ad4124cec6585 INFO: 172.19.0.1:35836 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52510 - "GET / HTTP/1.0" 200 OK 2026-03-16 23:10:13,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:10:13,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:60522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60534 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53270 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40974 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59066 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56644 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37316 - "GET / HTTP/1.0" 200 OK 2026-03-16 23:11:08,650 - lava_callback - INFO - Received callback for node 69b5eaff1727ff69d6f26a6d INFO: 172.19.0.1:37330 - "POST /node/69b5eaff1727ff69d6f26a6d HTTP/1.0" 202 Accepted 2026-03-16 23:11:08,656 - lava_callback - INFO - Starting async job submit for node 69b5eaff1727ff69d6f26a6d 2026-03-16 23:11:08,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:11:08,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5eaff1727ff69d6f26a6d HTTP/1.1" 200 None 2026-03-16 23:11:08,671 - lava_callback - DEBUG - Processing node 69b5eaff1727ff69d6f26a6d: baseline-arm64-clabbe 2026-03-16 23:11:08,671 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5eaff1727ff69d6f26a6d 2026-03-16 23:11:08,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:11:08,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5eaff1727ff69d6f26a6d HTTP/1.1" 200 None 2026-03-16 23:11:08,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:11:08,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-16 23:11:08,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:11:08,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5eaff1727ff69d6f26a6d HTTP/1.1" 200 None 2026-03-16 23:11:08,754 - lava_callback - ERROR - Error processing callback for node 69b5eaff1727ff69d6f26a6d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:54588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54600 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43528 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39680 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39694 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47386 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49766 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58074 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45312 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44382 - "GET / HTTP/1.0" 200 OK 2026-03-16 23:12:28,700 - lava_callback - INFO - Received callback for node 69b5eb491727ff69d6f26a7b INFO: 172.19.0.1:44394 - "POST /node/69b5eb491727ff69d6f26a7b HTTP/1.0" 202 Accepted 2026-03-16 23:12:28,706 - lava_callback - INFO - Starting async job submit for node 69b5eb491727ff69d6f26a7b 2026-03-16 23:12:28,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:12:28,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5eb491727ff69d6f26a7b HTTP/1.1" 200 None 2026-03-16 23:12:28,722 - lava_callback - DEBUG - Processing node 69b5eb491727ff69d6f26a7b: baseline-arm64-clabbe 2026-03-16 23:12:28,722 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5eb491727ff69d6f26a7b 2026-03-16 23:12:28,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:12:28,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5eb491727ff69d6f26a7b HTTP/1.1" 200 None 2026-03-16 23:12:28,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:12:28,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-16 23:12:28,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:12:28,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5eb491727ff69d6f26a7b HTTP/1.1" 200 None 2026-03-16 23:12:28,786 - lava_callback - ERROR - Error processing callback for node 69b5eb491727ff69d6f26a7b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:55206 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55212 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60080 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34990 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39828 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56232 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36400 - "GET / HTTP/1.0" 200 OK 2026-03-16 23:13:28,700 - lava_callback - INFO - Received callback for node 69b5eb931727ff69d6f26a88 INFO: 172.19.0.1:36408 - "POST /node/69b5eb931727ff69d6f26a88 HTTP/1.0" 202 Accepted 2026-03-16 23:13:28,705 - lava_callback - INFO - Starting async job submit for node 69b5eb931727ff69d6f26a88 2026-03-16 23:13:28,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:13:28,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5eb931727ff69d6f26a88 HTTP/1.1" 200 None 2026-03-16 23:13:28,743 - lava_callback - DEBUG - Processing node 69b5eb931727ff69d6f26a88: baseline-arm64-clabbe 2026-03-16 23:13:28,743 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5eb931727ff69d6f26a88 2026-03-16 23:13:28,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:13:28,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5eb931727ff69d6f26a88 HTTP/1.1" 200 None 2026-03-16 23:13:28,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:13:28,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-16 23:13:28,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:13:28,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5eb931727ff69d6f26a88 HTTP/1.1" 200 None 2026-03-16 23:13:28,807 - lava_callback - ERROR - Error processing callback for node 69b5eb931727ff69d6f26a88: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:44374 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44378 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47166 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59518 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34208 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56182 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56186 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33512 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36628 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36644 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44372 - "GET / HTTP/1.0" 200 OK 2026-03-16 23:14:48,781 - lava_callback - INFO - Received callback for node 69b5ebde1727ff69d6f26a9b INFO: 172.19.0.1:44380 - "POST /node/69b5ebde1727ff69d6f26a9b HTTP/1.0" 202 Accepted 2026-03-16 23:14:48,787 - lava_callback - INFO - Starting async job submit for node 69b5ebde1727ff69d6f26a9b 2026-03-16 23:14:48,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:14:48,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5ebde1727ff69d6f26a9b HTTP/1.1" 200 None 2026-03-16 23:14:48,819 - lava_callback - DEBUG - Processing node 69b5ebde1727ff69d6f26a9b: baseline-arm64-clabbe 2026-03-16 23:14:48,819 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5ebde1727ff69d6f26a9b 2026-03-16 23:14:48,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:14:48,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5ebde1727ff69d6f26a9b HTTP/1.1" 200 None 2026-03-16 23:14:48,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:14:48,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-16 23:14:48,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:14:48,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5ebde1727ff69d6f26a9b HTTP/1.1" 200 None 2026-03-16 23:14:48,882 - lava_callback - ERROR - Error processing callback for node 69b5ebde1727ff69d6f26a9b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:33180 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42110 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58742 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38762 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60688 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60704 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33216 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51616 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52456 - "GET / HTTP/1.0" 200 OK 2026-03-16 23:16:08,833 - lava_callback - INFO - Received callback for node 69b5ec281727ff69d6f26aa7 INFO: 172.19.0.1:52460 - "POST /node/69b5ec281727ff69d6f26aa7 HTTP/1.0" 202 Accepted 2026-03-16 23:16:08,839 - lava_callback - INFO - Starting async job submit for node 69b5ec281727ff69d6f26aa7 2026-03-16 23:16:08,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:16:08,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5ec281727ff69d6f26aa7 HTTP/1.1" 200 None 2026-03-16 23:16:08,855 - lava_callback - DEBUG - Processing node 69b5ec281727ff69d6f26aa7: baseline-arm64-clabbe 2026-03-16 23:16:08,855 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5ec281727ff69d6f26aa7 2026-03-16 23:16:08,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:16:08,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5ec281727ff69d6f26aa7 HTTP/1.1" 200 None 2026-03-16 23:16:08,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:16:08,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-16 23:16:08,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:16:08,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5ec281727ff69d6f26aa7 HTTP/1.1" 200 None 2026-03-16 23:16:08,931 - lava_callback - ERROR - Error processing callback for node 69b5ec281727ff69d6f26aa7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:41640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41652 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33922 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53468 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53476 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52734 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57232 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56414 - "GET / HTTP/1.0" 200 OK 2026-03-16 23:17:08,858 - lava_callback - INFO - Received callback for node 69b5ec721727ff69d6f26aba INFO: 172.19.0.1:56418 - "POST /node/69b5ec721727ff69d6f26aba HTTP/1.0" 202 Accepted 2026-03-16 23:17:08,864 - lava_callback - INFO - Starting async job submit for node 69b5ec721727ff69d6f26aba 2026-03-16 23:17:08,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:17:08,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5ec721727ff69d6f26aba HTTP/1.1" 200 None 2026-03-16 23:17:08,880 - lava_callback - DEBUG - Processing node 69b5ec721727ff69d6f26aba: baseline-arm64-clabbe 2026-03-16 23:17:08,880 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5ec721727ff69d6f26aba 2026-03-16 23:17:08,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:17:08,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5ec721727ff69d6f26aba HTTP/1.1" 200 None 2026-03-16 23:17:08,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:17:08,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-16 23:17:08,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:17:08,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5ec721727ff69d6f26aba HTTP/1.1" 200 None 2026-03-16 23:17:08,936 - lava_callback - ERROR - Error processing callback for node 69b5ec721727ff69d6f26aba: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:51118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51130 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58306 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53700 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53712 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37366 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37502 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40954 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40400 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40414 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45916 - "GET / HTTP/1.0" 200 OK 2026-03-16 23:18:28,912 - lava_callback - INFO - Received callback for node 69b5ecbc1727ff69d6f26ac6 INFO: 172.19.0.1:45928 - "POST /node/69b5ecbc1727ff69d6f26ac6 HTTP/1.0" 202 Accepted 2026-03-16 23:18:28,917 - lava_callback - INFO - Starting async job submit for node 69b5ecbc1727ff69d6f26ac6 2026-03-16 23:18:28,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:18:28,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5ecbc1727ff69d6f26ac6 HTTP/1.1" 200 None 2026-03-16 23:18:28,933 - lava_callback - DEBUG - Processing node 69b5ecbc1727ff69d6f26ac6: baseline-arm64-clabbe 2026-03-16 23:18:28,933 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5ecbc1727ff69d6f26ac6 2026-03-16 23:18:28,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:18:28,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5ecbc1727ff69d6f26ac6 HTTP/1.1" 200 None 2026-03-16 23:18:28,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:18:28,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-16 23:18:28,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:18:28,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5ecbc1727ff69d6f26ac6 HTTP/1.1" 200 None 2026-03-16 23:18:28,994 - lava_callback - ERROR - Error processing callback for node 69b5ecbc1727ff69d6f26ac6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:38578 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38584 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51746 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35450 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41940 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49876 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56742 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55860 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55862 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49370 - "GET / HTTP/1.0" 200 OK 2026-03-16 23:19:48,966 - lava_callback - INFO - Received callback for node 69b5ed051727ff69d6f26ad4 INFO: 172.19.0.1:49372 - "POST /node/69b5ed051727ff69d6f26ad4 HTTP/1.0" 202 Accepted 2026-03-16 23:19:48,971 - lava_callback - INFO - Starting async job submit for node 69b5ed051727ff69d6f26ad4 2026-03-16 23:19:48,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:19:48,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5ed051727ff69d6f26ad4 HTTP/1.1" 200 None 2026-03-16 23:19:48,988 - lava_callback - DEBUG - Processing node 69b5ed051727ff69d6f26ad4: baseline-arm64-clabbe 2026-03-16 23:19:48,988 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5ed051727ff69d6f26ad4 2026-03-16 23:19:48,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:19:49,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5ed051727ff69d6f26ad4 HTTP/1.1" 200 None 2026-03-16 23:19:49,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:19:49,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-16 23:19:49,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:19:49,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5ed051727ff69d6f26ad4 HTTP/1.1" 200 None 2026-03-16 23:19:49,056 - lava_callback - ERROR - Error processing callback for node 69b5ed051727ff69d6f26ad4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:59680 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47682 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57156 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40060 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47126 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47132 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50036 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34502 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60928 - "GET / HTTP/1.0" 200 OK 2026-03-16 23:21:09,016 - lava_callback - INFO - Received callback for node 69b5ed501727ff69d6f26adf INFO: 172.19.0.1:60932 - "POST /node/69b5ed501727ff69d6f26adf HTTP/1.0" 202 Accepted 2026-03-16 23:21:09,022 - lava_callback - INFO - Starting async job submit for node 69b5ed501727ff69d6f26adf 2026-03-16 23:21:09,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:21:09,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5ed501727ff69d6f26adf HTTP/1.1" 200 None 2026-03-16 23:21:09,038 - lava_callback - DEBUG - Processing node 69b5ed501727ff69d6f26adf: baseline-arm64-clabbe 2026-03-16 23:21:09,038 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5ed501727ff69d6f26adf 2026-03-16 23:21:09,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:21:09,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5ed501727ff69d6f26adf HTTP/1.1" 200 None 2026-03-16 23:21:09,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:21:09,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None 2026-03-16 23:21:09,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:21:09,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5ed501727ff69d6f26adf HTTP/1.1" 200 None 2026-03-16 23:21:09,109 - lava_callback - ERROR - Error processing callback for node 69b5ed501727ff69d6f26adf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:56658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56674 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59928 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36062 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36068 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45082 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38410 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38912 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43234 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43240 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52564 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39414 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39426 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39042 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33930 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48082 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48570 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50956 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44486 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44488 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41374 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40470 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50260 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39532 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39548 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60804 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48624 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48636 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43732 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58406 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40806 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38018 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36756 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45772 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45774 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33162 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52926 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48698 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37168 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37178 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51052 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52282 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52294 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46706 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51674 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42130 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60628 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42124 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58050 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58064 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36086 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58578 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59330 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48006 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41876 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50574 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50584 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57104 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46950 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36000 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53824 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58430 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36340 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36356 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40318 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60598 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43092 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34764 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36364 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36376 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34064 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56022 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51834 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46380 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58484 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41422 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41438 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50628 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54100 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52040 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38182 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38196 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57160 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53404 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53410 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40590 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38116 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47000 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60484 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46682 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57896 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57910 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60940 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59888 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55662 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56068 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42516 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37534 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37546 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60166 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47082 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38748 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50322 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43154 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39088 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39100 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55264 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54080 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60880 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40406 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48954 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38414 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38426 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35704 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57808 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59608 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39340 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39352 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51722 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59272 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59274 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42788 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48186 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36140 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60940 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42122 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33066 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33080 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38734 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44772 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32822 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35490 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58604 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43766 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43768 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45156 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44360 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53376 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45992 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34460 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51408 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51424 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59588 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34282 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51938 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42456 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42462 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40428 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49656 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49662 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51984 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33814 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43704 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52668 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52682 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50274 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53716 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53722 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42768 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46186 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56828 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43690 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36014 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41748 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41754 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40716 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38090 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36056 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46234 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58334 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46630 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46644 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47278 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36570 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37860 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58798 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54314 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60674 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60682 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56914 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43408 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52222 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55602 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45734 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38306 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38308 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38226 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35208 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38874 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43584 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46056 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40670 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40686 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56186 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51102 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37728 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52374 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52378 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43632 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38212 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38224 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38646 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58060 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42288 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51136 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52794 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49988 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39300 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33682 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38804 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38424 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38440 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35990 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37954 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37962 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34486 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44306 - "GET / HTTP/1.0" 200 OK 2026-03-16 23:50:58,223 - lava_callback - INFO - Received callback for node 69b5f4521727ff69d6f26b08 INFO: 172.19.0.1:44314 - "POST /node/69b5f4521727ff69d6f26b08 HTTP/1.0" 202 Accepted 2026-03-16 23:50:58,228 - lava_callback - INFO - Starting async job submit for node 69b5f4521727ff69d6f26b08 2026-03-16 23:50:58,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:50:58,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5f4521727ff69d6f26b08 HTTP/1.1" 200 None 2026-03-16 23:50:58,245 - lava_callback - DEBUG - Processing node 69b5f4521727ff69d6f26b08: baseline-arm-baylibre 2026-03-16 23:50:58,245 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5f4521727ff69d6f26b08 2026-03-16 23:50:58,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:50:58,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5f4521727ff69d6f26b08 HTTP/1.1" 200 None 2026-03-16 23:50:58,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:50:58,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None 2026-03-16 23:50:58,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:50:58,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5f4521727ff69d6f26b08 HTTP/1.1" 200 None 2026-03-16 23:50:58,322 - lava_callback - ERROR - Error processing callback for node 69b5f4521727ff69d6f26b08: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:51000 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47642 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48642 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43116 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43120 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37036 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39562 - "GET / HTTP/1.0" 200 OK 2026-03-16 23:51:58,129 - lava_callback - INFO - Received callback for node 69b5f48f1727ff69d6f26b14 INFO: 172.19.0.1:39576 - "POST /node/69b5f48f1727ff69d6f26b14 HTTP/1.0" 202 Accepted 2026-03-16 23:51:58,135 - lava_callback - INFO - Starting async job submit for node 69b5f48f1727ff69d6f26b14 2026-03-16 23:51:58,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:51:58,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5f48f1727ff69d6f26b14 HTTP/1.1" 200 None 2026-03-16 23:51:58,151 - lava_callback - DEBUG - Processing node 69b5f48f1727ff69d6f26b14: baseline-arm-baylibre 2026-03-16 23:51:58,151 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5f48f1727ff69d6f26b14 2026-03-16 23:51:58,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:51:58,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5f48f1727ff69d6f26b14 HTTP/1.1" 200 None 2026-03-16 23:51:58,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:51:58,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None 2026-03-16 23:51:58,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:51:58,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5f48f1727ff69d6f26b14 HTTP/1.1" 200 None 2026-03-16 23:51:58,216 - lava_callback - ERROR - Error processing callback for node 69b5f48f1727ff69d6f26b14: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:55756 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60616 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42104 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34872 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34888 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55924 - "GET / HTTP/1.0" 200 OK 2026-03-16 23:52:50,413 - lava_callback - INFO - Received callback for node 69b5f4cd1727ff69d6f26b22 INFO: 172.19.0.1:36752 - "POST /node/69b5f4cd1727ff69d6f26b22 HTTP/1.0" 202 Accepted 2026-03-16 23:52:50,418 - lava_callback - INFO - Starting async job submit for node 69b5f4cd1727ff69d6f26b22 2026-03-16 23:52:50,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:52:50,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5f4cd1727ff69d6f26b22 HTTP/1.1" 200 None 2026-03-16 23:52:50,435 - lava_callback - DEBUG - Processing node 69b5f4cd1727ff69d6f26b22: baseline-arm-clabbe 2026-03-16 23:52:50,435 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5f4cd1727ff69d6f26b22 2026-03-16 23:52:50,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:52:50,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5f4cd1727ff69d6f26b22 HTTP/1.1" 200 None 2026-03-16 23:52:50,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:52:50,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None 2026-03-16 23:52:50,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:52:50,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5f4cd1727ff69d6f26b22 HTTP/1.1" 200 None 2026-03-16 23:52:50,502 - lava_callback - ERROR - Error processing callback for node 69b5f4cd1727ff69d6f26b22: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:36756 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46326 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33096 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60452 - "GET / HTTP/1.0" 200 OK 2026-03-16 23:53:30,381 - lava_callback - INFO - Received callback for node 69b5f4f11727ff69d6f26b2e INFO: 172.19.0.1:47500 - "POST /node/69b5f4f11727ff69d6f26b2e HTTP/1.0" 202 Accepted 2026-03-16 23:53:30,387 - lava_callback - INFO - Starting async job submit for node 69b5f4f11727ff69d6f26b2e 2026-03-16 23:53:30,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:53:30,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5f4f11727ff69d6f26b2e HTTP/1.1" 200 None 2026-03-16 23:53:30,403 - lava_callback - DEBUG - Processing node 69b5f4f11727ff69d6f26b2e: baseline-arm-clabbe 2026-03-16 23:53:30,403 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5f4f11727ff69d6f26b2e 2026-03-16 23:53:30,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:53:30,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5f4f11727ff69d6f26b2e HTTP/1.1" 200 None 2026-03-16 23:53:30,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:53:30,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None 2026-03-16 23:53:30,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:53:30,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5f4f11727ff69d6f26b2e HTTP/1.1" 200 None 2026-03-16 23:53:30,465 - lava_callback - ERROR - Error processing callback for node 69b5f4f11727ff69d6f26b2e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:47502 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47516 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53970 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52018 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44192 - "GET / HTTP/1.0" 200 OK 2026-03-16 23:54:10,435 - lava_callback - INFO - Received callback for node 69b5f5161727ff69d6f26b3b INFO: 172.19.0.1:48978 - "POST /node/69b5f5161727ff69d6f26b3b HTTP/1.0" 202 Accepted 2026-03-16 23:54:10,441 - lava_callback - INFO - Starting async job submit for node 69b5f5161727ff69d6f26b3b 2026-03-16 23:54:10,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:54:10,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5f5161727ff69d6f26b3b HTTP/1.1" 200 None 2026-03-16 23:54:10,457 - lava_callback - DEBUG - Processing node 69b5f5161727ff69d6f26b3b: baseline-arm-clabbe 2026-03-16 23:54:10,458 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5f5161727ff69d6f26b3b 2026-03-16 23:54:10,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:54:10,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5f5161727ff69d6f26b3b HTTP/1.1" 200 None 2026-03-16 23:54:10,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:54:10,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None 2026-03-16 23:54:10,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:54:10,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5f5161727ff69d6f26b3b HTTP/1.1" 200 None 2026-03-16 23:54:10,514 - lava_callback - ERROR - Error processing callback for node 69b5f5161727ff69d6f26b3b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:48992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49000 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41056 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35688 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35698 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59066 - "GET / HTTP/1.0" 200 OK 2026-03-16 23:54:50,434 - lava_callback - INFO - Received callback for node 69b5f53a1727ff69d6f26b49 INFO: 172.19.0.1:57528 - "POST /node/69b5f53a1727ff69d6f26b49 HTTP/1.0" 202 Accepted 2026-03-16 23:54:50,440 - lava_callback - INFO - Starting async job submit for node 69b5f53a1727ff69d6f26b49 2026-03-16 23:54:50,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:54:50,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5f53a1727ff69d6f26b49 HTTP/1.1" 200 None 2026-03-16 23:54:50,456 - lava_callback - DEBUG - Processing node 69b5f53a1727ff69d6f26b49: baseline-arm-clabbe 2026-03-16 23:54:50,456 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5f53a1727ff69d6f26b49 2026-03-16 23:54:50,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:54:50,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5f53a1727ff69d6f26b49 HTTP/1.1" 200 None 2026-03-16 23:54:50,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:54:50,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None 2026-03-16 23:54:50,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:54:50,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5f53a1727ff69d6f26b49 HTTP/1.1" 200 None 2026-03-16 23:54:50,519 - lava_callback - ERROR - Error processing callback for node 69b5f53a1727ff69d6f26b49: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:57532 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41364 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54188 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46720 - "GET / HTTP/1.0" 200 OK 2026-03-16 23:55:30,485 - lava_callback - INFO - Received callback for node 69b5f55e1727ff69d6f26b53 INFO: 172.19.0.1:34026 - "POST /node/69b5f55e1727ff69d6f26b53 HTTP/1.0" 202 Accepted 2026-03-16 23:55:30,490 - lava_callback - INFO - Starting async job submit for node 69b5f55e1727ff69d6f26b53 2026-03-16 23:55:30,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:55:30,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5f55e1727ff69d6f26b53 HTTP/1.1" 200 None 2026-03-16 23:55:30,527 - lava_callback - DEBUG - Processing node 69b5f55e1727ff69d6f26b53: baseline-arm-clabbe 2026-03-16 23:55:30,527 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5f55e1727ff69d6f26b53 2026-03-16 23:55:30,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:55:30,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5f55e1727ff69d6f26b53 HTTP/1.1" 200 None 2026-03-16 23:55:30,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:55:30,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None 2026-03-16 23:55:30,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-16 23:55:30,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5f55e1727ff69d6f26b53 HTTP/1.1" 200 None 2026-03-16 23:55:30,585 - lava_callback - ERROR - Error processing callback for node 69b5f55e1727ff69d6f26b53: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:34028 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34030 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52720 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35212 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39234 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48258 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47002 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41616 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41618 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50426 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51246 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55766 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56722 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46424 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45950 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45958 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42222 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47006 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53106 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52992 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38250 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47636 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47652 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40148 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54822 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52464 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36054 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57542 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58986 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58998 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36478 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59792 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53116 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53570 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50576 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50032 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50034 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38648 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46066 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36562 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49320 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49328 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35864 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43202 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43218 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37414 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41290 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59696 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36296 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45284 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57008 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57022 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41280 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60224 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43902 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40396 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58996 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49344 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49348 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40174 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35072 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46752 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41360 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56846 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48602 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48608 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56984 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33360 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37014 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42598 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38634 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52684 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52694 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38698 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53314 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56636 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55038 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47820 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38202 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38204 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37718 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51364 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56616 - "GET / HTTP/1.0" 200 OK 2026-03-17 00:07:11,075 - lava_callback - INFO - Received callback for node 69b5f81f1727ff69d6f26b63 INFO: 172.19.0.1:45024 - "POST /node/69b5f81f1727ff69d6f26b63 HTTP/1.0" 202 Accepted 2026-03-17 00:07:11,081 - lava_callback - INFO - Starting async job submit for node 69b5f81f1727ff69d6f26b63 2026-03-17 00:07:11,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:07:11,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5f81f1727ff69d6f26b63 HTTP/1.1" 200 None 2026-03-17 00:07:11,098 - lava_callback - DEBUG - Processing node 69b5f81f1727ff69d6f26b63: baseline-arm-clabbe 2026-03-17 00:07:11,099 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5f81f1727ff69d6f26b63 2026-03-17 00:07:11,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:07:11,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5f81f1727ff69d6f26b63 HTTP/1.1" 200 None 2026-03-17 00:07:11,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:07:11,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None 2026-03-17 00:07:11,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:07:11,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5f81f1727ff69d6f26b63 HTTP/1.1" 200 None 2026-03-17 00:07:11,159 - lava_callback - ERROR - Error processing callback for node 69b5f81f1727ff69d6f26b63: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:45036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45044 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43216 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57800 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57804 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38400 - "GET / HTTP/1.0" 200 OK 2026-03-17 00:07:51,042 - lava_callback - INFO - Received callback for node 69b5f8461727ff69d6f26b70 INFO: 172.19.0.1:50052 - "POST /node/69b5f8461727ff69d6f26b70 HTTP/1.0" 202 Accepted 2026-03-17 00:07:51,047 - lava_callback - INFO - Starting async job submit for node 69b5f8461727ff69d6f26b70 2026-03-17 00:07:51,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:07:51,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5f8461727ff69d6f26b70 HTTP/1.1" 200 None 2026-03-17 00:07:51,072 - lava_callback - DEBUG - Processing node 69b5f8461727ff69d6f26b70: baseline-arm-clabbe 2026-03-17 00:07:51,073 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5f8461727ff69d6f26b70 2026-03-17 00:07:51,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:07:51,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5f8461727ff69d6f26b70 HTTP/1.1" 200 None 2026-03-17 00:07:51,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:07:51,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None 2026-03-17 00:07:51,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:07:51,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5f8461727ff69d6f26b70 HTTP/1.1" 200 None 2026-03-17 00:07:51,141 - lava_callback - ERROR - Error processing callback for node 69b5f8461727ff69d6f26b70: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:50066 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41004 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43252 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59598 - "GET / HTTP/1.0" 200 OK 2026-03-17 00:08:31,143 - lava_callback - INFO - Received callback for node 69b5f86f1727ff69d6f26b79 INFO: 172.19.0.1:57598 - "POST /node/69b5f86f1727ff69d6f26b79 HTTP/1.0" 202 Accepted 2026-03-17 00:08:31,148 - lava_callback - INFO - Starting async job submit for node 69b5f86f1727ff69d6f26b79 2026-03-17 00:08:31,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:08:31,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5f86f1727ff69d6f26b79 HTTP/1.1" 200 None 2026-03-17 00:08:31,165 - lava_callback - DEBUG - Processing node 69b5f86f1727ff69d6f26b79: baseline-arm-clabbe 2026-03-17 00:08:31,165 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5f86f1727ff69d6f26b79 2026-03-17 00:08:31,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:08:31,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5f86f1727ff69d6f26b79 HTTP/1.1" 200 None 2026-03-17 00:08:31,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:08:31,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None 2026-03-17 00:08:31,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:08:31,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5f86f1727ff69d6f26b79 HTTP/1.1" 200 None 2026-03-17 00:08:31,221 - lava_callback - ERROR - Error processing callback for node 69b5f86f1727ff69d6f26b79: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:57610 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57612 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57218 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42598 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38668 - "GET / HTTP/1.0" 200 OK 2026-03-17 00:09:11,129 - lava_callback - INFO - Received callback for node 69b5f8961727ff69d6f26b84 INFO: 172.19.0.1:47156 - "POST /node/69b5f8961727ff69d6f26b84 HTTP/1.0" 202 Accepted 2026-03-17 00:09:11,135 - lava_callback - INFO - Starting async job submit for node 69b5f8961727ff69d6f26b84 2026-03-17 00:09:11,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:09:11,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5f8961727ff69d6f26b84 HTTP/1.1" 200 None 2026-03-17 00:09:11,151 - lava_callback - DEBUG - Processing node 69b5f8961727ff69d6f26b84: baseline-arm-clabbe 2026-03-17 00:09:11,151 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5f8961727ff69d6f26b84 2026-03-17 00:09:11,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:09:11,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5f8961727ff69d6f26b84 HTTP/1.1" 200 None 2026-03-17 00:09:11,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:09:11,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None 2026-03-17 00:09:11,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:09:11,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5f8961727ff69d6f26b84 HTTP/1.1" 200 None 2026-03-17 00:09:11,215 - lava_callback - ERROR - Error processing callback for node 69b5f8961727ff69d6f26b84: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:47172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47184 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42410 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38886 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38890 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41168 - "GET / HTTP/1.0" 200 OK 2026-03-17 00:09:51,170 - lava_callback - INFO - Received callback for node 69b5f8be1727ff69d6f26b91 INFO: 172.19.0.1:39164 - "POST /node/69b5f8be1727ff69d6f26b91 HTTP/1.0" 202 Accepted 2026-03-17 00:09:51,176 - lava_callback - INFO - Starting async job submit for node 69b5f8be1727ff69d6f26b91 2026-03-17 00:09:51,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:09:51,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5f8be1727ff69d6f26b91 HTTP/1.1" 200 None 2026-03-17 00:09:51,192 - lava_callback - DEBUG - Processing node 69b5f8be1727ff69d6f26b91: baseline-arm-clabbe 2026-03-17 00:09:51,193 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b5f8be1727ff69d6f26b91 2026-03-17 00:09:51,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:09:51,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b5f8be1727ff69d6f26b91 HTTP/1.1" 200 None 2026-03-17 00:09:51,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:09:51,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None 2026-03-17 00:09:51,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-17 00:09:51,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b5f8be1727ff69d6f26b91 HTTP/1.1" 200 None 2026-03-17 00:09:51,246 - lava_callback - ERROR - Error processing callback for node 69b5f8be1727ff69d6f26b91: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:39172 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47366 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37544 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41788 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41744 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41754 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54890 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40114 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54546 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38736 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47810 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40386 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40396 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48610 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46672 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32918 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36172 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33634 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37040 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37048 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54292 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43950 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56406 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49974 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55104 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44168 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44178 - "GET / HTTP/1.0" 200 OK INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1]