INFO: Started server process [1]
INFO: Waiting for application startup.
INFO: Application startup complete.
INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit)
INFO: 172.19.0.1:60358 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33012 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33020 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:32934 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:14:08,901 - lava_callback - INFO - Received callback for node 69bacf43537ae4d3c823850c
2026-03-20 16:14:08,912 - lava_callback - INFO - Starting async job submit for node 69bacf43537ae4d3c823850c
INFO: 172.19.0.1:32942 - "POST /node/69bacf43537ae4d3c823850c HTTP/1.0" 202 Accepted
2026-03-20 16:14:08,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:14:08,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bacf43537ae4d3c823850c HTTP/1.1" 200 None
2026-03-20 16:14:08,941 - lava_callback - DEBUG - Processing node 69bacf43537ae4d3c823850c: baseline-arm-clabbe
2026-03-20 16:14:08,941 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bacf43537ae4d3c823850c
2026-03-20 16:14:08,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:14:08,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bacf43537ae4d3c823850c HTTP/1.1" 200 None
2026-03-20 16:14:08,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:14:08,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd6400b80c8ffdcb829f HTTP/1.1" 200 None
2026-03-20 16:14:08,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:14:09,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bacf43537ae4d3c823850c HTTP/1.1" 200 None
2026-03-20 16:14:09,045 - lava_callback - ERROR - Error processing callback for node 69bacf43537ae4d3c823850c: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:36220 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:36226 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51554 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:14:28,683 - lava_callback - INFO - Received callback for node 69bbba0cec3f435d20d52481
INFO: 172.19.0.1:51568 - "POST /node/69bbba0cec3f435d20d52481 HTTP/1.0" 202 Accepted
2026-03-20 16:14:28,693 - lava_callback - INFO - Starting async job submit for node 69bbba0cec3f435d20d52481
2026-03-20 16:14:28,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:14:28,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba0cec3f435d20d52481 HTTP/1.1" 200 None
2026-03-20 16:14:28,723 - lava_callback - DEBUG - Processing node 69bbba0cec3f435d20d52481: baseline-x86
2026-03-20 16:14:28,732 - lava_callback - WARNING - Failed to upload log
2026-03-20 16:14:28,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:14:28,800 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 502 150
Upload attempt 1 failed with 502 Bad Gateway: 502 Server Error: Bad Gateway for url: https://files-staging.kernelci.org/upload
Response body:
502 Bad Gateway
502 Bad Gateway
nginx
Retrying in 10 seconds... (4 retries remaining)
2026-03-20 16:14:34,697 - lava_callback - INFO - Received callback for node 69bbb68aec3f435d20d51b5b
2026-03-20 16:14:34,705 - lava_callback - INFO - Starting async job submit for node 69bbb68aec3f435d20d51b5b
INFO: 172.19.0.1:43356 - "POST /node/69bbb68aec3f435d20d51b5b HTTP/1.0" 202 Accepted
2026-03-20 16:14:34,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:14:34,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb68aec3f435d20d51b5b HTTP/1.1" 200 None
2026-03-20 16:14:34,756 - lava_callback - DEBUG - Processing node 69bbb68aec3f435d20d51b5b: baseline-x86
2026-03-20 16:14:35,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:14:35,307 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 502 150
Upload attempt 1 failed with 502 Bad Gateway: 502 Server Error: Bad Gateway for url: https://files-staging.kernelci.org/upload
Response body:
502 Bad Gateway
502 Bad Gateway
nginx
Retrying in 10 seconds... (4 retries remaining)
INFO: 172.19.0.1:43358 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:14:38,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:14:38,850 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 502 150
Upload attempt 2 failed with 502 Bad Gateway: 502 Server Error: Bad Gateway for url: https://files-staging.kernelci.org/upload
Response body:
502 Bad Gateway
502 Bad Gateway
nginx
Retrying in 10 seconds... (3 retries remaining)
2026-03-20 16:14:45,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:14:45,348 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 502 150
Upload attempt 2 failed with 502 Bad Gateway: 502 Server Error: Bad Gateway for url: https://files-staging.kernelci.org/upload
Response body:
502 Bad Gateway
502 Bad Gateway
nginx
Retrying in 10 seconds... (3 retries remaining)
INFO: 172.19.0.1:32906 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:14:48,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:14:48,889 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 502 150
Upload attempt 3 failed with 502 Bad Gateway: 502 Server Error: Bad Gateway for url: https://files-staging.kernelci.org/upload
Response body:
502 Bad Gateway
502 Bad Gateway
nginx
Retrying in 10 seconds... (2 retries remaining)
2026-03-20 16:14:48,967 - lava_callback - INFO - Received callback for node 69bacf6f537ae4d3c8238516
2026-03-20 16:14:48,973 - lava_callback - INFO - Starting async job submit for node 69bacf6f537ae4d3c8238516
INFO: 172.19.0.1:32908 - "POST /node/69bacf6f537ae4d3c8238516 HTTP/1.0" 202 Accepted
2026-03-20 16:14:48,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:14:48,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bacf6f537ae4d3c8238516 HTTP/1.1" 200 None
2026-03-20 16:14:48,992 - lava_callback - DEBUG - Processing node 69bacf6f537ae4d3c8238516: baseline-arm-clabbe
2026-03-20 16:14:48,993 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bacf6f537ae4d3c8238516
2026-03-20 16:14:48,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:14:49,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bacf6f537ae4d3c8238516 HTTP/1.1" 200 None
2026-03-20 16:14:49,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:14:49,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd6400b80c8ffdcb829f HTTP/1.1" 200 None
2026-03-20 16:14:49,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:14:49,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bacf6f537ae4d3c8238516 HTTP/1.1" 200 None
2026-03-20 16:14:49,059 - lava_callback - ERROR - Error processing callback for node 69bacf6f537ae4d3c8238516: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
2026-03-20 16:14:55,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:14:55,377 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 502 150
Upload attempt 3 failed with 502 Bad Gateway: 502 Server Error: Bad Gateway for url: https://files-staging.kernelci.org/upload
Response body:
502 Bad Gateway
502 Bad Gateway
nginx
Retrying in 10 seconds... (2 retries remaining)
INFO: 172.19.0.1:42760 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42766 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:14:58,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:14:58,929 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 502 150
Upload attempt 4 failed with 502 Bad Gateway: 502 Server Error: Bad Gateway for url: https://files-staging.kernelci.org/upload
Response body:
502 Bad Gateway
502 Bad Gateway
nginx
Retrying in 10 seconds... (1 retries remaining)
2026-03-20 16:15:05,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:15:05,426 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 502 150
Upload attempt 4 failed with 502 Bad Gateway: 502 Server Error: Bad Gateway for url: https://files-staging.kernelci.org/upload
Response body:
502 Bad Gateway
502 Bad Gateway
nginx
Retrying in 10 seconds... (1 retries remaining)
INFO: 172.19.0.1:45248 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:15:08,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:15:08,946 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 502 150
Upload failed after 5 attempts. Response body:
502 Bad Gateway
502 Bad Gateway
nginx
2026-03-20 16:15:08,947 - lava_callback - WARNING - Failed to upload lava-logs.yaml: 502 Server Error: Bad Gateway for url: https://files-staging.kernelci.org/upload
2026-03-20 16:15:08,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:15:08,961 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 502 150
Upload attempt 1 failed with 502 Bad Gateway: 502 Server Error: Bad Gateway for url: https://files-staging.kernelci.org/upload
Response body:
502 Bad Gateway
502 Bad Gateway
nginx
Retrying in 10 seconds... (4 retries remaining)
INFO: 172.19.0.1:58460 - "GET /api/metrics HTTP/1.0" 200 OK
2026-03-20 16:15:15,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:15:15,442 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 502 150
Upload failed after 5 attempts. Response body:
502 Bad Gateway
502 Bad Gateway
nginx
2026-03-20 16:15:15,443 - lava_callback - ERROR - Error processing callback for node 69bbb68aec3f435d20d51b5b: 502 Server Error: Bad Gateway for url: https://files-staging.kernelci.org/upload
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 324, in async_job_submit
log_txt_url = _upload_log(log_parser, job_node, storage)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/kernelci/pipeline/lava_callback.py", line 238, in _upload_log
return _upload_file(storage, job_node, src, 'log.txt.gz')
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/kernelci/pipeline/lava_callback.py", line 204, in _upload_file
return storage.upload_single((source_name, destination_name), upload_dir)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/storage/__init__.py", line 69, in upload_single
urls = self._upload([file_path], dest_path)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/storage/backend.py", line 130, in _upload
raise last_exception
File "/usr/local/lib/python3.12/site-packages/kernelci/storage/backend.py", line 96, in _upload
resp.raise_for_status()
File "/usr/local/lib/python3.12/site-packages/requests/models.py", line 1026, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 502 Server Error: Bad Gateway for url: https://files-staging.kernelci.org/upload
INFO: 172.19.0.1:58464 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:15:18,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:15:18,976 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 502 150
Upload attempt 2 failed with 502 Bad Gateway: 502 Server Error: Bad Gateway for url: https://files-staging.kernelci.org/upload
Response body:
502 Bad Gateway
502 Bad Gateway
nginx
Retrying in 10 seconds... (3 retries remaining)
INFO: 172.19.0.1:40418 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:15:28,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:15:28,997 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 502 150
Upload attempt 3 failed with 502 Bad Gateway: 502 Server Error: Bad Gateway for url: https://files-staging.kernelci.org/upload
Response body:
502 Bad Gateway
502 Bad Gateway
nginx
Retrying in 10 seconds... (2 retries remaining)
INFO: 172.19.0.1:44528 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:15:38,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:15:39,029 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 502 150
Upload attempt 4 failed with 502 Bad Gateway: 502 Server Error: Bad Gateway for url: https://files-staging.kernelci.org/upload
Response body:
502 Bad Gateway
502 Bad Gateway
nginx
Retrying in 10 seconds... (1 retries remaining)
INFO: 172.19.0.1:35614 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:15:49,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:15:49,064 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 502 150
Upload failed after 5 attempts. Response body:
502 Bad Gateway
502 Bad Gateway
nginx
2026-03-20 16:15:49,066 - lava_callback - ERROR - Error processing callback for node 69bbba0cec3f435d20d52481: 502 Server Error: Bad Gateway for url: https://files-staging.kernelci.org/upload
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 335, in async_job_submit
callback_json_url = _upload_callback_data(callback_data, job_node, storage)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/kernelci/pipeline/lava_callback.py", line 220, in _upload_callback_data
return _upload_file(storage, job_node, src, filename)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/kernelci/pipeline/lava_callback.py", line 204, in _upload_file
return storage.upload_single((source_name, destination_name), upload_dir)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/storage/__init__.py", line 69, in upload_single
urls = self._upload([file_path], dest_path)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/storage/backend.py", line 130, in _upload
raise last_exception
File "/usr/local/lib/python3.12/site-packages/kernelci/storage/backend.py", line 96, in _upload
resp.raise_for_status()
File "/usr/local/lib/python3.12/site-packages/requests/models.py", line 1026, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 502 Server Error: Bad Gateway for url: https://files-staging.kernelci.org/upload
INFO: 172.19.0.1:59168 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59184 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56954 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48084 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:48086 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48112 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59088 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46574 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41004 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41006 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39826 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52592 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:52598 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:17:18,030 - lava_callback - INFO - Received callback for node 69bb999fa1e2bfb1b3347d78
INFO: 172.19.0.1:52600 - "POST /node/69bb999fa1e2bfb1b3347d78 HTTP/1.0" 202 Accepted
2026-03-20 16:17:18,039 - lava_callback - INFO - Starting async job submit for node 69bb999fa1e2bfb1b3347d78
2026-03-20 16:17:18,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:17:18,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb999fa1e2bfb1b3347d78 HTTP/1.1" 200 None
2026-03-20 16:17:18,077 - lava_callback - DEBUG - Processing node 69bb999fa1e2bfb1b3347d78: baseline-x86
2026-03-20 16:17:18,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:17:18,564 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:17:18,566 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69bb999fa1e2bfb1b3347d78/log.txt.gz
2026-03-20 16:17:18,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:17:18,975 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:17:18,977 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69bb999fa1e2bfb1b3347d78/lava-logs.yaml
2026-03-20 16:17:18,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:17:19,144 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:17:19,145 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69bb999fa1e2bfb1b3347d78/lava_callback.json.gz
2026-03-20 16:17:19,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:17:19,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb999fa1e2bfb1b3347d78 HTTP/1.1" 200 None
2026-03-20 16:17:19,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:17:19,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb40e5a1e2bfb1b3344416 HTTP/1.1" 200 None
2026-03-20 16:17:19,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:17:19,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb999fa1e2bfb1b3347d78 HTTP/1.1" 200 None
2026-03-20 16:17:19,246 - lava_callback - INFO - Completed processing callback for node 69bb999fa1e2bfb1b3347d78
INFO: 172.19.0.1:45826 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57774 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:17:39,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:17:39,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:54404 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46656 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46660 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54640 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37866 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:37882 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:18:18,735 - lava_callback - INFO - Received callback for node 69bbee4dec3f435d20d52d77
INFO: 172.19.0.1:37884 - "POST /node/69bbee4dec3f435d20d52d77 HTTP/1.0" 202 Accepted
2026-03-20 16:18:18,747 - lava_callback - INFO - Starting async job submit for node 69bbee4dec3f435d20d52d77
2026-03-20 16:18:18,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:18:18,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbee4dec3f435d20d52d77 HTTP/1.1" 200 None
2026-03-20 16:18:18,822 - lava_callback - DEBUG - Processing node 69bbee4dec3f435d20d52d77: baseline-x86
2026-03-20 16:18:19,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:18:19,734 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:18:19,736 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69bbee4dec3f435d20d52d77/log.txt.gz
2026-03-20 16:18:20,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:18:20,525 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:18:20,527 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69bbee4dec3f435d20d52d77/lava-logs.yaml
2026-03-20 16:18:20,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:18:20,753 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:18:20,755 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69bbee4dec3f435d20d52d77/lava_callback.json.gz
2026-03-20 16:18:20,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:18:20,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbee4dec3f435d20d52d77 HTTP/1.1" 200 None
2026-03-20 16:18:20,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:18:20,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb40e5a1e2bfb1b3344416 HTTP/1.1" 200 None
2026-03-20 16:18:20,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:18:20,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbee4dec3f435d20d52d77 HTTP/1.1" 200 None
2026-03-20 16:18:20,897 - lava_callback - INFO - Completed processing callback for node 69bbee4dec3f435d20d52d77
INFO: 172.19.0.1:40216 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52012 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:18:39,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:18:39,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:54498 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59428 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59434 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38146 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55022 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:55024 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:19:19,131 - lava_callback - INFO - Received callback for node 69bc0badec3f435d20d532e8
INFO: 172.19.0.1:55034 - "POST /node/69bc0badec3f435d20d532e8 HTTP/1.0" 202 Accepted
2026-03-20 16:19:19,137 - lava_callback - INFO - Starting async job submit for node 69bc0badec3f435d20d532e8
2026-03-20 16:19:19,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:19:19,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc0badec3f435d20d532e8 HTTP/1.1" 200 None
2026-03-20 16:19:19,172 - lava_callback - DEBUG - Processing node 69bc0badec3f435d20d532e8: baseline-x86
2026-03-20 16:19:19,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:19:19,606 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:19:19,608 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69bc0badec3f435d20d532e8/log.txt.gz
2026-03-20 16:19:19,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:19:19,998 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:19:20,000 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69bc0badec3f435d20d532e8/lava-logs.yaml
2026-03-20 16:19:20,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:19:20,161 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:19:20,163 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69bc0badec3f435d20d532e8/lava_callback.json.gz
2026-03-20 16:19:20,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:19:20,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc0badec3f435d20d532e8 HTTP/1.1" 200 None
2026-03-20 16:19:20,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:19:20,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb14fec3f435d20d51ac2 HTTP/1.1" 200 None
2026-03-20 16:19:20,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:19:20,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bc0badec3f435d20d532e8 HTTP/1.1" 200 None
2026-03-20 16:19:20,252 - lava_callback - INFO - Completed processing callback for node 69bc0badec3f435d20d532e8
INFO: 172.19.0.1:47934 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58670 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:19:39,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:19:39,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:43376 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59098 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59112 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55038 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:20:12,626 - lava_callback - INFO - Received callback for node 69bc1280ec3f435d20d53531
INFO: 172.19.0.1:52054 - "POST /node/69bc1280ec3f435d20d53531 HTTP/1.0" 202 Accepted
2026-03-20 16:20:12,631 - lava_callback - INFO - Starting async job submit for node 69bc1280ec3f435d20d53531
2026-03-20 16:20:12,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:20:12,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc1280ec3f435d20d53531 HTTP/1.1" 200 None
2026-03-20 16:20:12,687 - lava_callback - DEBUG - Processing node 69bc1280ec3f435d20d53531: baseline-x86
2026-03-20 16:20:12,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:20:13,145 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:20:13,146 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69bc1280ec3f435d20d53531/log.txt.gz
2026-03-20 16:20:13,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:20:13,529 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:20:13,531 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69bc1280ec3f435d20d53531/lava-logs.yaml
2026-03-20 16:20:13,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:20:13,687 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:20:13,689 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69bc1280ec3f435d20d53531/lava_callback.json.gz
2026-03-20 16:20:13,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:20:13,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc1280ec3f435d20d53531 HTTP/1.1" 200 None
2026-03-20 16:20:13,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:20:13,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e550ec88e58bad0d108 HTTP/1.1" 200 None
2026-03-20 16:20:13,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:20:13,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bc1280ec3f435d20d53531 HTTP/1.1" 200 None
2026-03-20 16:20:13,767 - lava_callback - INFO - Completed processing callback for node 69bc1280ec3f435d20d53531
INFO: 172.19.0.1:52058 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:52064 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39076 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43764 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:20:39,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:20:39,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
2026-03-20 16:20:40,253 - lava_callback - INFO - Received callback for node 69bc1634ec3f435d20d535a9
INFO: 172.19.0.1:53162 - "POST /node/69bc1634ec3f435d20d535a9 HTTP/1.0" 202 Accepted
2026-03-20 16:20:40,259 - lava_callback - INFO - Starting async job submit for node 69bc1634ec3f435d20d535a9
2026-03-20 16:20:40,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:20:40,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc1634ec3f435d20d535a9 HTTP/1.1" 200 None
2026-03-20 16:20:40,295 - lava_callback - DEBUG - Processing node 69bc1634ec3f435d20d535a9: baseline-x86
2026-03-20 16:20:40,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:20:40,737 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:20:40,739 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69bc1634ec3f435d20d535a9/log.txt.gz
2026-03-20 16:20:40,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:20:41,125 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:20:41,127 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69bc1634ec3f435d20d535a9/lava-logs.yaml
2026-03-20 16:20:41,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:20:41,269 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:20:41,271 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69bc1634ec3f435d20d535a9/lava_callback.json.gz
2026-03-20 16:20:41,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:20:41,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc1634ec3f435d20d535a9 HTTP/1.1" 200 None
2026-03-20 16:20:41,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:20:41,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e550ec88e58bad0d108 HTTP/1.1" 200 None
2026-03-20 16:20:41,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:20:41,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bc1634ec3f435d20d535a9 HTTP/1.1" 200 None
2026-03-20 16:20:41,354 - lava_callback - INFO - Completed processing callback for node 69bc1634ec3f435d20d535a9
INFO: 172.19.0.1:53178 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39788 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39800 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40268 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:21:09,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:21:09,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:41798 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:41810 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57122 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46734 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60896 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48128 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48136 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:22:02,797 - lava_callback - INFO - Received callback for node 69bc1c18ec3f435d20d53666
INFO: 172.19.0.1:44482 - "POST /node/69bc1c18ec3f435d20d53666 HTTP/1.0" 202 Accepted
2026-03-20 16:22:02,803 - lava_callback - INFO - Starting async job submit for node 69bc1c18ec3f435d20d53666
2026-03-20 16:22:02,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:22:02,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc1c18ec3f435d20d53666 HTTP/1.1" 200 None
2026-03-20 16:22:02,837 - lava_callback - DEBUG - Processing node 69bc1c18ec3f435d20d53666: baseline-x86
2026-03-20 16:22:03,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:22:03,297 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:22:03,299 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69bc1c18ec3f435d20d53666/log.txt.gz
2026-03-20 16:22:03,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:22:03,718 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:22:03,720 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69bc1c18ec3f435d20d53666/lava-logs.yaml
2026-03-20 16:22:03,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:22:03,847 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:22:03,849 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69bc1c18ec3f435d20d53666/lava_callback.json.gz
2026-03-20 16:22:03,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:22:03,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc1c18ec3f435d20d53666 HTTP/1.1" 200 None
2026-03-20 16:22:03,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:22:03,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b974a7151254d948eeea18 HTTP/1.1" 200 None
2026-03-20 16:22:03,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:22:03,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bc1c18ec3f435d20d53666 HTTP/1.1" 200 None
2026-03-20 16:22:03,941 - lava_callback - INFO - Completed processing callback for node 69bc1c18ec3f435d20d53666
INFO: 172.19.0.1:44486 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:22:09,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:22:09,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:52228 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:52234 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60354 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47114 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57446 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49818 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:22:56,435 - lava_callback - INFO - Received callback for node 69bc3d3917e5cb936602e996
INFO: 172.19.0.1:49828 - "POST /node/69bc3d3917e5cb936602e996 HTTP/1.0" 202 Accepted
2026-03-20 16:22:56,441 - lava_callback - INFO - Starting async job submit for node 69bc3d3917e5cb936602e996
2026-03-20 16:22:56,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:22:56,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc3d3917e5cb936602e996 HTTP/1.1" 200 None
2026-03-20 16:22:56,474 - lava_callback - DEBUG - Processing node 69bc3d3917e5cb936602e996: baseline-x86
INFO: 172.19.0.1:49838 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:22:56,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:22:56,892 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:22:56,894 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69bc3d3917e5cb936602e996/log.txt.gz
2026-03-20 16:22:57,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:22:57,256 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:22:57,258 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69bc3d3917e5cb936602e996/lava-logs.yaml
2026-03-20 16:22:57,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:22:57,425 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:22:57,427 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69bc3d3917e5cb936602e996/lava_callback.json.gz
2026-03-20 16:22:57,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:22:57,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc3d3917e5cb936602e996 HTTP/1.1" 200 None
2026-03-20 16:22:57,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:22:57,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21d417e5cb936602bc3d HTTP/1.1" 200 None
2026-03-20 16:22:57,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:22:57,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bc3d3917e5cb936602e996 HTTP/1.1" 200 None
2026-03-20 16:22:57,510 - lava_callback - INFO - Completed processing callback for node 69bc3d3917e5cb936602e996
INFO: 172.19.0.1:54980 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:23:09,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:23:09,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:43426 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:43442 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:23:22,724 - lava_callback - INFO - Received callback for node 69bc430f17e5cb936602ea72
INFO: 172.19.0.1:33046 - "POST /node/69bc430f17e5cb936602ea72 HTTP/1.0" 202 Accepted
2026-03-20 16:23:22,729 - lava_callback - INFO - Starting async job submit for node 69bc430f17e5cb936602ea72
2026-03-20 16:23:22,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:23:22,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc430f17e5cb936602ea72 HTTP/1.1" 200 None
2026-03-20 16:23:22,761 - lava_callback - DEBUG - Processing node 69bc430f17e5cb936602ea72: baseline-x86
2026-03-20 16:23:23,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:23:23,244 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:23:23,246 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69bc430f17e5cb936602ea72/log.txt.gz
2026-03-20 16:23:23,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:23:23,627 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:23:23,629 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69bc430f17e5cb936602ea72/lava-logs.yaml
2026-03-20 16:23:23,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:23:23,761 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:23:23,763 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69bc430f17e5cb936602ea72/lava_callback.json.gz
2026-03-20 16:23:23,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:23:23,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc430f17e5cb936602ea72 HTTP/1.1" 200 None
2026-03-20 16:23:23,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:23:23,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb40e5a1e2bfb1b3344416 HTTP/1.1" 200 None
2026-03-20 16:23:23,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:23:23,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bc430f17e5cb936602ea72 HTTP/1.1" 200 None
2026-03-20 16:23:23,875 - lava_callback - INFO - Completed processing callback for node 69bc430f17e5cb936602ea72
INFO: 172.19.0.1:33050 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37528 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:23:39,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:23:39,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:34032 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43782 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43784 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60994 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47540 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:47554 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47658 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54892 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57754 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49640 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49656 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:25:02,709 - lava_callback - INFO - Received callback for node 69bc609717e5cb936602f2b4
INFO: 172.19.0.1:49906 - "POST /node/69bc609717e5cb936602f2b4 HTTP/1.0" 202 Accepted
2026-03-20 16:25:02,715 - lava_callback - INFO - Starting async job submit for node 69bc609717e5cb936602f2b4
2026-03-20 16:25:02,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:25:02,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc609717e5cb936602f2b4 HTTP/1.1" 200 None
2026-03-20 16:25:02,785 - lava_callback - DEBUG - Processing node 69bc609717e5cb936602f2b4: baseline-x86
2026-03-20 16:25:03,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:25:03,191 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:25:03,192 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69bc609717e5cb936602f2b4/log.txt.gz
2026-03-20 16:25:03,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:25:03,543 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:25:03,546 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69bc609717e5cb936602f2b4/lava-logs.yaml
2026-03-20 16:25:03,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:25:03,697 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:25:03,699 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69bc609717e5cb936602f2b4/lava_callback.json.gz
2026-03-20 16:25:03,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:25:03,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc609717e5cb936602f2b4 HTTP/1.1" 200 None
2026-03-20 16:25:03,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:25:03,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb14fec3f435d20d51ac2 HTTP/1.1" 200 None
2026-03-20 16:25:03,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:25:03,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bc609717e5cb936602f2b4 HTTP/1.1" 200 None
2026-03-20 16:25:03,779 - lava_callback - INFO - Completed processing callback for node 69bc609717e5cb936602f2b4
INFO: 172.19.0.1:49922 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:25:09,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:25:09,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:43812 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:43824 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38054 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54860 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35388 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36260 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36274 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:26:00,397 - lava_callback - INFO - Received callback for node 69bc657e17e5cb936602f59a
INFO: 172.19.0.1:34794 - "POST /node/69bc657e17e5cb936602f59a HTTP/1.0" 202 Accepted
2026-03-20 16:26:00,403 - lava_callback - INFO - Starting async job submit for node 69bc657e17e5cb936602f59a
2026-03-20 16:26:00,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:26:00,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc657e17e5cb936602f59a HTTP/1.1" 200 None
2026-03-20 16:26:00,437 - lava_callback - DEBUG - Processing node 69bc657e17e5cb936602f59a: baseline-x86
2026-03-20 16:26:00,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:26:00,880 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:26:00,882 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69bc657e17e5cb936602f59a/log.txt.gz
2026-03-20 16:26:01,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:26:01,259 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:26:01,261 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69bc657e17e5cb936602f59a/lava-logs.yaml
2026-03-20 16:26:01,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:26:01,408 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:26:01,409 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69bc657e17e5cb936602f59a/lava_callback.json.gz
2026-03-20 16:26:01,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:26:01,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc657e17e5cb936602f59a HTTP/1.1" 200 None
2026-03-20 16:26:01,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:26:01,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e550ec88e58bad0d108 HTTP/1.1" 200 None
2026-03-20 16:26:01,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:26:01,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bc657e17e5cb936602f59a HTTP/1.1" 200 None
2026-03-20 16:26:01,483 - lava_callback - INFO - Completed processing callback for node 69bc657e17e5cb936602f59a
INFO: 172.19.0.1:34798 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:26:09,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:26:09,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:34460 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:34468 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38408 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50950 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35748 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37600 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37608 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:26:57,392 - lava_callback - INFO - Received callback for node 69bc67c517e5cb936602f618
INFO: 172.19.0.1:37610 - "POST /node/69bc67c517e5cb936602f618 HTTP/1.0" 202 Accepted
2026-03-20 16:26:57,401 - lava_callback - INFO - Starting async job submit for node 69bc67c517e5cb936602f618
2026-03-20 16:26:57,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:26:57,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc67c517e5cb936602f618 HTTP/1.1" 200 None
2026-03-20 16:26:57,462 - lava_callback - DEBUG - Processing node 69bc67c517e5cb936602f618: baseline-x86
2026-03-20 16:26:57,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:26:58,385 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:26:58,387 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69bc67c517e5cb936602f618/log.txt.gz
2026-03-20 16:26:58,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:26:59,255 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:26:59,257 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69bc67c517e5cb936602f618/lava-logs.yaml
2026-03-20 16:26:59,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:26:59,761 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:26:59,764 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69bc67c517e5cb936602f618/lava_callback.json.gz
2026-03-20 16:26:59,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:26:59,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc67c517e5cb936602f618 HTTP/1.1" 200 None
2026-03-20 16:26:59,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:26:59,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e550ec88e58bad0d108 HTTP/1.1" 200 None
2026-03-20 16:26:59,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:26:59,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bc67c517e5cb936602f618 HTTP/1.1" 200 None
2026-03-20 16:26:59,894 - lava_callback - INFO - Completed processing callback for node 69bc67c517e5cb936602f618
2026-03-20 16:27:00,367 - lava_callback - INFO - Received callback for node 69bc6cde17e5cb936602f6d9
INFO: 172.19.0.1:53614 - "POST /node/69bc6cde17e5cb936602f6d9 HTTP/1.0" 202 Accepted
2026-03-20 16:27:00,376 - lava_callback - INFO - Starting async job submit for node 69bc6cde17e5cb936602f6d9
2026-03-20 16:27:00,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:27:00,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc6cde17e5cb936602f6d9 HTTP/1.1" 200 None
2026-03-20 16:27:00,442 - lava_callback - DEBUG - Processing node 69bc6cde17e5cb936602f6d9: baseline-x86
2026-03-20 16:27:00,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:27:01,349 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:27:01,351 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69bc6cde17e5cb936602f6d9/log.txt.gz
2026-03-20 16:27:01,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:27:02,250 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:27:02,252 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69bc6cde17e5cb936602f6d9/lava-logs.yaml
2026-03-20 16:27:02,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:27:02,765 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:27:02,767 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69bc6cde17e5cb936602f6d9/lava_callback.json.gz
2026-03-20 16:27:02,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:27:02,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc6cde17e5cb936602f6d9 HTTP/1.1" 200 None
2026-03-20 16:27:02,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:27:02,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e550ec88e58bad0d108 HTTP/1.1" 200 None
2026-03-20 16:27:02,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:27:02,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bc6cde17e5cb936602f6d9 HTTP/1.1" 200 None
2026-03-20 16:27:02,897 - lava_callback - INFO - Completed processing callback for node 69bc6cde17e5cb936602f6d9
INFO: 172.19.0.1:53618 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:27:09,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:27:09,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:36266 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:36276 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60474 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36844 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60562 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46930 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46936 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51814 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49596 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:49604 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45792 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44074 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48368 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35620 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35630 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:29:05,697 - lava_callback - INFO - Received callback for node 69bd755a0e93e2314723e3ac
INFO: 172.19.0.1:50010 - "POST /node/69bd755a0e93e2314723e3ac HTTP/1.0" 202 Accepted
2026-03-20 16:29:05,703 - lava_callback - INFO - Starting async job submit for node 69bd755a0e93e2314723e3ac
2026-03-20 16:29:05,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:29:05,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd755a0e93e2314723e3ac HTTP/1.1" 200 None
2026-03-20 16:29:05,741 - lava_callback - DEBUG - Processing node 69bd755a0e93e2314723e3ac: baseline-arm
2026-03-20 16:29:05,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:29:06,183 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:29:06,184 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69bd755a0e93e2314723e3ac/log.txt.gz
2026-03-20 16:29:06,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:29:06,495 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:29:06,497 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69bd755a0e93e2314723e3ac/lava-logs.yaml
2026-03-20 16:29:06,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
INFO: 172.19.0.1:50020 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:29:06,653 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:29:06,655 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69bd755a0e93e2314723e3ac/lava_callback.json.gz
2026-03-20 16:29:06,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:29:06,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd755a0e93e2314723e3ac HTTP/1.1" 200 None
2026-03-20 16:29:06,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:29:06,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73350e93e2314723e2bb HTTP/1.1" 200 None
2026-03-20 16:29:06,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:29:06,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd755a0e93e2314723e3ac HTTP/1.1" 200 None
2026-03-20 16:29:06,738 - lava_callback - INFO - Completed processing callback for node 69bd755a0e93e2314723e3ac
2026-03-20 16:29:09,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:29:09,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
2026-03-20 16:29:10,678 - lava_callback - INFO - Received callback for node 69bc729617e5cb936602f7bb
INFO: 172.19.0.1:54416 - "POST /node/69bc729617e5cb936602f7bb HTTP/1.0" 202 Accepted
2026-03-20 16:29:10,684 - lava_callback - INFO - Starting async job submit for node 69bc729617e5cb936602f7bb
2026-03-20 16:29:10,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:29:10,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc729617e5cb936602f7bb HTTP/1.1" 200 None
2026-03-20 16:29:10,720 - lava_callback - DEBUG - Processing node 69bc729617e5cb936602f7bb: baseline-x86
2026-03-20 16:29:11,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:29:11,136 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:29:11,137 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69bc729617e5cb936602f7bb/log.txt.gz
2026-03-20 16:29:11,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:29:11,520 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:29:11,522 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69bc729617e5cb936602f7bb/lava-logs.yaml
2026-03-20 16:29:11,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:29:11,691 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:29:11,693 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69bc729617e5cb936602f7bb/lava_callback.json.gz
2026-03-20 16:29:11,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:29:11,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc729617e5cb936602f7bb HTTP/1.1" 200 None
2026-03-20 16:29:11,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:29:11,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b974a7151254d948eeea18 HTTP/1.1" 200 None
2026-03-20 16:29:11,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:29:11,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bc729617e5cb936602f7bb HTTP/1.1" 200 None
2026-03-20 16:29:11,780 - lava_callback - INFO - Completed processing callback for node 69bc729617e5cb936602f7bb
INFO: 172.19.0.1:54430 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:54446 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:29:19,247 - lava_callback - INFO - Received callback for node 69bc72d617e5cb936602f7c3
INFO: 172.19.0.1:54448 - "POST /node/69bc72d617e5cb936602f7c3 HTTP/1.0" 202 Accepted
2026-03-20 16:29:19,253 - lava_callback - INFO - Starting async job submit for node 69bc72d617e5cb936602f7c3
2026-03-20 16:29:19,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:29:19,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc72d617e5cb936602f7c3 HTTP/1.1" 200 None
2026-03-20 16:29:19,287 - lava_callback - DEBUG - Processing node 69bc72d617e5cb936602f7c3: baseline-x86
2026-03-20 16:29:19,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:29:19,735 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:29:19,736 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69bc72d617e5cb936602f7c3/log.txt.gz
2026-03-20 16:29:19,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:29:20,134 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:29:20,136 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69bc72d617e5cb936602f7c3/lava-logs.yaml
2026-03-20 16:29:20,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:29:20,321 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:29:20,323 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69bc72d617e5cb936602f7c3/lava_callback.json.gz
2026-03-20 16:29:20,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:29:20,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc72d617e5cb936602f7c3 HTTP/1.1" 200 None
2026-03-20 16:29:20,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:29:20,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b974a7151254d948eeea18 HTTP/1.1" 200 None
2026-03-20 16:29:20,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:29:20,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bc72d617e5cb936602f7c3 HTTP/1.1" 200 None
2026-03-20 16:29:20,399 - lava_callback - INFO - Completed processing callback for node 69bc72d617e5cb936602f7c3
INFO: 172.19.0.1:52238 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48598 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:29:39,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:29:39,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:52184 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43258 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43262 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37296 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52982 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:52996 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46988 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59834 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40842 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60546 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60562 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53712 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43916 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:43930 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53530 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51704 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43754 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60722 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60738 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58406 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57138 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:57148 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:32794 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42262 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45988 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:32:51,927 - lava_callback - INFO - Received callback for node 69bc9727b4744551b27fa02b
INFO: 172.19.0.1:35634 - "POST /node/69bc9727b4744551b27fa02b HTTP/1.0" 202 Accepted
2026-03-20 16:32:51,933 - lava_callback - INFO - Starting async job submit for node 69bc9727b4744551b27fa02b
2026-03-20 16:32:51,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:32:51,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc9727b4744551b27fa02b HTTP/1.1" 200 None
2026-03-20 16:32:51,965 - lava_callback - DEBUG - Processing node 69bc9727b4744551b27fa02b: baseline-x86
2026-03-20 16:32:52,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:32:52,416 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:32:52,418 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69bc9727b4744551b27fa02b/log.txt.gz
2026-03-20 16:32:52,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:32:52,806 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:32:52,808 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69bc9727b4744551b27fa02b/lava-logs.yaml
2026-03-20 16:32:52,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:32:52,956 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:32:52,958 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69bc9727b4744551b27fa02b/lava_callback.json.gz
2026-03-20 16:32:52,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:32:53,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc9727b4744551b27fa02b HTTP/1.1" 200 None
2026-03-20 16:32:53,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:32:53,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc92fdb4744551b27f9fe5 HTTP/1.1" 200 None
2026-03-20 16:32:53,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:32:53,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bc9727b4744551b27fa02b HTTP/1.1" 200 None
2026-03-20 16:32:53,137 - lava_callback - INFO - Completed processing callback for node 69bc9727b4744551b27fa02b
INFO: 172.19.0.1:35638 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35652 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59326 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:33:09,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:33:09,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:46568 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:46578 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59088 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39874 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37050 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58338 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58346 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55976 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34236 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:34242 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:34:22,538 - lava_callback - INFO - Received callback for node 69bcb548b4744551b27fd3c9
INFO: 172.19.0.1:42350 - "POST /node/69bcb548b4744551b27fd3c9 HTTP/1.0" 202 Accepted
2026-03-20 16:34:22,545 - lava_callback - INFO - Starting async job submit for node 69bcb548b4744551b27fd3c9
2026-03-20 16:34:22,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:34:22,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bcb548b4744551b27fd3c9 HTTP/1.1" 200 None
2026-03-20 16:34:22,583 - lava_callback - DEBUG - Processing node 69bcb548b4744551b27fd3c9: baseline-x86
2026-03-20 16:34:22,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:34:23,029 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:34:23,031 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69bcb548b4744551b27fd3c9/log.txt.gz
2026-03-20 16:34:23,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:34:23,408 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:34:23,410 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69bcb548b4744551b27fd3c9/lava-logs.yaml
2026-03-20 16:34:23,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:34:23,547 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:34:23,549 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69bcb548b4744551b27fd3c9/lava_callback.json.gz
2026-03-20 16:34:23,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:34:23,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bcb548b4744551b27fd3c9 HTTP/1.1" 200 None
2026-03-20 16:34:23,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:34:23,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb14fec3f435d20d51ac2 HTTP/1.1" 200 None
2026-03-20 16:34:23,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:34:23,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bcb548b4744551b27fd3c9 HTTP/1.1" 200 None
2026-03-20 16:34:23,627 - lava_callback - INFO - Completed processing callback for node 69bcb548b4744551b27fd3c9
INFO: 172.19.0.1:42360 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:34:28,148 - lava_callback - INFO - Received callback for node 69bc9de8b4744551b27fa840
INFO: 172.19.0.1:42372 - "POST /node/69bc9de8b4744551b27fa840 HTTP/1.0" 202 Accepted
2026-03-20 16:34:28,154 - lava_callback - INFO - Starting async job submit for node 69bc9de8b4744551b27fa840
2026-03-20 16:34:28,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:34:28,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc9de8b4744551b27fa840 HTTP/1.1" 200 None
2026-03-20 16:34:28,186 - lava_callback - DEBUG - Processing node 69bc9de8b4744551b27fa840: baseline-x86
2026-03-20 16:34:28,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:34:28,631 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:34:28,632 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69bc9de8b4744551b27fa840/log.txt.gz
2026-03-20 16:34:28,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:34:28,984 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:34:28,986 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69bc9de8b4744551b27fa840/lava-logs.yaml
2026-03-20 16:34:28,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:34:29,125 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:34:29,127 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69bc9de8b4744551b27fa840/lava_callback.json.gz
2026-03-20 16:34:29,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:34:29,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc9de8b4744551b27fa840 HTTP/1.1" 200 None
2026-03-20 16:34:29,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:34:29,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9efafd5731cbd74145fe5 HTTP/1.1" 200 None
2026-03-20 16:34:29,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:34:29,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bc9de8b4744551b27fa840 HTTP/1.1" 200 None
2026-03-20 16:34:29,203 - lava_callback - INFO - Completed processing callback for node 69bc9de8b4744551b27fa840
INFO: 172.19.0.1:40868 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:34:39,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:34:39,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:45684 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51622 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51624 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41006 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34880 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:34896 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56374 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35520 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40222 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58828 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58842 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:35:59,390 - lava_callback - INFO - Received callback for node 69bcc5aeb4744551b27fd7fd
INFO: 172.19.0.1:58854 - "POST /node/69bcc5aeb4744551b27fd7fd HTTP/1.0" 202 Accepted
2026-03-20 16:35:59,399 - lava_callback - INFO - Starting async job submit for node 69bcc5aeb4744551b27fd7fd
2026-03-20 16:35:59,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:35:59,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bcc5aeb4744551b27fd7fd HTTP/1.1" 200 None
2026-03-20 16:35:59,481 - lava_callback - DEBUG - Processing node 69bcc5aeb4744551b27fd7fd: baseline-x86
2026-03-20 16:36:00,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:36:00,289 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:36:00,291 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69bcc5aeb4744551b27fd7fd/log.txt.gz
2026-03-20 16:36:00,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:36:01,043 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:36:01,045 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69bcc5aeb4744551b27fd7fd/lava-logs.yaml
2026-03-20 16:36:01,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:36:01,413 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:36:01,415 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69bcc5aeb4744551b27fd7fd/lava_callback.json.gz
2026-03-20 16:36:01,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:36:01,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bcc5aeb4744551b27fd7fd HTTP/1.1" 200 None
2026-03-20 16:36:01,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:36:01,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b974a7151254d948eeea18 HTTP/1.1" 200 None
2026-03-20 16:36:01,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:36:01,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bcc5aeb4744551b27fd7fd HTTP/1.1" 200 None
2026-03-20 16:36:01,557 - lava_callback - INFO - Completed processing callback for node 69bcc5aeb4744551b27fd7fd
INFO: 172.19.0.1:51672 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:36:09,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:36:09,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:36368 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:36380 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55354 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50240 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54338 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44954 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44960 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59522 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:37:10,220 - lava_callback - INFO - Received callback for node 69bad4a821a77312e2220f62
INFO: 172.19.0.1:33994 - "POST /node/69bad4a821a77312e2220f62 HTTP/1.0" 202 Accepted
2026-03-20 16:37:10,230 - lava_callback - INFO - Starting async job submit for node 69bad4a821a77312e2220f62
2026-03-20 16:37:10,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:37:10,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad4a821a77312e2220f62 HTTP/1.1" 200 None
2026-03-20 16:37:10,255 - lava_callback - DEBUG - Processing node 69bad4a821a77312e2220f62: baseline-arm-baylibre
2026-03-20 16:37:10,255 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bad4a821a77312e2220f62
2026-03-20 16:37:10,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:37:10,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad4a821a77312e2220f62 HTTP/1.1" 200 None
2026-03-20 16:37:10,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:37:10,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None
2026-03-20 16:37:10,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:37:10,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bad4a821a77312e2220f62 HTTP/1.1" 200 None
2026-03-20 16:37:10,347 - lava_callback - ERROR - Error processing callback for node 69bad4a821a77312e2220f62: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:34010 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:34024 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40036 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47180 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:37:40,454 - lava_callback - INFO - Received callback for node 69bcc75bb4744551b27fd924
INFO: 172.19.0.1:45196 - "POST /node/69bcc75bb4744551b27fd924 HTTP/1.0" 202 Accepted
2026-03-20 16:37:40,460 - lava_callback - INFO - Starting async job submit for node 69bcc75bb4744551b27fd924
2026-03-20 16:37:40,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:37:40,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bcc75bb4744551b27fd924 HTTP/1.1" 200 None
2026-03-20 16:37:40,492 - lava_callback - DEBUG - Processing node 69bcc75bb4744551b27fd924: baseline-x86
2026-03-20 16:37:40,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:37:40,943 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:37:40,945 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69bcc75bb4744551b27fd924/log.txt.gz
2026-03-20 16:37:41,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:37:41,323 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:37:41,325 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69bcc75bb4744551b27fd924/lava-logs.yaml
2026-03-20 16:37:41,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:37:41,505 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:37:41,507 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69bcc75bb4744551b27fd924/lava_callback.json.gz
2026-03-20 16:37:41,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:37:41,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bcc75bb4744551b27fd924 HTTP/1.1" 200 None
2026-03-20 16:37:41,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:37:41,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b974a7151254d948eeea18 HTTP/1.1" 200 None
2026-03-20 16:37:41,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:37:41,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bcc75bb4744551b27fd924 HTTP/1.1" 200 None
2026-03-20 16:37:41,584 - lava_callback - INFO - Completed processing callback for node 69bcc75bb4744551b27fd924
INFO: 172.19.0.1:45204 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:37:50,176 - lava_callback - INFO - Received callback for node 69bad4cd21a77312e2220fad
INFO: 172.19.0.1:57342 - "POST /node/69bad4cd21a77312e2220fad HTTP/1.0" 202 Accepted
2026-03-20 16:37:50,182 - lava_callback - INFO - Starting async job submit for node 69bad4cd21a77312e2220fad
2026-03-20 16:37:50,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:37:50,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad4cd21a77312e2220fad HTTP/1.1" 200 None
2026-03-20 16:37:50,200 - lava_callback - DEBUG - Processing node 69bad4cd21a77312e2220fad: baseline-arm-baylibre
2026-03-20 16:37:50,200 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bad4cd21a77312e2220fad
2026-03-20 16:37:50,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:37:50,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad4cd21a77312e2220fad HTTP/1.1" 200 None
2026-03-20 16:37:50,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:37:50,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad09221a77312e2220ee1 HTTP/1.1" 200 None
2026-03-20 16:37:50,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:37:50,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bad4cd21a77312e2220fad HTTP/1.1" 200 None
2026-03-20 16:37:50,250 - lava_callback - ERROR - Error processing callback for node 69bad4cd21a77312e2220fad: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
2026-03-20 16:37:50,849 - lava_callback - INFO - Received callback for node 69bad4cf21a77312e2220fb2
INFO: 172.19.0.1:57352 - "POST /node/69bad4cf21a77312e2220fb2 HTTP/1.0" 202 Accepted
2026-03-20 16:37:50,855 - lava_callback - INFO - Starting async job submit for node 69bad4cf21a77312e2220fb2
2026-03-20 16:37:50,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:37:50,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad4cf21a77312e2220fb2 HTTP/1.1" 200 None
2026-03-20 16:37:50,879 - lava_callback - DEBUG - Processing node 69bad4cf21a77312e2220fb2: baseline-arm-baylibre
2026-03-20 16:37:50,879 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bad4cf21a77312e2220fb2
2026-03-20 16:37:50,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:37:50,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad4cf21a77312e2220fb2 HTTP/1.1" 200 None
2026-03-20 16:37:50,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:37:50,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad09221a77312e2220ee1 HTTP/1.1" 200 None
2026-03-20 16:37:50,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:37:50,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bad4cf21a77312e2220fb2 HTTP/1.1" 200 None
2026-03-20 16:37:50,988 - lava_callback - ERROR - Error processing callback for node 69bad4cf21a77312e2220fb2: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
2026-03-20 16:37:51,535 - lava_callback - INFO - Received callback for node 69bad4d021a77312e2220fb5
INFO: 172.19.0.1:57354 - "POST /node/69bad4d021a77312e2220fb5 HTTP/1.0" 202 Accepted
2026-03-20 16:37:51,542 - lava_callback - INFO - Starting async job submit for node 69bad4d021a77312e2220fb5
2026-03-20 16:37:51,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:37:51,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad4d021a77312e2220fb5 HTTP/1.1" 200 None
2026-03-20 16:37:51,565 - lava_callback - DEBUG - Processing node 69bad4d021a77312e2220fb5: baseline-arm-baylibre
2026-03-20 16:37:51,565 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bad4d021a77312e2220fb5
2026-03-20 16:37:51,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:37:51,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad4d021a77312e2220fb5 HTTP/1.1" 200 None
2026-03-20 16:37:51,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:37:51,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad09221a77312e2220ee1 HTTP/1.1" 200 None
2026-03-20 16:37:51,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:37:51,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bad4d021a77312e2220fb5 HTTP/1.1" 200 None
2026-03-20 16:37:51,639 - lava_callback - ERROR - Error processing callback for node 69bad4d021a77312e2220fb5: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
2026-03-20 16:37:52,205 - lava_callback - INFO - Received callback for node 69bad4d121a77312e2220fb9
INFO: 172.19.0.1:57368 - "POST /node/69bad4d121a77312e2220fb9 HTTP/1.0" 202 Accepted
2026-03-20 16:37:52,211 - lava_callback - INFO - Starting async job submit for node 69bad4d121a77312e2220fb9
2026-03-20 16:37:52,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:37:52,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad4d121a77312e2220fb9 HTTP/1.1" 200 None
2026-03-20 16:37:52,227 - lava_callback - DEBUG - Processing node 69bad4d121a77312e2220fb9: baseline-arm-baylibre
2026-03-20 16:37:52,227 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bad4d121a77312e2220fb9
2026-03-20 16:37:52,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:37:52,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad4d121a77312e2220fb9 HTTP/1.1" 200 None
2026-03-20 16:37:52,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:37:52,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad09221a77312e2220ee1 HTTP/1.1" 200 None
2026-03-20 16:37:52,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:37:52,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bad4d121a77312e2220fb9 HTTP/1.1" 200 None
2026-03-20 16:37:52,311 - lava_callback - ERROR - Error processing callback for node 69bad4d121a77312e2220fb9: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
2026-03-20 16:37:52,849 - lava_callback - INFO - Received callback for node 69bad4d521a77312e2220fc4
INFO: 172.19.0.1:57378 - "POST /node/69bad4d521a77312e2220fc4 HTTP/1.0" 202 Accepted
2026-03-20 16:37:52,855 - lava_callback - INFO - Starting async job submit for node 69bad4d521a77312e2220fc4
2026-03-20 16:37:52,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:37:52,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad4d521a77312e2220fc4 HTTP/1.1" 200 None
2026-03-20 16:37:52,872 - lava_callback - DEBUG - Processing node 69bad4d521a77312e2220fc4: baseline-arm-baylibre
2026-03-20 16:37:52,873 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bad4d521a77312e2220fc4
2026-03-20 16:37:52,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:37:52,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad4d521a77312e2220fc4 HTTP/1.1" 200 None
2026-03-20 16:37:52,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:37:52,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None
2026-03-20 16:37:52,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:37:52,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bad4d521a77312e2220fc4 HTTP/1.1" 200 None
2026-03-20 16:37:52,946 - lava_callback - ERROR - Error processing callback for node 69bad4d521a77312e2220fc4: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
2026-03-20 16:37:53,528 - lava_callback - INFO - Received callback for node 69bad4d521a77312e2220fc6
INFO: 172.19.0.1:57382 - "POST /node/69bad4d521a77312e2220fc6 HTTP/1.0" 202 Accepted
2026-03-20 16:37:53,534 - lava_callback - INFO - Starting async job submit for node 69bad4d521a77312e2220fc6
2026-03-20 16:37:53,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:37:53,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad4d521a77312e2220fc6 HTTP/1.1" 200 None
2026-03-20 16:37:53,550 - lava_callback - DEBUG - Processing node 69bad4d521a77312e2220fc6: baseline-arm-baylibre
2026-03-20 16:37:53,550 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bad4d521a77312e2220fc6
2026-03-20 16:37:53,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:37:53,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad4d521a77312e2220fc6 HTTP/1.1" 200 None
2026-03-20 16:37:53,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:37:53,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad09221a77312e2220ee1 HTTP/1.1" 200 None
2026-03-20 16:37:53,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:37:53,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bad4d521a77312e2220fc6 HTTP/1.1" 200 None
2026-03-20 16:37:53,616 - lava_callback - ERROR - Error processing callback for node 69bad4d521a77312e2220fc6: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
2026-03-20 16:37:54,203 - lava_callback - INFO - Received callback for node 69bad4d621a77312e2220fca
INFO: 172.19.0.1:57392 - "POST /node/69bad4d621a77312e2220fca HTTP/1.0" 202 Accepted
2026-03-20 16:37:54,209 - lava_callback - INFO - Starting async job submit for node 69bad4d621a77312e2220fca
2026-03-20 16:37:54,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:37:54,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad4d621a77312e2220fca HTTP/1.1" 200 None
2026-03-20 16:37:54,226 - lava_callback - DEBUG - Processing node 69bad4d621a77312e2220fca: baseline-arm-baylibre
2026-03-20 16:37:54,226 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bad4d621a77312e2220fca
2026-03-20 16:37:54,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:37:54,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad4d621a77312e2220fca HTTP/1.1" 200 None
2026-03-20 16:37:54,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:37:54,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad09221a77312e2220ee1 HTTP/1.1" 200 None
2026-03-20 16:37:54,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:37:54,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bad4d621a77312e2220fca HTTP/1.1" 200 None
2026-03-20 16:37:54,293 - lava_callback - ERROR - Error processing callback for node 69bad4d621a77312e2220fca: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:57408 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57422 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59572 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:38:09,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:38:09,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
2026-03-20 16:38:09,911 - lava_callback - INFO - Received callback for node 69bad4e221a77312e2220fe9
INFO: 172.19.0.1:42740 - "POST /node/69bad4e221a77312e2220fe9 HTTP/1.0" 202 Accepted
2026-03-20 16:38:09,920 - lava_callback - INFO - Starting async job submit for node 69bad4e221a77312e2220fe9
2026-03-20 16:38:09,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:38:09,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad4e221a77312e2220fe9 HTTP/1.1" 200 None
2026-03-20 16:38:09,936 - lava_callback - DEBUG - Processing node 69bad4e221a77312e2220fe9: baseline-arm-clabbe
2026-03-20 16:38:09,936 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bad4e221a77312e2220fe9
2026-03-20 16:38:09,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:38:09,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad4e221a77312e2220fe9 HTTP/1.1" 200 None
2026-03-20 16:38:09,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:38:09,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad09221a77312e2220ee1 HTTP/1.1" 200 None
2026-03-20 16:38:09,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:38:09,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bad4e221a77312e2220fe9 HTTP/1.1" 200 None
2026-03-20 16:38:09,993 - lava_callback - ERROR - Error processing callback for node 69bad4e221a77312e2220fe9: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
2026-03-20 16:38:10,578 - lava_callback - INFO - Received callback for node 69bad4de21a77312e2220fdc
INFO: 172.19.0.1:42744 - "POST /node/69bad4de21a77312e2220fdc HTTP/1.0" 202 Accepted
2026-03-20 16:38:10,587 - lava_callback - INFO - Starting async job submit for node 69bad4de21a77312e2220fdc
2026-03-20 16:38:10,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:38:10,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad4de21a77312e2220fdc HTTP/1.1" 200 None
2026-03-20 16:38:10,604 - lava_callback - DEBUG - Processing node 69bad4de21a77312e2220fdc: baseline-arm-clabbe
2026-03-20 16:38:10,605 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bad4de21a77312e2220fdc
2026-03-20 16:38:10,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:38:10,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad4de21a77312e2220fdc HTTP/1.1" 200 None
2026-03-20 16:38:10,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:38:10,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad09221a77312e2220ee1 HTTP/1.1" 200 None
2026-03-20 16:38:10,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:38:10,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bad4de21a77312e2220fdc HTTP/1.1" 200 None
2026-03-20 16:38:10,680 - lava_callback - ERROR - Error processing callback for node 69bad4de21a77312e2220fdc: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
2026-03-20 16:38:11,262 - lava_callback - INFO - Received callback for node 69bad4e321a77312e2220fec
INFO: 172.19.0.1:42754 - "POST /node/69bad4e321a77312e2220fec HTTP/1.0" 202 Accepted
2026-03-20 16:38:11,267 - lava_callback - INFO - Starting async job submit for node 69bad4e321a77312e2220fec
2026-03-20 16:38:11,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:38:11,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad4e321a77312e2220fec HTTP/1.1" 200 None
2026-03-20 16:38:11,301 - lava_callback - DEBUG - Processing node 69bad4e321a77312e2220fec: baseline-arm-clabbe
2026-03-20 16:38:11,301 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bad4e321a77312e2220fec
2026-03-20 16:38:11,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:38:11,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad4e321a77312e2220fec HTTP/1.1" 200 None
2026-03-20 16:38:11,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:38:11,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad09221a77312e2220ee1 HTTP/1.1" 200 None
2026-03-20 16:38:11,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:38:11,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bad4e321a77312e2220fec HTTP/1.1" 200 None
2026-03-20 16:38:11,373 - lava_callback - ERROR - Error processing callback for node 69bad4e321a77312e2220fec: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
2026-03-20 16:38:11,932 - lava_callback - INFO - Received callback for node 69bad4e321a77312e2220fef
INFO: 172.19.0.1:42764 - "POST /node/69bad4e321a77312e2220fef HTTP/1.0" 202 Accepted
2026-03-20 16:38:11,937 - lava_callback - INFO - Starting async job submit for node 69bad4e321a77312e2220fef
2026-03-20 16:38:11,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:38:11,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad4e321a77312e2220fef HTTP/1.1" 200 None
2026-03-20 16:38:11,953 - lava_callback - DEBUG - Processing node 69bad4e321a77312e2220fef: baseline-arm-clabbe
2026-03-20 16:38:11,953 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bad4e321a77312e2220fef
2026-03-20 16:38:11,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:38:11,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad4e321a77312e2220fef HTTP/1.1" 200 None
2026-03-20 16:38:11,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:38:11,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad09221a77312e2220ee1 HTTP/1.1" 200 None
2026-03-20 16:38:11,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:38:12,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bad4e321a77312e2220fef HTTP/1.1" 200 None
2026-03-20 16:38:12,012 - lava_callback - ERROR - Error processing callback for node 69bad4e321a77312e2220fef: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
2026-03-20 16:38:12,597 - lava_callback - INFO - Received callback for node 69bad4e621a77312e222102e
INFO: 172.19.0.1:42780 - "POST /node/69bad4e621a77312e222102e HTTP/1.0" 202 Accepted
2026-03-20 16:38:12,602 - lava_callback - INFO - Starting async job submit for node 69bad4e621a77312e222102e
2026-03-20 16:38:12,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:38:12,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad4e621a77312e222102e HTTP/1.1" 200 None
2026-03-20 16:38:12,618 - lava_callback - DEBUG - Processing node 69bad4e621a77312e222102e: baseline-arm-clabbe
2026-03-20 16:38:12,618 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bad4e621a77312e222102e
2026-03-20 16:38:12,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:38:12,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad4e621a77312e222102e HTTP/1.1" 200 None
2026-03-20 16:38:12,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:38:12,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad09221a77312e2220ee1 HTTP/1.1" 200 None
2026-03-20 16:38:12,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:38:12,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bad4e621a77312e222102e HTTP/1.1" 200 None
2026-03-20 16:38:12,677 - lava_callback - ERROR - Error processing callback for node 69bad4e621a77312e222102e: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:42786 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:42788 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:38:16,753 - lava_callback - INFO - Received callback for node 69bd77d90e93e2314723e4d8
INFO: 172.19.0.1:42790 - "POST /node/69bd77d90e93e2314723e4d8 HTTP/1.0" 202 Accepted
2026-03-20 16:38:16,759 - lava_callback - INFO - Starting async job submit for node 69bd77d90e93e2314723e4d8
2026-03-20 16:38:16,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:38:16,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd77d90e93e2314723e4d8 HTTP/1.1" 200 None
2026-03-20 16:38:16,794 - lava_callback - DEBUG - Processing node 69bd77d90e93e2314723e4d8: baseline-x86
2026-03-20 16:38:16,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:38:17,119 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:38:17,120 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69bd77d90e93e2314723e4d8/log.txt.gz
2026-03-20 16:38:17,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:38:17,416 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:38:17,417 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69bd77d90e93e2314723e4d8/lava-logs.yaml
2026-03-20 16:38:17,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:38:17,590 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:38:17,591 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69bd77d90e93e2314723e4d8/lava_callback.json.gz
2026-03-20 16:38:17,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:38:17,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd77d90e93e2314723e4d8 HTTP/1.1" 200 None
2026-03-20 16:38:17,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:38:17,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd735d0e93e2314723e2ee HTTP/1.1" 200 None
2026-03-20 16:38:17,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:38:17,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd77d90e93e2314723e4d8 HTTP/1.1" 200 None
2026-03-20 16:38:17,680 - lava_callback - INFO - Completed processing callback for node 69bd77d90e93e2314723e4d8
2026-03-20 16:38:23,648 - lava_callback - INFO - Received callback for node 69bcc7c5b4744551b27fd95d
INFO: 172.19.0.1:35866 - "POST /node/69bcc7c5b4744551b27fd95d HTTP/1.0" 202 Accepted
2026-03-20 16:38:23,654 - lava_callback - INFO - Starting async job submit for node 69bcc7c5b4744551b27fd95d
2026-03-20 16:38:23,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:38:23,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bcc7c5b4744551b27fd95d HTTP/1.1" 200 None
2026-03-20 16:38:23,689 - lava_callback - DEBUG - Processing node 69bcc7c5b4744551b27fd95d: baseline-x86
2026-03-20 16:38:23,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:38:24,117 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:38:24,119 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69bcc7c5b4744551b27fd95d/log.txt.gz
2026-03-20 16:38:24,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:38:24,503 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:38:24,505 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69bcc7c5b4744551b27fd95d/lava-logs.yaml
2026-03-20 16:38:24,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:38:24,690 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:38:24,692 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69bcc7c5b4744551b27fd95d/lava_callback.json.gz
2026-03-20 16:38:24,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:38:24,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bcc7c5b4744551b27fd95d HTTP/1.1" 200 None
2026-03-20 16:38:24,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:38:24,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b974a7151254d948eeea18 HTTP/1.1" 200 None
2026-03-20 16:38:24,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:38:24,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bcc7c5b4744551b27fd95d HTTP/1.1" 200 None
2026-03-20 16:38:24,765 - lava_callback - INFO - Completed processing callback for node 69bcc7c5b4744551b27fd95d
INFO: 172.19.0.1:35878 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:38:27,961 - lava_callback - INFO - Received callback for node 69bd77db0e93e2314723e4e3
INFO: 172.19.0.1:35890 - "POST /node/69bd77db0e93e2314723e4e3 HTTP/1.0" 202 Accepted
2026-03-20 16:38:27,967 - lava_callback - INFO - Starting async job submit for node 69bd77db0e93e2314723e4e3
2026-03-20 16:38:27,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:38:28,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd77db0e93e2314723e4e3 HTTP/1.1" 200 None
2026-03-20 16:38:28,012 - lava_callback - DEBUG - Processing node 69bd77db0e93e2314723e4e3: baseline-x86
2026-03-20 16:38:28,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:38:28,299 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:38:28,301 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69bd77db0e93e2314723e4e3/log.txt.gz
2026-03-20 16:38:28,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:38:28,579 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:38:28,581 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69bd77db0e93e2314723e4e3/lava-logs.yaml
2026-03-20 16:38:28,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:38:28,761 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:38:28,763 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69bd77db0e93e2314723e4e3/lava_callback.json.gz
2026-03-20 16:38:28,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:38:28,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd77db0e93e2314723e4e3 HTTP/1.1" 200 None
2026-03-20 16:38:28,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:38:28,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd735d0e93e2314723e2ee HTTP/1.1" 200 None
2026-03-20 16:38:28,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:38:28,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd77db0e93e2314723e4e3 HTTP/1.1" 200 None
2026-03-20 16:38:28,839 - lava_callback - INFO - Completed processing callback for node 69bd77db0e93e2314723e4e3
2026-03-20 16:38:30,283 - lava_callback - INFO - Received callback for node 69bad4fe21a77312e2221083
INFO: 172.19.0.1:53318 - "POST /node/69bad4fe21a77312e2221083 HTTP/1.0" 202 Accepted
2026-03-20 16:38:30,289 - lava_callback - INFO - Starting async job submit for node 69bad4fe21a77312e2221083
2026-03-20 16:38:30,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:38:30,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad4fe21a77312e2221083 HTTP/1.1" 200 None
2026-03-20 16:38:30,304 - lava_callback - DEBUG - Processing node 69bad4fe21a77312e2221083: baseline-arm-baylibre
2026-03-20 16:38:30,305 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bad4fe21a77312e2221083
2026-03-20 16:38:30,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:38:30,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad4fe21a77312e2221083 HTTP/1.1" 200 None
2026-03-20 16:38:30,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:38:30,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None
2026-03-20 16:38:30,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:38:30,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bad4fe21a77312e2221083 HTTP/1.1" 200 None
2026-03-20 16:38:30,359 - lava_callback - ERROR - Error processing callback for node 69bad4fe21a77312e2221083: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:53322 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:38:39,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:38:39,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:51440 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36670 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36682 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:39:02,478 - lava_callback - INFO - Received callback for node 69bd77d90e93e2314723e4db
INFO: 172.19.0.1:43870 - "POST /node/69bd77d90e93e2314723e4db HTTP/1.0" 202 Accepted
2026-03-20 16:39:02,484 - lava_callback - INFO - Starting async job submit for node 69bd77d90e93e2314723e4db
2026-03-20 16:39:02,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:39:02,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd77d90e93e2314723e4db HTTP/1.1" 200 None
2026-03-20 16:39:02,518 - lava_callback - DEBUG - Processing node 69bd77d90e93e2314723e4db: baseline-x86
2026-03-20 16:39:02,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:39:02,970 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:39:02,972 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69bd77d90e93e2314723e4db/log.txt.gz
2026-03-20 16:39:03,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:39:03,361 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:39:03,363 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69bd77d90e93e2314723e4db/lava-logs.yaml
2026-03-20 16:39:03,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:39:03,530 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:39:03,531 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69bd77d90e93e2314723e4db/lava_callback.json.gz
2026-03-20 16:39:03,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:39:03,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd77d90e93e2314723e4db HTTP/1.1" 200 None
2026-03-20 16:39:03,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:39:03,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd735d0e93e2314723e2ee HTTP/1.1" 200 None
2026-03-20 16:39:03,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:39:03,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd77d90e93e2314723e4db HTTP/1.1" 200 None
2026-03-20 16:39:03,615 - lava_callback - INFO - Completed processing callback for node 69bd77d90e93e2314723e4db
INFO: 172.19.0.1:43878 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:39:09,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:39:09,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
2026-03-20 16:39:10,257 - lava_callback - INFO - Received callback for node 69bad52a21a77312e22210d5
INFO: 172.19.0.1:49218 - "POST /node/69bad52a21a77312e22210d5 HTTP/1.0" 202 Accepted
2026-03-20 16:39:10,263 - lava_callback - INFO - Starting async job submit for node 69bad52a21a77312e22210d5
2026-03-20 16:39:10,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:39:10,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad52a21a77312e22210d5 HTTP/1.1" 200 None
2026-03-20 16:39:10,280 - lava_callback - DEBUG - Processing node 69bad52a21a77312e22210d5: baseline-arm-baylibre
2026-03-20 16:39:10,280 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bad52a21a77312e22210d5
2026-03-20 16:39:10,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:39:10,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad52a21a77312e22210d5 HTTP/1.1" 200 None
2026-03-20 16:39:10,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:39:10,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None
2026-03-20 16:39:10,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:39:10,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bad52a21a77312e22210d5 HTTP/1.1" 200 None
2026-03-20 16:39:10,348 - lava_callback - ERROR - Error processing callback for node 69bad52a21a77312e22210d5: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:49232 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:49238 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:39:21,345 - lava_callback - INFO - Received callback for node 69bd77da0e93e2314723e4de
INFO: 172.19.0.1:48504 - "POST /node/69bd77da0e93e2314723e4de HTTP/1.0" 202 Accepted
2026-03-20 16:39:21,350 - lava_callback - INFO - Starting async job submit for node 69bd77da0e93e2314723e4de
2026-03-20 16:39:21,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:39:21,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd77da0e93e2314723e4de HTTP/1.1" 200 None
2026-03-20 16:39:21,388 - lava_callback - DEBUG - Processing node 69bd77da0e93e2314723e4de: baseline-x86
2026-03-20 16:39:21,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:39:21,806 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:39:21,808 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69bd77da0e93e2314723e4de/log.txt.gz
2026-03-20 16:39:21,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:39:22,175 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:39:22,177 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69bd77da0e93e2314723e4de/lava-logs.yaml
2026-03-20 16:39:22,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:39:22,313 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:39:22,315 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69bd77da0e93e2314723e4de/lava_callback.json.gz
2026-03-20 16:39:22,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:39:22,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd77da0e93e2314723e4de HTTP/1.1" 200 None
2026-03-20 16:39:22,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:39:22,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd735d0e93e2314723e2ee HTTP/1.1" 200 None
2026-03-20 16:39:22,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:39:22,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd77da0e93e2314723e4de HTTP/1.1" 200 None
2026-03-20 16:39:22,400 - lava_callback - INFO - Completed processing callback for node 69bd77da0e93e2314723e4de
INFO: 172.19.0.1:48510 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44468 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:39:39,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:39:39,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:38748 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56892 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56906 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:40:05,772 - lava_callback - INFO - Received callback for node 69bcec22b4744551b27fe201
INFO: 172.19.0.1:47690 - "POST /node/69bcec22b4744551b27fe201 HTTP/1.0" 202 Accepted
2026-03-20 16:40:05,778 - lava_callback - INFO - Starting async job submit for node 69bcec22b4744551b27fe201
2026-03-20 16:40:05,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:40:05,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bcec22b4744551b27fe201 HTTP/1.1" 200 None
2026-03-20 16:40:05,817 - lava_callback - DEBUG - Processing node 69bcec22b4744551b27fe201: baseline-x86
2026-03-20 16:40:06,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:40:06,265 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:40:06,267 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69bcec22b4744551b27fe201/log.txt.gz
2026-03-20 16:40:06,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
INFO: 172.19.0.1:47706 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:40:06,657 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:40:06,659 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69bcec22b4744551b27fe201/lava-logs.yaml
2026-03-20 16:40:06,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:40:06,816 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:40:06,818 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69bcec22b4744551b27fe201/lava_callback.json.gz
2026-03-20 16:40:06,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:40:06,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bcec22b4744551b27fe201 HTTP/1.1" 200 None
2026-03-20 16:40:06,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:40:06,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc92fdb4744551b27f9fe5 HTTP/1.1" 200 None
2026-03-20 16:40:06,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:40:06,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bcec22b4744551b27fe201 HTTP/1.1" 200 None
2026-03-20 16:40:06,914 - lava_callback - INFO - Completed processing callback for node 69bcec22b4744551b27fe201
2026-03-20 16:40:09,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:40:09,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
2026-03-20 16:40:10,312 - lava_callback - INFO - Received callback for node 69bad55721a77312e222111a
INFO: 172.19.0.1:54954 - "POST /node/69bad55721a77312e222111a HTTP/1.0" 202 Accepted
2026-03-20 16:40:10,318 - lava_callback - INFO - Starting async job submit for node 69bad55721a77312e222111a
2026-03-20 16:40:10,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:40:10,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad55721a77312e222111a HTTP/1.1" 200 None
2026-03-20 16:40:10,333 - lava_callback - DEBUG - Processing node 69bad55721a77312e222111a: baseline-arm-baylibre
2026-03-20 16:40:10,333 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bad55721a77312e222111a
2026-03-20 16:40:10,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:40:10,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad55721a77312e222111a HTTP/1.1" 200 None
2026-03-20 16:40:10,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:40:10,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None
2026-03-20 16:40:10,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:40:10,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bad55721a77312e222111a HTTP/1.1" 200 None
2026-03-20 16:40:10,396 - lava_callback - ERROR - Error processing callback for node 69bad55721a77312e222111a: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:54960 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:54964 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60906 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58250 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39248 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:40:50,303 - lava_callback - INFO - Received callback for node 69bad58421a77312e2221163
INFO: 172.19.0.1:55432 - "POST /node/69bad58421a77312e2221163 HTTP/1.0" 202 Accepted
2026-03-20 16:40:50,308 - lava_callback - INFO - Starting async job submit for node 69bad58421a77312e2221163
2026-03-20 16:40:50,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:40:50,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad58421a77312e2221163 HTTP/1.1" 200 None
2026-03-20 16:40:50,329 - lava_callback - DEBUG - Processing node 69bad58421a77312e2221163: baseline-arm-baylibre
2026-03-20 16:40:50,329 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bad58421a77312e2221163
2026-03-20 16:40:50,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:40:50,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad58421a77312e2221163 HTTP/1.1" 200 None
2026-03-20 16:40:50,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:40:50,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None
2026-03-20 16:40:50,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:40:50,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bad58421a77312e2221163 HTTP/1.1" 200 None
2026-03-20 16:40:50,388 - lava_callback - ERROR - Error processing callback for node 69bad58421a77312e2221163: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:55446 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55448 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45794 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57862 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:57876 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:41:21,005 - lava_callback - INFO - Received callback for node 69bcf320b4744551b27fe4a8
INFO: 172.19.0.1:37564 - "POST /node/69bcf320b4744551b27fe4a8 HTTP/1.0" 202 Accepted
2026-03-20 16:41:21,011 - lava_callback - INFO - Starting async job submit for node 69bcf320b4744551b27fe4a8
2026-03-20 16:41:21,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:41:21,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bcf320b4744551b27fe4a8 HTTP/1.1" 200 None
2026-03-20 16:41:21,043 - lava_callback - DEBUG - Processing node 69bcf320b4744551b27fe4a8: baseline-x86
2026-03-20 16:41:21,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:41:21,496 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:41:21,497 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69bcf320b4744551b27fe4a8/log.txt.gz
2026-03-20 16:41:21,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:41:21,896 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:41:21,897 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69bcf320b4744551b27fe4a8/lava-logs.yaml
2026-03-20 16:41:21,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:41:22,081 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:41:22,082 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69bcf320b4744551b27fe4a8/lava_callback.json.gz
2026-03-20 16:41:22,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:41:22,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bcf320b4744551b27fe4a8 HTTP/1.1" 200 None
2026-03-20 16:41:22,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:41:22,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9efafd5731cbd74145fe5 HTTP/1.1" 200 None
2026-03-20 16:41:22,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:41:22,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bcf320b4744551b27fe4a8 HTTP/1.1" 200 None
2026-03-20 16:41:22,165 - lava_callback - INFO - Completed processing callback for node 69bcf320b4744551b27fe4a8
INFO: 172.19.0.1:37576 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:41:30,120 - lava_callback - INFO - Received callback for node 69bad5b321a77312e222118d
INFO: 172.19.0.1:49042 - "POST /node/69bad5b321a77312e222118d HTTP/1.0" 202 Accepted
2026-03-20 16:41:30,126 - lava_callback - INFO - Starting async job submit for node 69bad5b321a77312e222118d
2026-03-20 16:41:30,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:41:30,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad5b321a77312e222118d HTTP/1.1" 200 None
2026-03-20 16:41:30,143 - lava_callback - DEBUG - Processing node 69bad5b321a77312e222118d: baseline-arm-clabbe
2026-03-20 16:41:30,143 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bad5b321a77312e222118d
2026-03-20 16:41:30,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:41:30,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad5b321a77312e222118d HTTP/1.1" 200 None
2026-03-20 16:41:30,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:41:30,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None
2026-03-20 16:41:30,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:41:30,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bad5b321a77312e222118d HTTP/1.1" 200 None
2026-03-20 16:41:30,203 - lava_callback - ERROR - Error processing callback for node 69bad5b321a77312e222118d: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:49044 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:41:39,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:41:39,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:41136 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51978 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51988 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:32986 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:42:09,751 - lava_callback - INFO - Received callback for node 69bd0ae605e4bbd6ba635868
INFO: 172.19.0.1:50596 - "POST /node/69bd0ae605e4bbd6ba635868 HTTP/1.0" 202 Accepted
2026-03-20 16:42:09,760 - lava_callback - INFO - Starting async job submit for node 69bd0ae605e4bbd6ba635868
2026-03-20 16:42:09,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:42:09,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd0ae605e4bbd6ba635868 HTTP/1.1" 200 None
2026-03-20 16:42:09,839 - lava_callback - DEBUG - Processing node 69bd0ae605e4bbd6ba635868: baseline-x86
2026-03-20 16:42:10,057 - lava_callback - INFO - Received callback for node 69bad5de21a77312e22211d2
INFO: 172.19.0.1:50600 - "POST /node/69bad5de21a77312e22211d2 HTTP/1.0" 202 Accepted
2026-03-20 16:42:10,074 - lava_callback - INFO - Starting async job submit for node 69bad5de21a77312e22211d2
2026-03-20 16:42:10,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:42:10,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad5de21a77312e22211d2 HTTP/1.1" 200 None
2026-03-20 16:42:10,127 - lava_callback - DEBUG - Processing node 69bad5de21a77312e22211d2: baseline-arm-clabbe
2026-03-20 16:42:10,127 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bad5de21a77312e22211d2
2026-03-20 16:42:10,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:42:10,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad5de21a77312e22211d2 HTTP/1.1" 200 None
2026-03-20 16:42:10,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:42:10,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None
2026-03-20 16:42:10,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:42:10,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bad5de21a77312e22211d2 HTTP/1.1" 200 None
2026-03-20 16:42:10,367 - lava_callback - ERROR - Error processing callback for node 69bad5de21a77312e22211d2: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
2026-03-20 16:42:10,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:42:10,899 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:42:10,901 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69bd0ae605e4bbd6ba635868/log.txt.gz
2026-03-20 16:42:11,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:42:11,732 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:42:11,734 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69bd0ae605e4bbd6ba635868/lava-logs.yaml
2026-03-20 16:42:11,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:42:12,229 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:42:12,231 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69bd0ae605e4bbd6ba635868/lava_callback.json.gz
2026-03-20 16:42:12,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:42:12,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd0ae605e4bbd6ba635868 HTTP/1.1" 200 None
2026-03-20 16:42:12,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:42:12,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd028c05e4bbd6ba634c81 HTTP/1.1" 200 None
2026-03-20 16:42:12,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:42:12,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd0ae605e4bbd6ba635868 HTTP/1.1" 200 None
2026-03-20 16:42:12,367 - lava_callback - INFO - Completed processing callback for node 69bd0ae605e4bbd6ba635868
INFO: 172.19.0.1:50612 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:50624 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51656 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47012 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:42:39,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:42:39,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:40980 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51526 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51542 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:43:05,860 - lava_callback - INFO - Received callback for node 69bd124705e4bbd6ba635b32
INFO: 172.19.0.1:47980 - "POST /node/69bd124705e4bbd6ba635b32 HTTP/1.0" 202 Accepted
2026-03-20 16:43:05,865 - lava_callback - INFO - Starting async job submit for node 69bd124705e4bbd6ba635b32
2026-03-20 16:43:05,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:43:05,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd124705e4bbd6ba635b32 HTTP/1.1" 200 None
2026-03-20 16:43:05,899 - lava_callback - DEBUG - Processing node 69bd124705e4bbd6ba635b32: baseline-x86
2026-03-20 16:43:06,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:43:06,340 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:43:06,342 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69bd124705e4bbd6ba635b32/log.txt.gz
2026-03-20 16:43:06,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
INFO: 172.19.0.1:47984 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:43:06,719 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:43:06,721 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69bd124705e4bbd6ba635b32/lava-logs.yaml
2026-03-20 16:43:06,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:43:06,890 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:43:06,891 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69bd124705e4bbd6ba635b32/lava_callback.json.gz
2026-03-20 16:43:06,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:43:06,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd124705e4bbd6ba635b32 HTTP/1.1" 200 None
2026-03-20 16:43:06,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:43:06,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f95537ae4d3c8236e6f HTTP/1.1" 200 None
2026-03-20 16:43:06,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:43:06,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd124705e4bbd6ba635b32 HTTP/1.1" 200 None
2026-03-20 16:43:06,971 - lava_callback - INFO - Completed processing callback for node 69bd124705e4bbd6ba635b32
2026-03-20 16:43:09,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:43:09,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
2026-03-20 16:43:10,176 - lava_callback - INFO - Received callback for node 69bad60a21a77312e22211ee
INFO: 172.19.0.1:56806 - "POST /node/69bad60a21a77312e22211ee HTTP/1.0" 202 Accepted
2026-03-20 16:43:10,185 - lava_callback - INFO - Starting async job submit for node 69bad60a21a77312e22211ee
2026-03-20 16:43:10,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:43:10,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad60a21a77312e22211ee HTTP/1.1" 200 None
2026-03-20 16:43:10,205 - lava_callback - DEBUG - Processing node 69bad60a21a77312e22211ee: baseline-arm-clabbe
2026-03-20 16:43:10,205 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bad60a21a77312e22211ee
2026-03-20 16:43:10,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:43:10,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad60a21a77312e22211ee HTTP/1.1" 200 None
2026-03-20 16:43:10,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:43:10,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None
2026-03-20 16:43:10,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:43:10,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bad60a21a77312e22211ee HTTP/1.1" 200 None
2026-03-20 16:43:10,262 - lava_callback - ERROR - Error processing callback for node 69bad60a21a77312e22211ee: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:56820 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:56828 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42742 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56568 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:43:44,020 - lava_callback - INFO - Received callback for node 69bd40ec05e4bbd6ba636398
INFO: 172.19.0.1:37270 - "POST /node/69bd40ec05e4bbd6ba636398 HTTP/1.0" 202 Accepted
2026-03-20 16:43:44,026 - lava_callback - INFO - Starting async job submit for node 69bd40ec05e4bbd6ba636398
2026-03-20 16:43:44,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:43:44,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd40ec05e4bbd6ba636398 HTTP/1.1" 200 None
2026-03-20 16:43:44,058 - lava_callback - DEBUG - Processing node 69bd40ec05e4bbd6ba636398: baseline-x86
2026-03-20 16:43:44,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:43:44,520 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:43:44,522 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69bd40ec05e4bbd6ba636398/log.txt.gz
2026-03-20 16:43:44,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:43:44,908 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:43:44,911 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69bd40ec05e4bbd6ba636398/lava-logs.yaml
2026-03-20 16:43:44,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:43:45,065 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:43:45,066 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69bd40ec05e4bbd6ba636398/lava_callback.json.gz
2026-03-20 16:43:45,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:43:45,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd40ec05e4bbd6ba636398 HTTP/1.1" 200 None
2026-03-20 16:43:45,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:43:45,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc92fdb4744551b27f9fe5 HTTP/1.1" 200 None
2026-03-20 16:43:45,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:43:45,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd40ec05e4bbd6ba636398 HTTP/1.1" 200 None
2026-03-20 16:43:45,146 - lava_callback - INFO - Completed processing callback for node 69bd40ec05e4bbd6ba636398
INFO: 172.19.0.1:37278 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:43:50,179 - lava_callback - INFO - Received callback for node 69bad63621a77312e2221237
INFO: 172.19.0.1:38060 - "POST /node/69bad63621a77312e2221237 HTTP/1.0" 202 Accepted
2026-03-20 16:43:50,185 - lava_callback - INFO - Starting async job submit for node 69bad63621a77312e2221237
2026-03-20 16:43:50,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:43:50,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad63621a77312e2221237 HTTP/1.1" 200 None
2026-03-20 16:43:50,203 - lava_callback - DEBUG - Processing node 69bad63621a77312e2221237: baseline-arm-clabbe
2026-03-20 16:43:50,203 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bad63621a77312e2221237
2026-03-20 16:43:50,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:43:50,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad63621a77312e2221237 HTTP/1.1" 200 None
2026-03-20 16:43:50,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:43:50,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None
2026-03-20 16:43:50,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:43:50,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bad63621a77312e2221237 HTTP/1.1" 200 None
2026-03-20 16:43:50,264 - lava_callback - ERROR - Error processing callback for node 69bad63621a77312e2221237: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:38064 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38076 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48156 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:44:09,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:44:09,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:57706 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:57710 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45296 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:44:30,162 - lava_callback - INFO - Received callback for node 69bad66221a77312e2221259
INFO: 172.19.0.1:58014 - "POST /node/69bad66221a77312e2221259 HTTP/1.0" 202 Accepted
2026-03-20 16:44:30,168 - lava_callback - INFO - Starting async job submit for node 69bad66221a77312e2221259
2026-03-20 16:44:30,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:44:30,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad66221a77312e2221259 HTTP/1.1" 200 None
2026-03-20 16:44:30,184 - lava_callback - DEBUG - Processing node 69bad66221a77312e2221259: baseline-arm-clabbe
2026-03-20 16:44:30,185 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bad66221a77312e2221259
2026-03-20 16:44:30,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:44:30,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad66221a77312e2221259 HTTP/1.1" 200 None
2026-03-20 16:44:30,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:44:30,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None
2026-03-20 16:44:30,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:44:30,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bad66221a77312e2221259 HTTP/1.1" 200 None
2026-03-20 16:44:30,237 - lava_callback - ERROR - Error processing callback for node 69bad66221a77312e2221259: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:58018 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:44:41,719 - lava_callback - INFO - Received callback for node 69bd491805e4bbd6ba636b2a
INFO: 172.19.0.1:50340 - "POST /node/69bd491805e4bbd6ba636b2a HTTP/1.0" 202 Accepted
2026-03-20 16:44:41,725 - lava_callback - INFO - Starting async job submit for node 69bd491805e4bbd6ba636b2a
2026-03-20 16:44:41,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:44:41,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd491805e4bbd6ba636b2a HTTP/1.1" 200 None
2026-03-20 16:44:41,757 - lava_callback - DEBUG - Processing node 69bd491805e4bbd6ba636b2a: baseline-x86
2026-03-20 16:44:42,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:44:42,212 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:44:42,213 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69bd491805e4bbd6ba636b2a/log.txt.gz
2026-03-20 16:44:42,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:44:42,585 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:44:42,588 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69bd491805e4bbd6ba636b2a/lava-logs.yaml
2026-03-20 16:44:42,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:44:42,751 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:44:42,753 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69bd491805e4bbd6ba636b2a/lava_callback.json.gz
2026-03-20 16:44:42,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:44:42,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd491805e4bbd6ba636b2a HTTP/1.1" 200 None
2026-03-20 16:44:42,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:44:42,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9efafd5731cbd74145fe5 HTTP/1.1" 200 None
2026-03-20 16:44:42,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:44:42,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd491805e4bbd6ba636b2a HTTP/1.1" 200 None
2026-03-20 16:44:42,833 - lava_callback - INFO - Completed processing callback for node 69bd491805e4bbd6ba636b2a
INFO: 172.19.0.1:50354 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49184 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49194 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49120 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:45:09,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:45:09,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:40724 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:40740 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:45:23,368 - lava_callback - INFO - Received callback for node 69bd653c05e4bbd6ba63731f
INFO: 172.19.0.1:47074 - "POST /node/69bd653c05e4bbd6ba63731f HTTP/1.0" 202 Accepted
2026-03-20 16:45:23,374 - lava_callback - INFO - Starting async job submit for node 69bd653c05e4bbd6ba63731f
2026-03-20 16:45:23,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:45:23,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd653c05e4bbd6ba63731f HTTP/1.1" 200 None
2026-03-20 16:45:23,407 - lava_callback - DEBUG - Processing node 69bd653c05e4bbd6ba63731f: baseline-x86
2026-03-20 16:45:23,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:45:23,871 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:45:23,873 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69bd653c05e4bbd6ba63731f/log.txt.gz
2026-03-20 16:45:24,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:45:24,289 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:45:24,291 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69bd653c05e4bbd6ba63731f/lava-logs.yaml
2026-03-20 16:45:24,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:45:24,434 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:45:24,436 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69bd653c05e4bbd6ba63731f/lava_callback.json.gz
2026-03-20 16:45:24,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:45:24,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd653c05e4bbd6ba63731f HTTP/1.1" 200 None
2026-03-20 16:45:24,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:45:24,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd028c05e4bbd6ba634c81 HTTP/1.1" 200 None
2026-03-20 16:45:24,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:45:24,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd653c05e4bbd6ba63731f HTTP/1.1" 200 None
2026-03-20 16:45:24,517 - lava_callback - INFO - Completed processing callback for node 69bd653c05e4bbd6ba63731f
INFO: 172.19.0.1:47090 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45696 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:45:39,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:45:39,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:42218 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50238 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50250 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45092 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51430 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:51436 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34356 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34514 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:46:45,959 - lava_callback - INFO - Received callback for node 69bd755b0e93e2314723e3af
INFO: 172.19.0.1:51840 - "POST /node/69bd755b0e93e2314723e3af HTTP/1.0" 202 Accepted
2026-03-20 16:46:45,966 - lava_callback - INFO - Starting async job submit for node 69bd755b0e93e2314723e3af
2026-03-20 16:46:46,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:46:46,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd755b0e93e2314723e3af HTTP/1.1" 200 None
2026-03-20 16:46:46,039 - lava_callback - DEBUG - Processing node 69bd755b0e93e2314723e3af: ltp-smoke
INFO: 172.19.0.1:51842 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:46:46,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:46:46,678 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:46:46,680 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69bd755b0e93e2314723e3af/log.txt.gz
2026-03-20 16:46:46,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:46:47,198 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:46:47,200 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69bd755b0e93e2314723e3af/lava-logs.yaml
2026-03-20 16:46:47,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:46:47,435 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:46:47,437 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69bd755b0e93e2314723e3af/lava_callback.json.gz
2026-03-20 16:46:47,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:46:47,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd755b0e93e2314723e3af HTTP/1.1" 200 None
2026-03-20 16:46:47,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:46:47,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73350e93e2314723e2bb HTTP/1.1" 200 None
2026-03-20 16:46:47,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:46:47,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd755b0e93e2314723e3af HTTP/1.1" 200 None
2026-03-20 16:46:47,737 - lava_callback - INFO - Completed processing callback for node 69bd755b0e93e2314723e3af
INFO: 172.19.0.1:44276 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44288 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60580 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:47:09,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:47:09,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:36530 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:36540 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49068 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58832 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60374 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58908 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58924 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:48:01,179 - lava_callback - INFO - Received callback for node 69bd6a6905e4bbd6ba6373cf
INFO: 172.19.0.1:46070 - "POST /node/69bd6a6905e4bbd6ba6373cf HTTP/1.0" 202 Accepted
2026-03-20 16:48:01,185 - lava_callback - INFO - Starting async job submit for node 69bd6a6905e4bbd6ba6373cf
2026-03-20 16:48:01,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:48:01,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd6a6905e4bbd6ba6373cf HTTP/1.1" 200 None
2026-03-20 16:48:01,218 - lava_callback - DEBUG - Processing node 69bd6a6905e4bbd6ba6373cf: baseline-x86
2026-03-20 16:48:01,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:48:01,682 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:48:01,683 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69bd6a6905e4bbd6ba6373cf/log.txt.gz
2026-03-20 16:48:01,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:48:02,096 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:48:02,098 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69bd6a6905e4bbd6ba6373cf/lava-logs.yaml
2026-03-20 16:48:02,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:48:02,283 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:48:02,285 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69bd6a6905e4bbd6ba6373cf/lava_callback.json.gz
2026-03-20 16:48:02,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:48:02,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd6a6905e4bbd6ba6373cf HTTP/1.1" 200 None
2026-03-20 16:48:02,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:48:02,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f95537ae4d3c8236e6f HTTP/1.1" 200 None
2026-03-20 16:48:02,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:48:02,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd6a6905e4bbd6ba6373cf HTTP/1.1" 200 None
2026-03-20 16:48:02,359 - lava_callback - INFO - Completed processing callback for node 69bd6a6905e4bbd6ba6373cf
INFO: 172.19.0.1:46084 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:48:09,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:48:09,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:34988 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:34994 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48278 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58570 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36394 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46628 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46634 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56102 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51258 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:51274 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34336 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59728 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43988 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56398 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56402 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59920 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:50:09,112 - lava_callback - INFO - Received callback for node 69bd77dc0e93e2314723e4e7
INFO: 172.19.0.1:59936 - "POST /node/69bd77dc0e93e2314723e4e7 HTTP/1.0" 202 Accepted
2026-03-20 16:50:09,121 - lava_callback - INFO - Starting async job submit for node 69bd77dc0e93e2314723e4e7
2026-03-20 16:50:09,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:50:09,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd77dc0e93e2314723e4e7 HTTP/1.1" 200 None
2026-03-20 16:50:09,170 - lava_callback - DEBUG - Processing node 69bd77dc0e93e2314723e4e7: baseline-x86
2026-03-20 16:50:09,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:50:10,268 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:50:10,270 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69bd77dc0e93e2314723e4e7/log.txt.gz
2026-03-20 16:50:10,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:50:11,119 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:50:11,121 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69bd77dc0e93e2314723e4e7/lava-logs.yaml
2026-03-20 16:50:11,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:50:11,599 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:50:11,601 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69bd77dc0e93e2314723e4e7/lava_callback.json.gz
2026-03-20 16:50:11,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:50:11,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd77dc0e93e2314723e4e7 HTTP/1.1" 200 None
2026-03-20 16:50:11,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:50:11,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd735d0e93e2314723e2ee HTTP/1.1" 200 None
2026-03-20 16:50:11,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:50:11,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd77dc0e93e2314723e4e7 HTTP/1.1" 200 None
2026-03-20 16:50:11,713 - lava_callback - INFO - Completed processing callback for node 69bd77dc0e93e2314723e4e7
INFO: 172.19.0.1:47938 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:47940 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51136 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:50:30,781 - lava_callback - INFO - Received callback for node 69bd7aa10e93e2314723e6a1
INFO: 172.19.0.1:44136 - "POST /node/69bd7aa10e93e2314723e6a1 HTTP/1.0" 202 Accepted
2026-03-20 16:50:30,793 - lava_callback - INFO - Starting async job submit for node 69bd7aa10e93e2314723e6a1
2026-03-20 16:50:30,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:50:30,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7aa10e93e2314723e6a1 HTTP/1.1" 200 None
2026-03-20 16:50:30,845 - lava_callback - DEBUG - Processing node 69bd7aa10e93e2314723e6a1: baseline-arm64
2026-03-20 16:50:31,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:50:32,077 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:50:32,079 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7aa10e93e2314723e6a1/log.txt.gz
2026-03-20 16:50:32,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:50:33,229 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:50:33,231 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7aa10e93e2314723e6a1/lava-logs.yaml
2026-03-20 16:50:33,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:50:34,354 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:50:34,356 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7aa10e93e2314723e6a1/lava_callback.json.gz
2026-03-20 16:50:34,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:50:34,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7aa10e93e2314723e6a1 HTTP/1.1" 200 None
2026-03-20 16:50:34,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:50:34,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 16:50:34,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:50:34,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7aa10e93e2314723e6a1 HTTP/1.1" 200 None
2026-03-20 16:50:34,473 - lava_callback - INFO - Completed processing callback for node 69bd7aa10e93e2314723e6a1
INFO: 172.19.0.1:44140 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:50:36,939 - lava_callback - INFO - Received callback for node 69bd7aaf0e93e2314723e6ce
INFO: 172.19.0.1:44150 - "POST /node/69bd7aaf0e93e2314723e6ce HTTP/1.0" 202 Accepted
2026-03-20 16:50:36,948 - lava_callback - INFO - Starting async job submit for node 69bd7aaf0e93e2314723e6ce
2026-03-20 16:50:36,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:50:36,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7aaf0e93e2314723e6ce HTTP/1.1" 200 None
2026-03-20 16:50:37,000 - lava_callback - DEBUG - Processing node 69bd7aaf0e93e2314723e6ce: baseline-arm64
2026-03-20 16:50:37,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:50:38,215 - lava_callback - INFO - Received callback for node 69bd7ac20e93e2314723e6f5
INFO: 172.19.0.1:44152 - "POST /node/69bd7ac20e93e2314723e6f5 HTTP/1.0" 202 Accepted
2026-03-20 16:50:38,224 - lava_callback - INFO - Starting async job submit for node 69bd7ac20e93e2314723e6f5
2026-03-20 16:50:38,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:50:38,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7ac20e93e2314723e6f5 HTTP/1.1" 200 None
2026-03-20 16:50:38,252 - lava_callback - DEBUG - Processing node 69bd7ac20e93e2314723e6f5: baseline-nfs-arm64
2026-03-20 16:50:38,254 - lava_callback - WARNING - Failed to upload log
2026-03-20 16:50:38,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:50:38,412 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:50:38,414 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7aaf0e93e2314723e6ce/log.txt.gz
2026-03-20 16:50:38,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:50:39,396 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:50:39,398 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd7ac20e93e2314723e6f5/lava-logs.yaml
2026-03-20 16:50:39,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:50:39,687 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:50:39,690 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7aaf0e93e2314723e6ce/lava-logs.yaml
2026-03-20 16:50:39,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:50:39,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:50:39,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
2026-03-20 16:50:40,635 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:50:40,637 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd7ac20e93e2314723e6f5/lava_callback.json.gz
2026-03-20 16:50:40,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:50:40,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7ac20e93e2314723e6f5 HTTP/1.1" 200 None
2026-03-20 16:50:40,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:50:40,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 16:50:40,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:50:40,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7ac20e93e2314723e6f5 HTTP/1.1" 200 None
2026-03-20 16:50:40,721 - lava_callback - INFO - Completed processing callback for node 69bd7ac20e93e2314723e6f5
2026-03-20 16:50:41,071 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:50:41,073 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7aaf0e93e2314723e6ce/lava_callback.json.gz
2026-03-20 16:50:41,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:50:41,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7aaf0e93e2314723e6ce HTTP/1.1" 200 None
2026-03-20 16:50:41,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:50:41,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 16:50:41,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:50:41,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7aaf0e93e2314723e6ce HTTP/1.1" 200 None
2026-03-20 16:50:41,202 - lava_callback - INFO - Completed processing callback for node 69bd7aaf0e93e2314723e6ce
INFO: 172.19.0.1:35852 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:50:55,334 - lava_callback - INFO - Received callback for node 69bd7ab40e93e2314723e6da
INFO: 172.19.0.1:59654 - "POST /node/69bd7ab40e93e2314723e6da HTTP/1.0" 202 Accepted
2026-03-20 16:50:55,345 - lava_callback - INFO - Starting async job submit for node 69bd7ab40e93e2314723e6da
2026-03-20 16:50:55,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:50:55,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7ab40e93e2314723e6da HTTP/1.1" 200 None
2026-03-20 16:50:55,401 - lava_callback - DEBUG - Processing node 69bd7ab40e93e2314723e6da: baseline-arm64
2026-03-20 16:50:55,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
INFO: 172.19.0.1:59668 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:50:56,526 - lava_callback - INFO - Received callback for node 69bd7aa30e93e2314723e6a7
INFO: 172.19.0.1:59676 - "POST /node/69bd7aa30e93e2314723e6a7 HTTP/1.0" 202 Accepted
2026-03-20 16:50:56,537 - lava_callback - INFO - Starting async job submit for node 69bd7aa30e93e2314723e6a7
2026-03-20 16:50:56,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:50:56,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7aa30e93e2314723e6a7 HTTP/1.1" 200 None
2026-03-20 16:50:56,599 - lava_callback - DEBUG - Processing node 69bd7aa30e93e2314723e6a7: baseline-arm64
INFO: 172.19.0.1:59686 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:50:57,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:50:57,342 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:50:57,344 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7ab40e93e2314723e6da/log.txt.gz
2026-03-20 16:50:57,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:50:58,552 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:50:58,554 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7aa30e93e2314723e6a7/log.txt.gz
2026-03-20 16:50:58,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:50:59,199 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:50:59,202 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7ab40e93e2314723e6da/lava-logs.yaml
2026-03-20 16:50:59,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:51:00,474 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:51:00,477 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7aa30e93e2314723e6a7/lava-logs.yaml
2026-03-20 16:51:00,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:51:00,818 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:51:00,820 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7ab40e93e2314723e6da/lava_callback.json.gz
2026-03-20 16:51:00,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:51:00,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7ab40e93e2314723e6da HTTP/1.1" 200 None
2026-03-20 16:51:00,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:51:00,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 16:51:00,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:51:00,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7ab40e93e2314723e6da HTTP/1.1" 200 None
2026-03-20 16:51:00,946 - lava_callback - INFO - Completed processing callback for node 69bd7ab40e93e2314723e6da
2026-03-20 16:51:02,156 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:51:02,158 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7aa30e93e2314723e6a7/lava_callback.json.gz
2026-03-20 16:51:02,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:51:02,203 - lava_callback - INFO - Received callback for node 69bd7aab0e93e2314723e6c8
INFO: 172.19.0.1:55850 - "POST /node/69bd7aab0e93e2314723e6c8 HTTP/1.0" 202 Accepted
2026-03-20 16:51:02,221 - lava_callback - INFO - Starting async job submit for node 69bd7aab0e93e2314723e6c8
2026-03-20 16:51:02,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:51:02,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7aa30e93e2314723e6a7 HTTP/1.1" 200 None
2026-03-20 16:51:02,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:51:02,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7aab0e93e2314723e6c8 HTTP/1.1" 200 None
2026-03-20 16:51:02,288 - lava_callback - DEBUG - Processing node 69bd7aab0e93e2314723e6c8: baseline-arm64
2026-03-20 16:51:02,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 16:51:02,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:51:02,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7aa30e93e2314723e6a7 HTTP/1.1" 200 None
2026-03-20 16:51:02,475 - lava_callback - INFO - Completed processing callback for node 69bd7aa30e93e2314723e6a7
2026-03-20 16:51:03,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:51:04,579 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:51:04,581 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7aab0e93e2314723e6c8/log.txt.gz
2026-03-20 16:51:04,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:51:05,836 - lava_callback - INFO - Received callback for node 69bd7aaa0e93e2314723e6c5
INFO: 172.19.0.1:55852 - "POST /node/69bd7aaa0e93e2314723e6c5 HTTP/1.0" 202 Accepted
2026-03-20 16:51:05,846 - lava_callback - INFO - Starting async job submit for node 69bd7aaa0e93e2314723e6c5
2026-03-20 16:51:05,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:51:05,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7aaa0e93e2314723e6c5 HTTP/1.1" 200 None
2026-03-20 16:51:05,905 - lava_callback - DEBUG - Processing node 69bd7aaa0e93e2314723e6c5: baseline-arm64
2026-03-20 16:51:06,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
INFO: 172.19.0.1:55864 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:51:06,650 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:51:06,652 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7aab0e93e2314723e6c8/lava-logs.yaml
2026-03-20 16:51:06,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:51:08,013 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:51:08,015 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7aaa0e93e2314723e6c5/log.txt.gz
2026-03-20 16:51:08,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:51:08,297 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:51:08,299 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7aab0e93e2314723e6c8/lava_callback.json.gz
2026-03-20 16:51:08,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:51:08,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7aab0e93e2314723e6c8 HTTP/1.1" 200 None
2026-03-20 16:51:08,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:51:08,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 16:51:08,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:51:08,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7aab0e93e2314723e6c8 HTTP/1.1" 200 None
2026-03-20 16:51:08,414 - lava_callback - INFO - Completed processing callback for node 69bd7aab0e93e2314723e6c8
2026-03-20 16:51:09,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:51:09,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15
2026-03-20 16:51:10,038 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:51:10,041 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7aaa0e93e2314723e6c5/lava-logs.yaml
2026-03-20 16:51:10,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:51:10,371 - lava_callback - INFO - Received callback for node 69bd7ab00e93e2314723e6d1
INFO: 172.19.0.1:37216 - "POST /node/69bd7ab00e93e2314723e6d1 HTTP/1.0" 202 Accepted
2026-03-20 16:51:10,383 - lava_callback - INFO - Starting async job submit for node 69bd7ab00e93e2314723e6d1
2026-03-20 16:51:10,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:51:10,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7ab00e93e2314723e6d1 HTTP/1.1" 200 None
2026-03-20 16:51:10,437 - lava_callback - DEBUG - Processing node 69bd7ab00e93e2314723e6d1: baseline-arm64
2026-03-20 16:51:10,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:51:11,597 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:51:11,599 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7aaa0e93e2314723e6c5/lava_callback.json.gz
2026-03-20 16:51:11,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:51:11,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7aaa0e93e2314723e6c5 HTTP/1.1" 200 None
2026-03-20 16:51:11,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:51:11,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 16:51:11,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:51:11,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7aaa0e93e2314723e6c5 HTTP/1.1" 200 None
2026-03-20 16:51:11,762 - lava_callback - INFO - Completed processing callback for node 69bd7aaa0e93e2314723e6c5
2026-03-20 16:51:12,406 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:51:12,408 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7ab00e93e2314723e6d1/log.txt.gz
2026-03-20 16:51:12,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:51:14,163 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:51:14,165 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7ab00e93e2314723e6d1/lava-logs.yaml
2026-03-20 16:51:14,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
INFO: 172.19.0.1:37222 - "GET /api/metrics HTTP/1.0" 200 OK
2026-03-20 16:51:15,600 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:51:15,602 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7ab00e93e2314723e6d1/lava_callback.json.gz
2026-03-20 16:51:15,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:51:15,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7ab00e93e2314723e6d1 HTTP/1.1" 200 None
2026-03-20 16:51:15,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:51:15,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 16:51:15,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:51:15,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7ab00e93e2314723e6d1 HTTP/1.1" 200 None
2026-03-20 16:51:15,710 - lava_callback - INFO - Completed processing callback for node 69bd7ab00e93e2314723e6d1
2026-03-20 16:51:16,452 - lava_callback - INFO - Received callback for node 69bd7aa20e93e2314723e6a4
INFO: 172.19.0.1:37228 - "POST /node/69bd7aa20e93e2314723e6a4 HTTP/1.0" 202 Accepted
2026-03-20 16:51:16,461 - lava_callback - INFO - Starting async job submit for node 69bd7aa20e93e2314723e6a4
2026-03-20 16:51:16,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
INFO: 172.19.0.1:37244 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:51:16,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7aa20e93e2314723e6a4 HTTP/1.1" 200 None
2026-03-20 16:51:16,510 - lava_callback - DEBUG - Processing node 69bd7aa20e93e2314723e6a4: baseline-arm64
2026-03-20 16:51:16,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:51:18,247 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:51:18,249 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7aa20e93e2314723e6a4/log.txt.gz
2026-03-20 16:51:18,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:51:19,713 - lava_callback - INFO - Received callback for node 69bd7aa90e93e2314723e6c2
INFO: 172.19.0.1:36298 - "POST /node/69bd7aa90e93e2314723e6c2 HTTP/1.0" 202 Accepted
2026-03-20 16:51:19,724 - lava_callback - INFO - Starting async job submit for node 69bd7aa90e93e2314723e6c2
2026-03-20 16:51:19,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:51:19,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7aa90e93e2314723e6c2 HTTP/1.1" 200 None
2026-03-20 16:51:19,772 - lava_callback - DEBUG - Processing node 69bd7aa90e93e2314723e6c2: baseline-arm64
2026-03-20 16:51:19,833 - lava_callback - INFO - Received callback for node 69bd7aa50e93e2314723e6ad
INFO: 172.19.0.1:36310 - "POST /node/69bd7aa50e93e2314723e6ad HTTP/1.0" 202 Accepted
2026-03-20 16:51:19,859 - lava_callback - INFO - Starting async job submit for node 69bd7aa50e93e2314723e6ad
2026-03-20 16:51:19,891 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:51:19,893 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7aa20e93e2314723e6a4/lava-logs.yaml
2026-03-20 16:51:19,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:51:19,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:51:20,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7aa50e93e2314723e6ad HTTP/1.1" 200 None
2026-03-20 16:51:20,042 - lava_callback - DEBUG - Processing node 69bd7aa50e93e2314723e6ad: baseline-arm64
2026-03-20 16:51:20,468 - lava_callback - WARNING - Failed to upload log
2026-03-20 16:51:20,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:51:20,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:51:21,057 - lava_callback - INFO - Received callback for node 69bd7aa60e93e2314723e6b0
2026-03-20 16:51:21,066 - lava_callback - INFO - Starting async job submit for node 69bd7aa60e93e2314723e6b0
INFO: 172.19.0.1:36318 - "POST /node/69bd7aa60e93e2314723e6b0 HTTP/1.0" 202 Accepted
2026-03-20 16:51:21,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:51:21,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7aa60e93e2314723e6b0 HTTP/1.1" 200 None
2026-03-20 16:51:21,138 - lava_callback - DEBUG - Processing node 69bd7aa60e93e2314723e6b0: baseline-arm64
2026-03-20 16:51:21,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:51:21,610 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:51:21,611 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7aa20e93e2314723e6a4/lava_callback.json.gz
2026-03-20 16:51:21,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:51:21,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7aa20e93e2314723e6a4 HTTP/1.1" 200 None
2026-03-20 16:51:21,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:51:21,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 16:51:21,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:51:21,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7aa20e93e2314723e6a4 HTTP/1.1" 200 None
2026-03-20 16:51:21,718 - lava_callback - INFO - Completed processing callback for node 69bd7aa20e93e2314723e6a4
2026-03-20 16:51:22,265 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:51:22,267 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7aa90e93e2314723e6c2/log.txt.gz
2026-03-20 16:51:22,364 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:51:22,387 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7aa50e93e2314723e6ad/lava-logs.yaml
2026-03-20 16:51:22,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:51:22,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:51:23,021 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:51:23,023 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7aa60e93e2314723e6b0/log.txt.gz
2026-03-20 16:51:23,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:51:24,154 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:51:24,157 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7aa50e93e2314723e6ad/lava_callback.json.gz
2026-03-20 16:51:24,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:51:24,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7aa50e93e2314723e6ad HTTP/1.1" 200 None
2026-03-20 16:51:24,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:51:24,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 16:51:24,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:51:24,241 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:51:24,243 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7aa90e93e2314723e6c2/lava-logs.yaml
2026-03-20 16:51:24,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:51:24,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7aa50e93e2314723e6ad HTTP/1.1" 200 None
2026-03-20 16:51:24,394 - lava_callback - INFO - Completed processing callback for node 69bd7aa50e93e2314723e6ad
2026-03-20 16:51:24,861 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:51:24,863 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7aa60e93e2314723e6b0/lava-logs.yaml
2026-03-20 16:51:24,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:51:25,246 - lava_callback - INFO - Received callback for node 69bd7ac90e93e2314723e71b
INFO: 172.19.0.1:36330 - "POST /node/69bd7ac90e93e2314723e71b HTTP/1.0" 202 Accepted
2026-03-20 16:51:25,255 - lava_callback - INFO - Starting async job submit for node 69bd7ac90e93e2314723e71b
2026-03-20 16:51:25,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:51:25,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7ac90e93e2314723e71b HTTP/1.1" 200 None
2026-03-20 16:51:25,308 - lava_callback - DEBUG - Processing node 69bd7ac90e93e2314723e71b: baseline-nfs-arm64
2026-03-20 16:51:25,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:51:25,914 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:51:25,916 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7aa90e93e2314723e6c2/lava_callback.json.gz
2026-03-20 16:51:25,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:51:25,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7aa90e93e2314723e6c2 HTTP/1.1" 200 None
2026-03-20 16:51:25,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:51:26,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 16:51:26,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:51:26,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7aa90e93e2314723e6c2 HTTP/1.1" 200 None
2026-03-20 16:51:26,051 - lava_callback - INFO - Completed processing callback for node 69bd7aa90e93e2314723e6c2
INFO: 172.19.0.1:36336 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:51:26,590 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:51:26,592 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7aa60e93e2314723e6b0/lava_callback.json.gz
2026-03-20 16:51:26,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:51:26,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7aa60e93e2314723e6b0 HTTP/1.1" 200 None
2026-03-20 16:51:26,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:51:26,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 16:51:26,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:51:26,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7aa60e93e2314723e6b0 HTTP/1.1" 200 None
2026-03-20 16:51:26,834 - lava_callback - INFO - Completed processing callback for node 69bd7aa60e93e2314723e6b0
2026-03-20 16:51:27,723 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:51:27,725 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd7ac90e93e2314723e71b/log.txt.gz
2026-03-20 16:51:28,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:51:29,766 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:51:29,768 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd7ac90e93e2314723e71b/lava-logs.yaml
2026-03-20 16:51:29,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:51:31,211 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:51:31,213 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd7ac90e93e2314723e71b/lava_callback.json.gz
2026-03-20 16:51:31,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:51:31,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7ac90e93e2314723e71b HTTP/1.1" 200 None
2026-03-20 16:51:31,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:51:31,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 16:51:31,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:51:31,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7ac90e93e2314723e71b HTTP/1.1" 200 None
2026-03-20 16:51:31,329 - lava_callback - INFO - Completed processing callback for node 69bd7ac90e93e2314723e71b
2026-03-20 16:51:35,446 - lava_callback - INFO - Received callback for node 69bd7ab20e93e2314723e6d7
INFO: 172.19.0.1:57332 - "POST /node/69bd7ab20e93e2314723e6d7 HTTP/1.0" 202 Accepted
2026-03-20 16:51:35,453 - lava_callback - INFO - Starting async job submit for node 69bd7ab20e93e2314723e6d7
2026-03-20 16:51:35,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:51:35,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7ab20e93e2314723e6d7 HTTP/1.1" 200 None
2026-03-20 16:51:35,498 - lava_callback - DEBUG - Processing node 69bd7ab20e93e2314723e6d7: baseline-arm64
2026-03-20 16:51:35,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
INFO: 172.19.0.1:57338 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:51:37,229 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:51:37,231 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7ab20e93e2314723e6d7/log.txt.gz
2026-03-20 16:51:37,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:51:38,959 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:51:38,961 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7ab20e93e2314723e6d7/lava-logs.yaml
2026-03-20 16:51:38,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:51:39,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:51:39,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15
2026-03-20 16:51:40,404 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:51:40,406 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7ab20e93e2314723e6d7/lava_callback.json.gz
2026-03-20 16:51:40,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:51:40,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7ab20e93e2314723e6d7 HTTP/1.1" 200 None
2026-03-20 16:51:40,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:51:40,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 16:51:40,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:51:40,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7ab20e93e2314723e6d7 HTTP/1.1" 200 None
2026-03-20 16:51:40,516 - lava_callback - INFO - Completed processing callback for node 69bd7ab20e93e2314723e6d7
INFO: 172.19.0.1:37192 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:51:52,200 - lava_callback - INFO - Received callback for node 69bd7ac30e93e2314723e6fc
INFO: 172.19.0.1:38534 - "POST /node/69bd7ac30e93e2314723e6fc HTTP/1.0" 202 Accepted
2026-03-20 16:51:52,207 - lava_callback - INFO - Starting async job submit for node 69bd7ac30e93e2314723e6fc
2026-03-20 16:51:52,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:51:52,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7ac30e93e2314723e6fc HTTP/1.1" 200 None
2026-03-20 16:51:52,257 - lava_callback - DEBUG - Processing node 69bd7ac30e93e2314723e6fc: baseline-nfs-arm64
2026-03-20 16:51:52,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:51:53,452 - lava_callback - INFO - Received callback for node 69bd7abb0e93e2314723e6e9
INFO: 172.19.0.1:38540 - "POST /node/69bd7abb0e93e2314723e6e9 HTTP/1.0" 202 Accepted
2026-03-20 16:51:53,463 - lava_callback - INFO - Starting async job submit for node 69bd7abb0e93e2314723e6e9
2026-03-20 16:51:53,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:51:53,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7abb0e93e2314723e6e9 HTTP/1.1" 200 None
2026-03-20 16:51:53,518 - lava_callback - DEBUG - Processing node 69bd7abb0e93e2314723e6e9: baseline-nfs-arm64
2026-03-20 16:51:53,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:51:54,181 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:51:54,183 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd7ac30e93e2314723e6fc/log.txt.gz
2026-03-20 16:51:54,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:51:55,482 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:51:55,484 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd7abb0e93e2314723e6e9/log.txt.gz
2026-03-20 16:51:55,626 - lava_callback - INFO - Received callback for node 69bd7abf0e93e2314723e6ef
INFO: 172.19.0.1:38548 - "POST /node/69bd7abf0e93e2314723e6ef HTTP/1.0" 202 Accepted
2026-03-20 16:51:55,647 - lava_callback - INFO - Starting async job submit for node 69bd7abf0e93e2314723e6ef
2026-03-20 16:51:55,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:51:55,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7abf0e93e2314723e6ef HTTP/1.1" 200 None
2026-03-20 16:51:55,834 - lava_callback - DEBUG - Processing node 69bd7abf0e93e2314723e6ef: baseline-nfs-arm64
2026-03-20 16:51:55,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:51:56,115 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:51:56,122 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd7ac30e93e2314723e6fc/lava-logs.yaml
2026-03-20 16:51:56,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
INFO: 172.19.0.1:38550 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:51:56,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
INFO: 172.19.0.1:38562 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:51:57,568 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:51:57,570 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd7abb0e93e2314723e6e9/lava-logs.yaml
2026-03-20 16:51:57,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:51:57,696 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:51:57,698 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd7ac30e93e2314723e6fc/lava_callback.json.gz
2026-03-20 16:51:57,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:51:57,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7ac30e93e2314723e6fc HTTP/1.1" 200 None
2026-03-20 16:51:57,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:51:57,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 16:51:57,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:51:57,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7ac30e93e2314723e6fc HTTP/1.1" 200 None
2026-03-20 16:51:57,831 - lava_callback - INFO - Completed processing callback for node 69bd7ac30e93e2314723e6fc
2026-03-20 16:51:58,325 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:51:58,327 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd7abf0e93e2314723e6ef/log.txt.gz
2026-03-20 16:51:58,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:51:59,362 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:51:59,365 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd7abb0e93e2314723e6e9/lava_callback.json.gz
2026-03-20 16:51:59,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:51:59,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7abb0e93e2314723e6e9 HTTP/1.1" 200 None
2026-03-20 16:51:59,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:51:59,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 16:51:59,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:51:59,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7abb0e93e2314723e6e9 HTTP/1.1" 200 None
2026-03-20 16:51:59,490 - lava_callback - INFO - Completed processing callback for node 69bd7abb0e93e2314723e6e9
2026-03-20 16:51:59,881 - lava_callback - INFO - Received callback for node 69bd7ac00e93e2314723e6f2
INFO: 172.19.0.1:51292 - "POST /node/69bd7ac00e93e2314723e6f2 HTTP/1.0" 202 Accepted
2026-03-20 16:51:59,891 - lava_callback - INFO - Starting async job submit for node 69bd7ac00e93e2314723e6f2
2026-03-20 16:51:59,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:51:59,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7ac00e93e2314723e6f2 HTTP/1.1" 200 None
2026-03-20 16:51:59,952 - lava_callback - DEBUG - Processing node 69bd7ac00e93e2314723e6f2: baseline-nfs-arm64
2026-03-20 16:52:00,660 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:52:00,718 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd7abf0e93e2314723e6ef/lava-logs.yaml
2026-03-20 16:52:00,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:52:00,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:52:02,419 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:52:02,422 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd7abf0e93e2314723e6ef/lava_callback.json.gz
2026-03-20 16:52:02,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:52:02,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7abf0e93e2314723e6ef HTTP/1.1" 200 None
2026-03-20 16:52:02,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:52:02,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 16:52:02,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:52:02,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7abf0e93e2314723e6ef HTTP/1.1" 200 None
2026-03-20 16:52:02,532 - lava_callback - INFO - Completed processing callback for node 69bd7abf0e93e2314723e6ef
2026-03-20 16:52:02,613 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:52:02,616 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd7ac00e93e2314723e6f2/log.txt.gz
2026-03-20 16:52:03,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:52:04,700 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:52:04,702 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd7ac00e93e2314723e6f2/lava-logs.yaml
2026-03-20 16:52:04,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:52:06,150 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:52:06,152 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd7ac00e93e2314723e6f2/lava_callback.json.gz
2026-03-20 16:52:06,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:52:06,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7ac00e93e2314723e6f2 HTTP/1.1" 200 None
2026-03-20 16:52:06,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:52:06,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 16:52:06,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:52:06,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7ac00e93e2314723e6f2 HTTP/1.1" 200 None
2026-03-20 16:52:06,267 - lava_callback - INFO - Completed processing callback for node 69bd7ac00e93e2314723e6f2
INFO: 172.19.0.1:51294 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:52:09,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:52:09,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15
2026-03-20 16:52:12,035 - lava_callback - INFO - Received callback for node 69bd7b060e93e2314723e7b3
INFO: 172.19.0.1:51200 - "POST /node/69bd7b060e93e2314723e7b3 HTTP/1.0" 202 Accepted
2026-03-20 16:52:12,042 - lava_callback - INFO - Starting async job submit for node 69bd7b060e93e2314723e7b3
2026-03-20 16:52:12,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:52:12,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7b060e93e2314723e7b3 HTTP/1.1" 200 None
2026-03-20 16:52:12,094 - lava_callback - DEBUG - Processing node 69bd7b060e93e2314723e7b3: baseline-arm64-pengutronix
2026-03-20 16:52:12,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:52:13,807 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:52:13,809 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69bd7b060e93e2314723e7b3/log.txt.gz
2026-03-20 16:52:13,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
INFO: 172.19.0.1:51212 - "GET /api/metrics HTTP/1.0" 200 OK
2026-03-20 16:52:15,472 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:52:15,474 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69bd7b060e93e2314723e7b3/lava-logs.yaml
2026-03-20 16:52:15,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
INFO: 172.19.0.1:51218 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:52:16,884 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:52:16,886 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69bd7b060e93e2314723e7b3/lava_callback.json.gz
2026-03-20 16:52:16,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:52:16,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7b060e93e2314723e7b3 HTTP/1.1" 200 None
2026-03-20 16:52:16,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:52:16,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 16:52:16,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:52:17,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7b060e93e2314723e7b3 HTTP/1.1" 200 None
2026-03-20 16:52:17,050 - lava_callback - INFO - Completed processing callback for node 69bd7b060e93e2314723e7b3
2026-03-20 16:52:21,634 - lava_callback - INFO - Received callback for node 69bd7b0e0e93e2314723e7c7
INFO: 172.19.0.1:54442 - "POST /node/69bd7b0e0e93e2314723e7c7 HTTP/1.0" 202 Accepted
2026-03-20 16:52:21,643 - lava_callback - INFO - Starting async job submit for node 69bd7b0e0e93e2314723e7c7
2026-03-20 16:52:21,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:52:21,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7b0e0e93e2314723e7c7 HTTP/1.1" 200 None
2026-03-20 16:52:21,709 - lava_callback - DEBUG - Processing node 69bd7b0e0e93e2314723e7c7: baseline-arm64-foundriesio
2026-03-20 16:52:22,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:52:23,538 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:52:23,540 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69bd7b0e0e93e2314723e7c7/log.txt.gz
2026-03-20 16:52:23,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:52:25,142 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:52:25,145 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69bd7b0e0e93e2314723e7c7/lava-logs.yaml
2026-03-20 16:52:25,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
INFO: 172.19.0.1:54452 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:52:26,657 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:52:26,659 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69bd7b0e0e93e2314723e7c7/lava_callback.json.gz
2026-03-20 16:52:26,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:52:26,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7b0e0e93e2314723e7c7 HTTP/1.1" 200 None
2026-03-20 16:52:26,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:52:26,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 16:52:26,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:52:26,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7b0e0e93e2314723e7c7 HTTP/1.1" 200 None
2026-03-20 16:52:26,806 - lava_callback - INFO - Completed processing callback for node 69bd7b0e0e93e2314723e7c7
2026-03-20 16:52:28,550 - lava_callback - INFO - Received callback for node 69bd7ab80e93e2314723e6e3
INFO: 172.19.0.1:54466 - "POST /node/69bd7ab80e93e2314723e6e3 HTTP/1.0" 202 Accepted
2026-03-20 16:52:28,560 - lava_callback - INFO - Starting async job submit for node 69bd7ab80e93e2314723e6e3
2026-03-20 16:52:28,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:52:28,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7ab80e93e2314723e6e3 HTTP/1.1" 200 None
2026-03-20 16:52:28,642 - lava_callback - DEBUG - Processing node 69bd7ab80e93e2314723e6e3: baseline-nfs-arm64
2026-03-20 16:52:29,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:52:29,756 - lava_callback - INFO - Received callback for node 69bd7b090e93e2314723e7b6
INFO: 172.19.0.1:49828 - "POST /node/69bd7b090e93e2314723e7b6 HTTP/1.0" 202 Accepted
2026-03-20 16:52:29,767 - lava_callback - INFO - Starting async job submit for node 69bd7b090e93e2314723e7b6
2026-03-20 16:52:29,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:52:29,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7b090e93e2314723e7b6 HTTP/1.1" 200 None
2026-03-20 16:52:29,832 - lava_callback - DEBUG - Processing node 69bd7b090e93e2314723e7b6: baseline-arm64-pengutronix
2026-03-20 16:52:30,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:52:30,774 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:52:30,776 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd7ab80e93e2314723e6e3/log.txt.gz
2026-03-20 16:52:31,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:52:31,584 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:52:31,586 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69bd7b090e93e2314723e7b6/log.txt.gz
2026-03-20 16:52:31,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:52:32,661 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:52:32,663 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd7ab80e93e2314723e6e3/lava-logs.yaml
2026-03-20 16:52:32,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:52:33,282 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:52:33,284 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69bd7b090e93e2314723e7b6/lava-logs.yaml
2026-03-20 16:52:33,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:52:34,105 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:52:34,107 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd7ab80e93e2314723e6e3/lava_callback.json.gz
2026-03-20 16:52:34,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:52:34,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7ab80e93e2314723e6e3 HTTP/1.1" 200 None
2026-03-20 16:52:34,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:52:34,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 16:52:34,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:52:34,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7ab80e93e2314723e6e3 HTTP/1.1" 200 None
2026-03-20 16:52:34,223 - lava_callback - INFO - Completed processing callback for node 69bd7ab80e93e2314723e6e3
2026-03-20 16:52:34,245 - lava_callback - INFO - Received callback for node 69bd7aad0e93e2314723e6cb
INFO: 172.19.0.1:49830 - "POST /node/69bd7aad0e93e2314723e6cb HTTP/1.0" 202 Accepted
2026-03-20 16:52:34,283 - lava_callback - INFO - Starting async job submit for node 69bd7aad0e93e2314723e6cb
2026-03-20 16:52:34,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:52:34,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7aad0e93e2314723e6cb HTTP/1.1" 200 None
2026-03-20 16:52:34,406 - lava_callback - DEBUG - Processing node 69bd7aad0e93e2314723e6cb: baseline-arm64
2026-03-20 16:52:35,013 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:52:35,050 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69bd7b090e93e2314723e7b6/lava_callback.json.gz
2026-03-20 16:52:35,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:52:35,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7b090e93e2314723e7b6 HTTP/1.1" 200 None
2026-03-20 16:52:35,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:52:35,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:52:35,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 16:52:35,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:52:35,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7b090e93e2314723e7b6 HTTP/1.1" 200 None
2026-03-20 16:52:35,289 - lava_callback - INFO - Completed processing callback for node 69bd7b090e93e2314723e7b6
INFO: 172.19.0.1:49844 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:52:36,771 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:52:36,773 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7aad0e93e2314723e6cb/log.txt.gz
2026-03-20 16:52:37,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:52:37,621 - lava_callback - INFO - Received callback for node 69bd7b300e93e2314723e7f7
INFO: 172.19.0.1:49846 - "POST /node/69bd7b300e93e2314723e7f7 HTTP/1.0" 202 Accepted
2026-03-20 16:52:37,632 - lava_callback - INFO - Starting async job submit for node 69bd7b300e93e2314723e7f7
2026-03-20 16:52:37,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:52:37,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7b300e93e2314723e7f7 HTTP/1.1" 200 None
2026-03-20 16:52:37,663 - lava_callback - DEBUG - Processing node 69bd7b300e93e2314723e7f7: baseline-nfs-arm64
2026-03-20 16:52:37,665 - lava_callback - WARNING - Failed to upload log
2026-03-20 16:52:37,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:52:38,802 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:52:38,805 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7aad0e93e2314723e6cb/lava-logs.yaml
2026-03-20 16:52:38,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:52:39,233 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:52:39,235 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd7b300e93e2314723e7f7/lava-logs.yaml
2026-03-20 16:52:39,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:52:39,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:52:39,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15
2026-03-20 16:52:40,442 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:52:40,444 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7aad0e93e2314723e6cb/lava_callback.json.gz
2026-03-20 16:52:40,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:52:40,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7aad0e93e2314723e6cb HTTP/1.1" 200 None
2026-03-20 16:52:40,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:52:40,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 16:52:40,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:52:40,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7aad0e93e2314723e6cb HTTP/1.1" 200 None
2026-03-20 16:52:40,684 - lava_callback - INFO - Completed processing callback for node 69bd7aad0e93e2314723e6cb
2026-03-20 16:52:40,856 - lava_callback - INFO - Received callback for node 69bd7b0c0e93e2314723e7bd
INFO: 172.19.0.1:46298 - "POST /node/69bd7b0c0e93e2314723e7bd HTTP/1.0" 202 Accepted
2026-03-20 16:52:40,878 - lava_callback - INFO - Starting async job submit for node 69bd7b0c0e93e2314723e7bd
2026-03-20 16:52:40,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:52:40,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7b0c0e93e2314723e7bd HTTP/1.1" 200 None
2026-03-20 16:52:40,982 - lava_callback - DEBUG - Processing node 69bd7b0c0e93e2314723e7bd: baseline-arm64-pengutronix
2026-03-20 16:52:41,113 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:52:41,120 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd7b300e93e2314723e7f7/lava_callback.json.gz
2026-03-20 16:52:41,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:52:41,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7b300e93e2314723e7f7 HTTP/1.1" 200 None
2026-03-20 16:52:41,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:52:41,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 16:52:41,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:52:41,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:52:41,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7b300e93e2314723e7f7 HTTP/1.1" 200 None
2026-03-20 16:52:41,398 - lava_callback - INFO - Completed processing callback for node 69bd7b300e93e2314723e7f7
2026-03-20 16:52:42,262 - lava_callback - INFO - Received callback for node 69bd7aa30e93e2314723e6aa
INFO: 172.19.0.1:46308 - "POST /node/69bd7aa30e93e2314723e6aa HTTP/1.0" 202 Accepted
2026-03-20 16:52:42,271 - lava_callback - INFO - Starting async job submit for node 69bd7aa30e93e2314723e6aa
2026-03-20 16:52:42,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:52:42,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7aa30e93e2314723e6aa HTTP/1.1" 200 None
2026-03-20 16:52:42,321 - lava_callback - DEBUG - Processing node 69bd7aa30e93e2314723e6aa: baseline-arm64
2026-03-20 16:52:42,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:52:42,976 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:52:42,978 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69bd7b0c0e93e2314723e7bd/log.txt.gz
2026-03-20 16:52:43,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:52:44,180 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:52:44,182 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7aa30e93e2314723e6aa/log.txt.gz
2026-03-20 16:52:44,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:52:44,713 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:52:44,715 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69bd7b0c0e93e2314723e7bd/lava-logs.yaml
2026-03-20 16:52:44,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:52:45,903 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:52:45,905 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7aa30e93e2314723e6aa/lava-logs.yaml
2026-03-20 16:52:45,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:52:46,158 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:52:46,160 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69bd7b0c0e93e2314723e7bd/lava_callback.json.gz
2026-03-20 16:52:46,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:52:46,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7b0c0e93e2314723e7bd HTTP/1.1" 200 None
2026-03-20 16:52:46,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:52:46,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 16:52:46,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:52:46,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7b0c0e93e2314723e7bd HTTP/1.1" 200 None
2026-03-20 16:52:46,287 - lava_callback - INFO - Completed processing callback for node 69bd7b0c0e93e2314723e7bd
INFO: 172.19.0.1:46314 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:52:47,471 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:52:47,473 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7aa30e93e2314723e6aa/lava_callback.json.gz
2026-03-20 16:52:47,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:52:47,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7aa30e93e2314723e6aa HTTP/1.1" 200 None
2026-03-20 16:52:47,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:52:47,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 16:52:47,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:52:47,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7aa30e93e2314723e6aa HTTP/1.1" 200 None
2026-03-20 16:52:47,706 - lava_callback - INFO - Completed processing callback for node 69bd7aa30e93e2314723e6aa
INFO: 172.19.0.1:58420 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58424 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48012 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:53:09,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:53:09,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15
INFO: 172.19.0.1:52088 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:52094 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36368 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57786 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43356 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:53:54,053 - lava_callback - INFO - Received callback for node 69bd693e05e4bbd6ba6373a1
INFO: 172.19.0.1:59228 - "POST /node/69bd693e05e4bbd6ba6373a1 HTTP/1.0" 202 Accepted
2026-03-20 16:53:54,060 - lava_callback - INFO - Starting async job submit for node 69bd693e05e4bbd6ba6373a1
2026-03-20 16:53:54,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:53:54,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd693e05e4bbd6ba6373a1 HTTP/1.1" 200 None
2026-03-20 16:53:54,102 - lava_callback - DEBUG - Processing node 69bd693e05e4bbd6ba6373a1: baseline-x86
2026-03-20 16:53:54,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:53:56,498 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:53:56,500 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69bd693e05e4bbd6ba6373a1/log.txt.gz
INFO: 172.19.0.1:59230 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59238 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:53:56,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:53:58,767 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:53:58,769 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69bd693e05e4bbd6ba6373a1/lava-logs.yaml
2026-03-20 16:53:58,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:54:00,626 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:54:00,628 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69bd693e05e4bbd6ba6373a1/lava_callback.json.gz
2026-03-20 16:54:00,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:54:00,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd693e05e4bbd6ba6373a1 HTTP/1.1" 200 None
2026-03-20 16:54:00,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:54:00,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f95537ae4d3c8236e6f HTTP/1.1" 200 None
2026-03-20 16:54:00,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:54:00,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd693e05e4bbd6ba6373a1 HTTP/1.1" 200 None
2026-03-20 16:54:00,765 - lava_callback - INFO - Completed processing callback for node 69bd693e05e4bbd6ba6373a1
INFO: 172.19.0.1:47662 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:54:09,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:54:09,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:36276 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:36292 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35020 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39980 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:54:39,551 - lava_callback - INFO - Received callback for node 69bd7b110e93e2314723e7cb
INFO: 172.19.0.1:39996 - "POST /node/69bd7b110e93e2314723e7cb HTTP/1.0" 202 Accepted
2026-03-20 16:54:39,565 - lava_callback - INFO - Starting async job submit for node 69bd7b110e93e2314723e7cb
2026-03-20 16:54:39,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:54:39,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7b110e93e2314723e7cb HTTP/1.1" 200 None
2026-03-20 16:54:39,658 - lava_callback - DEBUG - Processing node 69bd7b110e93e2314723e7cb: baseline-arm64-foundriesio
2026-03-20 16:54:40,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:54:42,290 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:54:42,292 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69bd7b110e93e2314723e7cb/log.txt.gz
2026-03-20 16:54:42,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:54:44,429 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:54:44,432 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69bd7b110e93e2314723e7cb/lava-logs.yaml
2026-03-20 16:54:44,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:54:45,811 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:54:45,814 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69bd7b110e93e2314723e7cb/lava_callback.json.gz
DEBUG: 69bd7b110e93e2314723e7cb Transitting job node result: pass -> incomplete
2026-03-20 16:54:45,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:54:45,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7b110e93e2314723e7cb HTTP/1.1" 200 None
2026-03-20 16:54:45,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:54:45,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 16:54:45,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:54:45,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7b110e93e2314723e7cb HTTP/1.1" 200 None
2026-03-20 16:54:45,987 - lava_callback - INFO - Completed processing callback for node 69bd7b110e93e2314723e7cb
INFO: 172.19.0.1:46426 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42032 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42048 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48854 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:55:09,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:55:10,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:41360 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:41372 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38748 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46150 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55824 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:55:55,668 - lava_callback - INFO - Received callback for node 69bd7bd00e93e2314723e86a
INFO: 172.19.0.1:49448 - "POST /node/69bd7bd00e93e2314723e86a HTTP/1.0" 202 Accepted
2026-03-20 16:55:55,677 - lava_callback - INFO - Starting async job submit for node 69bd7bd00e93e2314723e86a
2026-03-20 16:55:55,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:55:55,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7bd00e93e2314723e86a HTTP/1.1" 200 None
2026-03-20 16:55:55,752 - lava_callback - DEBUG - Processing node 69bd7bd00e93e2314723e86a: baseline-arm64
2026-03-20 16:55:55,986 - lava_callback - WARNING - Failed to upload log
2026-03-20 16:55:56,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
INFO: 172.19.0.1:49454 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49456 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:55:57,083 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:55:57,085 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7bd00e93e2314723e86a/lava-logs.yaml
2026-03-20 16:55:57,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:55:58,035 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:55:58,037 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7bd00e93e2314723e86a/lava_callback.json.gz
2026-03-20 16:55:58,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:55:58,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7bd00e93e2314723e86a HTTP/1.1" 200 None
2026-03-20 16:55:58,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:55:58,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 16:55:58,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:55:58,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7bd00e93e2314723e86a HTTP/1.1" 200 None
2026-03-20 16:55:58,336 - lava_callback - INFO - Completed processing callback for node 69bd7bd00e93e2314723e86a
INFO: 172.19.0.1:54244 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:56:10,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:56:10,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:56634 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:56640 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49076 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60146 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46924 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52422 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52432 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40996 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37518 - "GET /api/metrics HTTP/1.0" 200 OK
2026-03-20 16:57:15,606 - lava_callback - INFO - Received callback for node 69bd7c260e93e2314723e886
INFO: 172.19.0.1:37530 - "POST /node/69bd7c260e93e2314723e886 HTTP/1.0" 202 Accepted
2026-03-20 16:57:15,613 - lava_callback - INFO - Starting async job submit for node 69bd7c260e93e2314723e886
2026-03-20 16:57:15,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:57:15,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7c260e93e2314723e886 HTTP/1.1" 200 None
2026-03-20 16:57:15,657 - lava_callback - DEBUG - Processing node 69bd7c260e93e2314723e886: baseline-arm64
2026-03-20 16:57:15,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:57:15,947 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:57:15,949 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7c260e93e2314723e886/log.txt.gz
2026-03-20 16:57:16,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:57:16,171 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:57:16,173 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7c260e93e2314723e886/lava-logs.yaml
2026-03-20 16:57:16,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:57:16,284 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:57:16,286 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7c260e93e2314723e886/lava_callback.json.gz
2026-03-20 16:57:16,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:57:16,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7c260e93e2314723e886 HTTP/1.1" 200 None
2026-03-20 16:57:16,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:57:16,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 16:57:16,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:57:16,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7c260e93e2314723e886 HTTP/1.1" 200 None
2026-03-20 16:57:16,452 - lava_callback - INFO - Completed processing callback for node 69bd7c260e93e2314723e886
INFO: 172.19.0.1:37546 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:57:17,920 - lava_callback - INFO - Received callback for node 69bd7c610e93e2314723e8a7
INFO: 172.19.0.1:37548 - "POST /node/69bd7c610e93e2314723e8a7 HTTP/1.0" 202 Accepted
2026-03-20 16:57:17,934 - lava_callback - INFO - Starting async job submit for node 69bd7c610e93e2314723e8a7
2026-03-20 16:57:17,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:57:17,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7c610e93e2314723e8a7 HTTP/1.1" 200 None
2026-03-20 16:57:17,969 - lava_callback - DEBUG - Processing node 69bd7c610e93e2314723e8a7: baseline-arm
2026-03-20 16:57:17,977 - lava_callback - WARNING - Failed to upload log
2026-03-20 16:57:17,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:57:18,128 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:57:18,130 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69bd7c610e93e2314723e8a7/lava-logs.yaml
2026-03-20 16:57:18,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:57:18,243 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:57:18,244 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69bd7c610e93e2314723e8a7/lava_callback.json.gz
2026-03-20 16:57:18,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:57:18,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7c610e93e2314723e8a7 HTTP/1.1" 200 None
2026-03-20 16:57:18,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:57:18,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd732d0e93e2314723e2b5 HTTP/1.1" 200 None
2026-03-20 16:57:18,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:57:18,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7c610e93e2314723e8a7 HTTP/1.1" 200 None
2026-03-20 16:57:18,321 - lava_callback - INFO - Completed processing callback for node 69bd7c610e93e2314723e8a7
INFO: 172.19.0.1:38950 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58984 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:57:40,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:57:40,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:42740 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57108 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57110 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:57:57,729 - lava_callback - INFO - Received callback for node 69bd7c610e93e2314723e8aa
INFO: 172.19.0.1:57126 - "POST /node/69bd7c610e93e2314723e8aa HTTP/1.0" 202 Accepted
2026-03-20 16:57:57,781 - lava_callback - INFO - Starting async job submit for node 69bd7c610e93e2314723e8aa
2026-03-20 16:57:57,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:57:57,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7c610e93e2314723e8aa HTTP/1.1" 200 None
2026-03-20 16:57:57,822 - lava_callback - DEBUG - Processing node 69bd7c610e93e2314723e8aa: baseline-arm
2026-03-20 16:57:57,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:57:58,473 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:57:58,475 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69bd7c610e93e2314723e8aa/log.txt.gz
2026-03-20 16:57:58,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:57:58,813 - lava_callback - INFO - Received callback for node 69bd7c640e93e2314723e8b3
INFO: 172.19.0.1:57132 - "POST /node/69bd7c640e93e2314723e8b3 HTTP/1.0" 202 Accepted
2026-03-20 16:57:58,864 - lava_callback - INFO - Starting async job submit for node 69bd7c640e93e2314723e8b3
2026-03-20 16:57:58,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:57:58,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7c640e93e2314723e8b3 HTTP/1.1" 200 None
2026-03-20 16:57:58,916 - lava_callback - DEBUG - Processing node 69bd7c640e93e2314723e8b3: baseline-arm
2026-03-20 16:57:59,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:57:59,134 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:57:59,136 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69bd7c610e93e2314723e8aa/lava-logs.yaml
2026-03-20 16:57:59,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:57:59,690 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:57:59,692 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69bd7c640e93e2314723e8b3/log.txt.gz
2026-03-20 16:57:59,728 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:57:59,771 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69bd7c610e93e2314723e8aa/lava_callback.json.gz
2026-03-20 16:57:59,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:57:59,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:57:59,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7c610e93e2314723e8aa HTTP/1.1" 200 None
2026-03-20 16:57:59,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:57:59,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd732d0e93e2314723e2b5 HTTP/1.1" 200 None
2026-03-20 16:57:59,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:57:59,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7c610e93e2314723e8aa HTTP/1.1" 200 None
2026-03-20 16:57:59,956 - lava_callback - INFO - Completed processing callback for node 69bd7c610e93e2314723e8aa
2026-03-20 16:58:00,419 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:58:00,421 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69bd7c640e93e2314723e8b3/lava-logs.yaml
2026-03-20 16:58:00,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:58:00,959 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:58:00,961 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69bd7c640e93e2314723e8b3/lava_callback.json.gz
2026-03-20 16:58:00,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:58:01,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7c640e93e2314723e8b3 HTTP/1.1" 200 None
2026-03-20 16:58:01,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:58:01,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd732d0e93e2314723e2b5 HTTP/1.1" 200 None
2026-03-20 16:58:01,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:58:01,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7c640e93e2314723e8b3 HTTP/1.1" 200 None
2026-03-20 16:58:01,090 - lava_callback - INFO - Completed processing callback for node 69bd7c640e93e2314723e8b3
INFO: 172.19.0.1:33690 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:58:10,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:58:10,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
2026-03-20 16:58:12,769 - lava_callback - INFO - Received callback for node 69bd7aa70e93e2314723e6b3
INFO: 172.19.0.1:42472 - "POST /node/69bd7aa70e93e2314723e6b3 HTTP/1.0" 202 Accepted
2026-03-20 16:58:12,779 - lava_callback - INFO - Starting async job submit for node 69bd7aa70e93e2314723e6b3
2026-03-20 16:58:12,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:58:12,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7aa70e93e2314723e6b3 HTTP/1.1" 200 None
2026-03-20 16:58:12,828 - lava_callback - DEBUG - Processing node 69bd7aa70e93e2314723e6b3: baseline-arm64
2026-03-20 16:58:13,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:58:13,959 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:58:13,961 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7aa70e93e2314723e6b3/log.txt.gz
2026-03-20 16:58:14,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:58:15,015 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:58:15,017 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7aa70e93e2314723e6b3/lava-logs.yaml
2026-03-20 16:58:15,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
INFO: 172.19.0.1:42474 - "GET /api/metrics HTTP/1.0" 200 OK
2026-03-20 16:58:15,535 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:58:15,537 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7aa70e93e2314723e6b3/lava_callback.json.gz
2026-03-20 16:58:15,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:58:15,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7aa70e93e2314723e6b3 HTTP/1.1" 200 None
2026-03-20 16:58:15,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:58:15,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 16:58:15,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:58:15,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7aa70e93e2314723e6b3 HTTP/1.1" 200 None
2026-03-20 16:58:15,650 - lava_callback - INFO - Completed processing callback for node 69bd7aa70e93e2314723e6b3
INFO: 172.19.0.1:42478 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44656 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:58:27,158 - lava_callback - INFO - Received callback for node 69bd7c630e93e2314723e8b0
INFO: 172.19.0.1:44668 - "POST /node/69bd7c630e93e2314723e8b0 HTTP/1.0" 202 Accepted
2026-03-20 16:58:27,168 - lava_callback - INFO - Starting async job submit for node 69bd7c630e93e2314723e8b0
2026-03-20 16:58:27,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:58:27,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7c630e93e2314723e8b0 HTTP/1.1" 200 None
2026-03-20 16:58:27,240 - lava_callback - DEBUG - Processing node 69bd7c630e93e2314723e8b0: baseline-arm
2026-03-20 16:58:27,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:58:27,917 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:58:27,919 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69bd7c630e93e2314723e8b0/log.txt.gz
2026-03-20 16:58:28,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:58:28,640 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:58:28,642 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69bd7c630e93e2314723e8b0/lava-logs.yaml
2026-03-20 16:58:28,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:58:29,126 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:58:29,128 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69bd7c630e93e2314723e8b0/lava_callback.json.gz
2026-03-20 16:58:29,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:58:29,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7c630e93e2314723e8b0 HTTP/1.1" 200 None
2026-03-20 16:58:29,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:58:29,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd732d0e93e2314723e2b5 HTTP/1.1" 200 None
2026-03-20 16:58:29,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:58:29,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7c630e93e2314723e8b0 HTTP/1.1" 200 None
2026-03-20 16:58:29,279 - lava_callback - INFO - Completed processing callback for node 69bd7c630e93e2314723e8b0
2026-03-20 16:58:32,591 - lava_callback - INFO - Received callback for node 69bd7c840e93e2314723e910
INFO: 172.19.0.1:50548 - "POST /node/69bd7c840e93e2314723e910 HTTP/1.0" 202 Accepted
2026-03-20 16:58:32,600 - lava_callback - INFO - Starting async job submit for node 69bd7c840e93e2314723e910
2026-03-20 16:58:32,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:58:32,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7c840e93e2314723e910 HTTP/1.1" 200 None
2026-03-20 16:58:32,656 - lava_callback - DEBUG - Processing node 69bd7c840e93e2314723e910: baseline-arm-pengutronix
2026-03-20 16:58:32,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:58:33,195 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:58:33,197 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69bd7c840e93e2314723e910/log.txt.gz
2026-03-20 16:58:33,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:58:33,747 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:58:33,749 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69bd7c840e93e2314723e910/lava-logs.yaml
2026-03-20 16:58:33,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:58:34,202 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:58:34,204 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69bd7c840e93e2314723e910/lava_callback.json.gz
2026-03-20 16:58:34,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:58:34,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7c840e93e2314723e910 HTTP/1.1" 200 None
2026-03-20 16:58:34,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:58:34,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd732d0e93e2314723e2b5 HTTP/1.1" 200 None
2026-03-20 16:58:34,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:58:34,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7c840e93e2314723e910 HTTP/1.1" 200 None
2026-03-20 16:58:34,346 - lava_callback - INFO - Completed processing callback for node 69bd7c840e93e2314723e910
2026-03-20 16:58:36,004 - lava_callback - INFO - Received callback for node 69bd7c600e93e2314723e8a4
INFO: 172.19.0.1:50554 - "POST /node/69bd7c600e93e2314723e8a4 HTTP/1.0" 202 Accepted
2026-03-20 16:58:36,013 - lava_callback - INFO - Starting async job submit for node 69bd7c600e93e2314723e8a4
2026-03-20 16:58:36,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:58:36,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7c600e93e2314723e8a4 HTTP/1.1" 200 None
2026-03-20 16:58:36,123 - lava_callback - DEBUG - Processing node 69bd7c600e93e2314723e8a4: baseline-arm
2026-03-20 16:58:36,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
INFO: 172.19.0.1:50570 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:58:36,765 - lava_callback - INFO - Received callback for node 69bd7c7b0e93e2314723e8f9
INFO: 172.19.0.1:50572 - "POST /node/69bd7c7b0e93e2314723e8f9 HTTP/1.0" 202 Accepted
2026-03-20 16:58:36,778 - lava_callback - INFO - Starting async job submit for node 69bd7c7b0e93e2314723e8f9
2026-03-20 16:58:36,778 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:58:36,794 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69bd7c600e93e2314723e8a4/log.txt.gz
2026-03-20 16:58:36,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:58:36,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7c7b0e93e2314723e8f9 HTTP/1.1" 200 None
2026-03-20 16:58:36,922 - lava_callback - DEBUG - Processing node 69bd7c7b0e93e2314723e8f9: baseline-arm64
2026-03-20 16:58:37,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:58:37,821 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:58:37,824 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69bd7c600e93e2314723e8a4/lava-logs.yaml
2026-03-20 16:58:37,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:58:37,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:58:38,288 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:58:38,290 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7c7b0e93e2314723e8f9/log.txt.gz
2026-03-20 16:58:38,348 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:58:38,355 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69bd7c600e93e2314723e8a4/lava_callback.json.gz
2026-03-20 16:58:38,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:58:38,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7c600e93e2314723e8a4 HTTP/1.1" 200 None
2026-03-20 16:58:38,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:58:38,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd732d0e93e2314723e2b5 HTTP/1.1" 200 None
2026-03-20 16:58:38,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:58:38,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7c600e93e2314723e8a4 HTTP/1.1" 200 None
2026-03-20 16:58:38,685 - lava_callback - INFO - Completed processing callback for node 69bd7c600e93e2314723e8a4
2026-03-20 16:58:38,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:58:39,723 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:58:39,725 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7c7b0e93e2314723e8f9/lava-logs.yaml
2026-03-20 16:58:39,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:58:40,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:58:40,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15
2026-03-20 16:58:40,235 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:58:40,237 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7c7b0e93e2314723e8f9/lava_callback.json.gz
2026-03-20 16:58:40,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:58:40,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7c7b0e93e2314723e8f9 HTTP/1.1" 200 None
2026-03-20 16:58:40,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:58:40,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 16:58:40,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:58:40,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7c7b0e93e2314723e8f9 HTTP/1.1" 200 None
2026-03-20 16:58:40,393 - lava_callback - INFO - Completed processing callback for node 69bd7c7b0e93e2314723e8f9
2026-03-20 16:58:43,260 - lava_callback - INFO - Received callback for node 69bd7ab90e93e2314723e6e6
INFO: 172.19.0.1:40242 - "POST /node/69bd7ab90e93e2314723e6e6 HTTP/1.0" 202 Accepted
2026-03-20 16:58:43,273 - lava_callback - INFO - Starting async job submit for node 69bd7ab90e93e2314723e6e6
2026-03-20 16:58:43,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:58:43,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7ab90e93e2314723e6e6 HTTP/1.1" 200 None
2026-03-20 16:58:43,336 - lava_callback - DEBUG - Processing node 69bd7ab90e93e2314723e6e6: baseline-nfs-arm64
2026-03-20 16:58:44,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:58:44,469 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:58:44,471 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd7ab90e93e2314723e6e6/log.txt.gz
2026-03-20 16:58:44,716 - lava_callback - INFO - Received callback for node 69bd7c890e93e2314723e938
INFO: 172.19.0.1:40250 - "POST /node/69bd7c890e93e2314723e938 HTTP/1.0" 202 Accepted
2026-03-20 16:58:44,775 - lava_callback - INFO - Starting async job submit for node 69bd7c890e93e2314723e938
2026-03-20 16:58:44,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:58:44,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7c890e93e2314723e938 HTTP/1.1" 200 None
2026-03-20 16:58:44,922 - lava_callback - DEBUG - Processing node 69bd7c890e93e2314723e938: baseline-arm-pengutronix
2026-03-20 16:58:45,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:58:45,070 - lava_callback - INFO - Received callback for node 69bd7ac70e93e2314723e718
INFO: 172.19.0.1:40256 - "POST /node/69bd7ac70e93e2314723e718 HTTP/1.0" 202 Accepted
2026-03-20 16:58:45,093 - lava_callback - INFO - Starting async job submit for node 69bd7ac70e93e2314723e718
2026-03-20 16:58:45,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:58:45,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7ac70e93e2314723e718 HTTP/1.1" 200 None
2026-03-20 16:58:45,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:58:45,260 - lava_callback - DEBUG - Processing node 69bd7ac70e93e2314723e718: baseline-nfs-arm64
2026-03-20 16:58:45,602 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:58:45,604 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69bd7c890e93e2314723e938/log.txt.gz
2026-03-20 16:58:45,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:58:45,902 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:58:45,904 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd7ab90e93e2314723e6e6/lava-logs.yaml
2026-03-20 16:58:45,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:58:46,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:58:46,315 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:58:46,317 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69bd7c890e93e2314723e938/lava-logs.yaml
2026-03-20 16:58:46,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
INFO: 172.19.0.1:40262 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:58:46,510 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:58:46,513 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd7ac70e93e2314723e718/log.txt.gz
2026-03-20 16:58:46,574 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:58:46,576 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd7ab90e93e2314723e6e6/lava_callback.json.gz
2026-03-20 16:58:46,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:58:46,666 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:58:46,669 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69bd7c890e93e2314723e938/lava_callback.json.gz
2026-03-20 16:58:46,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7ab90e93e2314723e6e6 HTTP/1.1" 200 None
2026-03-20 16:58:46,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:58:46,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:58:46,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 16:58:46,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:58:46,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7c890e93e2314723e938 HTTP/1.1" 200 None
2026-03-20 16:58:46,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:58:46,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7ab90e93e2314723e6e6 HTTP/1.1" 200 None
2026-03-20 16:58:46,845 - lava_callback - INFO - Completed processing callback for node 69bd7ab90e93e2314723e6e6
2026-03-20 16:58:46,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd732d0e93e2314723e2b5 HTTP/1.1" 200 None
2026-03-20 16:58:46,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:58:47,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7c890e93e2314723e938 HTTP/1.1" 200 None
2026-03-20 16:58:47,015 - lava_callback - INFO - Completed processing callback for node 69bd7c890e93e2314723e938
2026-03-20 16:58:47,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:58:47,783 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:58:47,786 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd7ac70e93e2314723e718/lava-logs.yaml
2026-03-20 16:58:47,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:58:48,213 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:58:48,215 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd7ac70e93e2314723e718/lava_callback.json.gz
2026-03-20 16:58:48,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:58:48,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7ac70e93e2314723e718 HTTP/1.1" 200 None
2026-03-20 16:58:48,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:58:48,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 16:58:48,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:58:48,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7ac70e93e2314723e718 HTTP/1.1" 200 None
2026-03-20 16:58:48,385 - lava_callback - INFO - Completed processing callback for node 69bd7ac70e93e2314723e718
2026-03-20 16:58:49,942 - lava_callback - INFO - Received callback for node 69bd7c860e93e2314723e913
INFO: 172.19.0.1:50246 - "POST /node/69bd7c860e93e2314723e913 HTTP/1.0" 202 Accepted
2026-03-20 16:58:49,952 - lava_callback - INFO - Starting async job submit for node 69bd7c860e93e2314723e913
2026-03-20 16:58:49,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:58:50,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7c860e93e2314723e913 HTTP/1.1" 200 None
2026-03-20 16:58:50,025 - lava_callback - DEBUG - Processing node 69bd7c860e93e2314723e913: baseline-arm-pengutronix
2026-03-20 16:58:50,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:58:50,805 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:58:50,807 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69bd7c860e93e2314723e913/log.txt.gz
2026-03-20 16:58:50,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:58:51,628 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:58:51,631 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69bd7c860e93e2314723e913/lava-logs.yaml
2026-03-20 16:58:51,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:58:52,048 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:58:52,050 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69bd7c860e93e2314723e913/lava_callback.json.gz
2026-03-20 16:58:52,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:58:52,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7c860e93e2314723e913 HTTP/1.1" 200 None
2026-03-20 16:58:52,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:58:52,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd732d0e93e2314723e2b5 HTTP/1.1" 200 None
2026-03-20 16:58:52,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:58:52,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7c860e93e2314723e913 HTTP/1.1" 200 None
2026-03-20 16:58:52,200 - lava_callback - INFO - Completed processing callback for node 69bd7c860e93e2314723e913
INFO: 172.19.0.1:50250 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50252 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:59:01,122 - lava_callback - INFO - Received callback for node 69bd7c6f0e93e2314723e8db
INFO: 172.19.0.1:52070 - "POST /node/69bd7c6f0e93e2314723e8db HTTP/1.0" 202 Accepted
2026-03-20 16:59:01,128 - lava_callback - INFO - Starting async job submit for node 69bd7c6f0e93e2314723e8db
2026-03-20 16:59:01,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:59:01,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7c6f0e93e2314723e8db HTTP/1.1" 200 None
2026-03-20 16:59:01,165 - lava_callback - DEBUG - Processing node 69bd7c6f0e93e2314723e8db: baseline-arm-broonie
2026-03-20 16:59:01,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:59:01,577 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:59:01,579 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69bd7c6f0e93e2314723e8db/log.txt.gz
2026-03-20 16:59:01,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:59:01,878 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:59:01,880 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69bd7c6f0e93e2314723e8db/lava-logs.yaml
2026-03-20 16:59:01,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:59:02,018 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:59:02,020 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69bd7c6f0e93e2314723e8db/lava_callback.json.gz
2026-03-20 16:59:02,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:59:02,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7c6f0e93e2314723e8db HTTP/1.1" 200 None
2026-03-20 16:59:02,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:59:02,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd732d0e93e2314723e2b5 HTTP/1.1" 200 None
2026-03-20 16:59:02,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:59:02,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7c6f0e93e2314723e8db HTTP/1.1" 200 None
2026-03-20 16:59:02,108 - lava_callback - INFO - Completed processing callback for node 69bd7c6f0e93e2314723e8db
2026-03-20 16:59:05,972 - lava_callback - INFO - Received callback for node 69bd7c6c0e93e2314723e8d2
INFO: 172.19.0.1:52072 - "POST /node/69bd7c6c0e93e2314723e8d2 HTTP/1.0" 202 Accepted
2026-03-20 16:59:05,979 - lava_callback - INFO - Starting async job submit for node 69bd7c6c0e93e2314723e8d2
2026-03-20 16:59:06,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:59:06,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7c6c0e93e2314723e8d2 HTTP/1.1" 200 None
2026-03-20 16:59:06,030 - lava_callback - DEBUG - Processing node 69bd7c6c0e93e2314723e8d2: baseline-arm-broonie
2026-03-20 16:59:06,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:59:06,360 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:59:06,362 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69bd7c6c0e93e2314723e8d2/log.txt.gz
2026-03-20 16:59:06,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
INFO: 172.19.0.1:52076 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:59:06,655 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:59:06,657 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69bd7c6c0e93e2314723e8d2/lava-logs.yaml
2026-03-20 16:59:06,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:59:06,814 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:59:06,815 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69bd7c6c0e93e2314723e8d2/lava_callback.json.gz
2026-03-20 16:59:06,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:59:06,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7c6c0e93e2314723e8d2 HTTP/1.1" 200 None
2026-03-20 16:59:06,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:59:06,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd732d0e93e2314723e2b5 HTTP/1.1" 200 None
2026-03-20 16:59:06,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:59:06,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7c6c0e93e2314723e8d2 HTTP/1.1" 200 None
2026-03-20 16:59:06,906 - lava_callback - INFO - Completed processing callback for node 69bd7c6c0e93e2314723e8d2
2026-03-20 16:59:07,427 - lava_callback - INFO - Received callback for node 69bd7c6d0e93e2314723e8d6
INFO: 172.19.0.1:52084 - "POST /node/69bd7c6d0e93e2314723e8d6 HTTP/1.0" 202 Accepted
2026-03-20 16:59:07,434 - lava_callback - INFO - Starting async job submit for node 69bd7c6d0e93e2314723e8d6
2026-03-20 16:59:07,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:59:07,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7c6d0e93e2314723e8d6 HTTP/1.1" 200 None
2026-03-20 16:59:07,475 - lava_callback - DEBUG - Processing node 69bd7c6d0e93e2314723e8d6: baseline-arm-broonie
2026-03-20 16:59:07,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:59:07,819 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:59:07,821 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69bd7c6d0e93e2314723e8d6/log.txt.gz
2026-03-20 16:59:07,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:59:08,133 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:59:08,135 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69bd7c6d0e93e2314723e8d6/lava-logs.yaml
2026-03-20 16:59:08,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:59:08,268 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:59:08,270 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69bd7c6d0e93e2314723e8d6/lava_callback.json.gz
2026-03-20 16:59:08,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:59:08,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7c6d0e93e2314723e8d6 HTTP/1.1" 200 None
2026-03-20 16:59:08,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:59:08,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd732d0e93e2314723e2b5 HTTP/1.1" 200 None
2026-03-20 16:59:08,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:59:08,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7c6d0e93e2314723e8d6 HTTP/1.1" 200 None
2026-03-20 16:59:08,352 - lava_callback - INFO - Completed processing callback for node 69bd7c6d0e93e2314723e8d6
2026-03-20 16:59:10,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:59:10,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15
2026-03-20 16:59:11,923 - lava_callback - INFO - Received callback for node 69bd7cd30e93e2314723e9b0
INFO: 172.19.0.1:51832 - "POST /node/69bd7cd30e93e2314723e9b0 HTTP/1.0" 202 Accepted
2026-03-20 16:59:11,929 - lava_callback - INFO - Starting async job submit for node 69bd7cd30e93e2314723e9b0
2026-03-20 16:59:11,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:59:11,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7cd30e93e2314723e9b0 HTTP/1.1" 200 None
2026-03-20 16:59:11,946 - lava_callback - DEBUG - Processing node 69bd7cd30e93e2314723e9b0: baseline-nfs-arm64
2026-03-20 16:59:11,947 - lava_callback - WARNING - Failed to upload log
2026-03-20 16:59:11,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:59:12,087 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:59:12,088 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd7cd30e93e2314723e9b0/lava-logs.yaml
2026-03-20 16:59:12,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:59:12,192 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:59:12,193 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd7cd30e93e2314723e9b0/lava_callback.json.gz
2026-03-20 16:59:12,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:59:12,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7cd30e93e2314723e9b0 HTTP/1.1" 200 None
2026-03-20 16:59:12,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:59:12,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 16:59:12,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:59:12,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7cd30e93e2314723e9b0 HTTP/1.1" 200 None
2026-03-20 16:59:12,272 - lava_callback - INFO - Completed processing callback for node 69bd7cd30e93e2314723e9b0
INFO: 172.19.0.1:51840 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:51846 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36572 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:32774 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:59:40,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:59:40,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
2026-03-20 16:59:43,019 - lava_callback - INFO - Received callback for node 69bd7afd0e93e2314723e798
INFO: 172.19.0.1:54022 - "POST /node/69bd7afd0e93e2314723e798 HTTP/1.0" 202 Accepted
2026-03-20 16:59:43,030 - lava_callback - INFO - Starting async job submit for node 69bd7afd0e93e2314723e798
2026-03-20 16:59:43,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:59:43,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7afd0e93e2314723e798 HTTP/1.1" 200 None
2026-03-20 16:59:43,135 - lava_callback - DEBUG - Processing node 69bd7afd0e93e2314723e798: baseline-arm64-clabbe
2026-03-20 16:59:43,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:59:44,244 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:59:44,246 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69bd7afd0e93e2314723e798/log.txt.gz
2026-03-20 16:59:44,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:59:45,176 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:59:45,178 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69bd7afd0e93e2314723e798/lava-logs.yaml
2026-03-20 16:59:45,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:59:45,626 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:59:45,628 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69bd7afd0e93e2314723e798/lava_callback.json.gz
2026-03-20 16:59:45,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:59:45,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7afd0e93e2314723e798 HTTP/1.1" 200 None
2026-03-20 16:59:45,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:59:45,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 16:59:45,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:59:45,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7afd0e93e2314723e798 HTTP/1.1" 200 None
2026-03-20 16:59:45,806 - lava_callback - INFO - Completed processing callback for node 69bd7afd0e93e2314723e798
INFO: 172.19.0.1:54030 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46798 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46806 - "GET / HTTP/1.0" 200 OK
2026-03-20 16:59:58,465 - lava_callback - INFO - Received callback for node 69bd7ca00e93e2314723e947
INFO: 172.19.0.1:46820 - "POST /node/69bd7ca00e93e2314723e947 HTTP/1.0" 202 Accepted
2026-03-20 16:59:58,476 - lava_callback - INFO - Starting async job submit for node 69bd7ca00e93e2314723e947
2026-03-20 16:59:58,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 16:59:58,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7ca00e93e2314723e947 HTTP/1.1" 200 None
2026-03-20 16:59:58,551 - lava_callback - DEBUG - Processing node 69bd7ca00e93e2314723e947: ltp-dio
2026-03-20 16:59:59,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 16:59:59,743 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 16:59:59,745 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-69bd7ca00e93e2314723e947/log.txt.gz
2026-03-20 17:00:00,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:00:00,664 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:00:00,666 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-69bd7ca00e93e2314723e947/lava-logs.yaml
2026-03-20 17:00:00,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:00:01,154 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:00:01,156 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-69bd7ca00e93e2314723e947/lava_callback.json.gz
2026-03-20 17:00:01,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:00:01,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7ca00e93e2314723e947 HTTP/1.1" 200 None
2026-03-20 17:00:01,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:00:01,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd732d0e93e2314723e2b5 HTTP/1.1" 200 None
2026-03-20 17:00:01,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:00:01,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7ca00e93e2314723e947 HTTP/1.1" 200 None
2026-03-20 17:00:01,311 - lava_callback - INFO - Completed processing callback for node 69bd7ca00e93e2314723e947
INFO: 172.19.0.1:43226 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:00:10,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:00:10,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:48464 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:48468 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47264 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52258 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58510 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:00:46,699 - lava_callback - INFO - Received callback for node 69bd7ab60e93e2314723e6e0
INFO: 172.19.0.1:58514 - "POST /node/69bd7ab60e93e2314723e6e0 HTTP/1.0" 202 Accepted
2026-03-20 17:00:46,711 - lava_callback - INFO - Starting async job submit for node 69bd7ab60e93e2314723e6e0
2026-03-20 17:00:46,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:00:46,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7ab60e93e2314723e6e0 HTTP/1.1" 200 None
2026-03-20 17:00:46,804 - lava_callback - DEBUG - Processing node 69bd7ab60e93e2314723e6e0: baseline-arm64
2026-03-20 17:00:47,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:00:47,865 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:00:47,867 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7ab60e93e2314723e6e0/log.txt.gz
2026-03-20 17:00:48,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:00:48,689 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:00:48,692 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7ab60e93e2314723e6e0/lava-logs.yaml
2026-03-20 17:00:48,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:00:49,176 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:00:49,179 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7ab60e93e2314723e6e0/lava_callback.json.gz
DEBUG: Setup failed for 69bd7ab60e93e2314723e6e0. Transitting job node result: incomplete -> fail
2026-03-20 17:00:49,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:00:49,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7ab60e93e2314723e6e0 HTTP/1.1" 200 None
2026-03-20 17:00:49,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:00:49,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 17:00:49,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:00:49,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7ab60e93e2314723e6e0 HTTP/1.1" 200 None
2026-03-20 17:00:49,553 - lava_callback - INFO - Completed processing callback for node 69bd7ab60e93e2314723e6e0
2026-03-20 17:00:51,678 - lava_callback - INFO - Received callback for node 69bada2e21a77312e22216b5
INFO: 172.19.0.1:36012 - "POST /node/69bada2e21a77312e22216b5 HTTP/1.0" 202 Accepted
2026-03-20 17:00:51,688 - lava_callback - INFO - Starting async job submit for node 69bada2e21a77312e22216b5
2026-03-20 17:00:51,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:00:51,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bada2e21a77312e22216b5 HTTP/1.1" 200 None
2026-03-20 17:00:51,716 - lava_callback - DEBUG - Processing node 69bada2e21a77312e22216b5: baseline-arm64-baylibre
2026-03-20 17:00:51,717 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bada2e21a77312e22216b5
2026-03-20 17:00:51,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:00:51,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bada2e21a77312e22216b5 HTTP/1.1" 200 None
2026-03-20 17:00:51,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:00:51,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None
2026-03-20 17:00:51,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:00:51,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bada2e21a77312e22216b5 HTTP/1.1" 200 None
2026-03-20 17:00:51,823 - lava_callback - ERROR - Error processing callback for node 69bada2e21a77312e22216b5: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:36028 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36038 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55072 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:01:10,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:01:10,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:34358 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:34366 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:01:17,851 - lava_callback - INFO - Received callback for node 69bd7c750e93e2314723e8ea
INFO: 172.19.0.1:34376 - "POST /node/69bd7c750e93e2314723e8ea HTTP/1.0" 202 Accepted
2026-03-20 17:01:17,857 - lava_callback - INFO - Starting async job submit for node 69bd7c750e93e2314723e8ea
2026-03-20 17:01:17,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:01:17,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7c750e93e2314723e8ea HTTP/1.1" 200 None
2026-03-20 17:01:17,894 - lava_callback - DEBUG - Processing node 69bd7c750e93e2314723e8ea: baseline-arm-clabbe
2026-03-20 17:01:18,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:01:18,272 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:01:18,273 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69bd7c750e93e2314723e8ea/log.txt.gz
2026-03-20 17:01:18,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:01:18,631 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:01:18,633 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69bd7c750e93e2314723e8ea/lava-logs.yaml
2026-03-20 17:01:18,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:01:18,793 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:01:18,794 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69bd7c750e93e2314723e8ea/lava_callback.json.gz
2026-03-20 17:01:18,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:01:18,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7c750e93e2314723e8ea HTTP/1.1" 200 None
2026-03-20 17:01:18,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:01:18,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd732d0e93e2314723e2b5 HTTP/1.1" 200 None
2026-03-20 17:01:18,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:01:18,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7c750e93e2314723e8ea HTTP/1.1" 200 None
2026-03-20 17:01:18,885 - lava_callback - INFO - Completed processing callback for node 69bd7c750e93e2314723e8ea
INFO: 172.19.0.1:60582 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35794 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:01:40,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:01:40,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:46374 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:01:48,193 - lava_callback - INFO - Received callback for node 69bd7d200e93e2314723e9f4
INFO: 172.19.0.1:46382 - "POST /node/69bd7d200e93e2314723e9f4 HTTP/1.0" 202 Accepted
2026-03-20 17:01:48,199 - lava_callback - INFO - Starting async job submit for node 69bd7d200e93e2314723e9f4
2026-03-20 17:01:48,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:01:48,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7d200e93e2314723e9f4 HTTP/1.1" 200 None
2026-03-20 17:01:48,242 - lava_callback - DEBUG - Processing node 69bd7d200e93e2314723e9f4: baseline-arm64
2026-03-20 17:01:48,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:01:48,630 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:01:48,632 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7d200e93e2314723e9f4/log.txt.gz
2026-03-20 17:01:48,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:01:49,002 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:01:49,004 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7d200e93e2314723e9f4/lava-logs.yaml
2026-03-20 17:01:49,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:01:49,132 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:01:49,134 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7d200e93e2314723e9f4/lava_callback.json.gz
2026-03-20 17:01:49,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:01:49,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7d200e93e2314723e9f4 HTTP/1.1" 200 None
2026-03-20 17:01:49,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:01:49,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 17:01:49,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:01:49,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7d200e93e2314723e9f4 HTTP/1.1" 200 None
2026-03-20 17:01:49,290 - lava_callback - INFO - Completed processing callback for node 69bd7d200e93e2314723e9f4
INFO: 172.19.0.1:54804 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54818 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50816 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:02:10,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:02:10,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
2026-03-20 17:02:11,508 - lava_callback - INFO - Received callback for node 69bada8421a77312e22216d3
INFO: 172.19.0.1:50572 - "POST /node/69bada8421a77312e22216d3 HTTP/1.0" 202 Accepted
2026-03-20 17:02:11,514 - lava_callback - INFO - Starting async job submit for node 69bada8421a77312e22216d3
2026-03-20 17:02:11,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:02:11,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bada8421a77312e22216d3 HTTP/1.1" 200 None
2026-03-20 17:02:11,531 - lava_callback - DEBUG - Processing node 69bada8421a77312e22216d3: baseline-arm64-baylibre
2026-03-20 17:02:11,531 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bada8421a77312e22216d3
2026-03-20 17:02:11,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:02:11,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bada8421a77312e22216d3 HTTP/1.1" 200 None
2026-03-20 17:02:11,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:02:11,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None
2026-03-20 17:02:11,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:02:11,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bada8421a77312e22216d3 HTTP/1.1" 200 None
2026-03-20 17:02:11,600 - lava_callback - ERROR - Error processing callback for node 69bada8421a77312e22216d3: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:50586 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:50592 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:02:21,090 - lava_callback - INFO - Received callback for node 69bd7ca60e93e2314723e976
INFO: 172.19.0.1:51400 - "POST /node/69bd7ca60e93e2314723e976 HTTP/1.0" 202 Accepted
2026-03-20 17:02:21,097 - lava_callback - INFO - Starting async job submit for node 69bd7ca60e93e2314723e976
2026-03-20 17:02:21,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:02:21,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7ca60e93e2314723e976 HTTP/1.1" 200 None
2026-03-20 17:02:21,137 - lava_callback - DEBUG - Processing node 69bd7ca60e93e2314723e976: ltp-syscalls
2026-03-20 17:02:21,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:02:21,979 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:02:21,980 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-69bd7ca60e93e2314723e976/log.txt.gz
2026-03-20 17:02:22,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:02:22,649 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:02:22,651 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-69bd7ca60e93e2314723e976/lava-logs.yaml
2026-03-20 17:02:22,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:02:22,819 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:02:22,821 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-69bd7ca60e93e2314723e976/lava_callback.json.gz
2026-03-20 17:02:22,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:02:22,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7ca60e93e2314723e976 HTTP/1.1" 200 None
2026-03-20 17:02:22,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:02:22,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd732d0e93e2314723e2b5 HTTP/1.1" 200 None
2026-03-20 17:02:22,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:02:22,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7ca60e93e2314723e976 HTTP/1.1" 200 None
2026-03-20 17:02:22,909 - lava_callback - INFO - Completed processing callback for node 69bd7ca60e93e2314723e976
INFO: 172.19.0.1:51408 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50544 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:02:40,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:02:40,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:56196 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37492 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37498 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:02:56,883 - lava_callback - INFO - Received callback for node 69bd7c770e93e2314723e8ee
INFO: 172.19.0.1:37500 - "POST /node/69bd7c770e93e2314723e8ee HTTP/1.0" 202 Accepted
2026-03-20 17:02:56,890 - lava_callback - INFO - Starting async job submit for node 69bd7c770e93e2314723e8ee
2026-03-20 17:02:56,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:02:56,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7c770e93e2314723e8ee HTTP/1.1" 200 None
2026-03-20 17:02:56,932 - lava_callback - DEBUG - Processing node 69bd7c770e93e2314723e8ee: baseline-arm-clabbe
2026-03-20 17:02:57,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:02:57,263 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:02:57,265 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69bd7c770e93e2314723e8ee/log.txt.gz
2026-03-20 17:02:57,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:02:57,607 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:02:57,609 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69bd7c770e93e2314723e8ee/lava-logs.yaml
2026-03-20 17:02:57,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:02:57,775 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:02:57,777 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69bd7c770e93e2314723e8ee/lava_callback.json.gz
2026-03-20 17:02:57,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:02:57,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7c770e93e2314723e8ee HTTP/1.1" 200 None
2026-03-20 17:02:57,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:02:57,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd732d0e93e2314723e2b5 HTTP/1.1" 200 None
2026-03-20 17:02:57,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:02:57,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7c770e93e2314723e8ee HTTP/1.1" 200 None
2026-03-20 17:02:57,876 - lava_callback - INFO - Completed processing callback for node 69bd7c770e93e2314723e8ee
INFO: 172.19.0.1:60044 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:03:10,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:03:10,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:33712 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:33716 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39878 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:03:31,722 - lava_callback - INFO - Received callback for node 69badadc21a77312e222172c
INFO: 172.19.0.1:37520 - "POST /node/69badadc21a77312e222172c HTTP/1.0" 202 Accepted
2026-03-20 17:03:31,728 - lava_callback - INFO - Starting async job submit for node 69badadc21a77312e222172c
2026-03-20 17:03:31,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:03:31,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69badadc21a77312e222172c HTTP/1.1" 200 None
2026-03-20 17:03:31,746 - lava_callback - DEBUG - Processing node 69badadc21a77312e222172c: baseline-arm64-baylibre
2026-03-20 17:03:31,746 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69badadc21a77312e222172c
2026-03-20 17:03:31,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:03:31,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69badadc21a77312e222172c HTTP/1.1" 200 None
2026-03-20 17:03:31,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:03:31,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None
2026-03-20 17:03:31,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:03:31,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69badadc21a77312e222172c HTTP/1.1" 200 None
2026-03-20 17:03:31,802 - lava_callback - ERROR - Error processing callback for node 69badadc21a77312e222172c: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:37522 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59286 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:03:51,548 - lava_callback - INFO - Received callback for node 69badaed21a77312e222177c
INFO: 172.19.0.1:41556 - "POST /node/69badaed21a77312e222177c HTTP/1.0" 202 Accepted
2026-03-20 17:03:51,554 - lava_callback - INFO - Starting async job submit for node 69badaed21a77312e222177c
2026-03-20 17:03:51,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:03:51,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69badaed21a77312e222177c HTTP/1.1" 200 None
2026-03-20 17:03:51,569 - lava_callback - DEBUG - Processing node 69badaed21a77312e222177c: baseline-arm64-baylibre
2026-03-20 17:03:51,570 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69badaed21a77312e222177c
2026-03-20 17:03:51,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:03:51,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69badaed21a77312e222177c HTTP/1.1" 200 None
2026-03-20 17:03:51,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:03:51,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad0a721a77312e2220ef1 HTTP/1.1" 200 None
2026-03-20 17:03:51,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:03:51,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69badaed21a77312e222177c HTTP/1.1" 200 None
2026-03-20 17:03:51,638 - lava_callback - ERROR - Error processing callback for node 69badaed21a77312e222177c: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
2026-03-20 17:03:52,228 - lava_callback - INFO - Received callback for node 69badaee21a77312e222177f
INFO: 172.19.0.1:41560 - "POST /node/69badaee21a77312e222177f HTTP/1.0" 202 Accepted
2026-03-20 17:03:52,234 - lava_callback - INFO - Starting async job submit for node 69badaee21a77312e222177f
2026-03-20 17:03:52,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:03:52,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69badaee21a77312e222177f HTTP/1.1" 200 None
2026-03-20 17:03:52,250 - lava_callback - DEBUG - Processing node 69badaee21a77312e222177f: baseline-arm64-baylibre
2026-03-20 17:03:52,251 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69badaee21a77312e222177f
2026-03-20 17:03:52,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:03:52,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69badaee21a77312e222177f HTTP/1.1" 200 None
2026-03-20 17:03:52,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:03:52,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad0a721a77312e2220ef1 HTTP/1.1" 200 None
2026-03-20 17:03:52,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:03:52,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69badaee21a77312e222177f HTTP/1.1" 200 None
2026-03-20 17:03:52,313 - lava_callback - ERROR - Error processing callback for node 69badaee21a77312e222177f: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
2026-03-20 17:03:52,923 - lava_callback - INFO - Received callback for node 69badaf421a77312e222178c
INFO: 172.19.0.1:41572 - "POST /node/69badaf421a77312e222178c HTTP/1.0" 202 Accepted
2026-03-20 17:03:52,928 - lava_callback - INFO - Starting async job submit for node 69badaf421a77312e222178c
2026-03-20 17:03:52,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:03:52,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69badaf421a77312e222178c HTTP/1.1" 200 None
2026-03-20 17:03:52,945 - lava_callback - DEBUG - Processing node 69badaf421a77312e222178c: baseline-arm64-baylibre
2026-03-20 17:03:52,945 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69badaf421a77312e222178c
2026-03-20 17:03:52,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:03:52,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69badaf421a77312e222178c HTTP/1.1" 200 None
2026-03-20 17:03:52,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:03:52,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad0a721a77312e2220ef1 HTTP/1.1" 200 None
2026-03-20 17:03:52,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:03:53,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69badaf421a77312e222178c HTTP/1.1" 200 None
2026-03-20 17:03:53,014 - lava_callback - ERROR - Error processing callback for node 69badaf421a77312e222178c: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
2026-03-20 17:03:53,619 - lava_callback - INFO - Received callback for node 69badaec21a77312e2221779
INFO: 172.19.0.1:41584 - "POST /node/69badaec21a77312e2221779 HTTP/1.0" 202 Accepted
2026-03-20 17:03:53,625 - lava_callback - INFO - Starting async job submit for node 69badaec21a77312e2221779
2026-03-20 17:03:53,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:03:53,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69badaec21a77312e2221779 HTTP/1.1" 200 None
2026-03-20 17:03:53,641 - lava_callback - DEBUG - Processing node 69badaec21a77312e2221779: baseline-arm64-baylibre
2026-03-20 17:03:53,641 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69badaec21a77312e2221779
2026-03-20 17:03:53,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:03:53,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69badaec21a77312e2221779 HTTP/1.1" 200 None
2026-03-20 17:03:53,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:03:53,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad0a721a77312e2220ef1 HTTP/1.1" 200 None
2026-03-20 17:03:53,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:03:53,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69badaec21a77312e2221779 HTTP/1.1" 200 None
2026-03-20 17:03:53,717 - lava_callback - ERROR - Error processing callback for node 69badaec21a77312e2221779: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
2026-03-20 17:03:54,309 - lava_callback - INFO - Received callback for node 69badaf121a77312e2221786
INFO: 172.19.0.1:41594 - "POST /node/69badaf121a77312e2221786 HTTP/1.0" 202 Accepted
2026-03-20 17:03:54,315 - lava_callback - INFO - Starting async job submit for node 69badaf121a77312e2221786
2026-03-20 17:03:54,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:03:54,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69badaf121a77312e2221786 HTTP/1.1" 200 None
2026-03-20 17:03:54,330 - lava_callback - DEBUG - Processing node 69badaf121a77312e2221786: baseline-arm64-baylibre
2026-03-20 17:03:54,330 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69badaf121a77312e2221786
2026-03-20 17:03:54,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:03:54,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69badaf121a77312e2221786 HTTP/1.1" 200 None
2026-03-20 17:03:54,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:03:54,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad0a721a77312e2220ef1 HTTP/1.1" 200 None
2026-03-20 17:03:54,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:03:54,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69badaf121a77312e2221786 HTTP/1.1" 200 None
2026-03-20 17:03:54,384 - lava_callback - ERROR - Error processing callback for node 69badaf121a77312e2221786: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
2026-03-20 17:03:55,022 - lava_callback - INFO - Received callback for node 69badaf221a77312e2221789
INFO: 172.19.0.1:41600 - "POST /node/69badaf221a77312e2221789 HTTP/1.0" 202 Accepted
2026-03-20 17:03:55,028 - lava_callback - INFO - Starting async job submit for node 69badaf221a77312e2221789
2026-03-20 17:03:55,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:03:55,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69badaf221a77312e2221789 HTTP/1.1" 200 None
2026-03-20 17:03:55,045 - lava_callback - DEBUG - Processing node 69badaf221a77312e2221789: baseline-arm64-baylibre
2026-03-20 17:03:55,046 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69badaf221a77312e2221789
2026-03-20 17:03:55,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:03:55,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69badaf221a77312e2221789 HTTP/1.1" 200 None
2026-03-20 17:03:55,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:03:55,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad0a721a77312e2220ef1 HTTP/1.1" 200 None
2026-03-20 17:03:55,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:03:55,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69badaf221a77312e2221789 HTTP/1.1" 200 None
2026-03-20 17:03:55,101 - lava_callback - ERROR - Error processing callback for node 69badaf221a77312e2221789: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:41616 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41632 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39812 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:04:11,160 - lava_callback - INFO - Received callback for node 69badb0521a77312e22217ca
INFO: 172.19.0.1:52596 - "POST /node/69badb0521a77312e22217ca HTTP/1.0" 202 Accepted
2026-03-20 17:04:11,169 - lava_callback - INFO - Starting async job submit for node 69badb0521a77312e22217ca
2026-03-20 17:04:11,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:04:11,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69badb0521a77312e22217ca HTTP/1.1" 200 None
2026-03-20 17:04:11,193 - lava_callback - DEBUG - Processing node 69badb0521a77312e22217ca: baseline-arm64-clabbe
2026-03-20 17:04:11,193 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69badb0521a77312e22217ca
2026-03-20 17:04:11,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:04:11,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69badb0521a77312e22217ca HTTP/1.1" 200 None
2026-03-20 17:04:11,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:04:11,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad0a721a77312e2220ef1 HTTP/1.1" 200 None
2026-03-20 17:04:11,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:04:11,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69badb0521a77312e22217ca HTTP/1.1" 200 None
2026-03-20 17:04:11,249 - lava_callback - ERROR - Error processing callback for node 69badb0521a77312e22217ca: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
2026-03-20 17:04:11,845 - lava_callback - INFO - Received callback for node 69badb0721a77312e22217cd
INFO: 172.19.0.1:52612 - "POST /node/69badb0721a77312e22217cd HTTP/1.0" 202 Accepted
2026-03-20 17:04:11,851 - lava_callback - INFO - Starting async job submit for node 69badb0721a77312e22217cd
2026-03-20 17:04:11,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:04:11,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69badb0721a77312e22217cd HTTP/1.1" 200 None
2026-03-20 17:04:11,866 - lava_callback - DEBUG - Processing node 69badb0721a77312e22217cd: baseline-arm64-clabbe
2026-03-20 17:04:11,866 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69badb0721a77312e22217cd
2026-03-20 17:04:11,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:04:11,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69badb0721a77312e22217cd HTTP/1.1" 200 None
2026-03-20 17:04:11,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:04:11,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad0a721a77312e2220ef1 HTTP/1.1" 200 None
2026-03-20 17:04:11,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:04:11,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69badb0721a77312e22217cd HTTP/1.1" 200 None
2026-03-20 17:04:11,922 - lava_callback - ERROR - Error processing callback for node 69badb0721a77312e22217cd: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
2026-03-20 17:04:12,518 - lava_callback - INFO - Received callback for node 69badb0821a77312e22217d4
INFO: 172.19.0.1:52620 - "POST /node/69badb0821a77312e22217d4 HTTP/1.0" 202 Accepted
2026-03-20 17:04:12,524 - lava_callback - INFO - Starting async job submit for node 69badb0821a77312e22217d4
2026-03-20 17:04:12,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:04:12,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69badb0821a77312e22217d4 HTTP/1.1" 200 None
2026-03-20 17:04:12,540 - lava_callback - DEBUG - Processing node 69badb0821a77312e22217d4: baseline-arm64-clabbe
2026-03-20 17:04:12,540 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69badb0821a77312e22217d4
2026-03-20 17:04:12,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:04:12,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69badb0821a77312e22217d4 HTTP/1.1" 200 None
2026-03-20 17:04:12,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:04:12,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad0a721a77312e2220ef1 HTTP/1.1" 200 None
2026-03-20 17:04:12,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:04:12,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69badb0821a77312e22217d4 HTTP/1.1" 200 None
2026-03-20 17:04:12,599 - lava_callback - ERROR - Error processing callback for node 69badb0821a77312e22217d4: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
2026-03-20 17:04:13,174 - lava_callback - INFO - Received callback for node 69badb0921a77312e22217d7
INFO: 172.19.0.1:52636 - "POST /node/69badb0921a77312e22217d7 HTTP/1.0" 202 Accepted
2026-03-20 17:04:13,180 - lava_callback - INFO - Starting async job submit for node 69badb0921a77312e22217d7
2026-03-20 17:04:13,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:04:13,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69badb0921a77312e22217d7 HTTP/1.1" 200 None
2026-03-20 17:04:13,196 - lava_callback - DEBUG - Processing node 69badb0921a77312e22217d7: baseline-arm64-clabbe
2026-03-20 17:04:13,197 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69badb0921a77312e22217d7
2026-03-20 17:04:13,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:04:13,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69badb0921a77312e22217d7 HTTP/1.1" 200 None
2026-03-20 17:04:13,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:04:13,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad0a721a77312e2220ef1 HTTP/1.1" 200 None
2026-03-20 17:04:13,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:04:13,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69badb0921a77312e22217d7 HTTP/1.1" 200 None
2026-03-20 17:04:13,251 - lava_callback - ERROR - Error processing callback for node 69badb0921a77312e22217d7: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:52640 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:52644 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33088 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:04:28,255 - lava_callback - INFO - Received callback for node 69bd7ab50e93e2314723e6dd
INFO: 172.19.0.1:33104 - "POST /node/69bd7ab50e93e2314723e6dd HTTP/1.0" 202 Accepted
2026-03-20 17:04:28,262 - lava_callback - INFO - Starting async job submit for node 69bd7ab50e93e2314723e6dd
2026-03-20 17:04:28,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:04:28,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7ab50e93e2314723e6dd HTTP/1.1" 200 None
2026-03-20 17:04:28,326 - lava_callback - DEBUG - Processing node 69bd7ab50e93e2314723e6dd: baseline-arm64
2026-03-20 17:04:29,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:04:29,267 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:04:29,269 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7ab50e93e2314723e6dd/log.txt.gz
2026-03-20 17:04:29,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:04:29,951 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:04:29,953 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7ab50e93e2314723e6dd/lava-logs.yaml
2026-03-20 17:04:29,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:04:30,166 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:04:30,168 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7ab50e93e2314723e6dd/lava_callback.json.gz
DEBUG: Setup failed for 69bd7ab50e93e2314723e6dd. Transitting job node result: incomplete -> fail
2026-03-20 17:04:30,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:04:30,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7ab50e93e2314723e6dd HTTP/1.1" 200 None
2026-03-20 17:04:30,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:04:30,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 17:04:30,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:04:30,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7ab50e93e2314723e6dd HTTP/1.1" 200 None
2026-03-20 17:04:30,430 - lava_callback - INFO - Completed processing callback for node 69bd7ab50e93e2314723e6dd
2026-03-20 17:04:30,996 - lava_callback - INFO - Received callback for node 69badb0b21a77312e22217dd
INFO: 172.19.0.1:45160 - "POST /node/69badb0b21a77312e22217dd HTTP/1.0" 202 Accepted
2026-03-20 17:04:31,004 - lava_callback - INFO - Starting async job submit for node 69badb0b21a77312e22217dd
2026-03-20 17:04:31,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:04:31,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69badb0b21a77312e22217dd HTTP/1.1" 200 None
2026-03-20 17:04:31,020 - lava_callback - DEBUG - Processing node 69badb0b21a77312e22217dd: baseline-arm64-clabbe
2026-03-20 17:04:31,020 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69badb0b21a77312e22217dd
2026-03-20 17:04:31,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:04:31,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69badb0b21a77312e22217dd HTTP/1.1" 200 None
2026-03-20 17:04:31,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:04:31,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad0a721a77312e2220ef1 HTTP/1.1" 200 None
2026-03-20 17:04:31,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:04:31,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69badb0b21a77312e22217dd HTTP/1.1" 200 None
2026-03-20 17:04:31,083 - lava_callback - ERROR - Error processing callback for node 69badb0b21a77312e22217dd: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
2026-03-20 17:04:31,667 - lava_callback - INFO - Received callback for node 69badb0c21a77312e22217e0
INFO: 172.19.0.1:45162 - "POST /node/69badb0c21a77312e22217e0 HTTP/1.0" 202 Accepted
2026-03-20 17:04:31,673 - lava_callback - INFO - Starting async job submit for node 69badb0c21a77312e22217e0
2026-03-20 17:04:31,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:04:31,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69badb0c21a77312e22217e0 HTTP/1.1" 200 None
2026-03-20 17:04:31,689 - lava_callback - DEBUG - Processing node 69badb0c21a77312e22217e0: baseline-arm64-clabbe
2026-03-20 17:04:31,689 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69badb0c21a77312e22217e0
2026-03-20 17:04:31,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:04:31,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69badb0c21a77312e22217e0 HTTP/1.1" 200 None
2026-03-20 17:04:31,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:04:31,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad0a721a77312e2220ef1 HTTP/1.1" 200 None
2026-03-20 17:04:31,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:04:31,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69badb0c21a77312e22217e0 HTTP/1.1" 200 None
2026-03-20 17:04:31,748 - lava_callback - ERROR - Error processing callback for node 69badb0c21a77312e22217e0: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
2026-03-20 17:04:36,034 - lava_callback - INFO - Received callback for node 69bd7c7c0e93e2314723e8fc
INFO: 172.19.0.1:45178 - "POST /node/69bd7c7c0e93e2314723e8fc HTTP/1.0" 202 Accepted
2026-03-20 17:04:36,040 - lava_callback - INFO - Starting async job submit for node 69bd7c7c0e93e2314723e8fc
2026-03-20 17:04:36,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:04:36,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7c7c0e93e2314723e8fc HTTP/1.1" 200 None
2026-03-20 17:04:36,095 - lava_callback - DEBUG - Processing node 69bd7c7c0e93e2314723e8fc: baseline-arm-clabbe
2026-03-20 17:04:36,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:04:36,453 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:04:36,454 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69bd7c7c0e93e2314723e8fc/log.txt.gz
INFO: 172.19.0.1:45188 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:04:36,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:04:36,772 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:04:36,774 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69bd7c7c0e93e2314723e8fc/lava-logs.yaml
2026-03-20 17:04:36,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:04:36,915 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:04:36,916 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69bd7c7c0e93e2314723e8fc/lava_callback.json.gz
2026-03-20 17:04:36,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:04:36,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7c7c0e93e2314723e8fc HTTP/1.1" 200 None
2026-03-20 17:04:36,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:04:36,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd732d0e93e2314723e2b5 HTTP/1.1" 200 None
2026-03-20 17:04:36,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:04:37,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7c7c0e93e2314723e8fc HTTP/1.1" 200 None
2026-03-20 17:04:37,006 - lava_callback - INFO - Completed processing callback for node 69bd7c7c0e93e2314723e8fc
2026-03-20 17:04:40,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:04:40,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:60334 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58272 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58288 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:05:04,960 - lava_callback - INFO - Received callback for node 69bd7aca0e93e2314723e71e
INFO: 172.19.0.1:39692 - "POST /node/69bd7aca0e93e2314723e71e HTTP/1.0" 202 Accepted
2026-03-20 17:05:04,968 - lava_callback - INFO - Starting async job submit for node 69bd7aca0e93e2314723e71e
2026-03-20 17:05:05,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:05:05,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7aca0e93e2314723e71e HTTP/1.1" 200 None
2026-03-20 17:05:05,034 - lava_callback - DEBUG - Processing node 69bd7aca0e93e2314723e71e: baseline-nfs-arm64
2026-03-20 17:05:05,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:05:05,914 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:05:05,915 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd7aca0e93e2314723e71e/log.txt.gz
2026-03-20 17:05:06,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
INFO: 172.19.0.1:39708 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:05:06,557 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:05:06,559 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd7aca0e93e2314723e71e/lava-logs.yaml
2026-03-20 17:05:06,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:05:06,740 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:05:06,741 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd7aca0e93e2314723e71e/lava_callback.json.gz
DEBUG: Setup failed for 69bd7aca0e93e2314723e71e. Transitting job node result: incomplete -> fail
2026-03-20 17:05:06,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:05:06,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7aca0e93e2314723e71e HTTP/1.1" 200 None
2026-03-20 17:05:06,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:05:06,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 17:05:06,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:05:06,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7aca0e93e2314723e71e HTTP/1.1" 200 None
2026-03-20 17:05:06,995 - lava_callback - INFO - Completed processing callback for node 69bd7aca0e93e2314723e71e
2026-03-20 17:05:10,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:05:10,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:44756 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:44762 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50282 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:05:33,236 - lava_callback - INFO - Received callback for node 69bd7e180e93e2314723ea5f
INFO: 172.19.0.1:38248 - "POST /node/69bd7e180e93e2314723ea5f HTTP/1.0" 202 Accepted
2026-03-20 17:05:33,243 - lava_callback - INFO - Starting async job submit for node 69bd7e180e93e2314723ea5f
2026-03-20 17:05:33,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:05:33,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7e180e93e2314723ea5f HTTP/1.1" 200 None
2026-03-20 17:05:33,296 - lava_callback - DEBUG - Processing node 69bd7e180e93e2314723ea5f: baseline-arm64
2026-03-20 17:05:33,433 - lava_callback - WARNING - Failed to upload log
2026-03-20 17:05:33,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:05:33,697 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:05:33,699 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7e180e93e2314723ea5f/lava-logs.yaml
2026-03-20 17:05:33,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:05:33,838 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:05:33,840 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7e180e93e2314723ea5f/lava_callback.json.gz
2026-03-20 17:05:33,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:05:33,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7e180e93e2314723ea5f HTTP/1.1" 200 None
2026-03-20 17:05:33,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:05:33,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 17:05:33,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:05:33,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7e180e93e2314723ea5f HTTP/1.1" 200 None
2026-03-20 17:05:34,012 - lava_callback - INFO - Completed processing callback for node 69bd7e180e93e2314723ea5f
INFO: 172.19.0.1:38252 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:05:40,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:05:40,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:47702 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51522 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51530 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:06:06,376 - lava_callback - INFO - Received callback for node 69bd7a520e93e2314723e68c
INFO: 172.19.0.1:45922 - "POST /node/69bd7a520e93e2314723e68c HTTP/1.0" 202 Accepted
2026-03-20 17:06:06,383 - lava_callback - INFO - Starting async job submit for node 69bd7a520e93e2314723e68c
2026-03-20 17:06:06,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:06:06,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7a520e93e2314723e68c HTTP/1.1" 200 None
2026-03-20 17:06:06,462 - lava_callback - DEBUG - Processing node 69bd7a520e93e2314723e68c: ltp-smoke
INFO: 172.19.0.1:45924 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:06:06,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:06:07,093 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:06:07,095 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69bd7a520e93e2314723e68c/log.txt.gz
2026-03-20 17:06:07,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:06:07,704 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:06:07,706 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69bd7a520e93e2314723e68c/lava-logs.yaml
2026-03-20 17:06:07,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:06:07,866 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:06:07,867 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69bd7a520e93e2314723e68c/lava_callback.json.gz
2026-03-20 17:06:08,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:06:08,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7a520e93e2314723e68c HTTP/1.1" 200 None
2026-03-20 17:06:08,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:06:08,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73350e93e2314723e2bb HTTP/1.1" 200 None
2026-03-20 17:06:08,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:06:08,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7a520e93e2314723e68c HTTP/1.1" 200 None
2026-03-20 17:06:08,191 - lava_callback - INFO - Completed processing callback for node 69bd7a520e93e2314723e68c
2026-03-20 17:06:10,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:06:10,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
2026-03-20 17:06:11,684 - lava_callback - INFO - Received callback for node 69badb7821a77312e22218a4
INFO: 172.19.0.1:59030 - "POST /node/69badb7821a77312e22218a4 HTTP/1.0" 202 Accepted
2026-03-20 17:06:11,693 - lava_callback - INFO - Starting async job submit for node 69badb7821a77312e22218a4
2026-03-20 17:06:11,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:06:11,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69badb7821a77312e22218a4 HTTP/1.1" 200 None
2026-03-20 17:06:11,712 - lava_callback - DEBUG - Processing node 69badb7821a77312e22218a4: baseline-arm64-baylibre
2026-03-20 17:06:11,712 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69badb7821a77312e22218a4
2026-03-20 17:06:11,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:06:11,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69badb7821a77312e22218a4 HTTP/1.1" 200 None
2026-03-20 17:06:11,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:06:11,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None
2026-03-20 17:06:11,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:06:11,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69badb7821a77312e22218a4 HTTP/1.1" 200 None
2026-03-20 17:06:11,780 - lava_callback - ERROR - Error processing callback for node 69badb7821a77312e22218a4: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:59032 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:59040 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:06:19,083 - lava_callback - INFO - Received callback for node 69bd7c7e0e93e2314723e900
INFO: 172.19.0.1:59042 - "POST /node/69bd7c7e0e93e2314723e900 HTTP/1.0" 202 Accepted
2026-03-20 17:06:19,090 - lava_callback - INFO - Starting async job submit for node 69bd7c7e0e93e2314723e900
2026-03-20 17:06:19,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:06:19,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7c7e0e93e2314723e900 HTTP/1.1" 200 None
2026-03-20 17:06:19,156 - lava_callback - DEBUG - Processing node 69bd7c7e0e93e2314723e900: baseline-arm-clabbe
2026-03-20 17:06:19,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:06:19,488 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:06:19,489 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69bd7c7e0e93e2314723e900/log.txt.gz
2026-03-20 17:06:19,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:06:19,791 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:06:19,793 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69bd7c7e0e93e2314723e900/lava-logs.yaml
2026-03-20 17:06:19,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:06:19,943 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:06:19,945 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69bd7c7e0e93e2314723e900/lava_callback.json.gz
2026-03-20 17:06:19,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:06:19,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7c7e0e93e2314723e900 HTTP/1.1" 200 None
2026-03-20 17:06:19,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:06:20,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd732d0e93e2314723e2b5 HTTP/1.1" 200 None
2026-03-20 17:06:20,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:06:20,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7c7e0e93e2314723e900 HTTP/1.1" 200 None
2026-03-20 17:06:20,036 - lava_callback - INFO - Completed processing callback for node 69bd7c7e0e93e2314723e900
INFO: 172.19.0.1:38074 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56178 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:06:40,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:06:40,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:48402 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46180 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46184 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46568 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40080 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:40094 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60688 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:07:31,976 - lava_callback - INFO - Received callback for node 69badbce21a77312e22218ec
INFO: 172.19.0.1:59028 - "POST /node/69badbce21a77312e22218ec HTTP/1.0" 202 Accepted
2026-03-20 17:07:31,982 - lava_callback - INFO - Starting async job submit for node 69badbce21a77312e22218ec
2026-03-20 17:07:31,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:07:31,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69badbce21a77312e22218ec HTTP/1.1" 200 None
2026-03-20 17:07:31,998 - lava_callback - DEBUG - Processing node 69badbce21a77312e22218ec: baseline-arm64-baylibre
2026-03-20 17:07:31,998 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69badbce21a77312e22218ec
2026-03-20 17:07:31,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:07:32,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69badbce21a77312e22218ec HTTP/1.1" 200 None
2026-03-20 17:07:32,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:07:32,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None
2026-03-20 17:07:32,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:07:32,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69badbce21a77312e22218ec HTTP/1.1" 200 None
2026-03-20 17:07:32,066 - lava_callback - ERROR - Error processing callback for node 69badbce21a77312e22218ec: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:59040 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60306 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58960 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58970 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:08:00,445 - lava_callback - INFO - Received callback for node 69bd7ab10e93e2314723e6d4
INFO: 172.19.0.1:44146 - "POST /node/69bd7ab10e93e2314723e6d4 HTTP/1.0" 202 Accepted
2026-03-20 17:08:00,452 - lava_callback - INFO - Starting async job submit for node 69bd7ab10e93e2314723e6d4
2026-03-20 17:08:00,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:08:00,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7ab10e93e2314723e6d4 HTTP/1.1" 200 None
2026-03-20 17:08:00,492 - lava_callback - DEBUG - Processing node 69bd7ab10e93e2314723e6d4: baseline-arm64
2026-03-20 17:08:01,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:08:01,209 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:08:01,210 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7ab10e93e2314723e6d4/log.txt.gz
2026-03-20 17:08:01,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:08:01,674 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:08:01,676 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7ab10e93e2314723e6d4/lava-logs.yaml
2026-03-20 17:08:01,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:08:01,838 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:08:01,839 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7ab10e93e2314723e6d4/lava_callback.json.gz
2026-03-20 17:08:01,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:08:01,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7ab10e93e2314723e6d4 HTTP/1.1" 200 None
2026-03-20 17:08:01,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:08:01,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 17:08:01,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:08:01,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7ab10e93e2314723e6d4 HTTP/1.1" 200 None
2026-03-20 17:08:02,004 - lava_callback - INFO - Completed processing callback for node 69bd7ab10e93e2314723e6d4
INFO: 172.19.0.1:44158 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:08:10,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:08:10,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:35680 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:35690 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40566 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60938 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44574 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:08:53,899 - lava_callback - INFO - Received callback for node 69bd7ac50e93e2314723e6ff
INFO: 172.19.0.1:36298 - "POST /node/69bd7ac50e93e2314723e6ff HTTP/1.0" 202 Accepted
2026-03-20 17:08:53,905 - lava_callback - INFO - Starting async job submit for node 69bd7ac50e93e2314723e6ff
2026-03-20 17:08:53,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:08:53,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7ac50e93e2314723e6ff HTTP/1.1" 200 None
2026-03-20 17:08:53,947 - lava_callback - DEBUG - Processing node 69bd7ac50e93e2314723e6ff: baseline-nfs-arm64
2026-03-20 17:08:54,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:08:54,635 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:08:54,636 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd7ac50e93e2314723e6ff/log.txt.gz
2026-03-20 17:08:54,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:08:55,142 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:08:55,144 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd7ac50e93e2314723e6ff/lava-logs.yaml
2026-03-20 17:08:55,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:08:55,331 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:08:55,333 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd7ac50e93e2314723e6ff/lava_callback.json.gz
2026-03-20 17:08:55,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:08:55,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7ac50e93e2314723e6ff HTTP/1.1" 200 None
2026-03-20 17:08:55,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:08:55,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 17:08:55,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:08:55,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7ac50e93e2314723e6ff HTTP/1.1" 200 None
2026-03-20 17:08:55,473 - lava_callback - INFO - Completed processing callback for node 69bd7ac50e93e2314723e6ff
INFO: 172.19.0.1:36314 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36320 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:09:00,630 - lava_callback - INFO - Received callback for node 69bd7f210e93e2314723eb1c
INFO: 172.19.0.1:43942 - "POST /node/69bd7f210e93e2314723eb1c HTTP/1.0" 202 Accepted
2026-03-20 17:09:00,636 - lava_callback - INFO - Starting async job submit for node 69bd7f210e93e2314723eb1c
2026-03-20 17:09:00,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:09:00,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7f210e93e2314723eb1c HTTP/1.1" 200 None
2026-03-20 17:09:00,657 - lava_callback - DEBUG - Processing node 69bd7f210e93e2314723eb1c: baseline-arm
2026-03-20 17:09:00,662 - lava_callback - WARNING - Failed to upload log
2026-03-20 17:09:00,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:09:00,784 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:09:00,785 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69bd7f210e93e2314723eb1c/lava-logs.yaml
2026-03-20 17:09:00,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:09:00,932 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:09:00,933 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69bd7f210e93e2314723eb1c/lava_callback.json.gz
2026-03-20 17:09:00,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:09:00,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7f210e93e2314723eb1c HTTP/1.1" 200 None
2026-03-20 17:09:00,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:09:00,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd732d0e93e2314723e2b5 HTTP/1.1" 200 None
2026-03-20 17:09:00,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:09:00,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7f210e93e2314723eb1c HTTP/1.1" 200 None
2026-03-20 17:09:00,998 - lava_callback - INFO - Completed processing callback for node 69bd7f210e93e2314723eb1c
INFO: 172.19.0.1:43958 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:09:07,750 - lava_callback - INFO - Received callback for node 69bd7ecd0e93e2314723eafb
INFO: 172.19.0.1:43974 - "POST /node/69bd7ecd0e93e2314723eafb HTTP/1.0" 202 Accepted
2026-03-20 17:09:07,757 - lava_callback - INFO - Starting async job submit for node 69bd7ecd0e93e2314723eafb
2026-03-20 17:09:07,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:09:07,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7ecd0e93e2314723eafb HTTP/1.1" 200 None
2026-03-20 17:09:07,802 - lava_callback - DEBUG - Processing node 69bd7ecd0e93e2314723eafb: baseline-arm64
2026-03-20 17:09:07,998 - lava_callback - WARNING - Failed to upload log
2026-03-20 17:09:08,089 - lava_callback - INFO - Received callback for node 69bd7de00e93e2314723ea3e
INFO: 172.19.0.1:43976 - "POST /node/69bd7de00e93e2314723ea3e HTTP/1.0" 202 Accepted
2026-03-20 17:09:08,118 - lava_callback - INFO - Starting async job submit for node 69bd7de00e93e2314723ea3e
2026-03-20 17:09:08,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:09:08,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:09:08,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7de00e93e2314723ea3e HTTP/1.1" 200 None
2026-03-20 17:09:08,200 - lava_callback - DEBUG - Processing node 69bd7de00e93e2314723ea3e: baseline-arm64-foundriesio
2026-03-20 17:09:08,423 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:09:08,476 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7ecd0e93e2314723eafb/lava-logs.yaml
2026-03-20 17:09:08,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:09:08,762 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:09:08,799 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd7ecd0e93e2314723eafb/lava_callback.json.gz
2026-03-20 17:09:08,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:09:08,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7ecd0e93e2314723eafb HTTP/1.1" 200 None
2026-03-20 17:09:08,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:09:09,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 17:09:09,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:09:09,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7ecd0e93e2314723eafb HTTP/1.1" 200 None
2026-03-20 17:09:09,339 - lava_callback - INFO - Completed processing callback for node 69bd7ecd0e93e2314723eafb
2026-03-20 17:09:09,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:09:09,786 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:09:09,787 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69bd7de00e93e2314723ea3e/log.txt.gz
2026-03-20 17:09:10,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:09:10,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:09:10,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
2026-03-20 17:09:10,697 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:09:10,699 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69bd7de00e93e2314723ea3e/lava-logs.yaml
2026-03-20 17:09:10,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:09:10,913 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:09:10,915 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69bd7de00e93e2314723ea3e/lava_callback.json.gz
DEBUG: Setup failed for 69bd7de00e93e2314723ea3e. Transitting job node result: incomplete -> fail
2026-03-20 17:09:11,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:09:11,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7de00e93e2314723ea3e HTTP/1.1" 200 None
2026-03-20 17:09:11,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:09:11,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 17:09:11,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:09:11,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7de00e93e2314723ea3e HTTP/1.1" 200 None
2026-03-20 17:09:11,204 - lava_callback - INFO - Completed processing callback for node 69bd7de00e93e2314723ea3e
2026-03-20 17:09:11,898 - lava_callback - INFO - Received callback for node 69badc2421a77312e2221911
INFO: 172.19.0.1:35186 - "POST /node/69badc2421a77312e2221911 HTTP/1.0" 202 Accepted
2026-03-20 17:09:11,903 - lava_callback - INFO - Starting async job submit for node 69badc2421a77312e2221911
2026-03-20 17:09:11,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:09:11,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69badc2421a77312e2221911 HTTP/1.1" 200 None
2026-03-20 17:09:11,919 - lava_callback - DEBUG - Processing node 69badc2421a77312e2221911: baseline-arm64-baylibre
2026-03-20 17:09:11,919 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69badc2421a77312e2221911
2026-03-20 17:09:11,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:09:11,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69badc2421a77312e2221911 HTTP/1.1" 200 None
2026-03-20 17:09:11,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:09:11,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None
2026-03-20 17:09:11,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:09:11,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69badc2421a77312e2221911 HTTP/1.1" 200 None
2026-03-20 17:09:11,981 - lava_callback - ERROR - Error processing callback for node 69badc2421a77312e2221911: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:35198 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:35204 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55848 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44106 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:09:40,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:09:40,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:51010 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42772 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42782 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33234 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:10:08,210 - lava_callback - INFO - Received callback for node 69bd7abd0e93e2314723e6ec
INFO: 172.19.0.1:33242 - "POST /node/69bd7abd0e93e2314723e6ec HTTP/1.0" 202 Accepted
2026-03-20 17:10:08,218 - lava_callback - INFO - Starting async job submit for node 69bd7abd0e93e2314723e6ec
2026-03-20 17:10:08,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:10:08,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7abd0e93e2314723e6ec HTTP/1.1" 200 None
2026-03-20 17:10:08,277 - lava_callback - DEBUG - Processing node 69bd7abd0e93e2314723e6ec: baseline-nfs-arm64
2026-03-20 17:10:09,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:10:09,624 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:10:09,626 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd7abd0e93e2314723e6ec/log.txt.gz
2026-03-20 17:10:10,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:10:10,501 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:10:10,504 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd7abd0e93e2314723e6ec/lava-logs.yaml
2026-03-20 17:10:10,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:10:10,716 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:10:10,717 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd7abd0e93e2314723e6ec/lava_callback.json.gz
DEBUG: Setup failed for 69bd7abd0e93e2314723e6ec. Transitting job node result: incomplete -> fail
2026-03-20 17:10:10,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:10:10,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7abd0e93e2314723e6ec HTTP/1.1" 200 None
2026-03-20 17:10:10,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:10:10,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 17:10:10,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:10:10,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7abd0e93e2314723e6ec HTTP/1.1" 200 None
2026-03-20 17:10:10,964 - lava_callback - INFO - Completed processing callback for node 69bd7abd0e93e2314723e6ec
INFO: 172.19.0.1:43680 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:43690 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33642 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:10:31,405 - lava_callback - INFO - Received callback for node 69badc8121a77312e222192a
INFO: 172.19.0.1:53242 - "POST /node/69badc8121a77312e222192a HTTP/1.0" 202 Accepted
2026-03-20 17:10:31,411 - lava_callback - INFO - Starting async job submit for node 69badc8121a77312e222192a
2026-03-20 17:10:31,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:10:31,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69badc8121a77312e222192a HTTP/1.1" 200 None
2026-03-20 17:10:31,428 - lava_callback - DEBUG - Processing node 69badc8121a77312e222192a: baseline-arm64-clabbe
2026-03-20 17:10:31,428 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69badc8121a77312e222192a
2026-03-20 17:10:31,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:10:31,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69badc8121a77312e222192a HTTP/1.1" 200 None
2026-03-20 17:10:31,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:10:31,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None
2026-03-20 17:10:31,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:10:31,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69badc8121a77312e222192a HTTP/1.1" 200 None
2026-03-20 17:10:31,499 - lava_callback - ERROR - Error processing callback for node 69badc8121a77312e222192a: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:53248 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:10:40,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:10:40,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:51262 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52868 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52870 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35322 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54206 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:54222 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50396 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50428 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48258 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36856 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36858 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34184 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:12:11,501 - lava_callback - INFO - Received callback for node 69badcd621a77312e222193e
INFO: 172.19.0.1:37510 - "POST /node/69badcd621a77312e222193e HTTP/1.0" 202 Accepted
2026-03-20 17:12:11,507 - lava_callback - INFO - Starting async job submit for node 69badcd621a77312e222193e
2026-03-20 17:12:11,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:12:11,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69badcd621a77312e222193e HTTP/1.1" 200 None
2026-03-20 17:12:11,522 - lava_callback - DEBUG - Processing node 69badcd621a77312e222193e: baseline-arm64-clabbe
2026-03-20 17:12:11,523 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69badcd621a77312e222193e
2026-03-20 17:12:11,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:12:11,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69badcd621a77312e222193e HTTP/1.1" 200 None
2026-03-20 17:12:11,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:12:11,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None
2026-03-20 17:12:11,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:12:11,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69badcd621a77312e222193e HTTP/1.1" 200 None
2026-03-20 17:12:11,606 - lava_callback - ERROR - Error processing callback for node 69badcd621a77312e222193e: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:37512 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:37528 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40080 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36872 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43950 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:12:51,569 - lava_callback - INFO - Received callback for node 69bd7ff50e93e2314723ec43
INFO: 172.19.0.1:48006 - "POST /node/69bd7ff50e93e2314723ec43 HTTP/1.0" 202 Accepted
2026-03-20 17:12:51,575 - lava_callback - INFO - Starting async job submit for node 69bd7ff50e93e2314723ec43
2026-03-20 17:12:51,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:12:51,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7ff50e93e2314723ec43 HTTP/1.1" 200 None
2026-03-20 17:12:51,592 - lava_callback - DEBUG - Processing node 69bd7ff50e93e2314723ec43: baseline-nfs-arm64
2026-03-20 17:12:51,594 - lava_callback - WARNING - Failed to upload log
2026-03-20 17:12:51,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:12:51,748 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:12:51,750 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd7ff50e93e2314723ec43/lava-logs.yaml
2026-03-20 17:12:51,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:12:51,894 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:12:51,896 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd7ff50e93e2314723ec43/lava_callback.json.gz
2026-03-20 17:12:51,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:12:51,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7ff50e93e2314723ec43 HTTP/1.1" 200 None
2026-03-20 17:12:51,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:12:51,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 17:12:51,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:12:51,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7ff50e93e2314723ec43 HTTP/1.1" 200 None
2026-03-20 17:12:51,974 - lava_callback - INFO - Completed processing callback for node 69bd7ff50e93e2314723ec43
INFO: 172.19.0.1:48020 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48036 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46906 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:13:10,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:13:10,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:47100 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:47106 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52296 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59984 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53366 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55304 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55310 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44152 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:14:11,521 - lava_callback - INFO - Received callback for node 69badd5321a77312e2221959
INFO: 172.19.0.1:42158 - "POST /node/69badd5321a77312e2221959 HTTP/1.0" 202 Accepted
2026-03-20 17:14:11,527 - lava_callback - INFO - Starting async job submit for node 69badd5321a77312e2221959
2026-03-20 17:14:11,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:14:11,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69badd5321a77312e2221959 HTTP/1.1" 200 None
2026-03-20 17:14:11,546 - lava_callback - DEBUG - Processing node 69badd5321a77312e2221959: baseline-arm64-clabbe
2026-03-20 17:14:11,546 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69badd5321a77312e2221959
2026-03-20 17:14:11,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:14:11,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69badd5321a77312e2221959 HTTP/1.1" 200 None
2026-03-20 17:14:11,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:14:11,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None
2026-03-20 17:14:11,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:14:11,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69badd5321a77312e2221959 HTTP/1.1" 200 None
2026-03-20 17:14:11,622 - lava_callback - ERROR - Error processing callback for node 69badd5321a77312e2221959: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:42174 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:42186 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46540 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52946 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56630 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38482 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38494 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:15:05,242 - lava_callback - INFO - Received callback for node 69bd7c620e93e2314723e8ad
INFO: 172.19.0.1:35324 - "POST /node/69bd7c620e93e2314723e8ad HTTP/1.0" 202 Accepted
2026-03-20 17:15:05,248 - lava_callback - INFO - Starting async job submit for node 69bd7c620e93e2314723e8ad
2026-03-20 17:15:05,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:15:05,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7c620e93e2314723e8ad HTTP/1.1" 200 None
2026-03-20 17:15:05,336 - lava_callback - DEBUG - Processing node 69bd7c620e93e2314723e8ad: baseline-arm
2026-03-20 17:15:05,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:15:06,068 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:15:06,070 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69bd7c620e93e2314723e8ad/log.txt.gz
2026-03-20 17:15:06,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
INFO: 172.19.0.1:35340 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:15:06,636 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:15:06,638 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69bd7c620e93e2314723e8ad/lava-logs.yaml
2026-03-20 17:15:06,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:15:06,820 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:15:06,822 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69bd7c620e93e2314723e8ad/lava_callback.json.gz
DEBUG: Setup failed for 69bd7c620e93e2314723e8ad. Transitting job node result: incomplete -> fail
2026-03-20 17:15:06,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:15:06,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7c620e93e2314723e8ad HTTP/1.1" 200 None
2026-03-20 17:15:06,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:15:06,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd732d0e93e2314723e2b5 HTTP/1.1" 200 None
2026-03-20 17:15:06,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:15:07,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7c620e93e2314723e8ad HTTP/1.1" 200 None
2026-03-20 17:15:07,129 - lava_callback - INFO - Completed processing callback for node 69bd7c620e93e2314723e8ad
2026-03-20 17:15:10,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:15:10,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:38126 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:38142 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42984 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:15:31,667 - lava_callback - INFO - Received callback for node 69badda721a77312e2221966
INFO: 172.19.0.1:41314 - "POST /node/69badda721a77312e2221966 HTTP/1.0" 202 Accepted
2026-03-20 17:15:31,673 - lava_callback - INFO - Starting async job submit for node 69badda721a77312e2221966
2026-03-20 17:15:31,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:15:31,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69badda721a77312e2221966 HTTP/1.1" 200 None
2026-03-20 17:15:31,689 - lava_callback - DEBUG - Processing node 69badda721a77312e2221966: baseline-arm64-clabbe
2026-03-20 17:15:31,689 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69badda721a77312e2221966
2026-03-20 17:15:31,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:15:31,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69badda721a77312e2221966 HTTP/1.1" 200 None
2026-03-20 17:15:31,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:15:31,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None
2026-03-20 17:15:31,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:15:31,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69badda721a77312e2221966 HTTP/1.1" 200 None
2026-03-20 17:15:31,780 - lava_callback - ERROR - Error processing callback for node 69badda721a77312e2221966: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:41324 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58076 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47380 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47396 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60356 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36790 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:36800 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37184 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48796 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48296 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:16:51,674 - lava_callback - INFO - Received callback for node 69baddfb21a77312e2221977
INFO: 172.19.0.1:40730 - "POST /node/69baddfb21a77312e2221977 HTTP/1.0" 202 Accepted
2026-03-20 17:16:51,680 - lava_callback - INFO - Starting async job submit for node 69baddfb21a77312e2221977
2026-03-20 17:16:51,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:16:51,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baddfb21a77312e2221977 HTTP/1.1" 200 None
2026-03-20 17:16:51,698 - lava_callback - DEBUG - Processing node 69baddfb21a77312e2221977: baseline-arm64-clabbe
2026-03-20 17:16:51,698 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69baddfb21a77312e2221977
2026-03-20 17:16:51,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:16:51,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baddfb21a77312e2221977 HTTP/1.1" 200 None
2026-03-20 17:16:51,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:16:51,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None
2026-03-20 17:16:51,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:16:51,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baddfb21a77312e2221977 HTTP/1.1" 200 None
2026-03-20 17:16:51,766 - lava_callback - ERROR - Error processing callback for node 69baddfb21a77312e2221977: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:40746 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40750 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48318 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:17:12,717 - lava_callback - INFO - Received callback for node 69bd7c880e93e2314723e916
INFO: 172.19.0.1:56796 - "POST /node/69bd7c880e93e2314723e916 HTTP/1.0" 202 Accepted
2026-03-20 17:17:12,765 - lava_callback - INFO - Starting async job submit for node 69bd7c880e93e2314723e916
2026-03-20 17:17:12,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:17:12,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7c880e93e2314723e916 HTTP/1.1" 200 None
2026-03-20 17:17:12,805 - lava_callback - DEBUG - Processing node 69bd7c880e93e2314723e916: baseline-arm-pengutronix
2026-03-20 17:17:12,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:17:13,078 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:17:13,080 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69bd7c880e93e2314723e916/log.txt.gz
2026-03-20 17:17:13,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:17:13,341 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:17:13,343 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69bd7c880e93e2314723e916/lava-logs.yaml
2026-03-20 17:17:13,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:17:13,491 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:17:13,494 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69bd7c880e93e2314723e916/lava_callback.json.gz
DEBUG: Setup failed for 69bd7c880e93e2314723e916. Transitting job node result: incomplete -> fail
2026-03-20 17:17:13,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:17:13,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7c880e93e2314723e916 HTTP/1.1" 200 None
2026-03-20 17:17:13,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:17:13,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd732d0e93e2314723e2b5 HTTP/1.1" 200 None
2026-03-20 17:17:13,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:17:13,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7c880e93e2314723e916 HTTP/1.1" 200 None
2026-03-20 17:17:13,681 - lava_callback - INFO - Completed processing callback for node 69bd7c880e93e2314723e916
INFO: 172.19.0.1:56804 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:56810 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35760 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60484 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:17:40,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:17:40,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:36922 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43948 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43952 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52744 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60454 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:60464 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42206 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59490 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59324 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34714 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34726 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34066 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:19:11,766 - lava_callback - INFO - Received callback for node 69bade7b21a77312e2221993
INFO: 172.19.0.1:57094 - "POST /node/69bade7b21a77312e2221993 HTTP/1.0" 202 Accepted
2026-03-20 17:19:11,772 - lava_callback - INFO - Starting async job submit for node 69bade7b21a77312e2221993
2026-03-20 17:19:11,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:19:11,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bade7b21a77312e2221993 HTTP/1.1" 200 None
2026-03-20 17:19:11,789 - lava_callback - DEBUG - Processing node 69bade7b21a77312e2221993: baseline-arm64-clabbe
2026-03-20 17:19:11,790 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bade7b21a77312e2221993
2026-03-20 17:19:11,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:19:11,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bade7b21a77312e2221993 HTTP/1.1" 200 None
2026-03-20 17:19:11,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:19:11,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None
2026-03-20 17:19:11,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:19:11,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bade7b21a77312e2221993 HTTP/1.1" 200 None
2026-03-20 17:19:11,884 - lava_callback - ERROR - Error processing callback for node 69bade7b21a77312e2221993: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:57096 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:57102 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50966 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43764 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48676 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57962 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57966 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36164 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50888 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:50890 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48470 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:20:35,133 - lava_callback - INFO - Received callback for node 69bd80960e93e2314723ec57
INFO: 172.19.0.1:34020 - "POST /node/69bd80960e93e2314723ec57 HTTP/1.0" 202 Accepted
2026-03-20 17:20:35,141 - lava_callback - INFO - Starting async job submit for node 69bd80960e93e2314723ec57
2026-03-20 17:20:35,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:20:35,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd80960e93e2314723ec57 HTTP/1.1" 200 None
2026-03-20 17:20:35,191 - lava_callback - DEBUG - Processing node 69bd80960e93e2314723ec57: baseline-arm64
2026-03-20 17:20:35,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:20:35,729 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:20:35,731 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd80960e93e2314723ec57/log.txt.gz
2026-03-20 17:20:35,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:20:36,206 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:20:36,208 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd80960e93e2314723ec57/lava-logs.yaml
2026-03-20 17:20:36,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:20:36,401 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:20:36,403 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd80960e93e2314723ec57/lava_callback.json.gz
DEBUG: Setup failed for 69bd80960e93e2314723ec57. Transitting job node result: incomplete -> fail
2026-03-20 17:20:36,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:20:36,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd80960e93e2314723ec57 HTTP/1.1" 200 None
2026-03-20 17:20:36,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
INFO: 172.19.0.1:34028 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:20:36,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 17:20:36,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:20:36,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd80960e93e2314723ec57 HTTP/1.1" 200 None
2026-03-20 17:20:36,622 - lava_callback - INFO - Completed processing callback for node 69bd80960e93e2314723ec57
2026-03-20 17:20:40,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:20:40,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:54672 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:20:52,536 - lava_callback - INFO - Received callback for node 69badeef21a77312e22219ac
INFO: 172.19.0.1:38120 - "POST /node/69badeef21a77312e22219ac HTTP/1.0" 202 Accepted
2026-03-20 17:20:52,546 - lava_callback - INFO - Starting async job submit for node 69badeef21a77312e22219ac
2026-03-20 17:20:52,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:20:52,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69badeef21a77312e22219ac HTTP/1.1" 200 None
2026-03-20 17:20:52,569 - lava_callback - DEBUG - Processing node 69badeef21a77312e22219ac: baseline-arm64-baylibre
2026-03-20 17:20:52,569 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69badeef21a77312e22219ac
2026-03-20 17:20:52,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:20:52,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69badeef21a77312e22219ac HTTP/1.1" 200 None
2026-03-20 17:20:52,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:20:52,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None
2026-03-20 17:20:52,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:20:52,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69badeef21a77312e22219ac HTTP/1.1" 200 None
2026-03-20 17:20:52,639 - lava_callback - ERROR - Error processing callback for node 69badeef21a77312e22219ac: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:38136 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38146 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58190 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46144 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:46160 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47960 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40392 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44008 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58706 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58710 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51548 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60916 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:60918 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54200 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:22:31,433 - lava_callback - INFO - Received callback for node 69bd7af00e93e2314723e770
INFO: 172.19.0.1:40206 - "POST /node/69bd7af00e93e2314723e770 HTTP/1.0" 202 Accepted
2026-03-20 17:22:31,439 - lava_callback - INFO - Starting async job submit for node 69bd7af00e93e2314723e770
2026-03-20 17:22:31,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:22:31,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7af00e93e2314723e770 HTTP/1.1" 200 None
2026-03-20 17:22:31,477 - lava_callback - DEBUG - Processing node 69bd7af00e93e2314723e770: baseline-arm64-broonie
2026-03-20 17:22:31,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:22:31,857 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:22:31,859 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bd7af00e93e2314723e770/log.txt.gz
2026-03-20 17:22:32,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:22:32,236 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:22:32,238 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bd7af00e93e2314723e770/lava-logs.yaml
2026-03-20 17:22:32,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:22:32,394 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:22:32,396 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bd7af00e93e2314723e770/lava_callback.json.gz
2026-03-20 17:22:32,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:22:32,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7af00e93e2314723e770 HTTP/1.1" 200 None
2026-03-20 17:22:32,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:22:32,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 17:22:32,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:22:32,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7af00e93e2314723e770 HTTP/1.1" 200 None
2026-03-20 17:22:32,484 - lava_callback - INFO - Completed processing callback for node 69bd7af00e93e2314723e770
2026-03-20 17:22:32,612 - lava_callback - INFO - Received callback for node 69badf4421a77312e22219b6
INFO: 172.19.0.1:40222 - "POST /node/69badf4421a77312e22219b6 HTTP/1.0" 202 Accepted
2026-03-20 17:22:32,618 - lava_callback - INFO - Starting async job submit for node 69badf4421a77312e22219b6
2026-03-20 17:22:32,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:22:32,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69badf4421a77312e22219b6 HTTP/1.1" 200 None
2026-03-20 17:22:32,635 - lava_callback - DEBUG - Processing node 69badf4421a77312e22219b6: baseline-arm64-baylibre
2026-03-20 17:22:32,636 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69badf4421a77312e22219b6
2026-03-20 17:22:32,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:22:32,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69badf4421a77312e22219b6 HTTP/1.1" 200 None
2026-03-20 17:22:32,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:22:32,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None
2026-03-20 17:22:32,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:22:32,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69badf4421a77312e22219b6 HTTP/1.1" 200 None
2026-03-20 17:22:32,722 - lava_callback - ERROR - Error processing callback for node 69badf4421a77312e22219b6: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:40238 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:22:40,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:22:40,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:45134 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37182 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37198 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35610 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54590 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:54596 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49492 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53086 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45644 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:23:52,615 - lava_callback - INFO - Received callback for node 69badf9921a77312e22219c1
INFO: 172.19.0.1:40916 - "POST /node/69badf9921a77312e22219c1 HTTP/1.0" 202 Accepted
2026-03-20 17:23:52,620 - lava_callback - INFO - Starting async job submit for node 69badf9921a77312e22219c1
2026-03-20 17:23:52,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:23:52,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69badf9921a77312e22219c1 HTTP/1.1" 200 None
2026-03-20 17:23:52,641 - lava_callback - DEBUG - Processing node 69badf9921a77312e22219c1: baseline-arm64-baylibre
2026-03-20 17:23:52,641 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69badf9921a77312e22219c1
2026-03-20 17:23:52,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:23:52,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69badf9921a77312e22219c1 HTTP/1.1" 200 None
2026-03-20 17:23:52,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:23:52,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None
2026-03-20 17:23:52,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:23:52,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69badf9921a77312e22219c1 HTTP/1.1" 200 None
2026-03-20 17:23:52,715 - lava_callback - ERROR - Error processing callback for node 69badf9921a77312e22219c1: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:40920 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40936 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33176 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54000 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:54002 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49640 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54260 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44538 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37060 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37066 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53630 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35692 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:35702 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57272 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46082 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:32928 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36620 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36636 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51666 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33106 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:33110 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48998 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59956 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53110 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51664 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51666 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48094 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54096 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:54104 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46772 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43718 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56218 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:27:53,051 - lava_callback - INFO - Received callback for node 69bae09721a77312e22219ee
INFO: 172.19.0.1:58562 - "POST /node/69bae09721a77312e22219ee HTTP/1.0" 202 Accepted
2026-03-20 17:27:53,056 - lava_callback - INFO - Starting async job submit for node 69bae09721a77312e22219ee
2026-03-20 17:27:53,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:27:53,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bae09721a77312e22219ee HTTP/1.1" 200 None
2026-03-20 17:27:53,072 - lava_callback - DEBUG - Processing node 69bae09721a77312e22219ee: baseline-arm64-baylibre
2026-03-20 17:27:53,072 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bae09721a77312e22219ee
2026-03-20 17:27:53,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:27:53,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bae09721a77312e22219ee HTTP/1.1" 200 None
2026-03-20 17:27:53,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:27:53,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None
2026-03-20 17:27:53,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:27:53,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bae09721a77312e22219ee HTTP/1.1" 200 None
2026-03-20 17:27:53,145 - lava_callback - ERROR - Error processing callback for node 69bae09721a77312e22219ee: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:58576 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58580 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:28:04,321 - lava_callback - INFO - Received callback for node 69bd81890e93e2314723ec89
INFO: 172.19.0.1:34620 - "POST /node/69bd81890e93e2314723ec89 HTTP/1.0" 202 Accepted
2026-03-20 17:28:04,327 - lava_callback - INFO - Starting async job submit for node 69bd81890e93e2314723ec89
2026-03-20 17:28:04,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:28:04,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd81890e93e2314723ec89 HTTP/1.1" 200 None
2026-03-20 17:28:04,372 - lava_callback - DEBUG - Processing node 69bd81890e93e2314723ec89: baseline-arm64
2026-03-20 17:28:04,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:28:04,722 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:28:04,724 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd81890e93e2314723ec89/log.txt.gz
2026-03-20 17:28:04,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:28:05,067 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:28:05,069 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd81890e93e2314723ec89/lava-logs.yaml
2026-03-20 17:28:05,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:28:05,225 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:28:05,226 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd81890e93e2314723ec89/lava_callback.json.gz
2026-03-20 17:28:05,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:28:05,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd81890e93e2314723ec89 HTTP/1.1" 200 None
2026-03-20 17:28:05,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:28:05,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 17:28:05,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:28:05,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd81890e93e2314723ec89 HTTP/1.1" 200 None
2026-03-20 17:28:05,389 - lava_callback - INFO - Completed processing callback for node 69bd81890e93e2314723ec89
INFO: 172.19.0.1:34630 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:28:10,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:28:10,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:44288 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:44290 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36744 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50096 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49016 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50130 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50138 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35046 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38990 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:39006 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38206 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:32880 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58552 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57468 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57476 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43108 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39508 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:39510 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52410 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42784 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46198 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37758 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37768 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43326 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:31:07,451 - lava_callback - INFO - Received callback for node 69bd7ae30e93e2314723e74b
INFO: 172.19.0.1:43330 - "POST /node/69bd7ae30e93e2314723e74b HTTP/1.0" 202 Accepted
2026-03-20 17:31:07,457 - lava_callback - INFO - Starting async job submit for node 69bd7ae30e93e2314723e74b
2026-03-20 17:31:07,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:31:07,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7ae30e93e2314723e74b HTTP/1.1" 200 None
2026-03-20 17:31:07,495 - lava_callback - DEBUG - Processing node 69bd7ae30e93e2314723e74b: baseline-arm64-broonie
2026-03-20 17:31:07,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:31:07,927 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:31:07,928 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bd7ae30e93e2314723e74b/log.txt.gz
2026-03-20 17:31:08,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:31:08,296 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:31:08,298 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bd7ae30e93e2314723e74b/lava-logs.yaml
2026-03-20 17:31:08,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:31:08,480 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:31:08,482 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bd7ae30e93e2314723e74b/lava_callback.json.gz
2026-03-20 17:31:08,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:31:08,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7ae30e93e2314723e74b HTTP/1.1" 200 None
2026-03-20 17:31:08,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:31:08,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 17:31:08,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:31:08,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7ae30e93e2314723e74b HTTP/1.1" 200 None
2026-03-20 17:31:08,567 - lava_callback - INFO - Completed processing callback for node 69bd7ae30e93e2314723e74b
2026-03-20 17:31:10,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:31:10,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:35270 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:35272 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33498 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39946 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49990 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36306 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36310 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48786 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:32:13,399 - lava_callback - INFO - Received callback for node 69bae19521a77312e2221a18
INFO: 172.19.0.1:35630 - "POST /node/69bae19521a77312e2221a18 HTTP/1.0" 202 Accepted
2026-03-20 17:32:13,404 - lava_callback - INFO - Starting async job submit for node 69bae19521a77312e2221a18
2026-03-20 17:32:13,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:32:13,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bae19521a77312e2221a18 HTTP/1.1" 200 None
2026-03-20 17:32:13,421 - lava_callback - DEBUG - Processing node 69bae19521a77312e2221a18: baseline-arm64-baylibre
2026-03-20 17:32:13,421 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bae19521a77312e2221a18
2026-03-20 17:32:13,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:32:13,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bae19521a77312e2221a18 HTTP/1.1" 200 None
2026-03-20 17:32:13,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:32:13,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None
2026-03-20 17:32:13,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:32:13,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bae19521a77312e2221a18 HTTP/1.1" 200 None
2026-03-20 17:32:13,472 - lava_callback - ERROR - Error processing callback for node 69bae19521a77312e2221a18: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:35632 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:35648 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48862 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34320 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44836 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54378 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54382 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53642 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53192 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:53208 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36910 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43322 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59018 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55450 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55458 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56630 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53792 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:53806 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41688 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47638 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58346 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45428 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45430 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55358 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54242 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:54246 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38716 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54678 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34724 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45838 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45846 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43108 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:36:13,330 - lava_callback - INFO - Received callback for node 69bae27d21a77312e2221a38
INFO: 172.19.0.1:59454 - "POST /node/69bae27d21a77312e2221a38 HTTP/1.0" 202 Accepted
2026-03-20 17:36:13,336 - lava_callback - INFO - Starting async job submit for node 69bae27d21a77312e2221a38
2026-03-20 17:36:13,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:36:13,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bae27d21a77312e2221a38 HTTP/1.1" 200 None
2026-03-20 17:36:13,354 - lava_callback - DEBUG - Processing node 69bae27d21a77312e2221a38: baseline-arm64-baylibre
2026-03-20 17:36:13,355 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bae27d21a77312e2221a38
2026-03-20 17:36:13,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:36:13,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bae27d21a77312e2221a38 HTTP/1.1" 200 None
2026-03-20 17:36:13,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:36:13,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None
2026-03-20 17:36:13,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:36:13,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bae27d21a77312e2221a38 HTTP/1.1" 200 None
2026-03-20 17:36:13,412 - lava_callback - ERROR - Error processing callback for node 69bae27d21a77312e2221a38: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:59460 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:59466 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52482 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54104 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36018 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35758 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35760 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53718 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56174 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:56184 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49978 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:37:33,521 - lava_callback - INFO - Received callback for node 69bae2d821a77312e2221a44
INFO: 172.19.0.1:33694 - "POST /node/69bae2d821a77312e2221a44 HTTP/1.0" 202 Accepted
2026-03-20 17:37:33,526 - lava_callback - INFO - Starting async job submit for node 69bae2d821a77312e2221a44
2026-03-20 17:37:33,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:37:33,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bae2d821a77312e2221a44 HTTP/1.1" 200 None
2026-03-20 17:37:33,547 - lava_callback - DEBUG - Processing node 69bae2d821a77312e2221a44: baseline-arm64-baylibre
2026-03-20 17:37:33,547 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bae2d821a77312e2221a44
2026-03-20 17:37:33,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:37:33,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bae2d821a77312e2221a44 HTTP/1.1" 200 None
2026-03-20 17:37:33,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:37:33,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None
2026-03-20 17:37:33,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:37:33,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bae2d821a77312e2221a44 HTTP/1.1" 200 None
2026-03-20 17:37:33,605 - lava_callback - ERROR - Error processing callback for node 69bae2d821a77312e2221a44: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:33706 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36622 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58166 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58180 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35440 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54000 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:54004 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41756 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34876 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49188 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:38:53,431 - lava_callback - INFO - Received callback for node 69bae32821a77312e2221a4c
INFO: 172.19.0.1:60058 - "POST /node/69bae32821a77312e2221a4c HTTP/1.0" 202 Accepted
2026-03-20 17:38:53,437 - lava_callback - INFO - Starting async job submit for node 69bae32821a77312e2221a4c
2026-03-20 17:38:53,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:38:53,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bae32821a77312e2221a4c HTTP/1.1" 200 None
2026-03-20 17:38:53,453 - lava_callback - DEBUG - Processing node 69bae32821a77312e2221a4c: baseline-arm64-baylibre
2026-03-20 17:38:53,454 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bae32821a77312e2221a4c
2026-03-20 17:38:53,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:38:53,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bae32821a77312e2221a4c HTTP/1.1" 200 None
2026-03-20 17:38:53,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:38:53,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None
2026-03-20 17:38:53,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:38:53,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bae32821a77312e2221a4c HTTP/1.1" 200 None
2026-03-20 17:38:53,517 - lava_callback - ERROR - Error processing callback for node 69bae32821a77312e2221a4c: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:60070 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60086 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46858 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49072 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:49082 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47452 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60442 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43056 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40500 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40506 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42682 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44958 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:44966 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59320 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52840 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45698 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34610 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34616 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33398 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54362 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:54376 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45712 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59990 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43668 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:41:52,802 - lava_callback - INFO - Received callback for node 69bae3dd21a77312e2221a62
INFO: 172.19.0.1:38828 - "POST /node/69bae3dd21a77312e2221a62 HTTP/1.0" 202 Accepted
2026-03-20 17:41:52,807 - lava_callback - INFO - Starting async job submit for node 69bae3dd21a77312e2221a62
2026-03-20 17:41:52,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:41:52,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bae3dd21a77312e2221a62 HTTP/1.1" 200 None
2026-03-20 17:41:52,822 - lava_callback - DEBUG - Processing node 69bae3dd21a77312e2221a62: baseline-arm64-clabbe
2026-03-20 17:41:52,823 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bae3dd21a77312e2221a62
2026-03-20 17:41:52,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:41:52,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bae3dd21a77312e2221a62 HTTP/1.1" 200 None
2026-03-20 17:41:52,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:41:52,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None
2026-03-20 17:41:52,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:41:52,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bae3dd21a77312e2221a62 HTTP/1.1" 200 None
2026-03-20 17:41:52,889 - lava_callback - ERROR - Error processing callback for node 69bae3dd21a77312e2221a62: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:38832 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38844 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42004 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33840 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:33848 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50402 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56070 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37290 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34712 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34724 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56520 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:43:13,979 - lava_callback - INFO - Received callback for node 69bae42821a77312e2221a6d
INFO: 172.19.0.1:53116 - "POST /node/69bae42821a77312e2221a6d HTTP/1.0" 202 Accepted
2026-03-20 17:43:13,984 - lava_callback - INFO - Starting async job submit for node 69bae42821a77312e2221a6d
2026-03-20 17:43:13,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:43:14,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bae42821a77312e2221a6d HTTP/1.1" 200 None
2026-03-20 17:43:14,027 - lava_callback - DEBUG - Processing node 69bae42821a77312e2221a6d: baseline-arm64-baylibre
2026-03-20 17:43:14,028 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bae42821a77312e2221a6d
2026-03-20 17:43:14,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:43:14,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bae42821a77312e2221a6d HTTP/1.1" 200 None
2026-03-20 17:43:14,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:43:14,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None
2026-03-20 17:43:14,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:43:14,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bae42821a77312e2221a6d HTTP/1.1" 200 None
2026-03-20 17:43:14,088 - lava_callback - ERROR - Error processing callback for node 69bae42821a77312e2221a6d: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:53124 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:53132 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38090 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37882 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53878 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34192 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34202 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46136 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53802 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:53808 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51322 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42576 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39042 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:44:52,919 - lava_callback - INFO - Received callback for node 69bae48521a77312e2221a7b
INFO: 172.19.0.1:54846 - "POST /node/69bae48521a77312e2221a7b HTTP/1.0" 202 Accepted
2026-03-20 17:44:52,924 - lava_callback - INFO - Starting async job submit for node 69bae48521a77312e2221a7b
2026-03-20 17:44:52,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:44:52,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bae48521a77312e2221a7b HTTP/1.1" 200 None
2026-03-20 17:44:52,951 - lava_callback - DEBUG - Processing node 69bae48521a77312e2221a7b: baseline-arm64-clabbe
2026-03-20 17:44:52,951 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bae48521a77312e2221a7b
2026-03-20 17:44:52,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:44:52,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bae48521a77312e2221a7b HTTP/1.1" 200 None
2026-03-20 17:44:52,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:44:52,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None
2026-03-20 17:44:52,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:44:53,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bae48521a77312e2221a7b HTTP/1.1" 200 None
2026-03-20 17:44:53,010 - lava_callback - ERROR - Error processing callback for node 69bae48521a77312e2221a7b: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:54860 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54870 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34238 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35986 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:35994 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38462 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40106 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:45:43,395 - lava_callback - INFO - Received callback for node 69bd7ae00e93e2314723e740
INFO: 172.19.0.1:49156 - "POST /node/69bd7ae00e93e2314723e740 HTTP/1.0" 202 Accepted
2026-03-20 17:45:43,401 - lava_callback - INFO - Starting async job submit for node 69bd7ae00e93e2314723e740
2026-03-20 17:45:43,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:45:43,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7ae00e93e2314723e740 HTTP/1.1" 200 None
2026-03-20 17:45:43,439 - lava_callback - DEBUG - Processing node 69bd7ae00e93e2314723e740: baseline-arm64-broonie
2026-03-20 17:45:43,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:45:43,857 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:45:43,859 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bd7ae00e93e2314723e740/log.txt.gz
2026-03-20 17:45:44,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:45:44,224 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:45:44,226 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bd7ae00e93e2314723e740/lava-logs.yaml
2026-03-20 17:45:44,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:45:44,374 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:45:44,376 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bd7ae00e93e2314723e740/lava_callback.json.gz
2026-03-20 17:45:44,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:45:44,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7ae00e93e2314723e740 HTTP/1.1" 200 None
2026-03-20 17:45:44,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:45:44,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 17:45:44,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:45:44,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7ae00e93e2314723e740 HTTP/1.1" 200 None
2026-03-20 17:45:44,469 - lava_callback - INFO - Completed processing callback for node 69bd7ae00e93e2314723e740
INFO: 172.19.0.1:49168 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40390 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40400 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42234 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:46:10,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:46:10,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:47924 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:47932 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35866 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:46:35,069 - lava_callback - INFO - Received callback for node 69bd87b30e93e2314723ed74
INFO: 172.19.0.1:37438 - "POST /node/69bd87b30e93e2314723ed74 HTTP/1.0" 202 Accepted
2026-03-20 17:46:35,076 - lava_callback - INFO - Starting async job submit for node 69bd87b30e93e2314723ed74
2026-03-20 17:46:35,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:46:35,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd87b30e93e2314723ed74 HTTP/1.1" 200 None
2026-03-20 17:46:35,141 - lava_callback - DEBUG - Processing node 69bd87b30e93e2314723ed74: baseline-arm64
2026-03-20 17:46:35,278 - lava_callback - WARNING - Failed to upload log
2026-03-20 17:46:35,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:46:35,531 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:46:35,533 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd87b30e93e2314723ed74/lava-logs.yaml
2026-03-20 17:46:35,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:46:35,666 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:46:35,668 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd87b30e93e2314723ed74/lava_callback.json.gz
2026-03-20 17:46:35,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:46:35,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd87b30e93e2314723ed74 HTTP/1.1" 200 None
2026-03-20 17:46:35,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:46:35,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 17:46:35,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:46:35,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd87b30e93e2314723ed74 HTTP/1.1" 200 None
2026-03-20 17:46:35,828 - lava_callback - INFO - Completed processing callback for node 69bd87b30e93e2314723ed74
INFO: 172.19.0.1:37442 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:46:40,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:46:40,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:36216 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56030 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56032 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59888 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55868 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:55872 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37080 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:47:33,936 - lava_callback - INFO - Received callback for node 69bae52221a77312e2221a8e
INFO: 172.19.0.1:59956 - "POST /node/69bae52221a77312e2221a8e HTTP/1.0" 202 Accepted
2026-03-20 17:47:33,942 - lava_callback - INFO - Starting async job submit for node 69bae52221a77312e2221a8e
2026-03-20 17:47:33,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:47:33,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bae52221a77312e2221a8e HTTP/1.1" 200 None
2026-03-20 17:47:33,963 - lava_callback - DEBUG - Processing node 69bae52221a77312e2221a8e: baseline-arm64-baylibre
2026-03-20 17:47:33,964 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bae52221a77312e2221a8e
2026-03-20 17:47:33,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:47:33,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bae52221a77312e2221a8e HTTP/1.1" 200 None
2026-03-20 17:47:33,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:47:33,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None
2026-03-20 17:47:33,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:47:34,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bae52221a77312e2221a8e HTTP/1.1" 200 None
2026-03-20 17:47:34,027 - lava_callback - ERROR - Error processing callback for node 69bae52221a77312e2221a8e: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:59962 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53830 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38246 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38260 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35946 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48236 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:48240 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33900 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48974 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60192 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56362 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56368 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58768 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41560 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:41566 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46162 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53804 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56484 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39044 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39052 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36388 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:50:14,394 - lava_callback - INFO - Received callback for node 69bae5c621a77312e2221aa5
INFO: 172.19.0.1:51488 - "POST /node/69bae5c621a77312e2221aa5 HTTP/1.0" 202 Accepted
2026-03-20 17:50:14,399 - lava_callback - INFO - Starting async job submit for node 69bae5c621a77312e2221aa5
2026-03-20 17:50:14,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:50:14,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bae5c621a77312e2221aa5 HTTP/1.1" 200 None
2026-03-20 17:50:14,425 - lava_callback - DEBUG - Processing node 69bae5c621a77312e2221aa5: baseline-arm64-baylibre
2026-03-20 17:50:14,426 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bae5c621a77312e2221aa5
2026-03-20 17:50:14,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:50:14,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bae5c621a77312e2221aa5 HTTP/1.1" 200 None
2026-03-20 17:50:14,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:50:14,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None
2026-03-20 17:50:14,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:50:14,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bae5c621a77312e2221aa5 HTTP/1.1" 200 None
2026-03-20 17:50:14,487 - lava_callback - ERROR - Error processing callback for node 69bae5c621a77312e2221aa5: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:51494 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:51506 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38800 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39588 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:32816 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49576 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49582 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33712 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51822 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:51832 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60186 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:51:33,225 - lava_callback - INFO - Received callback for node 69bae62121a77312e2221aae
INFO: 172.19.0.1:47824 - "POST /node/69bae62121a77312e2221aae HTTP/1.0" 202 Accepted
2026-03-20 17:51:33,231 - lava_callback - INFO - Starting async job submit for node 69bae62121a77312e2221aae
2026-03-20 17:51:33,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:51:33,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bae62121a77312e2221aae HTTP/1.1" 200 None
2026-03-20 17:51:33,247 - lava_callback - DEBUG - Processing node 69bae62121a77312e2221aae: baseline-arm64-clabbe
2026-03-20 17:51:33,247 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bae62121a77312e2221aae
2026-03-20 17:51:33,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:51:33,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bae62121a77312e2221aae HTTP/1.1" 200 None
2026-03-20 17:51:33,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:51:33,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None
2026-03-20 17:51:33,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:51:33,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bae62121a77312e2221aae HTTP/1.1" 200 None
2026-03-20 17:51:33,327 - lava_callback - ERROR - Error processing callback for node 69bae62121a77312e2221aae: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:47830 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58388 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37072 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37080 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38062 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55290 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:55306 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60380 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41790 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46198 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39028 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39030 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:53:06,351 - lava_callback - INFO - Received callback for node 69bd86280e93e2314723ed41
INFO: 172.19.0.1:58810 - "POST /node/69bd86280e93e2314723ed41 HTTP/1.0" 202 Accepted
2026-03-20 17:53:06,363 - lava_callback - INFO - Starting async job submit for node 69bd86280e93e2314723ed41
2026-03-20 17:53:06,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:53:06,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd86280e93e2314723ed41 HTTP/1.1" 200 None
2026-03-20 17:53:06,435 - lava_callback - DEBUG - Processing node 69bd86280e93e2314723ed41: baseline-arm64
INFO: 172.19.0.1:58812 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:53:07,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:53:07,604 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:53:07,605 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd86280e93e2314723ed41/log.txt.gz
2026-03-20 17:53:08,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:53:08,409 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:53:08,411 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd86280e93e2314723ed41/lava-logs.yaml
2026-03-20 17:53:08,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:53:08,623 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:53:08,626 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd86280e93e2314723ed41/lava_callback.json.gz
DEBUG: Setup failed for 69bd86280e93e2314723ed41. Transitting job node result: incomplete -> fail
2026-03-20 17:53:08,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:53:08,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd86280e93e2314723ed41 HTTP/1.1" 200 None
2026-03-20 17:53:08,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:53:08,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 17:53:08,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:53:08,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd86280e93e2314723ed41 HTTP/1.1" 200 None
2026-03-20 17:53:08,938 - lava_callback - INFO - Completed processing callback for node 69bd86280e93e2314723ed41
2026-03-20 17:53:10,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:53:10,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
2026-03-20 17:53:13,256 - lava_callback - INFO - Received callback for node 69bae67321a77312e2221ab7
INFO: 172.19.0.1:41922 - "POST /node/69bae67321a77312e2221ab7 HTTP/1.0" 202 Accepted
2026-03-20 17:53:13,262 - lava_callback - INFO - Starting async job submit for node 69bae67321a77312e2221ab7
2026-03-20 17:53:13,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:53:13,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bae67321a77312e2221ab7 HTTP/1.1" 200 None
2026-03-20 17:53:13,283 - lava_callback - DEBUG - Processing node 69bae67321a77312e2221ab7: baseline-arm64-clabbe
2026-03-20 17:53:13,283 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bae67321a77312e2221ab7
2026-03-20 17:53:13,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:53:13,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bae67321a77312e2221ab7 HTTP/1.1" 200 None
2026-03-20 17:53:13,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:53:13,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None
2026-03-20 17:53:13,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:53:13,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bae67321a77312e2221ab7 HTTP/1.1" 200 None
2026-03-20 17:53:13,354 - lava_callback - ERROR - Error processing callback for node 69bae67321a77312e2221ab7: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:41928 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:41942 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33258 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37574 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38174 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47010 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47022 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51166 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:54:14,384 - lava_callback - INFO - Received callback for node 69bae6be21a77312e2221ac5
INFO: 172.19.0.1:53708 - "POST /node/69bae6be21a77312e2221ac5 HTTP/1.0" 202 Accepted
2026-03-20 17:54:14,389 - lava_callback - INFO - Starting async job submit for node 69bae6be21a77312e2221ac5
2026-03-20 17:54:14,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:54:14,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bae6be21a77312e2221ac5 HTTP/1.1" 200 None
2026-03-20 17:54:14,406 - lava_callback - DEBUG - Processing node 69bae6be21a77312e2221ac5: baseline-arm64-baylibre
2026-03-20 17:54:14,406 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bae6be21a77312e2221ac5
2026-03-20 17:54:14,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:54:14,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bae6be21a77312e2221ac5 HTTP/1.1" 200 None
2026-03-20 17:54:14,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:54:14,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None
2026-03-20 17:54:14,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:54:14,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bae6be21a77312e2221ac5 HTTP/1.1" 200 None
2026-03-20 17:54:14,471 - lava_callback - ERROR - Error processing callback for node 69bae6be21a77312e2221ac5: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:53712 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:53720 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58712 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37090 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35846 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51866 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51878 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34662 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59446 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:59458 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44720 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42678 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38070 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:55:53,472 - lava_callback - INFO - Received callback for node 69bae71721a77312e2221acf
INFO: 172.19.0.1:52388 - "POST /node/69bae71721a77312e2221acf HTTP/1.0" 202 Accepted
2026-03-20 17:55:53,477 - lava_callback - INFO - Starting async job submit for node 69bae71721a77312e2221acf
2026-03-20 17:55:53,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:55:53,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bae71721a77312e2221acf HTTP/1.1" 200 None
2026-03-20 17:55:53,494 - lava_callback - DEBUG - Processing node 69bae71721a77312e2221acf: baseline-arm64-clabbe
2026-03-20 17:55:53,494 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bae71721a77312e2221acf
2026-03-20 17:55:53,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:55:53,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bae71721a77312e2221acf HTTP/1.1" 200 None
2026-03-20 17:55:53,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:55:53,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None
2026-03-20 17:55:53,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:55:53,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bae71721a77312e2221acf HTTP/1.1" 200 None
2026-03-20 17:55:53,554 - lava_callback - ERROR - Error processing callback for node 69bae71721a77312e2221acf: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:52390 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52402 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51064 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51668 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:51684 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45060 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59064 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46070 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46676 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46692 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57866 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:57:13,488 - lava_callback - INFO - Received callback for node 69bae76921a77312e2221ad4
INFO: 172.19.0.1:48306 - "POST /node/69bae76921a77312e2221ad4 HTTP/1.0" 202 Accepted
2026-03-20 17:57:13,493 - lava_callback - INFO - Starting async job submit for node 69bae76921a77312e2221ad4
2026-03-20 17:57:13,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:57:13,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bae76921a77312e2221ad4 HTTP/1.1" 200 None
2026-03-20 17:57:13,512 - lava_callback - DEBUG - Processing node 69bae76921a77312e2221ad4: baseline-arm64-clabbe
2026-03-20 17:57:13,513 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bae76921a77312e2221ad4
2026-03-20 17:57:13,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:57:13,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bae76921a77312e2221ad4 HTTP/1.1" 200 None
2026-03-20 17:57:13,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:57:13,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None
2026-03-20 17:57:13,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:57:13,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bae76921a77312e2221ad4 HTTP/1.1" 200 None
2026-03-20 17:57:13,623 - lava_callback - ERROR - Error processing callback for node 69bae76921a77312e2221ad4: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:48308 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:48316 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:57:24,779 - lava_callback - INFO - Received callback for node 69bd8a710e93e231472414b5
INFO: 172.19.0.1:52410 - "POST /node/69bd8a710e93e231472414b5 HTTP/1.0" 202 Accepted
2026-03-20 17:57:24,785 - lava_callback - INFO - Starting async job submit for node 69bd8a710e93e231472414b5
2026-03-20 17:57:24,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:57:24,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd8a710e93e231472414b5 HTTP/1.1" 200 None
2026-03-20 17:57:24,802 - lava_callback - DEBUG - Processing node 69bd8a710e93e231472414b5: baseline-arm
2026-03-20 17:57:24,807 - lava_callback - WARNING - Failed to upload log
2026-03-20 17:57:24,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:57:24,968 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:57:24,969 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69bd8a710e93e231472414b5/lava-logs.yaml
2026-03-20 17:57:24,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:57:25,123 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:57:25,125 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69bd8a710e93e231472414b5/lava_callback.json.gz
2026-03-20 17:57:25,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:57:25,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd8a710e93e231472414b5 HTTP/1.1" 200 None
2026-03-20 17:57:25,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:57:25,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd732d0e93e2314723e2b5 HTTP/1.1" 200 None
2026-03-20 17:57:25,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:57:25,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd8a710e93e231472414b5 HTTP/1.1" 200 None
2026-03-20 17:57:25,186 - lava_callback - INFO - Completed processing callback for node 69bd8a710e93e231472414b5
INFO: 172.19.0.1:52418 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54838 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:57:40,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:57:40,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:41386 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59572 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59584 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49486 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56830 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:56842 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41378 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:58:33,486 - lava_callback - INFO - Received callback for node 69bae7bb21a77312e2221ae0
INFO: 172.19.0.1:40288 - "POST /node/69bae7bb21a77312e2221ae0 HTTP/1.0" 202 Accepted
2026-03-20 17:58:33,492 - lava_callback - INFO - Starting async job submit for node 69bae7bb21a77312e2221ae0
2026-03-20 17:58:33,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:58:33,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bae7bb21a77312e2221ae0 HTTP/1.1" 200 None
2026-03-20 17:58:33,513 - lava_callback - DEBUG - Processing node 69bae7bb21a77312e2221ae0: baseline-arm64-clabbe
2026-03-20 17:58:33,514 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bae7bb21a77312e2221ae0
2026-03-20 17:58:33,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:58:33,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bae7bb21a77312e2221ae0 HTTP/1.1" 200 None
2026-03-20 17:58:33,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:58:33,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None
2026-03-20 17:58:33,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:58:33,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bae7bb21a77312e2221ae0 HTTP/1.1" 200 None
2026-03-20 17:58:33,569 - lava_callback - ERROR - Error processing callback for node 69bae7bb21a77312e2221ae0: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:40304 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:58:40,352 - lava_callback - INFO - Received callback for node 69bd876f0e93e2314723ed69
INFO: 172.19.0.1:37022 - "POST /node/69bd876f0e93e2314723ed69 HTTP/1.0" 202 Accepted
2026-03-20 17:58:40,359 - lava_callback - INFO - Starting async job submit for node 69bd876f0e93e2314723ed69
2026-03-20 17:58:40,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:58:40,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd876f0e93e2314723ed69 HTTP/1.1" 200 None
2026-03-20 17:58:40,424 - lava_callback - DEBUG - Processing node 69bd876f0e93e2314723ed69: baseline-nfs-arm64
2026-03-20 17:58:41,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:58:41,408 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:58:41,410 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd876f0e93e2314723ed69/log.txt.gz
2026-03-20 17:58:41,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:58:42,125 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:58:42,128 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd876f0e93e2314723ed69/lava-logs.yaml
2026-03-20 17:58:42,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:58:42,303 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:58:42,304 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd876f0e93e2314723ed69/lava_callback.json.gz
DEBUG: Setup failed for 69bd876f0e93e2314723ed69. Transitting job node result: incomplete -> fail
2026-03-20 17:58:42,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:58:42,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd876f0e93e2314723ed69 HTTP/1.1" 200 None
2026-03-20 17:58:42,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:58:42,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 17:58:42,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:58:42,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd876f0e93e2314723ed69 HTTP/1.1" 200 None
2026-03-20 17:58:42,598 - lava_callback - INFO - Completed processing callback for node 69bd876f0e93e2314723ed69
INFO: 172.19.0.1:37030 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:58:47,908 - lava_callback - INFO - Received callback for node 69bd8a9a0e93e231472414cb
INFO: 172.19.0.1:37040 - "POST /node/69bd8a9a0e93e231472414cb HTTP/1.0" 202 Accepted
2026-03-20 17:58:47,915 - lava_callback - INFO - Starting async job submit for node 69bd8a9a0e93e231472414cb
2026-03-20 17:58:47,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:58:47,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd8a9a0e93e231472414cb HTTP/1.1" 200 None
2026-03-20 17:58:47,958 - lava_callback - DEBUG - Processing node 69bd8a9a0e93e231472414cb: baseline-arm64
2026-03-20 17:58:48,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:58:48,255 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:58:48,257 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd8a9a0e93e231472414cb/log.txt.gz
2026-03-20 17:58:48,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:58:48,510 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:58:48,512 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd8a9a0e93e231472414cb/lava-logs.yaml
2026-03-20 17:58:48,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 17:58:48,657 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 17:58:48,658 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd8a9a0e93e231472414cb/lava_callback.json.gz
2026-03-20 17:58:48,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:58:48,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd8a9a0e93e231472414cb HTTP/1.1" 200 None
2026-03-20 17:58:48,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:58:48,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 17:58:48,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:58:48,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd8a9a0e93e231472414cb HTTP/1.1" 200 None
2026-03-20 17:58:48,804 - lava_callback - INFO - Completed processing callback for node 69bd8a9a0e93e231472414cb
INFO: 172.19.0.1:46042 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46054 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56640 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:59:10,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:59:10,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:44038 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:44054 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35408 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40040 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44404 - "GET / HTTP/1.0" 200 OK
2026-03-20 17:59:53,559 - lava_callback - INFO - Received callback for node 69bae80e21a77312e2221aeb
INFO: 172.19.0.1:55706 - "POST /node/69bae80e21a77312e2221aeb HTTP/1.0" 202 Accepted
2026-03-20 17:59:53,565 - lava_callback - INFO - Starting async job submit for node 69bae80e21a77312e2221aeb
2026-03-20 17:59:53,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:59:53,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bae80e21a77312e2221aeb HTTP/1.1" 200 None
2026-03-20 17:59:53,581 - lava_callback - DEBUG - Processing node 69bae80e21a77312e2221aeb: baseline-arm64-clabbe
2026-03-20 17:59:53,581 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bae80e21a77312e2221aeb
2026-03-20 17:59:53,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:59:53,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bae80e21a77312e2221aeb HTTP/1.1" 200 None
2026-03-20 17:59:53,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:59:53,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None
2026-03-20 17:59:53,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 17:59:53,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bae80e21a77312e2221aeb HTTP/1.1" 200 None
2026-03-20 17:59:53,648 - lava_callback - ERROR - Error processing callback for node 69bae80e21a77312e2221aeb: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:55710 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55718 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41496 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37160 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:37166 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48412 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41652 - "GET / HTTP/1.0" 200 OK
2026-03-20 18:00:44,758 - lava_callback - INFO - Received callback for node 69bd8b000e93e231472414e8
INFO: 172.19.0.1:38600 - "POST /node/69bd8b000e93e231472414e8 HTTP/1.0" 202 Accepted
2026-03-20 18:00:44,771 - lava_callback - INFO - Starting async job submit for node 69bd8b000e93e231472414e8
2026-03-20 18:00:44,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:00:44,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd8b000e93e231472414e8 HTTP/1.1" 200 None
2026-03-20 18:00:44,835 - lava_callback - DEBUG - Processing node 69bd8b000e93e231472414e8: baseline-arm64-foundriesio
2026-03-20 18:00:45,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 18:00:45,424 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 18:00:45,425 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69bd8b000e93e231472414e8/log.txt.gz
2026-03-20 18:00:45,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 18:00:46,004 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 18:00:46,006 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69bd8b000e93e231472414e8/lava-logs.yaml
2026-03-20 18:00:46,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 18:00:46,206 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 18:00:46,208 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69bd8b000e93e231472414e8/lava_callback.json.gz
2026-03-20 18:00:46,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:00:46,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd8b000e93e231472414e8 HTTP/1.1" 200 None
2026-03-20 18:00:46,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:00:46,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 18:00:46,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:00:46,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd8b000e93e231472414e8 HTTP/1.1" 200 None
2026-03-20 18:00:46,316 - lava_callback - INFO - Completed processing callback for node 69bd8b000e93e231472414e8
INFO: 172.19.0.1:38608 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34226 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34238 - "GET / HTTP/1.0" 200 OK
2026-03-20 18:01:02,975 - lava_callback - INFO - Received callback for node 69bd7aed0e93e2314723e76d
INFO: 172.19.0.1:33226 - "POST /node/69bd7aed0e93e2314723e76d HTTP/1.0" 202 Accepted
2026-03-20 18:01:02,984 - lava_callback - INFO - Starting async job submit for node 69bd7aed0e93e2314723e76d
2026-03-20 18:01:03,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:01:03,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7aed0e93e2314723e76d HTTP/1.1" 200 None
2026-03-20 18:01:03,046 - lava_callback - DEBUG - Processing node 69bd7aed0e93e2314723e76d: baseline-arm64-broonie
2026-03-20 18:01:03,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 18:01:03,482 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 18:01:03,484 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bd7aed0e93e2314723e76d/log.txt.gz
2026-03-20 18:01:03,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 18:01:03,866 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 18:01:03,869 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bd7aed0e93e2314723e76d/lava-logs.yaml
2026-03-20 18:01:03,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 18:01:04,063 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 18:01:04,065 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bd7aed0e93e2314723e76d/lava_callback.json.gz
2026-03-20 18:01:04,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:01:04,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7aed0e93e2314723e76d HTTP/1.1" 200 None
2026-03-20 18:01:04,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:01:04,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 18:01:04,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:01:04,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7aed0e93e2314723e76d HTTP/1.1" 200 None
2026-03-20 18:01:04,191 - lava_callback - INFO - Completed processing callback for node 69bd7aed0e93e2314723e76d
INFO: 172.19.0.1:33242 - "GET / HTTP/1.0" 200 OK
2026-03-20 18:01:10,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:01:10,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
2026-03-20 18:01:13,886 - lava_callback - INFO - Received callback for node 69bae86021a77312e2221af7
INFO: 172.19.0.1:37794 - "POST /node/69bae86021a77312e2221af7 HTTP/1.0" 202 Accepted
2026-03-20 18:01:13,891 - lava_callback - INFO - Starting async job submit for node 69bae86021a77312e2221af7
2026-03-20 18:01:13,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:01:13,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bae86021a77312e2221af7 HTTP/1.1" 200 None
2026-03-20 18:01:13,908 - lava_callback - DEBUG - Processing node 69bae86021a77312e2221af7: baseline-arm64-clabbe
2026-03-20 18:01:13,908 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bae86021a77312e2221af7
2026-03-20 18:01:13,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:01:13,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bae86021a77312e2221af7 HTTP/1.1" 200 None
2026-03-20 18:01:13,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:01:13,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None
2026-03-20 18:01:13,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:01:13,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bae86021a77312e2221af7 HTTP/1.1" 200 None
2026-03-20 18:01:13,974 - lava_callback - ERROR - Error processing callback for node 69bae86021a77312e2221af7: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:37810 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:37818 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35082 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36884 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41336 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43946 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43952 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44132 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33538 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:33546 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39692 - "GET / HTTP/1.0" 200 OK
2026-03-20 18:02:33,708 - lava_callback - INFO - Received callback for node 69bae8b521a77312e2221b01
INFO: 172.19.0.1:55324 - "POST /node/69bae8b521a77312e2221b01 HTTP/1.0" 202 Accepted
2026-03-20 18:02:33,714 - lava_callback - INFO - Starting async job submit for node 69bae8b521a77312e2221b01
2026-03-20 18:02:33,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:02:33,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bae8b521a77312e2221b01 HTTP/1.1" 200 None
2026-03-20 18:02:33,734 - lava_callback - DEBUG - Processing node 69bae8b521a77312e2221b01: baseline-arm64-clabbe
2026-03-20 18:02:33,734 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bae8b521a77312e2221b01
2026-03-20 18:02:33,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:02:33,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bae8b521a77312e2221b01 HTTP/1.1" 200 None
2026-03-20 18:02:33,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:02:33,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None
2026-03-20 18:02:33,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:02:33,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bae8b521a77312e2221b01 HTTP/1.1" 200 None
2026-03-20 18:02:33,787 - lava_callback - ERROR - Error processing callback for node 69bae8b521a77312e2221b01: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:55338 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34508 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43128 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43144 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50852 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49122 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:49138 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50812 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44018 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52426 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38998 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39002 - "GET / HTTP/1.0" 200 OK
2026-03-20 18:04:04,960 - lava_callback - INFO - Received callback for node 69bd89890e93e23147241494
INFO: 172.19.0.1:58840 - "POST /node/69bd89890e93e23147241494 HTTP/1.0" 202 Accepted
2026-03-20 18:04:04,967 - lava_callback - INFO - Starting async job submit for node 69bd89890e93e23147241494
2026-03-20 18:04:04,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:04:05,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd89890e93e23147241494 HTTP/1.1" 200 None
2026-03-20 18:04:05,006 - lava_callback - DEBUG - Processing node 69bd89890e93e23147241494: baseline-arm64
2026-03-20 18:04:05,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 18:04:05,691 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 18:04:05,693 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd89890e93e23147241494/log.txt.gz
2026-03-20 18:04:05,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 18:04:06,193 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 18:04:06,195 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd89890e93e23147241494/lava-logs.yaml
2026-03-20 18:04:06,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 18:04:06,404 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 18:04:06,406 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd89890e93e23147241494/lava_callback.json.gz
2026-03-20 18:04:06,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:04:06,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd89890e93e23147241494 HTTP/1.1" 200 None
2026-03-20 18:04:06,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
INFO: 172.19.0.1:58852 - "GET / HTTP/1.0" 200 OK
2026-03-20 18:04:06,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 18:04:06,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:04:06,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd89890e93e23147241494 HTTP/1.1" 200 None
2026-03-20 18:04:06,564 - lava_callback - INFO - Completed processing callback for node 69bd89890e93e23147241494
2026-03-20 18:04:10,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:04:10,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
2026-03-20 18:04:13,729 - lava_callback - INFO - Received callback for node 69bae90821a77312e2221b0d
INFO: 172.19.0.1:53588 - "POST /node/69bae90821a77312e2221b0d HTTP/1.0" 202 Accepted
2026-03-20 18:04:13,734 - lava_callback - INFO - Starting async job submit for node 69bae90821a77312e2221b0d
2026-03-20 18:04:13,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:04:13,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bae90821a77312e2221b0d HTTP/1.1" 200 None
2026-03-20 18:04:13,756 - lava_callback - DEBUG - Processing node 69bae90821a77312e2221b0d: baseline-arm64-clabbe
2026-03-20 18:04:13,756 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bae90821a77312e2221b0d
2026-03-20 18:04:13,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:04:13,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bae90821a77312e2221b0d HTTP/1.1" 200 None
2026-03-20 18:04:13,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:04:13,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None
2026-03-20 18:04:13,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:04:13,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bae90821a77312e2221b0d HTTP/1.1" 200 None
2026-03-20 18:04:13,815 - lava_callback - ERROR - Error processing callback for node 69bae90821a77312e2221b0d: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:53598 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:53606 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50422 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51772 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50902 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44994 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45006 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47128 - "GET / HTTP/1.0" 200 OK
2026-03-20 18:05:09,009 - lava_callback - INFO - Received callback for node 69bd88280e93e2314723ed95
INFO: 172.19.0.1:47144 - "POST /node/69bd88280e93e2314723ed95 HTTP/1.0" 202 Accepted
2026-03-20 18:05:09,015 - lava_callback - INFO - Starting async job submit for node 69bd88280e93e2314723ed95
2026-03-20 18:05:09,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:05:09,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd88280e93e2314723ed95 HTTP/1.1" 200 None
2026-03-20 18:05:09,088 - lava_callback - DEBUG - Processing node 69bd88280e93e2314723ed95: ltp-smoke
2026-03-20 18:05:09,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 18:05:09,786 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 18:05:09,788 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69bd88280e93e2314723ed95/log.txt.gz
2026-03-20 18:05:10,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 18:05:10,278 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 18:05:10,280 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69bd88280e93e2314723ed95/lava-logs.yaml
2026-03-20 18:05:10,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 18:05:10,472 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 18:05:10,474 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69bd88280e93e2314723ed95/lava_callback.json.gz
2026-03-20 18:05:10,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:05:10,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd88280e93e2314723ed95 HTTP/1.1" 200 None
2026-03-20 18:05:10,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:05:10,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73350e93e2314723e2bb HTTP/1.1" 200 None
2026-03-20 18:05:10,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:05:10,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd88280e93e2314723ed95 HTTP/1.1" 200 None
2026-03-20 18:05:10,775 - lava_callback - INFO - Completed processing callback for node 69bd88280e93e2314723ed95
2026-03-20 18:05:10,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:05:10,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:55522 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:55538 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33754 - "GET / HTTP/1.0" 200 OK
2026-03-20 18:05:33,812 - lava_callback - INFO - Received callback for node 69bae95c21a77312e2221b1b
INFO: 172.19.0.1:45070 - "POST /node/69bae95c21a77312e2221b1b HTTP/1.0" 202 Accepted
2026-03-20 18:05:33,818 - lava_callback - INFO - Starting async job submit for node 69bae95c21a77312e2221b1b
2026-03-20 18:05:33,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:05:33,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bae95c21a77312e2221b1b HTTP/1.1" 200 None
2026-03-20 18:05:33,834 - lava_callback - DEBUG - Processing node 69bae95c21a77312e2221b1b: baseline-arm64-clabbe
2026-03-20 18:05:33,834 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bae95c21a77312e2221b1b
2026-03-20 18:05:33,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:05:33,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bae95c21a77312e2221b1b HTTP/1.1" 200 None
2026-03-20 18:05:33,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:05:33,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None
2026-03-20 18:05:33,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:05:33,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bae95c21a77312e2221b1b HTTP/1.1" 200 None
2026-03-20 18:05:33,891 - lava_callback - ERROR - Error processing callback for node 69bae95c21a77312e2221b1b: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:45078 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57112 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49592 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49594 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49446 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53994 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:54008 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46712 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53632 - "GET / HTTP/1.0" 200 OK
2026-03-20 18:06:40,683 - lava_callback - INFO - Received callback for node 69bd8a2c0e93e231472414ac
INFO: 172.19.0.1:41046 - "POST /node/69bd8a2c0e93e231472414ac HTTP/1.0" 202 Accepted
2026-03-20 18:06:40,689 - lava_callback - INFO - Starting async job submit for node 69bd8a2c0e93e231472414ac
2026-03-20 18:06:40,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:06:40,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd8a2c0e93e231472414ac HTTP/1.1" 200 None
2026-03-20 18:06:40,730 - lava_callback - DEBUG - Processing node 69bd8a2c0e93e231472414ac: baseline-nfs-arm64
2026-03-20 18:06:41,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 18:06:41,424 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 18:06:41,426 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd8a2c0e93e231472414ac/log.txt.gz
2026-03-20 18:06:41,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 18:06:41,934 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 18:06:41,936 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd8a2c0e93e231472414ac/lava-logs.yaml
2026-03-20 18:06:41,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 18:06:42,114 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 18:06:42,116 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd8a2c0e93e231472414ac/lava_callback.json.gz
2026-03-20 18:06:42,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:06:42,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd8a2c0e93e231472414ac HTTP/1.1" 200 None
2026-03-20 18:06:42,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:06:42,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 18:06:42,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:06:42,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd8a2c0e93e231472414ac HTTP/1.1" 200 None
2026-03-20 18:06:42,261 - lava_callback - INFO - Completed processing callback for node 69bd8a2c0e93e231472414ac
INFO: 172.19.0.1:41048 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49606 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49614 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49268 - "GET / HTTP/1.0" 200 OK
2026-03-20 18:07:11,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:07:11,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:55818 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:55824 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43310 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51468 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40076 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52968 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52982 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48514 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60880 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:60882 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34280 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33144 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37704 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51322 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51326 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57566 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53824 - "GET /api/metrics HTTP/1.0" 200 OK
2026-03-20 18:09:15,166 - lava_callback - INFO - Received callback for node 69baea4821a77312e2221b34
INFO: 172.19.0.1:53830 - "POST /node/69baea4821a77312e2221b34 HTTP/1.0" 202 Accepted
2026-03-20 18:09:15,172 - lava_callback - INFO - Starting async job submit for node 69baea4821a77312e2221b34
2026-03-20 18:09:15,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:09:15,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baea4821a77312e2221b34 HTTP/1.1" 200 None
2026-03-20 18:09:15,188 - lava_callback - DEBUG - Processing node 69baea4821a77312e2221b34: baseline-arm64-baylibre
2026-03-20 18:09:15,188 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69baea4821a77312e2221b34
2026-03-20 18:09:15,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:09:15,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baea4821a77312e2221b34 HTTP/1.1" 200 None
2026-03-20 18:09:15,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:09:15,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None
2026-03-20 18:09:15,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:09:15,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baea4821a77312e2221b34 HTTP/1.1" 200 None
2026-03-20 18:09:15,241 - lava_callback - ERROR - Error processing callback for node 69baea4821a77312e2221b34: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:53838 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39676 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35388 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37612 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49728 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49736 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49420 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42442 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:42446 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50614 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:32878 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35110 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46166 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46178 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35992 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54654 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:54670 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37842 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43544 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36560 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35760 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35768 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49820 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60606 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:60620 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55332 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44460 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59858 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33450 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33464 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56082 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54522 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:54532 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50510 - "GET / HTTP/1.0" 200 OK
2026-03-20 18:13:35,351 - lava_callback - INFO - Received callback for node 69baeb3e21a77312e2221b51
INFO: 172.19.0.1:60460 - "POST /node/69baeb3e21a77312e2221b51 HTTP/1.0" 202 Accepted
2026-03-20 18:13:35,357 - lava_callback - INFO - Starting async job submit for node 69baeb3e21a77312e2221b51
2026-03-20 18:13:35,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:13:35,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baeb3e21a77312e2221b51 HTTP/1.1" 200 None
2026-03-20 18:13:35,375 - lava_callback - DEBUG - Processing node 69baeb3e21a77312e2221b51: baseline-arm64-baylibre
2026-03-20 18:13:35,375 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69baeb3e21a77312e2221b51
2026-03-20 18:13:35,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:13:35,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baeb3e21a77312e2221b51 HTTP/1.1" 200 None
2026-03-20 18:13:35,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:13:35,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None
2026-03-20 18:13:35,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:13:35,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baeb3e21a77312e2221b51 HTTP/1.1" 200 None
2026-03-20 18:13:35,453 - lava_callback - ERROR - Error processing callback for node 69baeb3e21a77312e2221b51: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:60474 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47330 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49274 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49278 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55832 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46938 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:46944 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41068 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51652 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34566 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40838 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40850 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45180 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38856 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:38858 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52678 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46900 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37340 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51790 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51796 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42664 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51244 - "GET /api/metrics HTTP/1.0" 200 OK
2026-03-20 18:16:15,499 - lava_callback - INFO - Received callback for node 69baebe221a77312e2221b60
INFO: 172.19.0.1:51246 - "POST /node/69baebe221a77312e2221b60 HTTP/1.0" 202 Accepted
2026-03-20 18:16:15,505 - lava_callback - INFO - Starting async job submit for node 69baebe221a77312e2221b60
2026-03-20 18:16:15,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:16:15,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baebe221a77312e2221b60 HTTP/1.1" 200 None
2026-03-20 18:16:15,521 - lava_callback - DEBUG - Processing node 69baebe221a77312e2221b60: baseline-arm64-baylibre
2026-03-20 18:16:15,521 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69baebe221a77312e2221b60
2026-03-20 18:16:15,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:16:15,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baebe221a77312e2221b60 HTTP/1.1" 200 None
2026-03-20 18:16:15,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:16:15,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None
2026-03-20 18:16:15,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:16:15,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baebe221a77312e2221b60 HTTP/1.1" 200 None
2026-03-20 18:16:15,592 - lava_callback - ERROR - Error processing callback for node 69baebe221a77312e2221b60: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:51258 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48156 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53864 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59352 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33182 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33196 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40862 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56096 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:56106 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40844 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58504 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47600 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41514 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41520 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41936 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43710 - "GET /api/metrics HTTP/1.0" 200 OK
2026-03-20 18:18:15,626 - lava_callback - INFO - Received callback for node 69baec5e21a77312e2221b7a
INFO: 172.19.0.1:43718 - "POST /node/69baec5e21a77312e2221b7a HTTP/1.0" 202 Accepted
2026-03-20 18:18:15,631 - lava_callback - INFO - Starting async job submit for node 69baec5e21a77312e2221b7a
2026-03-20 18:18:15,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:18:15,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baec5e21a77312e2221b7a HTTP/1.1" 200 None
2026-03-20 18:18:15,647 - lava_callback - DEBUG - Processing node 69baec5e21a77312e2221b7a: baseline-arm64-baylibre
2026-03-20 18:18:15,647 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69baec5e21a77312e2221b7a
2026-03-20 18:18:15,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:18:15,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baec5e21a77312e2221b7a HTTP/1.1" 200 None
2026-03-20 18:18:15,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:18:15,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None
2026-03-20 18:18:15,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:18:15,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baec5e21a77312e2221b7a HTTP/1.1" 200 None
2026-03-20 18:18:15,703 - lava_callback - ERROR - Error processing callback for node 69baec5e21a77312e2221b7a: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:43724 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47908 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44760 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34800 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60048 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60060 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55478 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56310 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:56322 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60316 - "GET / HTTP/1.0" 200 OK
2026-03-20 18:19:34,379 - lava_callback - INFO - Received callback for node 69baecb421a77312e2221b7f
INFO: 172.19.0.1:48686 - "POST /node/69baecb421a77312e2221b7f HTTP/1.0" 202 Accepted
2026-03-20 18:19:34,386 - lava_callback - INFO - Starting async job submit for node 69baecb421a77312e2221b7f
2026-03-20 18:19:34,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:19:34,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baecb421a77312e2221b7f HTTP/1.1" 200 None
2026-03-20 18:19:34,403 - lava_callback - DEBUG - Processing node 69baecb421a77312e2221b7f: baseline-arm64-clabbe
2026-03-20 18:19:34,404 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69baecb421a77312e2221b7f
2026-03-20 18:19:34,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:19:34,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baecb421a77312e2221b7f HTTP/1.1" 200 None
2026-03-20 18:19:34,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:19:34,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None
2026-03-20 18:19:34,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:19:34,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baecb421a77312e2221b7f HTTP/1.1" 200 None
2026-03-20 18:19:34,463 - lava_callback - ERROR - Error processing callback for node 69baecb421a77312e2221b7f: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:48688 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36336 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54682 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54698 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49404 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40068 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:40078 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37950 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43154 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49804 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41812 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41826 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49400 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34778 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:34786 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48580 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37512 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40732 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40044 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40052 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60494 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56744 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:56756 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36892 - "GET / HTTP/1.0" 200 OK
2026-03-20 18:22:28,988 - lava_callback - INFO - Received callback for node 69bd8bb20e93e2314724151b
INFO: 172.19.0.1:36908 - "POST /node/69bd8bb20e93e2314724151b HTTP/1.0" 202 Accepted
2026-03-20 18:22:28,996 - lava_callback - INFO - Starting async job submit for node 69bd8bb20e93e2314724151b
2026-03-20 18:22:29,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:22:29,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd8bb20e93e2314724151b HTTP/1.1" 200 None
2026-03-20 18:22:29,057 - lava_callback - DEBUG - Processing node 69bd8bb20e93e2314724151b: baseline-nfs-arm64
2026-03-20 18:22:30,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 18:22:30,489 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 18:22:30,491 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd8bb20e93e2314724151b/log.txt.gz
2026-03-20 18:22:31,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 18:22:31,382 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 18:22:31,384 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd8bb20e93e2314724151b/lava-logs.yaml
2026-03-20 18:22:31,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 18:22:31,607 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 18:22:31,609 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd8bb20e93e2314724151b/lava_callback.json.gz
DEBUG: Setup failed for 69bd8bb20e93e2314724151b. Transitting job node result: incomplete -> fail
2026-03-20 18:22:31,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:22:31,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd8bb20e93e2314724151b HTTP/1.1" 200 None
2026-03-20 18:22:31,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:22:31,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 18:22:31,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:22:31,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd8bb20e93e2314724151b HTTP/1.1" 200 None
2026-03-20 18:22:31,871 - lava_callback - INFO - Completed processing callback for node 69bd8bb20e93e2314724151b
2026-03-20 18:22:34,532 - lava_callback - INFO - Received callback for node 69baed5821a77312e2221b9a
INFO: 172.19.0.1:54022 - "POST /node/69baed5821a77312e2221b9a HTTP/1.0" 202 Accepted
2026-03-20 18:22:34,538 - lava_callback - INFO - Starting async job submit for node 69baed5821a77312e2221b9a
2026-03-20 18:22:34,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:22:34,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baed5821a77312e2221b9a HTTP/1.1" 200 None
2026-03-20 18:22:34,554 - lava_callback - DEBUG - Processing node 69baed5821a77312e2221b9a: baseline-arm64-clabbe
2026-03-20 18:22:34,554 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69baed5821a77312e2221b9a
2026-03-20 18:22:34,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:22:34,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baed5821a77312e2221b9a HTTP/1.1" 200 None
2026-03-20 18:22:34,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:22:34,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None
2026-03-20 18:22:34,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:22:34,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baed5821a77312e2221b9a HTTP/1.1" 200 None
2026-03-20 18:22:34,636 - lava_callback - ERROR - Error processing callback for node 69baed5821a77312e2221b9a: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:54038 - "GET / HTTP/1.0" 200 OK
2026-03-20 18:22:41,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:22:41,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:57554 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55066 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55080 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33204 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38466 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:38468 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54980 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35740 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53682 - "GET / HTTP/1.0" 200 OK
2026-03-20 18:23:54,562 - lava_callback - INFO - Received callback for node 69baedaa21a77312e2221baa
INFO: 172.19.0.1:34696 - "POST /node/69baedaa21a77312e2221baa HTTP/1.0" 202 Accepted
2026-03-20 18:23:54,568 - lava_callback - INFO - Starting async job submit for node 69baedaa21a77312e2221baa
2026-03-20 18:23:54,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:23:54,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baedaa21a77312e2221baa HTTP/1.1" 200 None
2026-03-20 18:23:54,584 - lava_callback - DEBUG - Processing node 69baedaa21a77312e2221baa: baseline-arm64-clabbe
2026-03-20 18:23:54,584 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69baedaa21a77312e2221baa
2026-03-20 18:23:54,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:23:54,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baedaa21a77312e2221baa HTTP/1.1" 200 None
2026-03-20 18:23:54,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:23:54,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None
2026-03-20 18:23:54,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:23:54,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baedaa21a77312e2221baa HTTP/1.1" 200 None
2026-03-20 18:23:54,653 - lava_callback - ERROR - Error processing callback for node 69baedaa21a77312e2221baa: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:34702 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34718 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37066 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50282 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:50294 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40268 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58126 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33538 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56940 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56956 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40636 - "GET / HTTP/1.0" 200 OK
2026-03-20 18:25:14,541 - lava_callback - INFO - Received callback for node 69baedfd21a77312e2221baf
INFO: 172.19.0.1:60776 - "POST /node/69baedfd21a77312e2221baf HTTP/1.0" 202 Accepted
2026-03-20 18:25:14,547 - lava_callback - INFO - Starting async job submit for node 69baedfd21a77312e2221baf
2026-03-20 18:25:14,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:25:14,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baedfd21a77312e2221baf HTTP/1.1" 200 None
2026-03-20 18:25:14,563 - lava_callback - DEBUG - Processing node 69baedfd21a77312e2221baf: baseline-arm64-clabbe
2026-03-20 18:25:14,563 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69baedfd21a77312e2221baf
2026-03-20 18:25:14,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:25:14,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baedfd21a77312e2221baf HTTP/1.1" 200 None
2026-03-20 18:25:14,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:25:14,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None
2026-03-20 18:25:14,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:25:14,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baedfd21a77312e2221baf HTTP/1.1" 200 None
2026-03-20 18:25:14,624 - lava_callback - ERROR - Error processing callback for node 69baedfd21a77312e2221baf: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:60788 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:60794 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42698 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48470 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47900 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57502 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57518 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47284 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34348 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:34358 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50882 - "GET / HTTP/1.0" 200 OK
2026-03-20 18:26:34,665 - lava_callback - INFO - Received callback for node 69baee4f21a77312e2221bc2
INFO: 172.19.0.1:54214 - "POST /node/69baee4f21a77312e2221bc2 HTTP/1.0" 202 Accepted
2026-03-20 18:26:34,674 - lava_callback - INFO - Starting async job submit for node 69baee4f21a77312e2221bc2
2026-03-20 18:26:34,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:26:34,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baee4f21a77312e2221bc2 HTTP/1.1" 200 None
2026-03-20 18:26:34,692 - lava_callback - DEBUG - Processing node 69baee4f21a77312e2221bc2: baseline-arm64-clabbe
2026-03-20 18:26:34,693 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69baee4f21a77312e2221bc2
2026-03-20 18:26:34,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:26:34,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baee4f21a77312e2221bc2 HTTP/1.1" 200 None
2026-03-20 18:26:34,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:26:34,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None
2026-03-20 18:26:34,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:26:34,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baee4f21a77312e2221bc2 HTTP/1.1" 200 None
2026-03-20 18:26:34,752 - lava_callback - ERROR - Error processing callback for node 69baee4f21a77312e2221bc2: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:54220 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39206 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55688 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55702 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60382 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59930 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:59946 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48310 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54164 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43510 - "GET / HTTP/1.0" 200 OK
2026-03-20 18:27:54,739 - lava_callback - INFO - Received callback for node 69baeea021a77312e2221bce
INFO: 172.19.0.1:35606 - "POST /node/69baeea021a77312e2221bce HTTP/1.0" 202 Accepted
2026-03-20 18:27:54,745 - lava_callback - INFO - Starting async job submit for node 69baeea021a77312e2221bce
2026-03-20 18:27:54,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:27:54,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baeea021a77312e2221bce HTTP/1.1" 200 None
2026-03-20 18:27:54,761 - lava_callback - DEBUG - Processing node 69baeea021a77312e2221bce: baseline-arm64-clabbe
2026-03-20 18:27:54,761 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69baeea021a77312e2221bce
2026-03-20 18:27:54,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:27:54,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baeea021a77312e2221bce HTTP/1.1" 200 None
2026-03-20 18:27:54,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:27:54,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e73e6267e2e450f02132 HTTP/1.1" 200 None
2026-03-20 18:27:54,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:27:54,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baeea021a77312e2221bce HTTP/1.1" 200 None
2026-03-20 18:27:54,815 - lava_callback - ERROR - Error processing callback for node 69baeea021a77312e2221bce: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:35620 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35626 - "GET / HTTP/1.0" 200 OK
2026-03-20 18:28:02,776 - lava_callback - INFO - Received callback for node 69bd8e630e93e23147241599
INFO: 172.19.0.1:59272 - "POST /node/69bd8e630e93e23147241599 HTTP/1.0" 202 Accepted
2026-03-20 18:28:02,783 - lava_callback - INFO - Starting async job submit for node 69bd8e630e93e23147241599
2026-03-20 18:28:02,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:28:02,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd8e630e93e23147241599 HTTP/1.1" 200 None
2026-03-20 18:28:02,873 - lava_callback - DEBUG - Processing node 69bd8e630e93e23147241599: baseline-arm
2026-03-20 18:28:03,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 18:28:03,523 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 18:28:03,525 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69bd8e630e93e23147241599/log.txt.gz
2026-03-20 18:28:03,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 18:28:04,056 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 18:28:04,058 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69bd8e630e93e23147241599/lava-logs.yaml
2026-03-20 18:28:04,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 18:28:04,256 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 18:28:04,258 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69bd8e630e93e23147241599/lava_callback.json.gz
DEBUG: Setup failed for 69bd8e630e93e23147241599. Transitting job node result: incomplete -> fail
2026-03-20 18:28:04,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:28:04,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd8e630e93e23147241599 HTTP/1.1" 200 None
2026-03-20 18:28:04,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:28:04,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd732d0e93e2314723e2b5 HTTP/1.1" 200 None
2026-03-20 18:28:04,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:28:04,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd8e630e93e23147241599 HTTP/1.1" 200 None
2026-03-20 18:28:04,544 - lava_callback - INFO - Completed processing callback for node 69bd8e630e93e23147241599
INFO: 172.19.0.1:59276 - "GET / HTTP/1.0" 200 OK
2026-03-20 18:28:11,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:28:11,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:33400 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:33406 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59852 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43342 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59514 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56460 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56474 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57900 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44512 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:44518 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35938 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53702 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34250 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41396 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41410 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46030 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42466 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:42468 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55894 - "GET / HTTP/1.0" 200 OK
2026-03-20 18:30:36,388 - lava_callback - INFO - Received callback for node 69baef4321a77312e2221bda
INFO: 172.19.0.1:37044 - "POST /node/69baef4321a77312e2221bda HTTP/1.0" 202 Accepted
2026-03-20 18:30:36,394 - lava_callback - INFO - Starting async job submit for node 69baef4321a77312e2221bda
2026-03-20 18:30:36,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:30:36,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baef4321a77312e2221bda HTTP/1.1" 200 None
2026-03-20 18:30:36,410 - lava_callback - DEBUG - Processing node 69baef4321a77312e2221bda: baseline-arm-baylibre
2026-03-20 18:30:36,410 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69baef4321a77312e2221bda
2026-03-20 18:30:36,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:30:36,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baef4321a77312e2221bda HTTP/1.1" 200 None
2026-03-20 18:30:36,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:30:36,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None
2026-03-20 18:30:36,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:30:36,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baef4321a77312e2221bda HTTP/1.1" 200 None
2026-03-20 18:30:36,470 - lava_callback - ERROR - Error processing callback for node 69baef4321a77312e2221bda: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:37054 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57056 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44794 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44798 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48456 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57582 - "GET /api/metrics HTTP/1.0" 200 OK
2026-03-20 18:31:16,294 - lava_callback - INFO - Received callback for node 69baef6e21a77312e2221be4
INFO: 172.19.0.1:57590 - "POST /node/69baef6e21a77312e2221be4 HTTP/1.0" 202 Accepted
2026-03-20 18:31:16,300 - lava_callback - INFO - Starting async job submit for node 69baef6e21a77312e2221be4
2026-03-20 18:31:16,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:31:16,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baef6e21a77312e2221be4 HTTP/1.1" 200 None
2026-03-20 18:31:16,316 - lava_callback - DEBUG - Processing node 69baef6e21a77312e2221be4: baseline-arm-baylibre
2026-03-20 18:31:16,316 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69baef6e21a77312e2221be4
2026-03-20 18:31:16,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:31:16,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baef6e21a77312e2221be4 HTTP/1.1" 200 None
2026-03-20 18:31:16,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:31:16,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None
2026-03-20 18:31:16,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:31:16,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baef6e21a77312e2221be4 HTTP/1.1" 200 None
2026-03-20 18:31:16,377 - lava_callback - ERROR - Error processing callback for node 69baef6e21a77312e2221be4: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:57604 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57520 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37746 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50276 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49048 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49060 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37280 - "GET / HTTP/1.0" 200 OK
2026-03-20 18:32:14,945 - lava_callback - INFO - Received callback for node 69baef9c21a77312e2221bed
INFO: 172.19.0.1:49508 - "POST /node/69baef9c21a77312e2221bed HTTP/1.0" 202 Accepted
2026-03-20 18:32:14,951 - lava_callback - INFO - Starting async job submit for node 69baef9c21a77312e2221bed
2026-03-20 18:32:14,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:32:14,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baef9c21a77312e2221bed HTTP/1.1" 200 None
2026-03-20 18:32:14,967 - lava_callback - DEBUG - Processing node 69baef9c21a77312e2221bed: baseline-arm-clabbe
2026-03-20 18:32:14,967 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69baef9c21a77312e2221bed
2026-03-20 18:32:14,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:32:14,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baef9c21a77312e2221bed HTTP/1.1" 200 None
2026-03-20 18:32:14,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:32:15,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None
2026-03-20 18:32:15,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:32:15,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baef9c21a77312e2221bed HTTP/1.1" 200 None
2026-03-20 18:32:15,037 - lava_callback - ERROR - Error processing callback for node 69baef9c21a77312e2221bed: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:49516 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:49518 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48802 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41884 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56734 - "GET / HTTP/1.0" 200 OK
2026-03-20 18:32:54,937 - lava_callback - INFO - Received callback for node 69baefc821a77312e2221bf8
INFO: 172.19.0.1:43326 - "POST /node/69baefc821a77312e2221bf8 HTTP/1.0" 202 Accepted
2026-03-20 18:32:54,943 - lava_callback - INFO - Starting async job submit for node 69baefc821a77312e2221bf8
2026-03-20 18:32:54,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:32:54,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baefc821a77312e2221bf8 HTTP/1.1" 200 None
2026-03-20 18:32:54,964 - lava_callback - DEBUG - Processing node 69baefc821a77312e2221bf8: baseline-arm-clabbe
2026-03-20 18:32:54,964 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69baefc821a77312e2221bf8
2026-03-20 18:32:54,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:32:54,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baefc821a77312e2221bf8 HTTP/1.1" 200 None
2026-03-20 18:32:54,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:32:55,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None
2026-03-20 18:32:55,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:32:55,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baefc821a77312e2221bf8 HTTP/1.1" 200 None
2026-03-20 18:32:55,029 - lava_callback - ERROR - Error processing callback for node 69baefc821a77312e2221bf8: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:43336 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43344 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47320 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49028 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:49036 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51334 - "GET / HTTP/1.0" 200 OK
2026-03-20 18:33:35,008 - lava_callback - INFO - Received callback for node 69baeff321a77312e2221bff
INFO: 172.19.0.1:45448 - "POST /node/69baeff321a77312e2221bff HTTP/1.0" 202 Accepted
2026-03-20 18:33:35,014 - lava_callback - INFO - Starting async job submit for node 69baeff321a77312e2221bff
2026-03-20 18:33:35,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:33:35,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baeff321a77312e2221bff HTTP/1.1" 200 None
2026-03-20 18:33:35,034 - lava_callback - DEBUG - Processing node 69baeff321a77312e2221bff: baseline-arm-clabbe
2026-03-20 18:33:35,035 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69baeff321a77312e2221bff
2026-03-20 18:33:35,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:33:35,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baeff321a77312e2221bff HTTP/1.1" 200 None
2026-03-20 18:33:35,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:33:35,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None
2026-03-20 18:33:35,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:33:35,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baeff321a77312e2221bff HTTP/1.1" 200 None
2026-03-20 18:33:35,092 - lava_callback - ERROR - Error processing callback for node 69baeff321a77312e2221bff: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:45458 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52292 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47018 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47026 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58072 - "GET / HTTP/1.0" 200 OK
2026-03-20 18:34:15,012 - lava_callback - INFO - Received callback for node 69baf01f21a77312e2221c0a
INFO: 172.19.0.1:48920 - "POST /node/69baf01f21a77312e2221c0a HTTP/1.0" 202 Accepted
2026-03-20 18:34:15,017 - lava_callback - INFO - Starting async job submit for node 69baf01f21a77312e2221c0a
2026-03-20 18:34:15,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:34:15,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf01f21a77312e2221c0a HTTP/1.1" 200 None
2026-03-20 18:34:15,034 - lava_callback - DEBUG - Processing node 69baf01f21a77312e2221c0a: baseline-arm-clabbe
2026-03-20 18:34:15,034 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69baf01f21a77312e2221c0a
2026-03-20 18:34:15,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:34:15,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf01f21a77312e2221c0a HTTP/1.1" 200 None
2026-03-20 18:34:15,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:34:15,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None
2026-03-20 18:34:15,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:34:15,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baf01f21a77312e2221c0a HTTP/1.1" 200 None
2026-03-20 18:34:15,105 - lava_callback - ERROR - Error processing callback for node 69baf01f21a77312e2221c0a: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:48932 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:48938 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44406 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48048 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39864 - "GET / HTTP/1.0" 200 OK
2026-03-20 18:34:55,102 - lava_callback - INFO - Received callback for node 69baf04921a77312e2221c19
INFO: 172.19.0.1:51088 - "POST /node/69baf04921a77312e2221c19 HTTP/1.0" 202 Accepted
2026-03-20 18:34:55,108 - lava_callback - INFO - Starting async job submit for node 69baf04921a77312e2221c19
2026-03-20 18:34:55,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:34:55,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf04921a77312e2221c19 HTTP/1.1" 200 None
2026-03-20 18:34:55,124 - lava_callback - DEBUG - Processing node 69baf04921a77312e2221c19: baseline-arm-clabbe
2026-03-20 18:34:55,124 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69baf04921a77312e2221c19
2026-03-20 18:34:55,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:34:55,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf04921a77312e2221c19 HTTP/1.1" 200 None
2026-03-20 18:34:55,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:34:55,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b2e72a6267e2e450f0211d HTTP/1.1" 200 None
2026-03-20 18:34:55,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:34:55,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baf04921a77312e2221c19 HTTP/1.1" 200 None
2026-03-20 18:34:55,191 - lava_callback - ERROR - Error processing callback for node 69baf04921a77312e2221c19: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:51100 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51104 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47868 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53738 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:53742 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40778 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42856 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60262 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34320 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34328 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42500 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35006 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:35022 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39332 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45564 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59502 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52800 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52806 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57398 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60152 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:60154 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44980 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55676 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33318 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46212 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46218 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44710 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35320 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:35334 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47670 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36014 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54600 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48486 - "GET / HTTP/1.0" 200 OK
2026-03-20 18:38:57,306 - lava_callback - INFO - Received callback for node 69bd920a0e93e23147241665
INFO: 172.19.0.1:48488 - "POST /node/69bd920a0e93e23147241665 HTTP/1.0" 202 Accepted
2026-03-20 18:38:57,312 - lava_callback - INFO - Starting async job submit for node 69bd920a0e93e23147241665
2026-03-20 18:38:57,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:38:57,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd920a0e93e23147241665 HTTP/1.1" 200 None
2026-03-20 18:38:57,349 - lava_callback - DEBUG - Processing node 69bd920a0e93e23147241665: baseline-arm64
2026-03-20 18:38:57,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 18:38:57,880 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 18:38:57,882 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd920a0e93e23147241665/log.txt.gz
2026-03-20 18:38:58,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 18:38:58,247 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 18:38:58,249 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd920a0e93e23147241665/lava-logs.yaml
2026-03-20 18:38:58,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
INFO: 172.19.0.1:48490 - "GET / HTTP/1.0" 200 OK
2026-03-20 18:38:58,404 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 18:38:58,406 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd920a0e93e23147241665/lava_callback.json.gz
2026-03-20 18:38:58,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:38:58,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd920a0e93e23147241665 HTTP/1.1" 200 None
2026-03-20 18:38:58,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:38:58,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 18:38:58,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:38:58,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd920a0e93e23147241665 HTTP/1.1" 200 None
2026-03-20 18:38:58,498 - lava_callback - INFO - Completed processing callback for node 69bd920a0e93e23147241665
INFO: 172.19.0.1:33340 - "GET / HTTP/1.0" 200 OK
2026-03-20 18:39:11,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:39:11,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:40222 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:40228 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45838 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43862 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58402 - "GET / HTTP/1.0" 200 OK
2026-03-20 18:39:53,735 - lava_callback - INFO - Received callback for node 69bd8fea0e93e231472415f2
INFO: 172.19.0.1:42146 - "POST /node/69bd8fea0e93e231472415f2 HTTP/1.0" 202 Accepted
2026-03-20 18:39:53,781 - lava_callback - INFO - Starting async job submit for node 69bd8fea0e93e231472415f2
2026-03-20 18:39:53,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:39:53,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd8fea0e93e231472415f2 HTTP/1.1" 200 None
2026-03-20 18:39:53,867 - lava_callback - DEBUG - Processing node 69bd8fea0e93e231472415f2: baseline-arm-pengutronix
2026-03-20 18:39:53,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 18:39:54,189 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 18:39:54,191 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69bd8fea0e93e231472415f2/log.txt.gz
2026-03-20 18:39:54,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 18:39:54,412 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 18:39:54,414 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69bd8fea0e93e231472415f2/lava-logs.yaml
2026-03-20 18:39:54,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 18:39:54,536 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 18:39:54,537 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69bd8fea0e93e231472415f2/lava_callback.json.gz
DEBUG: Setup failed for 69bd8fea0e93e231472415f2. Transitting job node result: incomplete -> fail
2026-03-20 18:39:54,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:39:54,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd8fea0e93e231472415f2 HTTP/1.1" 200 None
2026-03-20 18:39:54,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:39:54,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd732d0e93e2314723e2b5 HTTP/1.1" 200 None
2026-03-20 18:39:54,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:39:54,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd8fea0e93e231472415f2 HTTP/1.1" 200 None
2026-03-20 18:39:54,726 - lava_callback - INFO - Completed processing callback for node 69bd8fea0e93e231472415f2
INFO: 172.19.0.1:42154 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42164 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57288 - "GET / HTTP/1.0" 200 OK
2026-03-20 18:40:11,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:40:11,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:35792 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:35800 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55870 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53386 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47234 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44660 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44666 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48072 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39082 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:39090 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45534 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37184 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60324 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49544 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49550 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58218 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57826 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:57842 - "GET / HTTP/1.0" 200 OK
2026-03-20 18:42:24,997 - lava_callback - INFO - Received callback for node 69bd90650e93e2314724162a
INFO: 172.19.0.1:38316 - "POST /node/69bd90650e93e2314724162a HTTP/1.0" 202 Accepted
2026-03-20 18:42:25,006 - lava_callback - INFO - Starting async job submit for node 69bd90650e93e2314724162a
2026-03-20 18:42:25,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:42:25,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd90650e93e2314724162a HTTP/1.1" 200 None
2026-03-20 18:42:25,066 - lava_callback - DEBUG - Processing node 69bd90650e93e2314724162a: baseline-arm64
2026-03-20 18:42:25,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 18:42:25,653 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 18:42:25,655 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd90650e93e2314724162a/log.txt.gz
2026-03-20 18:42:25,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 18:42:26,094 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 18:42:26,096 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd90650e93e2314724162a/lava-logs.yaml
2026-03-20 18:42:26,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 18:42:26,268 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 18:42:26,270 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd90650e93e2314724162a/lava_callback.json.gz
DEBUG: Setup failed for 69bd90650e93e2314724162a. Transitting job node result: incomplete -> fail
2026-03-20 18:42:26,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:42:26,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd90650e93e2314724162a HTTP/1.1" 200 None
2026-03-20 18:42:26,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:42:26,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 18:42:26,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:42:26,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd90650e93e2314724162a HTTP/1.1" 200 None
2026-03-20 18:42:26,481 - lava_callback - INFO - Completed processing callback for node 69bd90650e93e2314724162a
INFO: 172.19.0.1:38330 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40976 - "GET / HTTP/1.0" 200 OK
2026-03-20 18:42:41,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:42:41,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:34200 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46178 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46184 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53150 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60140 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:60156 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59306 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45492 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43254 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37016 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37022 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46900 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36028 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:36040 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58250 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50194 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33678 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43530 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43534 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38032 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47158 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:47172 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51442 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35992 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42936 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45700 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45708 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36596 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59790 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:59792 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43064 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40812 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42322 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52314 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52330 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53110 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55226 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:55238 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50456 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57832 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60014 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53024 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53034 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55230 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43994 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:43998 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59090 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60556 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51882 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56338 - "GET / HTTP/1.0" 200 OK
2026-03-20 18:48:57,447 - lava_callback - INFO - Received callback for node 69baf38f21a77312e2221c8c
INFO: 172.19.0.1:56344 - "POST /node/69baf38f21a77312e2221c8c HTTP/1.0" 202 Accepted
2026-03-20 18:48:57,452 - lava_callback - INFO - Starting async job submit for node 69baf38f21a77312e2221c8c
2026-03-20 18:48:57,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:48:57,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf38f21a77312e2221c8c HTTP/1.1" 200 None
2026-03-20 18:48:57,469 - lava_callback - DEBUG - Processing node 69baf38f21a77312e2221c8c: baseline-arm-baylibre
2026-03-20 18:48:57,469 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69baf38f21a77312e2221c8c
2026-03-20 18:48:57,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:48:57,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf38f21a77312e2221c8c HTTP/1.1" 200 None
2026-03-20 18:48:57,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:48:57,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None
2026-03-20 18:48:57,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:48:57,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baf38f21a77312e2221c8c HTTP/1.1" 200 None
2026-03-20 18:48:57,521 - lava_callback - ERROR - Error processing callback for node 69baf38f21a77312e2221c8c: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:56360 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58298 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45412 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:45420 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44412 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46970 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46992 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49180 - "GET / HTTP/1.0" 200 OK
2026-03-20 18:49:57,414 - lava_callback - INFO - Received callback for node 69baf3cc21a77312e2221c9a
INFO: 172.19.0.1:49186 - "POST /node/69baf3cc21a77312e2221c9a HTTP/1.0" 202 Accepted
2026-03-20 18:49:57,419 - lava_callback - INFO - Starting async job submit for node 69baf3cc21a77312e2221c9a
2026-03-20 18:49:57,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:49:57,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf3cc21a77312e2221c9a HTTP/1.1" 200 None
2026-03-20 18:49:57,434 - lava_callback - DEBUG - Processing node 69baf3cc21a77312e2221c9a: baseline-arm-baylibre
2026-03-20 18:49:57,435 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69baf3cc21a77312e2221c9a
2026-03-20 18:49:57,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:49:57,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf3cc21a77312e2221c9a HTTP/1.1" 200 None
2026-03-20 18:49:57,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:49:57,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None
2026-03-20 18:49:57,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:49:57,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baf3cc21a77312e2221c9a HTTP/1.1" 200 None
2026-03-20 18:49:57,496 - lava_callback - ERROR - Error processing callback for node 69baf3cc21a77312e2221c9a: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:49198 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54270 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55162 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:55168 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52942 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45050 - "GET / HTTP/1.0" 200 OK
2026-03-20 18:50:37,424 - lava_callback - INFO - Received callback for node 69baf3f621a77312e2221ca5
INFO: 172.19.0.1:45058 - "POST /node/69baf3f621a77312e2221ca5 HTTP/1.0" 202 Accepted
2026-03-20 18:50:37,429 - lava_callback - INFO - Starting async job submit for node 69baf3f621a77312e2221ca5
2026-03-20 18:50:37,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:50:37,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf3f621a77312e2221ca5 HTTP/1.1" 200 None
2026-03-20 18:50:37,445 - lava_callback - DEBUG - Processing node 69baf3f621a77312e2221ca5: baseline-arm-baylibre
2026-03-20 18:50:37,445 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69baf3f621a77312e2221ca5
2026-03-20 18:50:37,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:50:37,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf3f621a77312e2221ca5 HTTP/1.1" 200 None
2026-03-20 18:50:37,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:50:37,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None
2026-03-20 18:50:37,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:50:37,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baf3f621a77312e2221ca5 HTTP/1.1" 200 None
2026-03-20 18:50:37,508 - lava_callback - ERROR - Error processing callback for node 69baf3f621a77312e2221ca5: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:36592 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50504 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50512 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39274 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:32820 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:32834 - "GET / HTTP/1.0" 200 OK
2026-03-20 18:51:17,471 - lava_callback - INFO - Received callback for node 69baf42021a77312e2221cb3
INFO: 172.19.0.1:32840 - "POST /node/69baf42021a77312e2221cb3 HTTP/1.0" 202 Accepted
2026-03-20 18:51:17,477 - lava_callback - INFO - Starting async job submit for node 69baf42021a77312e2221cb3
2026-03-20 18:51:17,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:51:17,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf42021a77312e2221cb3 HTTP/1.1" 200 None
2026-03-20 18:51:17,493 - lava_callback - DEBUG - Processing node 69baf42021a77312e2221cb3: baseline-arm-baylibre
2026-03-20 18:51:17,493 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69baf42021a77312e2221cb3
2026-03-20 18:51:17,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:51:17,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf42021a77312e2221cb3 HTTP/1.1" 200 None
2026-03-20 18:51:17,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:51:17,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None
2026-03-20 18:51:17,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:51:17,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baf42021a77312e2221cb3 HTTP/1.1" 200 None
2026-03-20 18:51:17,549 - lava_callback - ERROR - Error processing callback for node 69baf42021a77312e2221cb3: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:45732 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39488 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60214 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42090 - "GET / HTTP/1.0" 200 OK
2026-03-20 18:51:57,515 - lava_callback - INFO - Received callback for node 69baf44a21a77312e2221cc2
INFO: 172.19.0.1:42092 - "POST /node/69baf44a21a77312e2221cc2 HTTP/1.0" 202 Accepted
2026-03-20 18:51:57,521 - lava_callback - INFO - Starting async job submit for node 69baf44a21a77312e2221cc2
2026-03-20 18:51:57,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:51:57,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf44a21a77312e2221cc2 HTTP/1.1" 200 None
2026-03-20 18:51:57,549 - lava_callback - DEBUG - Processing node 69baf44a21a77312e2221cc2: baseline-arm-baylibre
2026-03-20 18:51:57,550 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69baf44a21a77312e2221cc2
2026-03-20 18:51:57,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:51:57,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf44a21a77312e2221cc2 HTTP/1.1" 200 None
2026-03-20 18:51:57,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:51:57,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None
2026-03-20 18:51:57,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:51:57,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baf44a21a77312e2221cc2 HTTP/1.1" 200 None
2026-03-20 18:51:57,616 - lava_callback - ERROR - Error processing callback for node 69baf44a21a77312e2221cc2: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:42108 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36262 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56536 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:56546 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35570 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35292 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34316 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55696 - "GET / HTTP/1.0" 200 OK
2026-03-20 18:52:57,547 - lava_callback - INFO - Received callback for node 69baf47521a77312e2221cd1
INFO: 172.19.0.1:55710 - "POST /node/69baf47521a77312e2221cd1 HTTP/1.0" 202 Accepted
2026-03-20 18:52:57,556 - lava_callback - INFO - Starting async job submit for node 69baf47521a77312e2221cd1
2026-03-20 18:52:57,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:52:57,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf47521a77312e2221cd1 HTTP/1.1" 200 None
2026-03-20 18:52:57,591 - lava_callback - DEBUG - Processing node 69baf47521a77312e2221cd1: baseline-arm-baylibre
2026-03-20 18:52:57,591 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69baf47521a77312e2221cd1
2026-03-20 18:52:57,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:52:57,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf47521a77312e2221cd1 HTTP/1.1" 200 None
2026-03-20 18:52:57,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:52:57,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None
2026-03-20 18:52:57,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:52:57,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baf47521a77312e2221cd1 HTTP/1.1" 200 None
2026-03-20 18:52:57,642 - lava_callback - ERROR - Error processing callback for node 69baf47521a77312e2221cd1: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:55712 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38250 - "GET / HTTP/1.0" 200 OK
2026-03-20 18:53:07,395 - lava_callback - INFO - Received callback for node 69bd977a0e93e231472417c0
INFO: 172.19.0.1:38256 - "POST /node/69bd977a0e93e231472417c0 HTTP/1.0" 202 Accepted
2026-03-20 18:53:07,401 - lava_callback - INFO - Starting async job submit for node 69bd977a0e93e231472417c0
2026-03-20 18:53:07,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:53:07,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd977a0e93e231472417c0 HTTP/1.1" 200 None
2026-03-20 18:53:07,427 - lava_callback - DEBUG - Processing node 69bd977a0e93e231472417c0: baseline-arm
2026-03-20 18:53:07,432 - lava_callback - WARNING - Failed to upload log
2026-03-20 18:53:07,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 18:53:07,588 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 18:53:07,590 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69bd977a0e93e231472417c0/lava-logs.yaml
2026-03-20 18:53:07,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 18:53:07,742 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 18:53:07,743 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69bd977a0e93e231472417c0/lava_callback.json.gz
2026-03-20 18:53:07,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:53:07,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd977a0e93e231472417c0 HTTP/1.1" 200 None
2026-03-20 18:53:07,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:53:07,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd732d0e93e2314723e2b5 HTTP/1.1" 200 None
2026-03-20 18:53:07,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:53:07,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd977a0e93e231472417c0 HTTP/1.1" 200 None
2026-03-20 18:53:07,812 - lava_callback - INFO - Completed processing callback for node 69bd977a0e93e231472417c0
2026-03-20 18:53:11,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:53:11,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:51116 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:51118 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36782 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38972 - "GET / HTTP/1.0" 200 OK
2026-03-20 18:53:37,617 - lava_callback - INFO - Received callback for node 69baf4a121a77312e2221ce3
INFO: 172.19.0.1:38986 - "POST /node/69baf4a121a77312e2221ce3 HTTP/1.0" 202 Accepted
2026-03-20 18:53:37,623 - lava_callback - INFO - Starting async job submit for node 69baf4a121a77312e2221ce3
2026-03-20 18:53:37,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:53:37,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf4a121a77312e2221ce3 HTTP/1.1" 200 None
2026-03-20 18:53:37,646 - lava_callback - DEBUG - Processing node 69baf4a121a77312e2221ce3: baseline-arm-baylibre
2026-03-20 18:53:37,646 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69baf4a121a77312e2221ce3
2026-03-20 18:53:37,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:53:37,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf4a121a77312e2221ce3 HTTP/1.1" 200 None
2026-03-20 18:53:37,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:53:37,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None
2026-03-20 18:53:37,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:53:37,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baf4a121a77312e2221ce3 HTTP/1.1" 200 None
2026-03-20 18:53:37,741 - lava_callback - ERROR - Error processing callback for node 69baf4a121a77312e2221ce3: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:49892 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60672 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60682 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46534 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38828 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:38840 - "GET / HTTP/1.0" 200 OK
2026-03-20 18:54:17,644 - lava_callback - INFO - Received callback for node 69baf4cb21a77312e2221cf1
INFO: 172.19.0.1:38846 - "POST /node/69baf4cb21a77312e2221cf1 HTTP/1.0" 202 Accepted
2026-03-20 18:54:17,650 - lava_callback - INFO - Starting async job submit for node 69baf4cb21a77312e2221cf1
2026-03-20 18:54:17,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:54:17,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf4cb21a77312e2221cf1 HTTP/1.1" 200 None
2026-03-20 18:54:17,671 - lava_callback - DEBUG - Processing node 69baf4cb21a77312e2221cf1: baseline-arm-baylibre
2026-03-20 18:54:17,672 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69baf4cb21a77312e2221cf1
2026-03-20 18:54:17,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:54:17,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf4cb21a77312e2221cf1 HTTP/1.1" 200 None
2026-03-20 18:54:17,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:54:17,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None
2026-03-20 18:54:17,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:54:17,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baf4cb21a77312e2221cf1 HTTP/1.1" 200 None
2026-03-20 18:54:17,722 - lava_callback - ERROR - Error processing callback for node 69baf4cb21a77312e2221cf1: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:58612 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59168 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36488 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42550 - "GET / HTTP/1.0" 200 OK
2026-03-20 18:54:57,649 - lava_callback - INFO - Received callback for node 69baf4f321a77312e2221d01
INFO: 172.19.0.1:42560 - "POST /node/69baf4f321a77312e2221d01 HTTP/1.0" 202 Accepted
2026-03-20 18:54:57,655 - lava_callback - INFO - Starting async job submit for node 69baf4f321a77312e2221d01
2026-03-20 18:54:57,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:54:57,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf4f321a77312e2221d01 HTTP/1.1" 200 None
2026-03-20 18:54:57,671 - lava_callback - DEBUG - Processing node 69baf4f321a77312e2221d01: baseline-arm-baylibre
2026-03-20 18:54:57,671 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69baf4f321a77312e2221d01
2026-03-20 18:54:57,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:54:57,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf4f321a77312e2221d01 HTTP/1.1" 200 None
2026-03-20 18:54:57,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:54:57,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None
2026-03-20 18:54:57,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:54:57,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baf4f321a77312e2221d01 HTTP/1.1" 200 None
2026-03-20 18:54:57,748 - lava_callback - ERROR - Error processing callback for node 69baf4f321a77312e2221d01: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:42572 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44616 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41598 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:41602 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42678 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40756 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43538 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40630 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40642 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59004 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50766 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:50776 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52844 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33864 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33806 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52890 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52892 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39218 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53310 - "GET /api/metrics HTTP/1.0" 200 OK
2026-03-20 18:57:16,029 - lava_callback - INFO - Received callback for node 69baf57821a77312e2221d2a
INFO: 172.19.0.1:53320 - "POST /node/69baf57821a77312e2221d2a HTTP/1.0" 202 Accepted
2026-03-20 18:57:16,035 - lava_callback - INFO - Starting async job submit for node 69baf57821a77312e2221d2a
2026-03-20 18:57:16,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:57:16,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf57821a77312e2221d2a HTTP/1.1" 200 None
2026-03-20 18:57:16,051 - lava_callback - DEBUG - Processing node 69baf57821a77312e2221d2a: baseline-arm-clabbe
2026-03-20 18:57:16,051 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69baf57821a77312e2221d2a
2026-03-20 18:57:16,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:57:16,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf57821a77312e2221d2a HTTP/1.1" 200 None
2026-03-20 18:57:16,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:57:16,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None
2026-03-20 18:57:16,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:57:16,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baf57821a77312e2221d2a HTTP/1.1" 200 None
2026-03-20 18:57:16,111 - lava_callback - ERROR - Error processing callback for node 69baf57821a77312e2221d2a: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:53332 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38910 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40034 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34782 - "GET / HTTP/1.0" 200 OK
2026-03-20 18:57:55,955 - lava_callback - INFO - Received callback for node 69baf5a221a77312e2221d41
INFO: 172.19.0.1:55122 - "POST /node/69baf5a221a77312e2221d41 HTTP/1.0" 202 Accepted
2026-03-20 18:57:55,961 - lava_callback - INFO - Starting async job submit for node 69baf5a221a77312e2221d41
2026-03-20 18:57:55,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:57:55,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf5a221a77312e2221d41 HTTP/1.1" 200 None
2026-03-20 18:57:55,977 - lava_callback - DEBUG - Processing node 69baf5a221a77312e2221d41: baseline-arm-clabbe
2026-03-20 18:57:55,977 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69baf5a221a77312e2221d41
2026-03-20 18:57:55,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:57:55,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf5a221a77312e2221d41 HTTP/1.1" 200 None
2026-03-20 18:57:55,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:57:56,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None
2026-03-20 18:57:56,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:57:56,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baf5a221a77312e2221d41 HTTP/1.1" 200 None
2026-03-20 18:57:56,030 - lava_callback - ERROR - Error processing callback for node 69baf5a221a77312e2221d41: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:55132 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55138 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54908 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46752 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:46754 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47406 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53140 - "GET / HTTP/1.0" 200 OK
2026-03-20 18:58:37,850 - lava_callback - INFO - Received callback for node 69baf5c821a77312e2221d50
INFO: 172.19.0.1:53146 - "POST /node/69baf5c821a77312e2221d50 HTTP/1.0" 202 Accepted
2026-03-20 18:58:37,856 - lava_callback - INFO - Starting async job submit for node 69baf5c821a77312e2221d50
2026-03-20 18:58:37,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:58:37,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf5c821a77312e2221d50 HTTP/1.1" 200 None
2026-03-20 18:58:37,885 - lava_callback - DEBUG - Processing node 69baf5c821a77312e2221d50: baseline-arm-baylibre
2026-03-20 18:58:37,885 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69baf5c821a77312e2221d50
2026-03-20 18:58:37,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:58:37,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf5c821a77312e2221d50 HTTP/1.1" 200 None
2026-03-20 18:58:37,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:58:37,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None
2026-03-20 18:58:37,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:58:37,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baf5c821a77312e2221d50 HTTP/1.1" 200 None
2026-03-20 18:58:37,943 - lava_callback - ERROR - Error processing callback for node 69baf5c821a77312e2221d50: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:51840 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47358 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47372 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40648 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38602 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:38612 - "GET / HTTP/1.0" 200 OK
2026-03-20 18:59:17,828 - lava_callback - INFO - Received callback for node 69baf5f421a77312e2221d68
INFO: 172.19.0.1:38622 - "POST /node/69baf5f421a77312e2221d68 HTTP/1.0" 202 Accepted
2026-03-20 18:59:17,834 - lava_callback - INFO - Starting async job submit for node 69baf5f421a77312e2221d68
2026-03-20 18:59:17,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:59:17,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf5f421a77312e2221d68 HTTP/1.1" 200 None
2026-03-20 18:59:17,850 - lava_callback - DEBUG - Processing node 69baf5f421a77312e2221d68: baseline-arm-baylibre
2026-03-20 18:59:17,850 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69baf5f421a77312e2221d68
2026-03-20 18:59:17,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:59:17,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf5f421a77312e2221d68 HTTP/1.1" 200 None
2026-03-20 18:59:17,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:59:17,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None
2026-03-20 18:59:17,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:59:17,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baf5f421a77312e2221d68 HTTP/1.1" 200 None
2026-03-20 18:59:17,905 - lava_callback - ERROR - Error processing callback for node 69baf5f421a77312e2221d68: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:56084 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47096 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44030 - "GET / HTTP/1.0" 200 OK
2026-03-20 18:59:56,076 - lava_callback - INFO - Received callback for node 69baf62121a77312e2221d73
INFO: 172.19.0.1:55660 - "POST /node/69baf62121a77312e2221d73 HTTP/1.0" 202 Accepted
2026-03-20 18:59:56,081 - lava_callback - INFO - Starting async job submit for node 69baf62121a77312e2221d73
2026-03-20 18:59:56,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:59:56,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf62121a77312e2221d73 HTTP/1.1" 200 None
2026-03-20 18:59:56,104 - lava_callback - DEBUG - Processing node 69baf62121a77312e2221d73: baseline-arm-clabbe
2026-03-20 18:59:56,104 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69baf62121a77312e2221d73
2026-03-20 18:59:56,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:59:56,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf62121a77312e2221d73 HTTP/1.1" 200 None
2026-03-20 18:59:56,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:59:56,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None
2026-03-20 18:59:56,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 18:59:56,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baf62121a77312e2221d73 HTTP/1.1" 200 None
2026-03-20 18:59:56,177 - lava_callback - ERROR - Error processing callback for node 69baf62121a77312e2221d73: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:55668 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55678 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55514 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37270 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:37272 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50892 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55176 - "GET / HTTP/1.0" 200 OK
2026-03-20 19:00:37,963 - lava_callback - INFO - Received callback for node 69baf64c21a77312e2221d7f
INFO: 172.19.0.1:55182 - "POST /node/69baf64c21a77312e2221d7f HTTP/1.0" 202 Accepted
2026-03-20 19:00:37,969 - lava_callback - INFO - Starting async job submit for node 69baf64c21a77312e2221d7f
2026-03-20 19:00:37,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:00:37,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf64c21a77312e2221d7f HTTP/1.1" 200 None
2026-03-20 19:00:37,985 - lava_callback - DEBUG - Processing node 69baf64c21a77312e2221d7f: baseline-arm-baylibre
2026-03-20 19:00:37,985 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69baf64c21a77312e2221d7f
2026-03-20 19:00:37,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:00:37,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf64c21a77312e2221d7f HTTP/1.1" 200 None
2026-03-20 19:00:38,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:00:38,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None
2026-03-20 19:00:38,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:00:38,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baf64c21a77312e2221d7f HTTP/1.1" 200 None
2026-03-20 19:00:38,040 - lava_callback - ERROR - Error processing callback for node 69baf64c21a77312e2221d7f: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:47494 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36684 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36688 - "GET / HTTP/1.0" 200 OK
2026-03-20 19:01:06,318 - lava_callback - INFO - Received callback for node 69bd95e80e93e2314724175d
INFO: 172.19.0.1:38696 - "POST /node/69bd95e80e93e2314724175d HTTP/1.0" 202 Accepted
2026-03-20 19:01:06,326 - lava_callback - INFO - Starting async job submit for node 69bd95e80e93e2314724175d
2026-03-20 19:01:06,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:01:06,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd95e80e93e2314724175d HTTP/1.1" 200 None
2026-03-20 19:01:06,413 - lava_callback - DEBUG - Processing node 69bd95e80e93e2314724175d: baseline-arm64
INFO: 172.19.0.1:38700 - "GET / HTTP/1.0" 200 OK
2026-03-20 19:01:07,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 19:01:07,339 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 19:01:07,341 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd95e80e93e2314724175d/log.txt.gz
2026-03-20 19:01:07,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 19:01:08,035 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 19:01:08,037 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd95e80e93e2314724175d/lava-logs.yaml
2026-03-20 19:01:08,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 19:01:08,234 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 19:01:08,236 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd95e80e93e2314724175d/lava_callback.json.gz
DEBUG: Setup failed for 69bd95e80e93e2314724175d. Transitting job node result: incomplete -> fail
2026-03-20 19:01:08,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:01:08,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd95e80e93e2314724175d HTTP/1.1" 200 None
2026-03-20 19:01:08,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:01:08,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 19:01:08,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:01:08,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd95e80e93e2314724175d HTTP/1.1" 200 None
2026-03-20 19:01:08,498 - lava_callback - INFO - Completed processing callback for node 69bd95e80e93e2314724175d
2026-03-20 19:01:11,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:01:11,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:46562 - "GET /api/metrics HTTP/1.0" 200 OK
2026-03-20 19:01:16,147 - lava_callback - INFO - Received callback for node 69baf67821a77312e2221d90
INFO: 172.19.0.1:46570 - "POST /node/69baf67821a77312e2221d90 HTTP/1.0" 202 Accepted
2026-03-20 19:01:16,153 - lava_callback - INFO - Starting async job submit for node 69baf67821a77312e2221d90
2026-03-20 19:01:16,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:01:16,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf67821a77312e2221d90 HTTP/1.1" 200 None
2026-03-20 19:01:16,168 - lava_callback - DEBUG - Processing node 69baf67821a77312e2221d90: baseline-arm-clabbe
2026-03-20 19:01:16,168 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69baf67821a77312e2221d90
2026-03-20 19:01:16,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:01:16,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf67821a77312e2221d90 HTTP/1.1" 200 None
2026-03-20 19:01:16,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:01:16,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None
2026-03-20 19:01:16,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:01:16,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baf67821a77312e2221d90 HTTP/1.1" 200 None
2026-03-20 19:01:16,242 - lava_callback - ERROR - Error processing callback for node 69baf67821a77312e2221d90: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:46576 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38630 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46088 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34212 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48084 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48092 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49746 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39130 - "GET /api/metrics HTTP/1.0" 200 OK
2026-03-20 19:02:16,167 - lava_callback - INFO - Received callback for node 69baf6a321a77312e2221d9c
INFO: 172.19.0.1:39138 - "POST /node/69baf6a321a77312e2221d9c HTTP/1.0" 202 Accepted
2026-03-20 19:02:16,172 - lava_callback - INFO - Starting async job submit for node 69baf6a321a77312e2221d9c
2026-03-20 19:02:16,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:02:16,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf6a321a77312e2221d9c HTTP/1.1" 200 None
2026-03-20 19:02:16,187 - lava_callback - DEBUG - Processing node 69baf6a321a77312e2221d9c: baseline-arm-clabbe
2026-03-20 19:02:16,188 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69baf6a321a77312e2221d9c
2026-03-20 19:02:16,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:02:16,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf6a321a77312e2221d9c HTTP/1.1" 200 None
2026-03-20 19:02:16,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:02:16,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None
2026-03-20 19:02:16,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:02:16,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baf6a321a77312e2221d9c HTTP/1.1" 200 None
2026-03-20 19:02:16,250 - lava_callback - ERROR - Error processing callback for node 69baf6a321a77312e2221d9c: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:39150 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45590 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51994 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58064 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40040 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40046 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47210 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45256 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:45260 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53728 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44146 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35982 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55184 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55200 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54140 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38336 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:38342 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55450 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56690 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35958 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59644 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59652 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51490 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40190 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:40206 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59458 - "GET / HTTP/1.0" 200 OK
2026-03-20 19:05:36,322 - lava_callback - INFO - Received callback for node 69baf77121a77312e2221dda
INFO: 172.19.0.1:35698 - "POST /node/69baf77121a77312e2221dda HTTP/1.0" 202 Accepted
2026-03-20 19:05:36,328 - lava_callback - INFO - Starting async job submit for node 69baf77121a77312e2221dda
2026-03-20 19:05:36,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:05:36,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf77121a77312e2221dda HTTP/1.1" 200 None
2026-03-20 19:05:36,344 - lava_callback - DEBUG - Processing node 69baf77121a77312e2221dda: baseline-arm-clabbe
2026-03-20 19:05:36,344 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69baf77121a77312e2221dda
2026-03-20 19:05:36,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:05:36,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf77121a77312e2221dda HTTP/1.1" 200 None
2026-03-20 19:05:36,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:05:36,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None
2026-03-20 19:05:36,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:05:36,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baf77121a77312e2221dda HTTP/1.1" 200 None
2026-03-20 19:05:36,406 - lava_callback - ERROR - Error processing callback for node 69baf77121a77312e2221dda: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:35714 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37358 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57816 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57818 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46122 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49014 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:49016 - "GET / HTTP/1.0" 200 OK
2026-03-20 19:06:18,251 - lava_callback - INFO - Received callback for node 69baf79621a77312e2221de3
INFO: 172.19.0.1:49022 - "POST /node/69baf79621a77312e2221de3 HTTP/1.0" 202 Accepted
2026-03-20 19:06:18,256 - lava_callback - INFO - Starting async job submit for node 69baf79621a77312e2221de3
2026-03-20 19:06:18,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:06:18,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf79621a77312e2221de3 HTTP/1.1" 200 None
2026-03-20 19:06:18,272 - lava_callback - DEBUG - Processing node 69baf79621a77312e2221de3: baseline-arm-baylibre
2026-03-20 19:06:18,272 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69baf79621a77312e2221de3
2026-03-20 19:06:18,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:06:18,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf79621a77312e2221de3 HTTP/1.1" 200 None
2026-03-20 19:06:18,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:06:18,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9ef76d5731cbd74145fb9 HTTP/1.1" 200 None
2026-03-20 19:06:18,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:06:18,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baf79621a77312e2221de3 HTTP/1.1" 200 None
2026-03-20 19:06:18,336 - lava_callback - ERROR - Error processing callback for node 69baf79621a77312e2221de3: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:33054 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:32846 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52682 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56624 - "GET / HTTP/1.0" 200 OK
2026-03-20 19:06:58,217 - lava_callback - INFO - Received callback for node 69baf7c121a77312e2221dec
INFO: 172.19.0.1:56638 - "POST /node/69baf7c121a77312e2221dec HTTP/1.0" 202 Accepted
2026-03-20 19:06:58,222 - lava_callback - INFO - Starting async job submit for node 69baf7c121a77312e2221dec
2026-03-20 19:06:58,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:06:58,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf7c121a77312e2221dec HTTP/1.1" 200 None
2026-03-20 19:06:58,239 - lava_callback - DEBUG - Processing node 69baf7c121a77312e2221dec: baseline-arm-baylibre
2026-03-20 19:06:58,239 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69baf7c121a77312e2221dec
2026-03-20 19:06:58,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:06:58,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf7c121a77312e2221dec HTTP/1.1" 200 None
2026-03-20 19:06:58,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:06:58,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9ef76d5731cbd74145fb9 HTTP/1.1" 200 None
2026-03-20 19:06:58,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:06:58,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baf7c121a77312e2221dec HTTP/1.1" 200 None
2026-03-20 19:06:58,309 - lava_callback - ERROR - Error processing callback for node 69baf7c121a77312e2221dec: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:56640 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52884 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34718 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:34732 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51532 - "GET / HTTP/1.0" 200 OK
2026-03-20 19:07:36,402 - lava_callback - INFO - Received callback for node 69baf7f121a77312e2221df8
INFO: 172.19.0.1:49342 - "POST /node/69baf7f121a77312e2221df8 HTTP/1.0" 202 Accepted
2026-03-20 19:07:36,409 - lava_callback - INFO - Starting async job submit for node 69baf7f121a77312e2221df8
2026-03-20 19:07:36,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:07:36,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf7f121a77312e2221df8 HTTP/1.1" 200 None
2026-03-20 19:07:36,436 - lava_callback - DEBUG - Processing node 69baf7f121a77312e2221df8: baseline-arm-clabbe
2026-03-20 19:07:36,436 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69baf7f121a77312e2221df8
2026-03-20 19:07:36,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:07:36,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf7f121a77312e2221df8 HTTP/1.1" 200 None
2026-03-20 19:07:36,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:07:36,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None
2026-03-20 19:07:36,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:07:36,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baf7f121a77312e2221df8 HTTP/1.1" 200 None
2026-03-20 19:07:36,488 - lava_callback - ERROR - Error processing callback for node 69baf7f121a77312e2221df8: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:49344 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33884 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41862 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41874 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60640 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51908 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:51912 - "GET / HTTP/1.0" 200 OK
2026-03-20 19:08:18,340 - lava_callback - INFO - Received callback for node 69baf81621a77312e2221e03
INFO: 172.19.0.1:51920 - "POST /node/69baf81621a77312e2221e03 HTTP/1.0" 202 Accepted
2026-03-20 19:08:18,345 - lava_callback - INFO - Starting async job submit for node 69baf81621a77312e2221e03
2026-03-20 19:08:18,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:08:18,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf81621a77312e2221e03 HTTP/1.1" 200 None
2026-03-20 19:08:18,369 - lava_callback - DEBUG - Processing node 69baf81621a77312e2221e03: baseline-arm-baylibre
2026-03-20 19:08:18,370 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69baf81621a77312e2221e03
2026-03-20 19:08:18,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:08:18,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf81621a77312e2221e03 HTTP/1.1" 200 None
2026-03-20 19:08:18,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:08:18,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9ef76d5731cbd74145fb9 HTTP/1.1" 200 None
2026-03-20 19:08:18,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:08:18,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baf81621a77312e2221e03 HTTP/1.1" 200 None
2026-03-20 19:08:18,450 - lava_callback - ERROR - Error processing callback for node 69baf81621a77312e2221e03: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:46862 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42716 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33410 - "GET / HTTP/1.0" 200 OK
2026-03-20 19:08:56,439 - lava_callback - INFO - Received callback for node 69baf84621a77312e2221e0a
INFO: 172.19.0.1:53340 - "POST /node/69baf84621a77312e2221e0a HTTP/1.0" 202 Accepted
2026-03-20 19:08:56,444 - lava_callback - INFO - Starting async job submit for node 69baf84621a77312e2221e0a
2026-03-20 19:08:56,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:08:56,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf84621a77312e2221e0a HTTP/1.1" 200 None
2026-03-20 19:08:56,502 - lava_callback - DEBUG - Processing node 69baf84621a77312e2221e0a: baseline-arm-clabbe
2026-03-20 19:08:56,502 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69baf84621a77312e2221e0a
2026-03-20 19:08:56,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:08:56,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf84621a77312e2221e0a HTTP/1.1" 200 None
INFO: 172.19.0.1:53356 - "GET / HTTP/1.0" 200 OK
2026-03-20 19:08:56,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:08:56,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None
2026-03-20 19:08:56,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:08:56,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baf84621a77312e2221e0a HTTP/1.1" 200 None
2026-03-20 19:08:56,559 - lava_callback - ERROR - Error processing callback for node 69baf84621a77312e2221e0a: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:53364 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36026 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33440 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:33448 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33408 - "GET / HTTP/1.0" 200 OK
2026-03-20 19:09:28,052 - lava_callback - INFO - Received callback for node 69bd97ff0e93e231472417ee
INFO: 172.19.0.1:33416 - "POST /node/69bd97ff0e93e231472417ee HTTP/1.0" 202 Accepted
2026-03-20 19:09:28,059 - lava_callback - INFO - Starting async job submit for node 69bd97ff0e93e231472417ee
2026-03-20 19:09:28,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:09:28,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd97ff0e93e231472417ee HTTP/1.1" 200 None
2026-03-20 19:09:28,139 - lava_callback - DEBUG - Processing node 69bd97ff0e93e231472417ee: baseline-nfs-arm64
2026-03-20 19:09:28,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 19:09:29,075 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 19:09:29,077 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd97ff0e93e231472417ee/log.txt.gz
2026-03-20 19:09:29,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 19:09:29,776 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 19:09:29,779 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd97ff0e93e231472417ee/lava-logs.yaml
2026-03-20 19:09:29,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 19:09:29,955 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 19:09:29,957 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd97ff0e93e231472417ee/lava_callback.json.gz
DEBUG: Setup failed for 69bd97ff0e93e231472417ee. Transitting job node result: incomplete -> fail
2026-03-20 19:09:30,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:09:30,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd97ff0e93e231472417ee HTTP/1.1" 200 None
2026-03-20 19:09:30,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:09:30,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 19:09:30,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:09:30,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd97ff0e93e231472417ee HTTP/1.1" 200 None
2026-03-20 19:09:30,218 - lava_callback - INFO - Completed processing callback for node 69bd97ff0e93e231472417ee
INFO: 172.19.0.1:60458 - "GET / HTTP/1.0" 200 OK
2026-03-20 19:09:41,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:09:41,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:56554 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60262 - "GET / HTTP/1.0" 200 OK
2026-03-20 19:09:56,555 - lava_callback - INFO - Received callback for node 69baf87021a77312e2221e15
INFO: 172.19.0.1:60272 - "POST /node/69baf87021a77312e2221e15 HTTP/1.0" 202 Accepted
2026-03-20 19:09:56,560 - lava_callback - INFO - Starting async job submit for node 69baf87021a77312e2221e15
2026-03-20 19:09:56,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:09:56,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf87021a77312e2221e15 HTTP/1.1" 200 None
2026-03-20 19:09:56,577 - lava_callback - DEBUG - Processing node 69baf87021a77312e2221e15: baseline-arm-clabbe
2026-03-20 19:09:56,577 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69baf87021a77312e2221e15
2026-03-20 19:09:56,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:09:56,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf87021a77312e2221e15 HTTP/1.1" 200 None
2026-03-20 19:09:56,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:09:56,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None
2026-03-20 19:09:56,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:09:56,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baf87021a77312e2221e15 HTTP/1.1" 200 None
2026-03-20 19:09:56,628 - lava_callback - ERROR - Error processing callback for node 69baf87021a77312e2221e15: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:60284 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37544 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38576 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:38586 - "GET / HTTP/1.0" 200 OK
2026-03-20 19:10:18,419 - lava_callback - INFO - Received callback for node 69baf89721a77312e2221e1c
INFO: 172.19.0.1:38602 - "POST /node/69baf89721a77312e2221e1c HTTP/1.0" 202 Accepted
2026-03-20 19:10:18,425 - lava_callback - INFO - Starting async job submit for node 69baf89721a77312e2221e1c
2026-03-20 19:10:18,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:10:18,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf89721a77312e2221e1c HTTP/1.1" 200 None
2026-03-20 19:10:18,441 - lava_callback - DEBUG - Processing node 69baf89721a77312e2221e1c: baseline-arm-baylibre
2026-03-20 19:10:18,441 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69baf89721a77312e2221e1c
2026-03-20 19:10:18,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:10:18,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf89721a77312e2221e1c HTTP/1.1" 200 None
2026-03-20 19:10:18,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:10:18,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9ef76d5731cbd74145fb9 HTTP/1.1" 200 None
2026-03-20 19:10:18,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:10:18,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baf89721a77312e2221e1c HTTP/1.1" 200 None
2026-03-20 19:10:18,509 - lava_callback - ERROR - Error processing callback for node 69baf89721a77312e2221e1c: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:39888 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56266 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47634 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45944 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45954 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35926 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44412 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:44414 - "GET / HTTP/1.0" 200 OK
2026-03-20 19:11:18,465 - lava_callback - INFO - Received callback for node 69baf8c321a77312e2221e26
INFO: 172.19.0.1:44420 - "POST /node/69baf8c321a77312e2221e26 HTTP/1.0" 202 Accepted
2026-03-20 19:11:18,471 - lava_callback - INFO - Starting async job submit for node 69baf8c321a77312e2221e26
2026-03-20 19:11:18,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:11:18,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf8c321a77312e2221e26 HTTP/1.1" 200 None
2026-03-20 19:11:18,489 - lava_callback - DEBUG - Processing node 69baf8c321a77312e2221e26: baseline-arm-baylibre
2026-03-20 19:11:18,489 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69baf8c321a77312e2221e26
2026-03-20 19:11:18,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:11:18,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf8c321a77312e2221e26 HTTP/1.1" 200 None
2026-03-20 19:11:18,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:11:18,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9ef76d5731cbd74145fb9 HTTP/1.1" 200 None
2026-03-20 19:11:18,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:11:18,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baf8c321a77312e2221e26 HTTP/1.1" 200 None
2026-03-20 19:11:18,540 - lava_callback - ERROR - Error processing callback for node 69baf8c321a77312e2221e26: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:33968 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35636 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57662 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45794 - "GET / HTTP/1.0" 200 OK
2026-03-20 19:11:56,594 - lava_callback - INFO - Received callback for node 69baf8f121a77312e2221e2f
INFO: 172.19.0.1:45806 - "POST /node/69baf8f121a77312e2221e2f HTTP/1.0" 202 Accepted
2026-03-20 19:11:56,600 - lava_callback - INFO - Starting async job submit for node 69baf8f121a77312e2221e2f
2026-03-20 19:11:56,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:11:56,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf8f121a77312e2221e2f HTTP/1.1" 200 None
2026-03-20 19:11:56,615 - lava_callback - DEBUG - Processing node 69baf8f121a77312e2221e2f: baseline-arm-clabbe
2026-03-20 19:11:56,615 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69baf8f121a77312e2221e2f
2026-03-20 19:11:56,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:11:56,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf8f121a77312e2221e2f HTTP/1.1" 200 None
2026-03-20 19:11:56,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:11:56,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None
2026-03-20 19:11:56,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:11:56,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baf8f121a77312e2221e2f HTTP/1.1" 200 None
2026-03-20 19:11:56,683 - lava_callback - ERROR - Error processing callback for node 69baf8f121a77312e2221e2f: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:45814 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53524 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45566 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:45580 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42574 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36160 - "GET / HTTP/1.0" 200 OK
2026-03-20 19:12:38,614 - lava_callback - INFO - Received callback for node 69baf91921a77312e2221e38
INFO: 172.19.0.1:36166 - "POST /node/69baf91921a77312e2221e38 HTTP/1.0" 202 Accepted
2026-03-20 19:12:38,620 - lava_callback - INFO - Starting async job submit for node 69baf91921a77312e2221e38
2026-03-20 19:12:38,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:12:38,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf91921a77312e2221e38 HTTP/1.1" 200 None
2026-03-20 19:12:38,635 - lava_callback - DEBUG - Processing node 69baf91921a77312e2221e38: baseline-arm-baylibre
2026-03-20 19:12:38,636 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69baf91921a77312e2221e38
2026-03-20 19:12:38,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:12:38,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf91921a77312e2221e38 HTTP/1.1" 200 None
2026-03-20 19:12:38,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:12:38,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9ef76d5731cbd74145fb9 HTTP/1.1" 200 None
2026-03-20 19:12:38,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:12:38,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baf91921a77312e2221e38 HTTP/1.1" 200 None
2026-03-20 19:12:38,709 - lava_callback - ERROR - Error processing callback for node 69baf91921a77312e2221e38: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:43106 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60598 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60604 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54386 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41648 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:41662 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42520 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58588 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57992 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50676 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50688 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55730 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55098 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:55100 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53894 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38120 - "GET / HTTP/1.0" 200 OK
2026-03-20 19:14:36,797 - lava_callback - INFO - Received callback for node 69baf99921a77312e2221e53
INFO: 172.19.0.1:38122 - "POST /node/69baf99921a77312e2221e53 HTTP/1.0" 202 Accepted
2026-03-20 19:14:36,803 - lava_callback - INFO - Starting async job submit for node 69baf99921a77312e2221e53
2026-03-20 19:14:36,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:14:36,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf99921a77312e2221e53 HTTP/1.1" 200 None
2026-03-20 19:14:36,824 - lava_callback - DEBUG - Processing node 69baf99921a77312e2221e53: baseline-arm-clabbe
2026-03-20 19:14:36,824 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69baf99921a77312e2221e53
2026-03-20 19:14:36,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:14:36,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf99921a77312e2221e53 HTTP/1.1" 200 None
2026-03-20 19:14:36,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:14:36,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9ef76d5731cbd74145fb9 HTTP/1.1" 200 None
2026-03-20 19:14:36,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:14:36,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baf99921a77312e2221e53 HTTP/1.1" 200 None
2026-03-20 19:14:36,884 - lava_callback - ERROR - Error processing callback for node 69baf99921a77312e2221e53: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:35300 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52292 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52304 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35898 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54262 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:54272 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35070 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59904 - "GET / HTTP/1.0" 200 OK
2026-03-20 19:15:36,789 - lava_callback - INFO - Received callback for node 69baf9c521a77312e2221e5c
INFO: 172.19.0.1:59906 - "POST /node/69baf9c521a77312e2221e5c HTTP/1.0" 202 Accepted
2026-03-20 19:15:36,794 - lava_callback - INFO - Starting async job submit for node 69baf9c521a77312e2221e5c
2026-03-20 19:15:36,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:15:36,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf9c521a77312e2221e5c HTTP/1.1" 200 None
2026-03-20 19:15:36,810 - lava_callback - DEBUG - Processing node 69baf9c521a77312e2221e5c: baseline-arm-clabbe
2026-03-20 19:15:36,810 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69baf9c521a77312e2221e5c
2026-03-20 19:15:36,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:15:36,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf9c521a77312e2221e5c HTTP/1.1" 200 None
2026-03-20 19:15:36,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:15:36,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9ef76d5731cbd74145fb9 HTTP/1.1" 200 None
2026-03-20 19:15:36,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:15:36,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baf9c521a77312e2221e5c HTTP/1.1" 200 None
2026-03-20 19:15:36,865 - lava_callback - ERROR - Error processing callback for node 69baf9c521a77312e2221e5c: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:38330 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55324 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55336 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37346 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43510 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:43526 - "GET / HTTP/1.0" 200 OK
2026-03-20 19:16:16,777 - lava_callback - INFO - Received callback for node 69baf9ef21a77312e2221e65
INFO: 172.19.0.1:43538 - "POST /node/69baf9ef21a77312e2221e65 HTTP/1.0" 202 Accepted
2026-03-20 19:16:16,783 - lava_callback - INFO - Starting async job submit for node 69baf9ef21a77312e2221e65
2026-03-20 19:16:16,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:16:16,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf9ef21a77312e2221e65 HTTP/1.1" 200 None
2026-03-20 19:16:16,798 - lava_callback - DEBUG - Processing node 69baf9ef21a77312e2221e65: baseline-arm-clabbe
2026-03-20 19:16:16,799 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69baf9ef21a77312e2221e65
2026-03-20 19:16:16,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:16:16,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baf9ef21a77312e2221e65 HTTP/1.1" 200 None
2026-03-20 19:16:16,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:16:16,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9ef76d5731cbd74145fb9 HTTP/1.1" 200 None
2026-03-20 19:16:16,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:16:16,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baf9ef21a77312e2221e65 HTTP/1.1" 200 None
2026-03-20 19:16:16,849 - lava_callback - ERROR - Error processing callback for node 69baf9ef21a77312e2221e65: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:55572 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49446 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58074 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55070 - "GET / HTTP/1.0" 200 OK
2026-03-20 19:16:56,898 - lava_callback - INFO - Received callback for node 69bafa1921a77312e2221e70
INFO: 172.19.0.1:55072 - "POST /node/69bafa1921a77312e2221e70 HTTP/1.0" 202 Accepted
2026-03-20 19:16:56,904 - lava_callback - INFO - Starting async job submit for node 69bafa1921a77312e2221e70
2026-03-20 19:16:56,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:16:56,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bafa1921a77312e2221e70 HTTP/1.1" 200 None
2026-03-20 19:16:56,920 - lava_callback - DEBUG - Processing node 69bafa1921a77312e2221e70: baseline-arm-clabbe
2026-03-20 19:16:56,920 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bafa1921a77312e2221e70
2026-03-20 19:16:56,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:16:56,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bafa1921a77312e2221e70 HTTP/1.1" 200 None
2026-03-20 19:16:56,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:16:56,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9ef76d5731cbd74145fb9 HTTP/1.1" 200 None
2026-03-20 19:16:56,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:16:56,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bafa1921a77312e2221e70 HTTP/1.1" 200 None
2026-03-20 19:16:56,984 - lava_callback - ERROR - Error processing callback for node 69bafa1921a77312e2221e70: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:55084 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55080 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51754 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:51756 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52130 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60796 - "GET / HTTP/1.0" 200 OK
2026-03-20 19:17:36,838 - lava_callback - INFO - Received callback for node 69bafa4421a77312e2221e77
INFO: 172.19.0.1:60806 - "POST /node/69bafa4421a77312e2221e77 HTTP/1.0" 202 Accepted
2026-03-20 19:17:36,843 - lava_callback - INFO - Starting async job submit for node 69bafa4421a77312e2221e77
2026-03-20 19:17:36,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:17:36,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bafa4421a77312e2221e77 HTTP/1.1" 200 None
2026-03-20 19:17:36,859 - lava_callback - DEBUG - Processing node 69bafa4421a77312e2221e77: baseline-arm-clabbe
2026-03-20 19:17:36,859 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bafa4421a77312e2221e77
2026-03-20 19:17:36,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:17:36,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bafa4421a77312e2221e77 HTTP/1.1" 200 None
2026-03-20 19:17:36,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:17:36,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9ef76d5731cbd74145fb9 HTTP/1.1" 200 None
2026-03-20 19:17:36,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:17:36,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bafa4421a77312e2221e77 HTTP/1.1" 200 None
2026-03-20 19:17:36,911 - lava_callback - ERROR - Error processing callback for node 69bafa4421a77312e2221e77: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:34322 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55028 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55038 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52552 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60256 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:60268 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35520 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56664 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59754 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43238 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43246 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50218 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40514 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:40518 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60864 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36330 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49396 - "GET / HTTP/1.0" 200 OK
2026-03-20 19:19:56,420 - lava_callback - INFO - Received callback for node 69bd9c190e93e2314724190b
INFO: 172.19.0.1:40232 - "POST /node/69bd9c190e93e2314724190b HTTP/1.0" 202 Accepted
2026-03-20 19:19:56,428 - lava_callback - INFO - Starting async job submit for node 69bd9c190e93e2314724190b
2026-03-20 19:19:56,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:19:56,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd9c190e93e2314724190b HTTP/1.1" 200 None
2026-03-20 19:19:56,489 - lava_callback - DEBUG - Processing node 69bd9c190e93e2314724190b: baseline-arm64
INFO: 172.19.0.1:40244 - "GET / HTTP/1.0" 200 OK
2026-03-20 19:19:56,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 19:19:57,067 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 19:19:57,069 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd9c190e93e2314724190b/log.txt.gz
2026-03-20 19:19:57,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 19:19:57,498 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 19:19:57,500 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd9c190e93e2314724190b/lava-logs.yaml
2026-03-20 19:19:57,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 19:19:57,675 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 19:19:57,676 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd9c190e93e2314724190b/lava_callback.json.gz
DEBUG: Setup failed for 69bd9c190e93e2314724190b. Transitting job node result: incomplete -> fail
2026-03-20 19:19:57,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:19:57,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd9c190e93e2314724190b HTTP/1.1" 200 None
2026-03-20 19:19:57,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:19:57,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 19:19:57,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:19:57,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd9c190e93e2314724190b HTTP/1.1" 200 None
2026-03-20 19:19:57,892 - lava_callback - INFO - Completed processing callback for node 69bd9c190e93e2314724190b
INFO: 172.19.0.1:40246 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51846 - "GET / HTTP/1.0" 200 OK
2026-03-20 19:20:11,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:20:11,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:39718 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:39732 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37378 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51908 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60414 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46388 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46392 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35344 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37466 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:37476 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59444 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37228 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41504 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58618 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58624 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51690 - "GET / HTTP/1.0" 200 OK
2026-03-20 19:22:11,347 - lava_callback - INFO - Received callback for node 69bd9a320e93e2314724188b
INFO: 172.19.0.1:51908 - "POST /node/69bd9a320e93e2314724188b HTTP/1.0" 202 Accepted
2026-03-20 19:22:11,354 - lava_callback - INFO - Starting async job submit for node 69bd9a320e93e2314724188b
2026-03-20 19:22:11,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:22:11,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd9a320e93e2314724188b HTTP/1.1" 200 None
2026-03-20 19:22:11,450 - lava_callback - DEBUG - Processing node 69bd9a320e93e2314724188b: ltp-smoke
2026-03-20 19:22:11,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 19:22:12,174 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 19:22:12,176 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69bd9a320e93e2314724188b/log.txt.gz
2026-03-20 19:22:12,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 19:22:12,693 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 19:22:12,695 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69bd9a320e93e2314724188b/lava-logs.yaml
2026-03-20 19:22:12,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 19:22:12,891 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 19:22:12,893 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69bd9a320e93e2314724188b/lava_callback.json.gz
2026-03-20 19:22:13,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:22:13,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd9a320e93e2314724188b HTTP/1.1" 200 None
2026-03-20 19:22:13,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:22:13,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73350e93e2314723e2bb HTTP/1.1" 200 None
2026-03-20 19:22:13,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:22:13,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd9a320e93e2314724188b HTTP/1.1" 200 None
2026-03-20 19:22:13,208 - lava_callback - INFO - Completed processing callback for node 69bd9a320e93e2314724188b
INFO: 172.19.0.1:51910 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:51926 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51262 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44622 - "GET / HTTP/1.0" 200 OK
2026-03-20 19:22:41,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:22:41,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:58900 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50444 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50448 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49508 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39840 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:39852 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41530 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40392 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43236 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39440 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39442 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50398 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59480 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:59492 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53320 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43098 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35384 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50810 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50826 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49758 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38194 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:38196 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48738 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38326 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54562 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51642 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51646 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38810 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54342 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:54352 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52410 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34694 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41350 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52716 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52728 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54694 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40592 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:40594 - "GET / HTTP/1.0" 200 OK
2026-03-20 19:27:24,795 - lava_callback - INFO - Received callback for node 69bd9b7b0e93e231472418e4
INFO: 172.19.0.1:47172 - "POST /node/69bd9b7b0e93e231472418e4 HTTP/1.0" 202 Accepted
2026-03-20 19:27:24,801 - lava_callback - INFO - Starting async job submit for node 69bd9b7b0e93e231472418e4
2026-03-20 19:27:24,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:27:24,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd9b7b0e93e231472418e4 HTTP/1.1" 200 None
2026-03-20 19:27:24,881 - lava_callback - DEBUG - Processing node 69bd9b7b0e93e231472418e4: baseline-arm
2026-03-20 19:27:25,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 19:27:25,643 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 19:27:25,645 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69bd9b7b0e93e231472418e4/log.txt.gz
2026-03-20 19:27:25,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 19:27:26,216 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 19:27:26,218 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69bd9b7b0e93e231472418e4/lava-logs.yaml
2026-03-20 19:27:26,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 19:27:26,402 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 19:27:26,404 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69bd9b7b0e93e231472418e4/lava_callback.json.gz
DEBUG: Setup failed for 69bd9b7b0e93e231472418e4. Transitting job node result: incomplete -> fail
2026-03-20 19:27:26,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:27:26,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd9b7b0e93e231472418e4 HTTP/1.1" 200 None
2026-03-20 19:27:26,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
INFO: 172.19.0.1:47178 - "GET / HTTP/1.0" 200 OK
2026-03-20 19:27:26,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd732d0e93e2314723e2b5 HTTP/1.1" 200 None
2026-03-20 19:27:26,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:27:26,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd9b7b0e93e231472418e4 HTTP/1.1" 200 None
2026-03-20 19:27:26,684 - lava_callback - INFO - Completed processing callback for node 69bd9b7b0e93e231472418e4
INFO: 172.19.0.1:44000 - "GET / HTTP/1.0" 200 OK
2026-03-20 19:27:41,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:27:41,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:56278 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43870 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43876 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37732 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34270 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:34276 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49950 - "GET / HTTP/1.0" 200 OK
2026-03-20 19:28:30,406 - lava_callback - INFO - Received callback for node 69bd9b320e93e231472418cc
INFO: 172.19.0.1:45892 - "POST /node/69bd9b320e93e231472418cc HTTP/1.0" 202 Accepted
2026-03-20 19:28:30,414 - lava_callback - INFO - Starting async job submit for node 69bd9b320e93e231472418cc
2026-03-20 19:28:30,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:28:30,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd9b320e93e231472418cc HTTP/1.1" 200 None
2026-03-20 19:28:30,474 - lava_callback - DEBUG - Processing node 69bd9b320e93e231472418cc: baseline-nfs-arm64
2026-03-20 19:28:31,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 19:28:31,867 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 19:28:31,868 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd9b320e93e231472418cc/log.txt.gz
2026-03-20 19:28:32,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 19:28:32,780 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 19:28:32,783 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd9b320e93e231472418cc/lava-logs.yaml
2026-03-20 19:28:32,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 19:28:33,002 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 19:28:33,004 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd9b320e93e231472418cc/lava_callback.json.gz
DEBUG: Setup failed for 69bd9b320e93e231472418cc. Transitting job node result: incomplete -> fail
2026-03-20 19:28:33,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:28:33,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd9b320e93e231472418cc HTTP/1.1" 200 None
2026-03-20 19:28:33,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:28:33,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 19:28:33,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:28:33,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd9b320e93e231472418cc HTTP/1.1" 200 None
2026-03-20 19:28:33,245 - lava_callback - INFO - Completed processing callback for node 69bd9b320e93e231472418cc
INFO: 172.19.0.1:45906 - "GET / HTTP/1.0" 200 OK
2026-03-20 19:28:41,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:28:41,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:44390 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54842 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54844 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36802 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58690 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:58704 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38484 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60746 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40080 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45342 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45354 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:32930 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58648 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:58656 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53394 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55736 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58956 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53728 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53730 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44206 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57760 - "GET /api/metrics HTTP/1.0" 200 OK
2026-03-20 19:31:16,342 - lava_callback - INFO - Received callback for node 69bd9bf40e93e231472418fc
INFO: 172.19.0.1:57774 - "POST /node/69bd9bf40e93e231472418fc HTTP/1.0" 202 Accepted
2026-03-20 19:31:16,389 - lava_callback - INFO - Starting async job submit for node 69bd9bf40e93e231472418fc
2026-03-20 19:31:16,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:31:16,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd9bf40e93e231472418fc HTTP/1.1" 200 None
2026-03-20 19:31:16,432 - lava_callback - DEBUG - Processing node 69bd9bf40e93e231472418fc: baseline-arm-pengutronix
INFO: 172.19.0.1:57782 - "GET / HTTP/1.0" 200 OK
2026-03-20 19:31:16,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 19:31:16,735 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 19:31:16,736 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69bd9bf40e93e231472418fc/log.txt.gz
2026-03-20 19:31:16,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 19:31:17,044 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 19:31:17,045 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69bd9bf40e93e231472418fc/lava-logs.yaml
2026-03-20 19:31:17,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 19:31:17,285 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 19:31:17,286 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69bd9bf40e93e231472418fc/lava_callback.json.gz
DEBUG: Setup failed for 69bd9bf40e93e231472418fc. Transitting job node result: incomplete -> fail
2026-03-20 19:31:17,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:31:17,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd9bf40e93e231472418fc HTTP/1.1" 200 None
2026-03-20 19:31:17,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:31:17,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd732d0e93e2314723e2b5 HTTP/1.1" 200 None
2026-03-20 19:31:17,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:31:17,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd9bf40e93e231472418fc HTTP/1.1" 200 None
2026-03-20 19:31:17,452 - lava_callback - INFO - Completed processing callback for node 69bd9bf40e93e231472418fc
INFO: 172.19.0.1:48516 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33956 - "GET / HTTP/1.0" 200 OK
2026-03-20 19:31:41,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:31:41,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:48850 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36756 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36772 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56248 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50044 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:50052 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57176 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48364 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60862 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50608 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50610 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54004 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49974 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:49980 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46594 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57904 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37050 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57132 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57138 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57934 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54738 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:54740 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58220 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39902 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44694 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50206 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50214 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40812 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36304 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:36312 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59660 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55026 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42308 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45012 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45026 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60640 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41296 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:41306 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39662 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43014 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51090 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35096 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35104 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43024 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56378 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:56382 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54654 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43414 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45968 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47950 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47966 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54096 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35068 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:35084 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49784 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55990 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56130 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33086 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33096 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47070 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55780 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:55794 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42144 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37644 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59974 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57566 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57578 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42886 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60558 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:60566 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48338 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55710 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56612 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55184 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55186 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54848 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54670 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:54676 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37688 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46596 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34828 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38144 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38158 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60254 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43852 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:43856 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48596 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52048 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42510 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35432 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35446 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59618 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36360 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:36370 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37574 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56922 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57714 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53666 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53668 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46168 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44128 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:44142 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57312 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43478 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38728 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53628 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53632 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34390 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34660 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:34670 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54652 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44328 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47968 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48740 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48746 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46908 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60552 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:60566 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35576 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55742 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57200 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53752 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53768 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52972 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44386 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:44402 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43854 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34080 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47764 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55982 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55998 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59828 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58000 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:58008 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57656 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37340 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49306 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44550 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44562 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59316 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45386 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:45388 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53728 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51540 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46350 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59690 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59698 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47328 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48904 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:48916 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48568 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50894 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42478 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42614 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42618 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51930 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39504 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:39514 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42574 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54576 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40392 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40406 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41670 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41674 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41688 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45924 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45928 - "GET /favicon.ico HTTP/1.0" 404 Not Found
INFO: 172.19.0.1:52930 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:52934 - "GET / HTTP/1.0" 200 OK
2026-03-20 19:52:18,064 - lava_callback - INFO - Received callback for node 69bda20e0e93e23147241bec
INFO: 172.19.0.1:52948 - "POST /node/69bda20e0e93e23147241bec HTTP/1.0" 202 Accepted
2026-03-20 19:52:18,071 - lava_callback - INFO - Starting async job submit for node 69bda20e0e93e23147241bec
2026-03-20 19:52:18,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:52:18,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bda20e0e93e23147241bec HTTP/1.1" 200 None
2026-03-20 19:52:18,135 - lava_callback - DEBUG - Processing node 69bda20e0e93e23147241bec: baseline-arm64
2026-03-20 19:52:18,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 19:52:19,030 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 19:52:19,031 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bda20e0e93e23147241bec/log.txt.gz
2026-03-20 19:52:19,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 19:52:19,711 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 19:52:19,713 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bda20e0e93e23147241bec/lava-logs.yaml
2026-03-20 19:52:19,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 19:52:19,910 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 19:52:19,912 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bda20e0e93e23147241bec/lava_callback.json.gz
DEBUG: Setup failed for 69bda20e0e93e23147241bec. Transitting job node result: incomplete -> fail
2026-03-20 19:52:20,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:52:20,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bda20e0e93e23147241bec HTTP/1.1" 200 None
2026-03-20 19:52:20,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:52:20,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 19:52:20,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:52:20,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bda20e0e93e23147241bec HTTP/1.1" 200 None
2026-03-20 19:52:20,172 - lava_callback - INFO - Completed processing callback for node 69bda20e0e93e23147241bec
INFO: 172.19.0.1:56406 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45092 - "GET / HTTP/1.0" 200 OK
2026-03-20 19:52:41,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:52:41,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:56950 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41260 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41272 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53836 - "GET /wiki HTTP/1.0" 404 Not Found
INFO: 172.19.0.1:53850 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54392 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:54404 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43540 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39180 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45258 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51368 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51380 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35524 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36236 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:36244 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52054 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48714 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51106 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44428 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44438 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39540 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39546 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39558 - "GET /favicon.ico HTTP/1.0" 404 Not Found
INFO: 172.19.0.1:46978 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:46988 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35250 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57676 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:32866 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38828 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38836 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35244 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39562 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:39572 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43452 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43462 - "GET /robots.txt HTTP/1.0" 404 Not Found
INFO: 172.19.0.1:41372 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48138 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37238 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37244 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56798 - "GET / HTTP/1.0" 200 OK
2026-03-20 19:57:07,016 - lava_callback - INFO - Received callback for node 69bda3330e93e23147241cce
INFO: 172.19.0.1:56804 - "POST /node/69bda3330e93e23147241cce HTTP/1.0" 202 Accepted
2026-03-20 19:57:07,023 - lava_callback - INFO - Starting async job submit for node 69bda3330e93e23147241cce
2026-03-20 19:57:07,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:57:07,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bda3330e93e23147241cce HTTP/1.1" 200 None
2026-03-20 19:57:07,089 - lava_callback - DEBUG - Processing node 69bda3330e93e23147241cce: baseline-nfs-arm64
2026-03-20 19:57:07,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 19:57:08,040 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 19:57:08,042 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bda3330e93e23147241cce/log.txt.gz
2026-03-20 19:57:08,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 19:57:08,744 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 19:57:08,747 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bda3330e93e23147241cce/lava-logs.yaml
2026-03-20 19:57:08,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 19:57:08,951 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 19:57:08,952 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bda3330e93e23147241cce/lava_callback.json.gz
DEBUG: Setup failed for 69bda3330e93e23147241cce. Transitting job node result: incomplete -> fail
2026-03-20 19:57:09,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:57:09,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bda3330e93e23147241cce HTTP/1.1" 200 None
2026-03-20 19:57:09,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:57:09,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 19:57:09,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:57:09,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bda3330e93e23147241cce HTTP/1.1" 200 None
2026-03-20 19:57:09,214 - lava_callback - INFO - Completed processing callback for node 69bda3330e93e23147241cce
2026-03-20 19:57:11,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:57:11,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:53864 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:53876 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52262 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43950 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57544 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59236 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59252 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58340 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44386 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:44388 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57030 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45952 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55448 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51242 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51256 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44604 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56278 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:56284 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52336 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43282 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59616 - "GET / HTTP/1.0" 200 OK
2026-03-20 19:59:55,039 - lava_callback - INFO - Received callback for node 69bda3ce0e93e23147241d3a
INFO: 172.19.0.1:52976 - "POST /node/69bda3ce0e93e23147241d3a HTTP/1.0" 202 Accepted
2026-03-20 19:59:55,045 - lava_callback - INFO - Starting async job submit for node 69bda3ce0e93e23147241d3a
2026-03-20 19:59:55,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:59:55,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bda3ce0e93e23147241d3a HTTP/1.1" 200 None
2026-03-20 19:59:55,136 - lava_callback - DEBUG - Processing node 69bda3ce0e93e23147241d3a: baseline-arm
2026-03-20 19:59:55,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 19:59:55,765 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 19:59:55,767 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69bda3ce0e93e23147241d3a/log.txt.gz
2026-03-20 19:59:56,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 19:59:56,272 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 19:59:56,274 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69bda3ce0e93e23147241d3a/lava-logs.yaml
2026-03-20 19:59:56,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 19:59:56,445 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 19:59:56,446 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69bda3ce0e93e23147241d3a/lava_callback.json.gz
DEBUG: Setup failed for 69bda3ce0e93e23147241d3a. Transitting job node result: incomplete -> fail
2026-03-20 19:59:56,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:59:56,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bda3ce0e93e23147241d3a HTTP/1.1" 200 None
2026-03-20 19:59:56,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:59:56,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd732d0e93e2314723e2b5 HTTP/1.1" 200 None
2026-03-20 19:59:56,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 19:59:56,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bda3ce0e93e23147241d3a HTTP/1.1" 200 None
INFO: 172.19.0.1:52980 - "GET / HTTP/1.0" 200 OK
2026-03-20 19:59:56,715 - lava_callback - INFO - Completed processing callback for node 69bda3ce0e93e23147241d3a
INFO: 172.19.0.1:52982 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37844 - "GET / HTTP/1.0" 200 OK
2026-03-20 20:00:11,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:00:11,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:48732 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:48748 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54050 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56726 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39372 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50946 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50960 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39570 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47842 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:47856 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48556 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51852 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38462 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33128 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33144 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51072 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48444 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:48448 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39186 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40384 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55508 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44708 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44710 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36936 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53822 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:53834 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51154 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38564 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60790 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51832 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51834 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41514 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53012 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:53014 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55082 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51724 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55556 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35402 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35414 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41576 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60138 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:60142 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39576 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47210 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42688 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41506 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41510 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59368 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36486 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:36494 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35554 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50810 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42932 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36058 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36066 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51432 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44162 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:44172 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40216 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34612 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58378 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41898 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41900 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48424 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54682 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:54684 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43944 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48458 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45440 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44086 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44092 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53346 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57140 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:57144 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41132 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43144 - "GET / HTTP/1.0" 200 OK
2026-03-20 20:09:37,088 - lava_callback - INFO - Received callback for node 69bda4f50e93e23147241dbf
INFO: 172.19.0.1:43154 - "POST /node/69bda4f50e93e23147241dbf HTTP/1.0" 202 Accepted
2026-03-20 20:09:37,137 - lava_callback - INFO - Starting async job submit for node 69bda4f50e93e23147241dbf
2026-03-20 20:09:37,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:09:37,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bda4f50e93e23147241dbf HTTP/1.1" 200 None
2026-03-20 20:09:37,202 - lava_callback - DEBUG - Processing node 69bda4f50e93e23147241dbf: baseline-arm-pengutronix
2026-03-20 20:09:37,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 20:09:37,501 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 20:09:37,503 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69bda4f50e93e23147241dbf/log.txt.gz
2026-03-20 20:09:37,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 20:09:37,768 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 20:09:37,770 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69bda4f50e93e23147241dbf/lava-logs.yaml
2026-03-20 20:09:37,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 20:09:37,915 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 20:09:37,917 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69bda4f50e93e23147241dbf/lava_callback.json.gz
DEBUG: Setup failed for 69bda4f50e93e23147241dbf. Transitting job node result: incomplete -> fail
2026-03-20 20:09:37,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:09:37,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bda4f50e93e23147241dbf HTTP/1.1" 200 None
2026-03-20 20:09:37,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:09:37,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd732d0e93e2314723e2b5 HTTP/1.1" 200 None
2026-03-20 20:09:37,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:09:38,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bda4f50e93e23147241dbf HTTP/1.1" 200 None
2026-03-20 20:09:38,084 - lava_callback - INFO - Completed processing callback for node 69bda4f50e93e23147241dbf
2026-03-20 20:09:41,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:09:41,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:34398 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48638 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48654 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50362 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59560 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:59562 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58242 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33058 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59902 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38772 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38778 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57534 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40858 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:40866 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52358 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55680 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53934 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54826 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54842 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56556 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60100 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:60106 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36980 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37976 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38942 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42820 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42832 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50590 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55142 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:55146 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57818 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46816 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59254 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35770 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35774 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37992 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59098 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:59114 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40248 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39932 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38068 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59940 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37256 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37262 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39174 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:39190 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49516 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33524 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49782 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56290 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58684 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58692 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50184 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:50188 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35290 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40484 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50716 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47686 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50824 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50826 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44912 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:44918 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48304 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36928 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51132 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33502 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37758 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37768 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51832 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:51840 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58800 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35028 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39270 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60022 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46936 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46946 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35464 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:35474 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36132 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37574 - "GET / HTTP/1.0" 200 OK
2026-03-20 20:19:41,067 - lava_callback - INFO - Received callback for node 69bd99910e93e23147241867
INFO: 172.19.0.1:42514 - "POST /node/69bd99910e93e23147241867 HTTP/1.0" 202 Accepted
2026-03-20 20:19:41,074 - lava_callback - INFO - Starting async job submit for node 69bd99910e93e23147241867
2026-03-20 20:19:41,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:19:41,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd99910e93e23147241867 HTTP/1.1" 200 None
2026-03-20 20:19:41,115 - lava_callback - DEBUG - Processing node 69bd99910e93e23147241867: baseline-arm64
2026-03-20 20:19:41,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 20:19:41,770 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 20:19:41,772 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd99910e93e23147241867/log.txt.gz
2026-03-20 20:19:42,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 20:19:42,291 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 20:19:42,293 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd99910e93e23147241867/lava-logs.yaml
2026-03-20 20:19:42,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 20:19:42,480 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 20:19:42,482 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd99910e93e23147241867/lava_callback.json.gz
2026-03-20 20:19:42,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:19:42,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd99910e93e23147241867 HTTP/1.1" 200 None
2026-03-20 20:19:42,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:19:42,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 20:19:42,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:19:42,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd99910e93e23147241867 HTTP/1.1" 200 None
2026-03-20 20:19:42,642 - lava_callback - INFO - Completed processing callback for node 69bd99910e93e23147241867
INFO: 172.19.0.1:42528 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50406 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53230 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53246 - "GET / HTTP/1.0" 200 OK
2026-03-20 20:20:11,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:20:11,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:48588 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:48596 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47338 - "GET / HTTP/1.0" 200 OK
2026-03-20 20:20:30,640 - lava_callback - INFO - Received callback for node 69bda3ff0e93e23147241d81
INFO: 172.19.0.1:45084 - "POST /node/69bda3ff0e93e23147241d81 HTTP/1.0" 202 Accepted
2026-03-20 20:20:30,648 - lava_callback - INFO - Starting async job submit for node 69bda3ff0e93e23147241d81
2026-03-20 20:20:30,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:20:30,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bda3ff0e93e23147241d81 HTTP/1.1" 200 None
2026-03-20 20:20:30,712 - lava_callback - DEBUG - Processing node 69bda3ff0e93e23147241d81: baseline-nfs-arm64
2026-03-20 20:20:31,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 20:20:32,029 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 20:20:32,031 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bda3ff0e93e23147241d81/log.txt.gz
2026-03-20 20:20:32,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 20:20:32,939 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 20:20:32,942 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bda3ff0e93e23147241d81/lava-logs.yaml
2026-03-20 20:20:32,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 20:20:33,196 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 20:20:33,197 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bda3ff0e93e23147241d81/lava_callback.json.gz
DEBUG: Setup failed for 69bda3ff0e93e23147241d81. Transitting job node result: incomplete -> fail
2026-03-20 20:20:33,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:20:33,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bda3ff0e93e23147241d81 HTTP/1.1" 200 None
2026-03-20 20:20:33,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:20:33,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 20:20:33,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:20:33,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bda3ff0e93e23147241d81 HTTP/1.1" 200 None
2026-03-20 20:20:33,441 - lava_callback - INFO - Completed processing callback for node 69bda3ff0e93e23147241d81
INFO: 172.19.0.1:45086 - "GET / HTTP/1.0" 200 OK
2026-03-20 20:20:41,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:20:41,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:38650 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58726 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41836 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41842 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34530 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:34536 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33230 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47746 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47262 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40292 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38858 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38860 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48504 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:48520 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41744 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56688 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51582 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55552 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37158 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37160 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39718 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:39722 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47226 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53916 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41786 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35904 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43206 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43216 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41658 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:41660 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36764 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45060 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44862 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40272 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49638 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49646 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38754 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:38770 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45786 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57684 - "GET / HTTP/1.0" 200 OK
2026-03-20 20:25:46,389 - lava_callback - INFO - Received callback for node 69bd9a910e93e231472418a5
INFO: 172.19.0.1:56822 - "POST /node/69bd9a910e93e231472418a5 HTTP/1.0" 202 Accepted
2026-03-20 20:25:46,396 - lava_callback - INFO - Starting async job submit for node 69bd9a910e93e231472418a5
2026-03-20 20:25:46,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:25:46,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd9a910e93e231472418a5 HTTP/1.1" 200 None
2026-03-20 20:25:46,446 - lava_callback - DEBUG - Processing node 69bd9a910e93e231472418a5: baseline-nfs-arm64
INFO: 172.19.0.1:56828 - "GET / HTTP/1.0" 200 OK
2026-03-20 20:25:46,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 20:25:47,131 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 20:25:47,133 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd9a910e93e231472418a5/log.txt.gz
2026-03-20 20:25:47,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 20:25:47,637 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 20:25:47,639 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd9a910e93e231472418a5/lava-logs.yaml
2026-03-20 20:25:47,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 20:25:47,816 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 20:25:47,818 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd9a910e93e231472418a5/lava_callback.json.gz
2026-03-20 20:25:47,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:25:47,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd9a910e93e231472418a5 HTTP/1.1" 200 None
2026-03-20 20:25:47,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:25:47,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 20:25:47,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:25:47,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd9a910e93e231472418a5 HTTP/1.1" 200 None
2026-03-20 20:25:47,972 - lava_callback - INFO - Completed processing callback for node 69bd9a910e93e231472418a5
INFO: 172.19.0.1:43870 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58586 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58594 - "GET / HTTP/1.0" 200 OK
2026-03-20 20:26:11,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:26:11,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:36164 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:36168 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57752 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48708 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57260 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60286 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34952 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34964 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52490 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:52496 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37728 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51312 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58756 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42934 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56728 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56730 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46966 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:46974 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57538 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47190 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51920 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46310 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52630 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52640 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34862 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:34870 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59472 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42052 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35004 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51528 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53116 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53122 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59172 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:59174 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51416 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35682 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48732 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35832 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34330 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34346 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38746 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:38756 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39486 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57360 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59372 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41678 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42792 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42800 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59446 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:59458 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52738 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56604 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56738 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41682 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36522 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36530 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38610 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:38616 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38184 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41204 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53974 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49620 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34068 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34070 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33136 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:33150 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38560 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43288 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:32990 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47820 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39026 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39034 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43188 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:43194 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34950 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54638 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36970 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36346 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40326 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40330 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53378 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:53388 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36796 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45178 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42890 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53894 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48532 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48544 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56534 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:56542 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41444 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36826 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56988 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48682 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52006 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52022 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35596 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:35604 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41760 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47966 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40718 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33724 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43034 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43050 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40742 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:40758 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43236 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48400 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41968 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55504 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60472 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60488 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36394 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:36406 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41222 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60622 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38720 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34880 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56880 - "GET / HTTP/1.0" 200 OK
2026-03-20 20:41:03,596 - lava_callback - INFO - Received callback for node 69bb0dd921a77312e2221ed9
INFO: 172.19.0.1:56890 - "POST /node/69bb0dd921a77312e2221ed9 HTTP/1.0" 202 Accepted
2026-03-20 20:41:03,601 - lava_callback - INFO - Starting async job submit for node 69bb0dd921a77312e2221ed9
2026-03-20 20:41:03,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:41:03,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb0dd921a77312e2221ed9 HTTP/1.1" 200 None
2026-03-20 20:41:03,618 - lava_callback - DEBUG - Processing node 69bb0dd921a77312e2221ed9: baseline-arm-baylibre
2026-03-20 20:41:03,618 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb0dd921a77312e2221ed9
2026-03-20 20:41:03,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:41:03,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb0dd921a77312e2221ed9 HTTP/1.1" 200 None
2026-03-20 20:41:03,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:41:03,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None
2026-03-20 20:41:03,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:41:03,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb0dd921a77312e2221ed9 HTTP/1.1" 200 None
2026-03-20 20:41:03,670 - lava_callback - ERROR - Error processing callback for node 69bb0dd921a77312e2221ed9: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:56896 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42534 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:42538 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54870 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48092 - "GET / HTTP/1.0" 200 OK
2026-03-20 20:41:43,457 - lava_callback - INFO - Received callback for node 69bb0e0321a77312e2221ee2
INFO: 172.19.0.1:43088 - "POST /node/69bb0e0321a77312e2221ee2 HTTP/1.0" 202 Accepted
2026-03-20 20:41:43,463 - lava_callback - INFO - Starting async job submit for node 69bb0e0321a77312e2221ee2
2026-03-20 20:41:43,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:41:43,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb0e0321a77312e2221ee2 HTTP/1.1" 200 None
2026-03-20 20:41:43,479 - lava_callback - DEBUG - Processing node 69bb0e0321a77312e2221ee2: baseline-arm-baylibre
2026-03-20 20:41:43,479 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb0e0321a77312e2221ee2
2026-03-20 20:41:43,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:41:43,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb0e0321a77312e2221ee2 HTTP/1.1" 200 None
2026-03-20 20:41:43,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:41:43,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None
2026-03-20 20:41:43,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:41:43,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb0e0321a77312e2221ee2 HTTP/1.1" 200 None
2026-03-20 20:41:43,548 - lava_callback - ERROR - Error processing callback for node 69bb0e0321a77312e2221ee2: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:43098 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51768 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43786 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43800 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52246 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:52254 - "GET / HTTP/1.0" 200 OK
2026-03-20 20:42:23,870 - lava_callback - INFO - Received callback for node 69bb0e2d21a77312e2221eee
INFO: 172.19.0.1:48326 - "POST /node/69bb0e2d21a77312e2221eee HTTP/1.0" 202 Accepted
2026-03-20 20:42:23,875 - lava_callback - INFO - Starting async job submit for node 69bb0e2d21a77312e2221eee
2026-03-20 20:42:23,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:42:23,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb0e2d21a77312e2221eee HTTP/1.1" 200 None
2026-03-20 20:42:23,891 - lava_callback - DEBUG - Processing node 69bb0e2d21a77312e2221eee: baseline-arm-baylibre
2026-03-20 20:42:23,891 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb0e2d21a77312e2221eee
2026-03-20 20:42:23,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:42:23,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb0e2d21a77312e2221eee HTTP/1.1" 200 None
2026-03-20 20:42:23,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:42:23,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None
2026-03-20 20:42:23,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:42:23,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb0e2d21a77312e2221eee HTTP/1.1" 200 None
2026-03-20 20:42:23,977 - lava_callback - ERROR - Error processing callback for node 69bb0e2d21a77312e2221eee: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:48330 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55152 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52826 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59922 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54306 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54318 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40696 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:40708 - "GET / HTTP/1.0" 200 OK
2026-03-20 20:43:23,552 - lava_callback - INFO - Received callback for node 69bb0e5821a77312e2221efa
INFO: 172.19.0.1:50538 - "POST /node/69bb0e5821a77312e2221efa HTTP/1.0" 202 Accepted
2026-03-20 20:43:23,558 - lava_callback - INFO - Starting async job submit for node 69bb0e5821a77312e2221efa
2026-03-20 20:43:23,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:43:23,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb0e5821a77312e2221efa HTTP/1.1" 200 None
2026-03-20 20:43:23,577 - lava_callback - DEBUG - Processing node 69bb0e5821a77312e2221efa: baseline-arm-baylibre
2026-03-20 20:43:23,577 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb0e5821a77312e2221efa
2026-03-20 20:43:23,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:43:23,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb0e5821a77312e2221efa HTTP/1.1" 200 None
2026-03-20 20:43:23,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:43:23,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None
2026-03-20 20:43:23,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:43:23,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb0e5821a77312e2221efa HTTP/1.1" 200 None
2026-03-20 20:43:23,638 - lava_callback - ERROR - Error processing callback for node 69bb0e5821a77312e2221efa: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:50540 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50652 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46012 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43788 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37846 - "GET / HTTP/1.0" 200 OK
2026-03-20 20:44:03,634 - lava_callback - INFO - Received callback for node 69bb0e8f21a77312e2221f09
INFO: 172.19.0.1:37862 - "POST /node/69bb0e8f21a77312e2221f09 HTTP/1.0" 202 Accepted
2026-03-20 20:44:03,643 - lava_callback - INFO - Starting async job submit for node 69bb0e8f21a77312e2221f09
2026-03-20 20:44:03,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:44:03,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb0e8f21a77312e2221f09 HTTP/1.1" 200 None
2026-03-20 20:44:03,659 - lava_callback - DEBUG - Processing node 69bb0e8f21a77312e2221f09: baseline-arm-baylibre
2026-03-20 20:44:03,660 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb0e8f21a77312e2221f09
2026-03-20 20:44:03,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:44:03,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb0e8f21a77312e2221f09 HTTP/1.1" 200 None
2026-03-20 20:44:03,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:44:03,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None
2026-03-20 20:44:03,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:44:03,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb0e8f21a77312e2221f09 HTTP/1.1" 200 None
2026-03-20 20:44:03,714 - lava_callback - ERROR - Error processing callback for node 69bb0e8f21a77312e2221f09: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:37878 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34320 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:34324 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54304 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60188 - "GET / HTTP/1.0" 200 OK
2026-03-20 20:44:43,625 - lava_callback - INFO - Received callback for node 69bb0eb921a77312e2221f12
INFO: 172.19.0.1:44942 - "POST /node/69bb0eb921a77312e2221f12 HTTP/1.0" 202 Accepted
2026-03-20 20:44:43,630 - lava_callback - INFO - Starting async job submit for node 69bb0eb921a77312e2221f12
2026-03-20 20:44:43,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:44:43,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb0eb921a77312e2221f12 HTTP/1.1" 200 None
2026-03-20 20:44:43,648 - lava_callback - DEBUG - Processing node 69bb0eb921a77312e2221f12: baseline-arm-baylibre
2026-03-20 20:44:43,648 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb0eb921a77312e2221f12
2026-03-20 20:44:43,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:44:43,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb0eb921a77312e2221f12 HTTP/1.1" 200 None
2026-03-20 20:44:43,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:44:43,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None
2026-03-20 20:44:43,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:44:43,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb0eb921a77312e2221f12 HTTP/1.1" 200 None
2026-03-20 20:44:43,699 - lava_callback - ERROR - Error processing callback for node 69bb0eb921a77312e2221f12: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:44956 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33690 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48640 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48644 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53872 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:53886 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60198 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49920 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35866 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35418 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51364 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51376 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51592 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:51604 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45850 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38400 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49768 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57068 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51440 - "GET / HTTP/1.0" 200 OK
2026-03-20 20:47:00,681 - lava_callback - INFO - Received callback for node 69bb0f3621a77312e2221f36
INFO: 172.19.0.1:51448 - "POST /node/69bb0f3621a77312e2221f36 HTTP/1.0" 202 Accepted
2026-03-20 20:47:00,687 - lava_callback - INFO - Starting async job submit for node 69bb0f3621a77312e2221f36
2026-03-20 20:47:00,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:47:00,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb0f3621a77312e2221f36 HTTP/1.1" 200 None
2026-03-20 20:47:00,703 - lava_callback - DEBUG - Processing node 69bb0f3621a77312e2221f36: baseline-arm-clabbe
2026-03-20 20:47:00,703 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb0f3621a77312e2221f36
2026-03-20 20:47:00,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:47:00,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb0f3621a77312e2221f36 HTTP/1.1" 200 None
2026-03-20 20:47:00,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:47:00,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None
2026-03-20 20:47:00,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:47:00,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb0f3621a77312e2221f36 HTTP/1.1" 200 None
2026-03-20 20:47:00,767 - lava_callback - ERROR - Error processing callback for node 69bb0f3621a77312e2221f36: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:51456 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57710 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:57714 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45614 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59002 - "GET / HTTP/1.0" 200 OK
2026-03-20 20:47:40,614 - lava_callback - INFO - Received callback for node 69bb0f6021a77312e2221f42
INFO: 172.19.0.1:48618 - "POST /node/69bb0f6021a77312e2221f42 HTTP/1.0" 202 Accepted
2026-03-20 20:47:40,619 - lava_callback - INFO - Starting async job submit for node 69bb0f6021a77312e2221f42
2026-03-20 20:47:40,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:47:40,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb0f6021a77312e2221f42 HTTP/1.1" 200 None
2026-03-20 20:47:40,635 - lava_callback - DEBUG - Processing node 69bb0f6021a77312e2221f42: baseline-arm-clabbe
2026-03-20 20:47:40,636 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb0f6021a77312e2221f42
2026-03-20 20:47:40,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:47:40,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb0f6021a77312e2221f42 HTTP/1.1" 200 None
2026-03-20 20:47:40,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:47:40,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None
2026-03-20 20:47:40,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:47:40,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb0f6021a77312e2221f42 HTTP/1.1" 200 None
2026-03-20 20:47:40,691 - lava_callback - ERROR - Error processing callback for node 69bb0f6021a77312e2221f42: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:48632 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45796 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44104 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44112 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38746 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:38760 - "GET / HTTP/1.0" 200 OK
2026-03-20 20:48:20,678 - lava_callback - INFO - Received callback for node 69bb0f8a21a77312e2221f50
INFO: 172.19.0.1:48352 - "POST /node/69bb0f8a21a77312e2221f50 HTTP/1.0" 202 Accepted
2026-03-20 20:48:20,683 - lava_callback - INFO - Starting async job submit for node 69bb0f8a21a77312e2221f50
2026-03-20 20:48:20,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:48:20,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb0f8a21a77312e2221f50 HTTP/1.1" 200 None
2026-03-20 20:48:20,703 - lava_callback - DEBUG - Processing node 69bb0f8a21a77312e2221f50: baseline-arm-clabbe
2026-03-20 20:48:20,704 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb0f8a21a77312e2221f50
2026-03-20 20:48:20,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:48:20,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb0f8a21a77312e2221f50 HTTP/1.1" 200 None
2026-03-20 20:48:20,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:48:20,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None
2026-03-20 20:48:20,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:48:20,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb0f8a21a77312e2221f50 HTTP/1.1" 200 None
2026-03-20 20:48:20,766 - lava_callback - ERROR - Error processing callback for node 69bb0f8a21a77312e2221f50: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:48364 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33756 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60730 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34476 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44578 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44588 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47816 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:47826 - "GET / HTTP/1.0" 200 OK
2026-03-20 20:49:20,762 - lava_callback - INFO - Received callback for node 69bb0fbf21a77312e2221f5d
INFO: 172.19.0.1:58444 - "POST /node/69bb0fbf21a77312e2221f5d HTTP/1.0" 202 Accepted
2026-03-20 20:49:20,767 - lava_callback - INFO - Starting async job submit for node 69bb0fbf21a77312e2221f5d
2026-03-20 20:49:20,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:49:20,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb0fbf21a77312e2221f5d HTTP/1.1" 200 None
2026-03-20 20:49:20,784 - lava_callback - DEBUG - Processing node 69bb0fbf21a77312e2221f5d: baseline-arm-clabbe
2026-03-20 20:49:20,784 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb0fbf21a77312e2221f5d
2026-03-20 20:49:20,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:49:20,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb0fbf21a77312e2221f5d HTTP/1.1" 200 None
2026-03-20 20:49:20,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:49:20,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None
2026-03-20 20:49:20,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:49:20,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb0fbf21a77312e2221f5d HTTP/1.1" 200 None
2026-03-20 20:49:20,857 - lava_callback - ERROR - Error processing callback for node 69bb0fbf21a77312e2221f5d: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:58460 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46102 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48368 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47428 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34564 - "GET / HTTP/1.0" 200 OK
2026-03-20 20:50:00,686 - lava_callback - INFO - Received callback for node 69bb0feb21a77312e2221f66
INFO: 172.19.0.1:34570 - "POST /node/69bb0feb21a77312e2221f66 HTTP/1.0" 202 Accepted
2026-03-20 20:50:00,692 - lava_callback - INFO - Starting async job submit for node 69bb0feb21a77312e2221f66
2026-03-20 20:50:00,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:50:00,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb0feb21a77312e2221f66 HTTP/1.1" 200 None
2026-03-20 20:50:00,710 - lava_callback - DEBUG - Processing node 69bb0feb21a77312e2221f66: baseline-arm-clabbe
2026-03-20 20:50:00,710 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb0feb21a77312e2221f66
2026-03-20 20:50:00,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:50:00,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb0feb21a77312e2221f66 HTTP/1.1" 200 None
2026-03-20 20:50:00,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:50:00,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None
2026-03-20 20:50:00,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:50:00,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb0feb21a77312e2221f66 HTTP/1.1" 200 None
2026-03-20 20:50:00,767 - lava_callback - ERROR - Error processing callback for node 69bb0feb21a77312e2221f66: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:34584 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48802 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:48806 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50580 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52064 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43308 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57886 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55166 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55180 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40912 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:40922 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60760 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36218 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36012 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35828 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55260 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55274 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53410 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:53424 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59418 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40320 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44708 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35050 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44362 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44376 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54834 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:54838 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40888 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48708 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49902 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44540 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57142 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57150 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37520 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:37536 - "GET / HTTP/1.0" 200 OK
2026-03-20 20:54:24,203 - lava_callback - INFO - Received callback for node 69bb10f121a77312e2221f83
INFO: 172.19.0.1:50196 - "POST /node/69bb10f121a77312e2221f83 HTTP/1.0" 202 Accepted
2026-03-20 20:54:24,209 - lava_callback - INFO - Starting async job submit for node 69bb10f121a77312e2221f83
2026-03-20 20:54:24,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:54:24,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb10f121a77312e2221f83 HTTP/1.1" 200 None
2026-03-20 20:54:24,226 - lava_callback - DEBUG - Processing node 69bb10f121a77312e2221f83: baseline-arm64-baylibre
2026-03-20 20:54:24,227 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb10f121a77312e2221f83
2026-03-20 20:54:24,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:54:24,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb10f121a77312e2221f83 HTTP/1.1" 200 None
2026-03-20 20:54:24,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:54:24,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None
2026-03-20 20:54:24,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:54:24,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb10f121a77312e2221f83 HTTP/1.1" 200 None
2026-03-20 20:54:24,282 - lava_callback - ERROR - Error processing callback for node 69bb10f121a77312e2221f83: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:50202 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39384 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39952 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50632 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33230 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33236 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45470 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:45486 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48788 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54600 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45036 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49588 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49766 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49774 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44468 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:44476 - "GET / HTTP/1.0" 200 OK
2026-03-20 20:56:24,295 - lava_callback - INFO - Received callback for node 69bb116a21a77312e2221f8e
INFO: 172.19.0.1:49758 - "POST /node/69bb116a21a77312e2221f8e HTTP/1.0" 202 Accepted
2026-03-20 20:56:24,301 - lava_callback - INFO - Starting async job submit for node 69bb116a21a77312e2221f8e
2026-03-20 20:56:24,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:56:24,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb116a21a77312e2221f8e HTTP/1.1" 200 None
2026-03-20 20:56:24,317 - lava_callback - DEBUG - Processing node 69bb116a21a77312e2221f8e: baseline-arm64-baylibre
2026-03-20 20:56:24,317 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb116a21a77312e2221f8e
2026-03-20 20:56:24,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:56:24,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb116a21a77312e2221f8e HTTP/1.1" 200 None
2026-03-20 20:56:24,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:56:24,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None
2026-03-20 20:56:24,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:56:24,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb116a21a77312e2221f8e HTTP/1.1" 200 None
2026-03-20 20:56:24,406 - lava_callback - ERROR - Error processing callback for node 69bb116a21a77312e2221f8e: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:49766 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51950 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43408 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44622 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41216 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41222 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40584 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:40586 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49368 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34222 - "GET / HTTP/1.0" 200 OK
2026-03-20 20:57:44,383 - lava_callback - INFO - Received callback for node 69bb11bc21a77312e2221f95
INFO: 172.19.0.1:39870 - "POST /node/69bb11bc21a77312e2221f95 HTTP/1.0" 202 Accepted
2026-03-20 20:57:44,388 - lava_callback - INFO - Starting async job submit for node 69bb11bc21a77312e2221f95
2026-03-20 20:57:44,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:57:44,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb11bc21a77312e2221f95 HTTP/1.1" 200 None
2026-03-20 20:57:44,405 - lava_callback - DEBUG - Processing node 69bb11bc21a77312e2221f95: baseline-arm64-baylibre
2026-03-20 20:57:44,405 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb11bc21a77312e2221f95
2026-03-20 20:57:44,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:57:44,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb11bc21a77312e2221f95 HTTP/1.1" 200 None
2026-03-20 20:57:44,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:57:44,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None
2026-03-20 20:57:44,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:57:44,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb11bc21a77312e2221f95 HTTP/1.1" 200 None
2026-03-20 20:57:44,464 - lava_callback - ERROR - Error processing callback for node 69bb11bc21a77312e2221f95: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:39886 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54138 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44032 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44040 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45318 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:45322 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55336 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34110 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48888 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46708 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40172 - "GET / HTTP/1.0" 200 OK
2026-03-20 20:59:04,461 - lava_callback - INFO - Received callback for node 69bb120e21a77312e2221fa0
INFO: 172.19.0.1:40176 - "POST /node/69bb120e21a77312e2221fa0 HTTP/1.0" 202 Accepted
2026-03-20 20:59:04,466 - lava_callback - INFO - Starting async job submit for node 69bb120e21a77312e2221fa0
2026-03-20 20:59:04,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:59:04,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb120e21a77312e2221fa0 HTTP/1.1" 200 None
2026-03-20 20:59:04,498 - lava_callback - DEBUG - Processing node 69bb120e21a77312e2221fa0: baseline-arm64-baylibre
2026-03-20 20:59:04,498 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb120e21a77312e2221fa0
2026-03-20 20:59:04,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:59:04,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb120e21a77312e2221fa0 HTTP/1.1" 200 None
2026-03-20 20:59:04,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:59:04,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None
2026-03-20 20:59:04,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 20:59:04,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb120e21a77312e2221fa0 HTTP/1.1" 200 None
2026-03-20 20:59:04,551 - lava_callback - ERROR - Error processing callback for node 69bb120e21a77312e2221fa0: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:40190 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36886 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:36890 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34000 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35498 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53100 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60340 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44038 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44040 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47404 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:47412 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45696 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38092 - "GET / HTTP/1.0" 200 OK
2026-03-20 21:00:44,559 - lava_callback - INFO - Received callback for node 69bb126d21a77312e2221fb2
INFO: 172.19.0.1:57810 - "POST /node/69bb126d21a77312e2221fb2 HTTP/1.0" 202 Accepted
2026-03-20 21:00:44,565 - lava_callback - INFO - Starting async job submit for node 69bb126d21a77312e2221fb2
2026-03-20 21:00:44,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:00:44,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb126d21a77312e2221fb2 HTTP/1.1" 200 None
2026-03-20 21:00:44,581 - lava_callback - DEBUG - Processing node 69bb126d21a77312e2221fb2: baseline-arm64-baylibre
2026-03-20 21:00:44,581 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb126d21a77312e2221fb2
2026-03-20 21:00:44,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:00:44,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb126d21a77312e2221fb2 HTTP/1.1" 200 None
2026-03-20 21:00:44,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:00:44,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None
2026-03-20 21:00:44,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:00:44,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb126d21a77312e2221fb2 HTTP/1.1" 200 None
2026-03-20 21:00:44,662 - lava_callback - ERROR - Error processing callback for node 69bb126d21a77312e2221fb2: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:57820 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33712 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39070 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39072 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45264 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:45268 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36034 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39820 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38684 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48400 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55730 - "GET / HTTP/1.0" 200 OK
2026-03-20 21:02:04,607 - lava_callback - INFO - Received callback for node 69bb12bf21a77312e2221fbf
INFO: 172.19.0.1:55746 - "POST /node/69bb12bf21a77312e2221fbf HTTP/1.0" 202 Accepted
2026-03-20 21:02:04,613 - lava_callback - INFO - Starting async job submit for node 69bb12bf21a77312e2221fbf
2026-03-20 21:02:04,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:02:04,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb12bf21a77312e2221fbf HTTP/1.1" 200 None
2026-03-20 21:02:04,637 - lava_callback - DEBUG - Processing node 69bb12bf21a77312e2221fbf: baseline-arm64-baylibre
2026-03-20 21:02:04,637 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb12bf21a77312e2221fbf
2026-03-20 21:02:04,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:02:04,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb12bf21a77312e2221fbf HTTP/1.1" 200 None
2026-03-20 21:02:04,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:02:04,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None
2026-03-20 21:02:04,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:02:04,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb12bf21a77312e2221fbf HTTP/1.1" 200 None
2026-03-20 21:02:04,692 - lava_callback - ERROR - Error processing callback for node 69bb12bf21a77312e2221fbf: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:55750 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46148 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:46158 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60902 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52314 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57454 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:32866 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39776 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39786 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53734 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:53740 - "GET / HTTP/1.0" 200 OK
2026-03-20 21:03:24,679 - lava_callback - INFO - Received callback for node 69bb131521a77312e2221fce
INFO: 172.19.0.1:59144 - "POST /node/69bb131521a77312e2221fce HTTP/1.0" 202 Accepted
2026-03-20 21:03:24,685 - lava_callback - INFO - Starting async job submit for node 69bb131521a77312e2221fce
2026-03-20 21:03:24,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:03:24,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb131521a77312e2221fce HTTP/1.1" 200 None
2026-03-20 21:03:24,702 - lava_callback - DEBUG - Processing node 69bb131521a77312e2221fce: baseline-arm64-baylibre
2026-03-20 21:03:24,702 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb131521a77312e2221fce
2026-03-20 21:03:24,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:03:24,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb131521a77312e2221fce HTTP/1.1" 200 None
2026-03-20 21:03:24,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:03:24,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None
2026-03-20 21:03:24,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:03:24,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb131521a77312e2221fce HTTP/1.1" 200 None
2026-03-20 21:03:24,757 - lava_callback - ERROR - Error processing callback for node 69bb131521a77312e2221fce: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:59160 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:32830 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37080 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42874 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41298 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41312 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47002 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:47012 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39046 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43228 - "GET / HTTP/1.0" 200 OK
2026-03-20 21:04:44,795 - lava_callback - INFO - Received callback for node 69bb136621a77312e2221fdc
INFO: 172.19.0.1:55466 - "POST /node/69bb136621a77312e2221fdc HTTP/1.0" 202 Accepted
2026-03-20 21:04:44,801 - lava_callback - INFO - Starting async job submit for node 69bb136621a77312e2221fdc
2026-03-20 21:04:44,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:04:44,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb136621a77312e2221fdc HTTP/1.1" 200 None
2026-03-20 21:04:44,822 - lava_callback - DEBUG - Processing node 69bb136621a77312e2221fdc: baseline-arm64-baylibre
2026-03-20 21:04:44,823 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb136621a77312e2221fdc
2026-03-20 21:04:44,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:04:44,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb136621a77312e2221fdc HTTP/1.1" 200 None
2026-03-20 21:04:44,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:04:44,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None
2026-03-20 21:04:44,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:04:44,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb136621a77312e2221fdc HTTP/1.1" 200 None
2026-03-20 21:04:44,888 - lava_callback - ERROR - Error processing callback for node 69bb136621a77312e2221fdc: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:55472 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46770 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56550 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56552 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46120 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:46126 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51582 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34966 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41264 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37582 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45800 - "GET / HTTP/1.0" 200 OK
2026-03-20 21:06:04,842 - lava_callback - INFO - Received callback for node 69bb13b921a77312e2221fe4
INFO: 172.19.0.1:45802 - "POST /node/69bb13b921a77312e2221fe4 HTTP/1.0" 202 Accepted
2026-03-20 21:06:04,847 - lava_callback - INFO - Starting async job submit for node 69bb13b921a77312e2221fe4
2026-03-20 21:06:04,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:06:04,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb13b921a77312e2221fe4 HTTP/1.1" 200 None
2026-03-20 21:06:04,864 - lava_callback - DEBUG - Processing node 69bb13b921a77312e2221fe4: baseline-arm64-baylibre
2026-03-20 21:06:04,864 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb13b921a77312e2221fe4
2026-03-20 21:06:04,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:06:04,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb13b921a77312e2221fe4 HTTP/1.1" 200 None
2026-03-20 21:06:04,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:06:04,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None
2026-03-20 21:06:04,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:06:04,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb13b921a77312e2221fe4 HTTP/1.1" 200 None
2026-03-20 21:06:04,935 - lava_callback - ERROR - Error processing callback for node 69bb13b921a77312e2221fe4: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:45810 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45258 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:45270 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40702 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50278 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47292 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56194 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46716 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46718 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39714 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:39728 - "GET / HTTP/1.0" 200 OK
2026-03-20 21:07:24,879 - lava_callback - INFO - Received callback for node 69bb140821a77312e2221ff2
INFO: 172.19.0.1:43048 - "POST /node/69bb140821a77312e2221ff2 HTTP/1.0" 202 Accepted
2026-03-20 21:07:24,885 - lava_callback - INFO - Starting async job submit for node 69bb140821a77312e2221ff2
2026-03-20 21:07:24,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:07:24,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb140821a77312e2221ff2 HTTP/1.1" 200 None
2026-03-20 21:07:24,903 - lava_callback - DEBUG - Processing node 69bb140821a77312e2221ff2: baseline-arm64-baylibre
2026-03-20 21:07:24,904 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb140821a77312e2221ff2
2026-03-20 21:07:24,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:07:24,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb140821a77312e2221ff2 HTTP/1.1" 200 None
2026-03-20 21:07:24,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:07:24,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None
2026-03-20 21:07:24,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:07:24,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb140821a77312e2221ff2 HTTP/1.1" 200 None
2026-03-20 21:07:24,973 - lava_callback - ERROR - Error processing callback for node 69bb140821a77312e2221ff2: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:43062 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52374 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41900 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42652 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40152 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40164 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35378 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:35394 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49572 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55814 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53920 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44826 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58390 - "GET / HTTP/1.0" 200 OK
2026-03-20 21:09:01,459 - lava_callback - INFO - Received callback for node 69bb146321a77312e2221fff
INFO: 172.19.0.1:58398 - "POST /node/69bb146321a77312e2221fff HTTP/1.0" 202 Accepted
2026-03-20 21:09:01,464 - lava_callback - INFO - Starting async job submit for node 69bb146321a77312e2221fff
2026-03-20 21:09:01,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:09:01,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb146321a77312e2221fff HTTP/1.1" 200 None
2026-03-20 21:09:01,481 - lava_callback - DEBUG - Processing node 69bb146321a77312e2221fff: baseline-arm64-clabbe
2026-03-20 21:09:01,481 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb146321a77312e2221fff
2026-03-20 21:09:01,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:09:01,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb146321a77312e2221fff HTTP/1.1" 200 None
2026-03-20 21:09:01,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:09:01,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None
2026-03-20 21:09:01,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:09:01,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb146321a77312e2221fff HTTP/1.1" 200 None
2026-03-20 21:09:01,540 - lava_callback - ERROR - Error processing callback for node 69bb146321a77312e2221fff: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:58404 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49928 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:49930 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54102 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34378 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47802 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58086 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54770 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54778 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33522 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:33528 - "GET / HTTP/1.0" 200 OK
2026-03-20 21:10:25,072 - lava_callback - INFO - Received callback for node 69bb14b021a77312e222200e
INFO: 172.19.0.1:60454 - "POST /node/69bb14b021a77312e222200e HTTP/1.0" 202 Accepted
2026-03-20 21:10:25,078 - lava_callback - INFO - Starting async job submit for node 69bb14b021a77312e222200e
2026-03-20 21:10:25,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:10:25,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb14b021a77312e222200e HTTP/1.1" 200 None
2026-03-20 21:10:25,094 - lava_callback - DEBUG - Processing node 69bb14b021a77312e222200e: baseline-arm64-baylibre
2026-03-20 21:10:25,094 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb14b021a77312e222200e
2026-03-20 21:10:25,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:10:25,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb14b021a77312e222200e HTTP/1.1" 200 None
2026-03-20 21:10:25,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:10:25,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None
2026-03-20 21:10:25,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:10:25,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb14b021a77312e222200e HTTP/1.1" 200 None
2026-03-20 21:10:25,156 - lava_callback - ERROR - Error processing callback for node 69bb14b021a77312e222200e: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:60466 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60862 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52822 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33362 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48700 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48704 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52500 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:52508 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33584 - "GET / HTTP/1.0" 200 OK
2026-03-20 21:11:35,952 - lava_callback - INFO - Received callback for node 69bdabe40e93e23147241ec8
INFO: 172.19.0.1:37648 - "POST /node/69bdabe40e93e23147241ec8 HTTP/1.0" 202 Accepted
2026-03-20 21:11:35,958 - lava_callback - INFO - Starting async job submit for node 69bdabe40e93e23147241ec8
2026-03-20 21:11:35,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:11:35,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bdabe40e93e23147241ec8 HTTP/1.1" 200 None
2026-03-20 21:11:35,998 - lava_callback - DEBUG - Processing node 69bdabe40e93e23147241ec8: baseline-arm64
INFO: 172.19.0.1:37652 - "GET / HTTP/1.0" 200 OK
2026-03-20 21:11:36,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 21:11:36,704 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 21:11:36,706 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bdabe40e93e23147241ec8/log.txt.gz
2026-03-20 21:11:36,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 21:11:37,210 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 21:11:37,212 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bdabe40e93e23147241ec8/lava-logs.yaml
2026-03-20 21:11:37,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 21:11:37,402 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 21:11:37,404 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bdabe40e93e23147241ec8/lava_callback.json.gz
2026-03-20 21:11:37,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:11:37,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bdabe40e93e23147241ec8 HTTP/1.1" 200 None
2026-03-20 21:11:37,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:11:37,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 21:11:37,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:11:37,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bdabe40e93e23147241ec8 HTTP/1.1" 200 None
2026-03-20 21:11:37,583 - lava_callback - INFO - Completed processing callback for node 69bdabe40e93e23147241ec8
2026-03-20 21:11:41,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:11:41,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
2026-03-20 21:11:41,830 - lava_callback - INFO - Received callback for node 69bb150a21a77312e222201d
INFO: 172.19.0.1:36742 - "POST /node/69bb150a21a77312e222201d HTTP/1.0" 202 Accepted
2026-03-20 21:11:41,836 - lava_callback - INFO - Starting async job submit for node 69bb150a21a77312e222201d
2026-03-20 21:11:41,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:11:41,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb150a21a77312e222201d HTTP/1.1" 200 None
2026-03-20 21:11:41,853 - lava_callback - DEBUG - Processing node 69bb150a21a77312e222201d: baseline-arm64-clabbe
2026-03-20 21:11:41,853 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb150a21a77312e222201d
2026-03-20 21:11:41,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:11:41,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb150a21a77312e222201d HTTP/1.1" 200 None
2026-03-20 21:11:41,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:11:41,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None
2026-03-20 21:11:41,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:11:41,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb150a21a77312e222201d HTTP/1.1" 200 None
2026-03-20 21:11:41,911 - lava_callback - ERROR - Error processing callback for node 69bb150a21a77312e222201d: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:36754 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47156 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41834 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41850 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60334 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:60346 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39846 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53374 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41886 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38284 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39730 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39740 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39746 - "GET /favicon.ico HTTP/1.0" 404 Not Found
2026-03-20 21:13:05,233 - lava_callback - INFO - Received callback for node 69bb155621a77312e2222024
INFO: 172.19.0.1:39754 - "POST /node/69bb155621a77312e2222024 HTTP/1.0" 202 Accepted
2026-03-20 21:13:05,239 - lava_callback - INFO - Starting async job submit for node 69bb155621a77312e2222024
2026-03-20 21:13:05,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:13:05,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb155621a77312e2222024 HTTP/1.1" 200 None
2026-03-20 21:13:05,255 - lava_callback - DEBUG - Processing node 69bb155621a77312e2222024: baseline-arm64-baylibre
2026-03-20 21:13:05,256 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb155621a77312e2222024
2026-03-20 21:13:05,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:13:05,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb155621a77312e2222024 HTTP/1.1" 200 None
2026-03-20 21:13:05,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:13:05,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None
2026-03-20 21:13:05,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:13:05,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb155621a77312e2222024 HTTP/1.1" 200 None
2026-03-20 21:13:05,341 - lava_callback - ERROR - Error processing callback for node 69bb155621a77312e2222024: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:39768 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40862 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:40876 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58122 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59302 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48016 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37082 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51368 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51384 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55914 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:55928 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42824 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50548 - "GET / HTTP/1.0" 200 OK
2026-03-20 21:14:41,705 - lava_callback - INFO - Received callback for node 69bb15b121a77312e2222034
INFO: 172.19.0.1:46202 - "POST /node/69bb15b121a77312e2222034 HTTP/1.0" 202 Accepted
2026-03-20 21:14:41,711 - lava_callback - INFO - Starting async job submit for node 69bb15b121a77312e2222034
2026-03-20 21:14:41,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:14:41,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb15b121a77312e2222034 HTTP/1.1" 200 None
2026-03-20 21:14:41,735 - lava_callback - DEBUG - Processing node 69bb15b121a77312e2222034: baseline-arm64-clabbe
2026-03-20 21:14:41,735 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb15b121a77312e2222034
2026-03-20 21:14:41,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:14:41,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb15b121a77312e2222034 HTTP/1.1" 200 None
2026-03-20 21:14:41,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:14:41,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None
2026-03-20 21:14:41,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:14:41,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb15b121a77312e2222034 HTTP/1.1" 200 None
2026-03-20 21:14:41,807 - lava_callback - ERROR - Error processing callback for node 69bb15b121a77312e2222034: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:46204 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47794 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40152 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40156 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41652 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:41656 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59954 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39970 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33460 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59976 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58472 - "GET / HTTP/1.0" 200 OK
2026-03-20 21:16:01,766 - lava_callback - INFO - Received callback for node 69bb160321a77312e222203d
INFO: 172.19.0.1:58480 - "POST /node/69bb160321a77312e222203d HTTP/1.0" 202 Accepted
2026-03-20 21:16:01,772 - lava_callback - INFO - Starting async job submit for node 69bb160321a77312e222203d
2026-03-20 21:16:01,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:16:01,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb160321a77312e222203d HTTP/1.1" 200 None
2026-03-20 21:16:01,794 - lava_callback - DEBUG - Processing node 69bb160321a77312e222203d: baseline-arm64-clabbe
2026-03-20 21:16:01,794 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb160321a77312e222203d
2026-03-20 21:16:01,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:16:01,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb160321a77312e222203d HTTP/1.1" 200 None
2026-03-20 21:16:01,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:16:01,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None
2026-03-20 21:16:01,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:16:01,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb160321a77312e222203d HTTP/1.1" 200 None
2026-03-20 21:16:01,854 - lava_callback - ERROR - Error processing callback for node 69bb160321a77312e222203d: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:58494 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42622 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:42630 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53566 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39412 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36970 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41608 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50280 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50294 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40422 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:40438 - "GET / HTTP/1.0" 200 OK
2026-03-20 21:17:21,817 - lava_callback - INFO - Received callback for node 69bb165521a77312e222204a
INFO: 172.19.0.1:59740 - "POST /node/69bb165521a77312e222204a HTTP/1.0" 202 Accepted
2026-03-20 21:17:21,823 - lava_callback - INFO - Starting async job submit for node 69bb165521a77312e222204a
2026-03-20 21:17:21,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:17:21,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb165521a77312e222204a HTTP/1.1" 200 None
2026-03-20 21:17:21,846 - lava_callback - DEBUG - Processing node 69bb165521a77312e222204a: baseline-arm64-clabbe
2026-03-20 21:17:21,846 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb165521a77312e222204a
2026-03-20 21:17:21,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:17:21,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb165521a77312e222204a HTTP/1.1" 200 None
2026-03-20 21:17:21,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:17:21,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None
2026-03-20 21:17:21,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:17:21,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb165521a77312e222204a HTTP/1.1" 200 None
2026-03-20 21:17:21,902 - lava_callback - ERROR - Error processing callback for node 69bb165521a77312e222204a: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:59754 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52604 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44760 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36890 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48462 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48466 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60096 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:60110 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42368 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38522 - "GET / HTTP/1.0" 200 OK
2026-03-20 21:18:41,880 - lava_callback - INFO - Received callback for node 69bb16ab21a77312e2222050
INFO: 172.19.0.1:43544 - "POST /node/69bb16ab21a77312e2222050 HTTP/1.0" 202 Accepted
2026-03-20 21:18:41,886 - lava_callback - INFO - Starting async job submit for node 69bb16ab21a77312e2222050
2026-03-20 21:18:41,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:18:41,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb16ab21a77312e2222050 HTTP/1.1" 200 None
2026-03-20 21:18:41,902 - lava_callback - DEBUG - Processing node 69bb16ab21a77312e2222050: baseline-arm64-clabbe
2026-03-20 21:18:41,902 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb16ab21a77312e2222050
2026-03-20 21:18:41,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:18:41,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb16ab21a77312e2222050 HTTP/1.1" 200 None
2026-03-20 21:18:41,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:18:41,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None
2026-03-20 21:18:41,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:18:41,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb16ab21a77312e2222050 HTTP/1.1" 200 None
2026-03-20 21:18:41,953 - lava_callback - ERROR - Error processing callback for node 69bb16ab21a77312e2222050: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:43546 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38768 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49840 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49846 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58304 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:58318 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33190 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54076 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50120 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60980 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55028 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55036 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40772 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:40778 - "GET / HTTP/1.0" 200 OK
2026-03-20 21:20:21,934 - lava_callback - INFO - Received callback for node 69bb170121a77312e222205d
INFO: 172.19.0.1:43040 - "POST /node/69bb170121a77312e222205d HTTP/1.0" 202 Accepted
2026-03-20 21:20:21,940 - lava_callback - INFO - Starting async job submit for node 69bb170121a77312e222205d
2026-03-20 21:20:21,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:20:21,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb170121a77312e222205d HTTP/1.1" 200 None
2026-03-20 21:20:21,968 - lava_callback - DEBUG - Processing node 69bb170121a77312e222205d: baseline-arm64-clabbe
2026-03-20 21:20:21,968 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb170121a77312e222205d
2026-03-20 21:20:21,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:20:22,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb170121a77312e222205d HTTP/1.1" 200 None
2026-03-20 21:20:22,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:20:22,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None
2026-03-20 21:20:22,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:20:22,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb170121a77312e222205d HTTP/1.1" 200 None
2026-03-20 21:20:22,044 - lava_callback - ERROR - Error processing callback for node 69bb170121a77312e222205d: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:43048 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41766 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45424 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38088 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54252 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54258 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51082 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:51084 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33544 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57986 - "GET / HTTP/1.0" 200 OK
2026-03-20 21:21:42,008 - lava_callback - INFO - Received callback for node 69bb175721a77312e2222067
INFO: 172.19.0.1:49414 - "POST /node/69bb175721a77312e2222067 HTTP/1.0" 202 Accepted
2026-03-20 21:21:42,013 - lava_callback - INFO - Starting async job submit for node 69bb175721a77312e2222067
2026-03-20 21:21:42,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:21:42,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb175721a77312e2222067 HTTP/1.1" 200 None
2026-03-20 21:21:42,034 - lava_callback - DEBUG - Processing node 69bb175721a77312e2222067: baseline-arm64-clabbe
2026-03-20 21:21:42,034 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb175721a77312e2222067
2026-03-20 21:21:42,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:21:42,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb175721a77312e2222067 HTTP/1.1" 200 None
2026-03-20 21:21:42,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:21:42,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None
2026-03-20 21:21:42,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:21:42,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb175721a77312e2222067 HTTP/1.1" 200 None
2026-03-20 21:21:42,095 - lava_callback - ERROR - Error processing callback for node 69bb175721a77312e2222067: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:49416 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43984 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59278 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59290 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55612 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:55626 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39892 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60826 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47660 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34700 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60842 - "GET / HTTP/1.0" 200 OK
2026-03-20 21:23:02,081 - lava_callback - INFO - Received callback for node 69bb17ad21a77312e2222073
INFO: 172.19.0.1:60846 - "POST /node/69bb17ad21a77312e2222073 HTTP/1.0" 202 Accepted
2026-03-20 21:23:02,087 - lava_callback - INFO - Starting async job submit for node 69bb17ad21a77312e2222073
2026-03-20 21:23:02,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:23:02,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb17ad21a77312e2222073 HTTP/1.1" 200 None
2026-03-20 21:23:02,102 - lava_callback - DEBUG - Processing node 69bb17ad21a77312e2222073: baseline-arm64-clabbe
2026-03-20 21:23:02,102 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb17ad21a77312e2222073
2026-03-20 21:23:02,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:23:02,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb17ad21a77312e2222073 HTTP/1.1" 200 None
2026-03-20 21:23:02,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:23:02,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None
2026-03-20 21:23:02,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:23:02,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb17ad21a77312e2222073 HTTP/1.1" 200 None
2026-03-20 21:23:02,165 - lava_callback - ERROR - Error processing callback for node 69bb17ad21a77312e2222073: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:60858 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55808 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:55818 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48712 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53510 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41622 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53646 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52076 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52084 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55498 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:55502 - "GET / HTTP/1.0" 200 OK
2026-03-20 21:24:22,182 - lava_callback - INFO - Received callback for node 69bb180321a77312e222207f
INFO: 172.19.0.1:35978 - "POST /node/69bb180321a77312e222207f HTTP/1.0" 202 Accepted
2026-03-20 21:24:22,188 - lava_callback - INFO - Starting async job submit for node 69bb180321a77312e222207f
2026-03-20 21:24:22,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:24:22,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb180321a77312e222207f HTTP/1.1" 200 None
2026-03-20 21:24:22,204 - lava_callback - DEBUG - Processing node 69bb180321a77312e222207f: baseline-arm64-clabbe
2026-03-20 21:24:22,205 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb180321a77312e222207f
2026-03-20 21:24:22,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:24:22,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb180321a77312e222207f HTTP/1.1" 200 None
2026-03-20 21:24:22,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:24:22,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None
2026-03-20 21:24:22,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:24:22,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb180321a77312e222207f HTTP/1.1" 200 None
2026-03-20 21:24:22,269 - lava_callback - ERROR - Error processing callback for node 69bb180321a77312e222207f: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:35990 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:32786 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43708 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38596 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52158 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52164 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53670 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:53682 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38360 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60890 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47620 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49004 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49822 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49834 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49750 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:49754 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43420 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34664 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53714 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57060 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43014 - "GET / HTTP/1.0" 200 OK
2026-03-20 21:27:02,324 - lava_callback - INFO - Received callback for node 69bb189821a77312e2222095
INFO: 172.19.0.1:43026 - "POST /node/69bb189821a77312e2222095 HTTP/1.0" 202 Accepted
2026-03-20 21:27:02,330 - lava_callback - INFO - Starting async job submit for node 69bb189821a77312e2222095
2026-03-20 21:27:02,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:27:02,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb189821a77312e2222095 HTTP/1.1" 200 None
2026-03-20 21:27:02,346 - lava_callback - DEBUG - Processing node 69bb189821a77312e2222095: baseline-arm64-clabbe
2026-03-20 21:27:02,347 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb189821a77312e2222095
2026-03-20 21:27:02,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:27:02,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb189821a77312e2222095 HTTP/1.1" 200 None
2026-03-20 21:27:02,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:27:02,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None
2026-03-20 21:27:02,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:27:02,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb189821a77312e2222095 HTTP/1.1" 200 None
2026-03-20 21:27:02,402 - lava_callback - ERROR - Error processing callback for node 69bb189821a77312e2222095: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:43038 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60104 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:60116 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55624 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42408 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37560 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47818 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45686 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45696 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57526 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:57540 - "GET / HTTP/1.0" 200 OK
2026-03-20 21:28:22,393 - lava_callback - INFO - Received callback for node 69bb18ea21a77312e222209f
INFO: 172.19.0.1:44290 - "POST /node/69bb18ea21a77312e222209f HTTP/1.0" 202 Accepted
2026-03-20 21:28:22,398 - lava_callback - INFO - Starting async job submit for node 69bb18ea21a77312e222209f
2026-03-20 21:28:22,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:28:22,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb18ea21a77312e222209f HTTP/1.1" 200 None
2026-03-20 21:28:22,436 - lava_callback - DEBUG - Processing node 69bb18ea21a77312e222209f: baseline-arm64-clabbe
2026-03-20 21:28:22,436 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb18ea21a77312e222209f
2026-03-20 21:28:22,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:28:22,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb18ea21a77312e222209f HTTP/1.1" 200 None
2026-03-20 21:28:22,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:28:22,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None
2026-03-20 21:28:22,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:28:22,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb18ea21a77312e222209f HTTP/1.1" 200 None
2026-03-20 21:28:22,496 - lava_callback - ERROR - Error processing callback for node 69bb18ea21a77312e222209f: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:44306 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40478 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56586 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34600 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50600 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50608 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53152 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:53168 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50314 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45042 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33680 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58408 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50768 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50782 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48022 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:48038 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60124 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44234 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38238 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59522 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55798 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55812 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50178 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:50186 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49168 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50788 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48998 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46606 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47274 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47278 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41404 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:41416 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52010 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46392 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39074 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59894 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49826 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49830 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55570 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:55572 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58868 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39226 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41330 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58742 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36304 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36306 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45106 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:45112 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36298 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42528 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45430 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44410 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41794 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41806 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50238 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:50250 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54050 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57562 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39354 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52122 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56556 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56566 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37198 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:37210 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54480 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42384 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40524 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50288 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47258 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47272 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54366 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:54380 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59288 - "GET / HTTP/1.0" 200 OK
2026-03-20 21:37:26,620 - lava_callback - INFO - Received callback for node 69bb1b0c21a77312e22220e5
INFO: 172.19.0.1:59302 - "POST /node/69bb1b0c21a77312e22220e5 HTTP/1.0" 202 Accepted
2026-03-20 21:37:26,625 - lava_callback - INFO - Starting async job submit for node 69bb1b0c21a77312e22220e5
2026-03-20 21:37:26,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:37:26,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb1b0c21a77312e22220e5 HTTP/1.1" 200 None
2026-03-20 21:37:26,642 - lava_callback - DEBUG - Processing node 69bb1b0c21a77312e22220e5: baseline-arm64-baylibre
2026-03-20 21:37:26,642 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb1b0c21a77312e22220e5
2026-03-20 21:37:26,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:37:26,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb1b0c21a77312e22220e5 HTTP/1.1" 200 None
2026-03-20 21:37:26,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:37:26,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9ef90d5731cbd74145fce HTTP/1.1" 200 None
2026-03-20 21:37:26,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:37:26,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb1b0c21a77312e22220e5 HTTP/1.1" 200 None
2026-03-20 21:37:26,694 - lava_callback - ERROR - Error processing callback for node 69bb1b0c21a77312e22220e5: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:41370 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47228 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43678 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43320 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43322 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48684 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:48698 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54806 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41658 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43226 - "GET / HTTP/1.0" 200 OK
2026-03-20 21:38:46,908 - lava_callback - INFO - Received callback for node 69bb1b5e21a77312e22220f2
INFO: 172.19.0.1:43240 - "POST /node/69bb1b5e21a77312e22220f2 HTTP/1.0" 202 Accepted
2026-03-20 21:38:46,913 - lava_callback - INFO - Starting async job submit for node 69bb1b5e21a77312e22220f2
2026-03-20 21:38:46,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:38:46,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb1b5e21a77312e22220f2 HTTP/1.1" 200 None
2026-03-20 21:38:46,936 - lava_callback - DEBUG - Processing node 69bb1b5e21a77312e22220f2: baseline-arm64-baylibre
2026-03-20 21:38:46,937 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb1b5e21a77312e22220f2
2026-03-20 21:38:46,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:38:46,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb1b5e21a77312e22220f2 HTTP/1.1" 200 None
2026-03-20 21:38:46,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:38:46,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9ef90d5731cbd74145fce HTTP/1.1" 200 None
2026-03-20 21:38:46,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:38:46,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb1b5e21a77312e22220f2 HTTP/1.1" 200 None
2026-03-20 21:38:46,992 - lava_callback - ERROR - Error processing callback for node 69bb1b5e21a77312e22220f2: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:44446 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55372 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55382 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39596 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:39602 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37334 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52088 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59160 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38550 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52872 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52874 - "GET / HTTP/1.0" 200 OK
2026-03-20 21:40:06,766 - lava_callback - INFO - Received callback for node 69bb1bb421a77312e22220fb
INFO: 172.19.0.1:52890 - "POST /node/69bb1bb421a77312e22220fb HTTP/1.0" 202 Accepted
2026-03-20 21:40:06,771 - lava_callback - INFO - Starting async job submit for node 69bb1bb421a77312e22220fb
2026-03-20 21:40:06,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:40:06,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb1bb421a77312e22220fb HTTP/1.1" 200 None
2026-03-20 21:40:06,786 - lava_callback - DEBUG - Processing node 69bb1bb421a77312e22220fb: baseline-arm64-baylibre
2026-03-20 21:40:06,787 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb1bb421a77312e22220fb
2026-03-20 21:40:06,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:40:06,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb1bb421a77312e22220fb HTTP/1.1" 200 None
2026-03-20 21:40:06,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:40:06,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9ef90d5731cbd74145fce HTTP/1.1" 200 None
2026-03-20 21:40:06,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:40:06,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb1bb421a77312e22220fb HTTP/1.1" 200 None
2026-03-20 21:40:06,844 - lava_callback - ERROR - Error processing callback for node 69bb1bb421a77312e22220fb: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:48250 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:48258 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49530 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50494 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49334 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38688 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42762 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42766 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47192 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:47198 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35196 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44718 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41192 - "GET / HTTP/1.0" 200 OK
2026-03-20 21:41:46,878 - lava_callback - INFO - Received callback for node 69bb1c0721a77312e2222105
INFO: 172.19.0.1:41194 - "POST /node/69bb1c0721a77312e2222105 HTTP/1.0" 202 Accepted
2026-03-20 21:41:46,883 - lava_callback - INFO - Starting async job submit for node 69bb1c0721a77312e2222105
2026-03-20 21:41:46,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:41:46,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb1c0721a77312e2222105 HTTP/1.1" 200 None
2026-03-20 21:41:46,900 - lava_callback - DEBUG - Processing node 69bb1c0721a77312e2222105: baseline-arm64-baylibre
2026-03-20 21:41:46,900 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb1c0721a77312e2222105
2026-03-20 21:41:46,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:41:46,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb1c0721a77312e2222105 HTTP/1.1" 200 None
2026-03-20 21:41:46,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:41:46,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9ef90d5731cbd74145fce HTTP/1.1" 200 None
2026-03-20 21:41:46,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:41:46,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb1c0721a77312e2222105 HTTP/1.1" 200 None
2026-03-20 21:41:46,973 - lava_callback - ERROR - Error processing callback for node 69bb1c0721a77312e2222105: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:54562 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53416 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53428 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50444 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:50446 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49474 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34800 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34520 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43310 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38858 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38866 - "GET / HTTP/1.0" 200 OK
2026-03-20 21:43:06,953 - lava_callback - INFO - Received callback for node 69bb1c5921a77312e222210e
INFO: 172.19.0.1:38868 - "POST /node/69bb1c5921a77312e222210e HTTP/1.0" 202 Accepted
2026-03-20 21:43:06,958 - lava_callback - INFO - Starting async job submit for node 69bb1c5921a77312e222210e
2026-03-20 21:43:06,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:43:06,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb1c5921a77312e222210e HTTP/1.1" 200 None
2026-03-20 21:43:06,975 - lava_callback - DEBUG - Processing node 69bb1c5921a77312e222210e: baseline-arm64-baylibre
2026-03-20 21:43:06,975 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb1c5921a77312e222210e
2026-03-20 21:43:06,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:43:06,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb1c5921a77312e222210e HTTP/1.1" 200 None
2026-03-20 21:43:06,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:43:07,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9ef90d5731cbd74145fce HTTP/1.1" 200 None
2026-03-20 21:43:07,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:43:07,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb1c5921a77312e222210e HTTP/1.1" 200 None
2026-03-20 21:43:07,046 - lava_callback - ERROR - Error processing callback for node 69bb1c5921a77312e222210e: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:32992 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:33004 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39618 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59122 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47332 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55278 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42252 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42260 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45090 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:45102 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58578 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47046 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50952 - "GET / HTTP/1.0" 200 OK
2026-03-20 21:44:47,073 - lava_callback - INFO - Received callback for node 69bb1cc821a77312e222211c
INFO: 172.19.0.1:50954 - "POST /node/69bb1cc821a77312e222211c HTTP/1.0" 202 Accepted
2026-03-20 21:44:47,079 - lava_callback - INFO - Starting async job submit for node 69bb1cc821a77312e222211c
2026-03-20 21:44:47,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:44:47,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb1cc821a77312e222211c HTTP/1.1" 200 None
2026-03-20 21:44:47,095 - lava_callback - DEBUG - Processing node 69bb1cc821a77312e222211c: baseline-arm64-baylibre
2026-03-20 21:44:47,095 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb1cc821a77312e222211c
2026-03-20 21:44:47,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:44:47,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb1cc821a77312e222211c HTTP/1.1" 200 None
2026-03-20 21:44:47,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:44:47,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9ef90d5731cbd74145fce HTTP/1.1" 200 None
2026-03-20 21:44:47,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:44:47,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb1cc821a77312e222211c HTTP/1.1" 200 None
2026-03-20 21:44:47,165 - lava_callback - ERROR - Error processing callback for node 69bb1cc821a77312e222211c: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:36568 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51766 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51770 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57934 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:57942 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56094 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38210 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40016 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43716 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50272 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50282 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38732 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:38746 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51760 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55516 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57530 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42814 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50098 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50112 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59816 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:59826 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39420 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59706 - "GET / HTTP/1.0" 200 OK
2026-03-20 21:47:43,268 - lava_callback - INFO - Received callback for node 69bb1d6f21a77312e2222133
INFO: 172.19.0.1:44546 - "POST /node/69bb1d6f21a77312e2222133 HTTP/1.0" 202 Accepted
2026-03-20 21:47:43,274 - lava_callback - INFO - Starting async job submit for node 69bb1d6f21a77312e2222133
2026-03-20 21:47:43,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:47:43,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb1d6f21a77312e2222133 HTTP/1.1" 200 None
2026-03-20 21:47:43,293 - lava_callback - DEBUG - Processing node 69bb1d6f21a77312e2222133: baseline-arm64-clabbe
2026-03-20 21:47:43,293 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb1d6f21a77312e2222133
2026-03-20 21:47:43,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:47:43,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb1d6f21a77312e2222133 HTTP/1.1" 200 None
2026-03-20 21:47:43,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:47:43,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9ef90d5731cbd74145fce HTTP/1.1" 200 None
2026-03-20 21:47:43,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:47:43,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb1d6f21a77312e2222133 HTTP/1.1" 200 None
2026-03-20 21:47:43,352 - lava_callback - ERROR - Error processing callback for node 69bb1d6f21a77312e2222133: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:44562 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38124 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52332 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52340 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46806 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:46818 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33776 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34206 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56336 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54802 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57654 - "GET / HTTP/1.0" 200 OK
2026-03-20 21:49:03,317 - lava_callback - INFO - Received callback for node 69bb1dc121a77312e222213d
INFO: 172.19.0.1:57658 - "POST /node/69bb1dc121a77312e222213d HTTP/1.0" 202 Accepted
2026-03-20 21:49:03,323 - lava_callback - INFO - Starting async job submit for node 69bb1dc121a77312e222213d
2026-03-20 21:49:03,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:49:03,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb1dc121a77312e222213d HTTP/1.1" 200 None
2026-03-20 21:49:03,339 - lava_callback - DEBUG - Processing node 69bb1dc121a77312e222213d: baseline-arm64-clabbe
2026-03-20 21:49:03,339 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb1dc121a77312e222213d
2026-03-20 21:49:03,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:49:03,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb1dc121a77312e222213d HTTP/1.1" 200 None
2026-03-20 21:49:03,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:49:03,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9ef90d5731cbd74145fce HTTP/1.1" 200 None
2026-03-20 21:49:03,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:49:03,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb1dc121a77312e222213d HTTP/1.1" 200 None
2026-03-20 21:49:03,395 - lava_callback - ERROR - Error processing callback for node 69bb1dc121a77312e222213d: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:57668 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60446 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:60462 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51838 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51930 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55820 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41350 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49578 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49582 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45340 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:45348 - "GET / HTTP/1.0" 200 OK
2026-03-20 21:50:23,321 - lava_callback - INFO - Received callback for node 69bb1e1221a77312e222214a
INFO: 172.19.0.1:48676 - "POST /node/69bb1e1221a77312e222214a HTTP/1.0" 202 Accepted
2026-03-20 21:50:23,326 - lava_callback - INFO - Starting async job submit for node 69bb1e1221a77312e222214a
2026-03-20 21:50:23,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:50:23,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb1e1221a77312e222214a HTTP/1.1" 200 None
2026-03-20 21:50:23,342 - lava_callback - DEBUG - Processing node 69bb1e1221a77312e222214a: baseline-arm64-clabbe
2026-03-20 21:50:23,342 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb1e1221a77312e222214a
2026-03-20 21:50:23,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:50:23,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb1e1221a77312e222214a HTTP/1.1" 200 None
2026-03-20 21:50:23,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:50:23,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9ef90d5731cbd74145fce HTTP/1.1" 200 None
2026-03-20 21:50:23,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:50:23,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb1e1221a77312e222214a HTTP/1.1" 200 None
2026-03-20 21:50:23,409 - lava_callback - ERROR - Error processing callback for node 69bb1e1221a77312e222214a: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:48680 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36844 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34136 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56402 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58242 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58248 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56702 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:56708 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46756 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56708 - "GET / HTTP/1.0" 200 OK
2026-03-20 21:51:43,407 - lava_callback - INFO - Received callback for node 69bb1e6421a77312e2222150
INFO: 172.19.0.1:51036 - "POST /node/69bb1e6421a77312e2222150 HTTP/1.0" 202 Accepted
2026-03-20 21:51:43,412 - lava_callback - INFO - Starting async job submit for node 69bb1e6421a77312e2222150
2026-03-20 21:51:43,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:51:43,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb1e6421a77312e2222150 HTTP/1.1" 200 None
2026-03-20 21:51:43,429 - lava_callback - DEBUG - Processing node 69bb1e6421a77312e2222150: baseline-arm64-clabbe
2026-03-20 21:51:43,429 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb1e6421a77312e2222150
2026-03-20 21:51:43,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:51:43,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb1e6421a77312e2222150 HTTP/1.1" 200 None
2026-03-20 21:51:43,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:51:43,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9ef90d5731cbd74145fce HTTP/1.1" 200 None
2026-03-20 21:51:43,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:51:43,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb1e6421a77312e2222150 HTTP/1.1" 200 None
2026-03-20 21:51:43,509 - lava_callback - ERROR - Error processing callback for node 69bb1e6421a77312e2222150: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:51042 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35652 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33134 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33150 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35854 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:35870 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40144 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45582 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58368 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55344 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39294 - "GET / HTTP/1.0" 200 OK
2026-03-20 21:53:03,423 - lava_callback - INFO - Received callback for node 69bb1eb521a77312e222215d
INFO: 172.19.0.1:39298 - "POST /node/69bb1eb521a77312e222215d HTTP/1.0" 202 Accepted
2026-03-20 21:53:03,429 - lava_callback - INFO - Starting async job submit for node 69bb1eb521a77312e222215d
2026-03-20 21:53:03,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:53:03,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb1eb521a77312e222215d HTTP/1.1" 200 None
2026-03-20 21:53:03,445 - lava_callback - DEBUG - Processing node 69bb1eb521a77312e222215d: baseline-arm64-clabbe
2026-03-20 21:53:03,445 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb1eb521a77312e222215d
2026-03-20 21:53:03,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:53:03,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb1eb521a77312e222215d HTTP/1.1" 200 None
2026-03-20 21:53:03,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:53:03,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9ef90d5731cbd74145fce HTTP/1.1" 200 None
2026-03-20 21:53:03,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:53:03,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb1eb521a77312e222215d HTTP/1.1" 200 None
2026-03-20 21:53:03,532 - lava_callback - ERROR - Error processing callback for node 69bb1eb521a77312e222215d: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:39310 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39780 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:39794 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58172 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56482 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44624 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51832 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56846 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56858 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46798 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:46812 - "GET / HTTP/1.0" 200 OK
2026-03-20 21:54:23,556 - lava_callback - INFO - Received callback for node 69bb1f0821a77312e2222169
INFO: 172.19.0.1:49832 - "POST /node/69bb1f0821a77312e2222169 HTTP/1.0" 202 Accepted
2026-03-20 21:54:23,561 - lava_callback - INFO - Starting async job submit for node 69bb1f0821a77312e2222169
2026-03-20 21:54:23,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:54:23,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb1f0821a77312e2222169 HTTP/1.1" 200 None
2026-03-20 21:54:23,594 - lava_callback - DEBUG - Processing node 69bb1f0821a77312e2222169: baseline-arm64-clabbe
2026-03-20 21:54:23,594 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb1f0821a77312e2222169
2026-03-20 21:54:23,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:54:23,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb1f0821a77312e2222169 HTTP/1.1" 200 None
2026-03-20 21:54:23,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:54:23,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9ef90d5731cbd74145fce HTTP/1.1" 200 None
2026-03-20 21:54:23,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:54:23,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb1f0821a77312e2222169 HTTP/1.1" 200 None
2026-03-20 21:54:23,652 - lava_callback - ERROR - Error processing callback for node 69bb1f0821a77312e2222169: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:49844 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47700 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39428 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49094 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39282 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39294 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45388 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:45396 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59058 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47794 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55220 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45004 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54878 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54886 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41846 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:41850 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44956 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49280 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52586 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53252 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57134 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57144 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57328 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:57344 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47188 - "GET / HTTP/1.0" 200 OK
2026-03-20 21:57:31,779 - lava_callback - INFO - Received callback for node 69bdad570e93e23147241ede
INFO: 172.19.0.1:47606 - "POST /node/69bdad570e93e23147241ede HTTP/1.0" 202 Accepted
2026-03-20 21:57:31,786 - lava_callback - INFO - Starting async job submit for node 69bdad570e93e23147241ede
2026-03-20 21:57:31,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:57:31,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bdad570e93e23147241ede HTTP/1.1" 200 None
2026-03-20 21:57:31,827 - lava_callback - DEBUG - Processing node 69bdad570e93e23147241ede: baseline-nfs-arm64
2026-03-20 21:57:32,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 21:57:32,524 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 21:57:32,526 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bdad570e93e23147241ede/log.txt.gz
2026-03-20 21:57:32,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 21:57:33,011 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 21:57:33,013 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bdad570e93e23147241ede/lava-logs.yaml
2026-03-20 21:57:33,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 21:57:33,202 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 21:57:33,204 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bdad570e93e23147241ede/lava_callback.json.gz
2026-03-20 21:57:33,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:57:33,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bdad570e93e23147241ede HTTP/1.1" 200 None
2026-03-20 21:57:33,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:57:33,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 21:57:33,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:57:33,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bdad570e93e23147241ede HTTP/1.1" 200 None
2026-03-20 21:57:33,357 - lava_callback - INFO - Completed processing callback for node 69bdad570e93e23147241ede
INFO: 172.19.0.1:47618 - "GET / HTTP/1.0" 200 OK
2026-03-20 21:57:41,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 21:57:41,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:58564 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46668 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53952 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53966 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50566 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:50580 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45082 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39366 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44490 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59632 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56982 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56998 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40372 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:40386 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49364 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51868 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59124 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35168 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48910 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48926 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60870 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:60884 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39530 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53518 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39986 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50460 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46060 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46076 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53632 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:53648 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43052 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35720 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54482 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48136 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49666 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49680 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41990 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:41992 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57846 - "GET / HTTP/1.0" 200 OK
2026-03-20 22:02:28,110 - lava_callback - INFO - Received callback for node 69bb20e421a77312e22221b7
INFO: 172.19.0.1:57854 - "POST /node/69bb20e421a77312e22221b7 HTTP/1.0" 202 Accepted
2026-03-20 22:02:28,115 - lava_callback - INFO - Starting async job submit for node 69bb20e421a77312e22221b7
2026-03-20 22:02:28,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:02:28,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb20e421a77312e22221b7 HTTP/1.1" 200 None
2026-03-20 22:02:28,131 - lava_callback - DEBUG - Processing node 69bb20e421a77312e22221b7: baseline-arm64-baylibre
2026-03-20 22:02:28,131 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb20e421a77312e22221b7
2026-03-20 22:02:28,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:02:28,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb20e421a77312e22221b7 HTTP/1.1" 200 None
2026-03-20 22:02:28,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:02:28,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None
2026-03-20 22:02:28,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:02:28,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb20e421a77312e22221b7 HTTP/1.1" 200 None
2026-03-20 22:02:28,192 - lava_callback - ERROR - Error processing callback for node 69bb20e421a77312e22221b7: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:37490 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55274 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40228 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45350 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45360 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46590 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:46600 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44794 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40886 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33842 - "GET / HTTP/1.0" 200 OK
2026-03-20 22:03:47,975 - lava_callback - INFO - Received callback for node 69bb213621a77312e22221c4
INFO: 172.19.0.1:33858 - "POST /node/69bb213621a77312e22221c4 HTTP/1.0" 202 Accepted
2026-03-20 22:03:47,981 - lava_callback - INFO - Starting async job submit for node 69bb213621a77312e22221c4
2026-03-20 22:03:47,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:03:47,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb213621a77312e22221c4 HTTP/1.1" 200 None
2026-03-20 22:03:47,997 - lava_callback - DEBUG - Processing node 69bb213621a77312e22221c4: baseline-arm64-baylibre
2026-03-20 22:03:47,997 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb213621a77312e22221c4
2026-03-20 22:03:47,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:03:48,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb213621a77312e22221c4 HTTP/1.1" 200 None
2026-03-20 22:03:48,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:03:48,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None
2026-03-20 22:03:48,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:03:48,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb213621a77312e22221c4 HTTP/1.1" 200 None
2026-03-20 22:03:48,053 - lava_callback - ERROR - Error processing callback for node 69bb213621a77312e22221c4: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:35496 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46434 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46442 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49946 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:49960 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35012 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54916 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34582 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59476 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38710 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38714 - "GET / HTTP/1.0" 200 OK
2026-03-20 22:05:08,086 - lava_callback - INFO - Received callback for node 69bb218721a77312e22221db
INFO: 172.19.0.1:38718 - "POST /node/69bb218721a77312e22221db HTTP/1.0" 202 Accepted
2026-03-20 22:05:08,092 - lava_callback - INFO - Starting async job submit for node 69bb218721a77312e22221db
2026-03-20 22:05:08,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:05:08,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb218721a77312e22221db HTTP/1.1" 200 None
2026-03-20 22:05:08,107 - lava_callback - DEBUG - Processing node 69bb218721a77312e22221db: baseline-arm64-baylibre
2026-03-20 22:05:08,107 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb218721a77312e22221db
2026-03-20 22:05:08,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:05:08,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb218721a77312e22221db HTTP/1.1" 200 None
2026-03-20 22:05:08,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:05:08,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None
2026-03-20 22:05:08,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:05:08,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb218721a77312e22221db HTTP/1.1" 200 None
2026-03-20 22:05:08,170 - lava_callback - ERROR - Error processing callback for node 69bb218721a77312e22221db: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:50112 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:50118 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48480 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50210 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35962 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36600 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56454 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56470 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34104 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:34112 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33386 - "GET / HTTP/1.0" 200 OK
2026-03-20 22:06:28,191 - lava_callback - INFO - Received callback for node 69bb21da21a77312e22221e7
INFO: 172.19.0.1:33398 - "POST /node/69bb21da21a77312e22221e7 HTTP/1.0" 202 Accepted
2026-03-20 22:06:28,196 - lava_callback - INFO - Starting async job submit for node 69bb21da21a77312e22221e7
2026-03-20 22:06:28,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:06:28,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb21da21a77312e22221e7 HTTP/1.1" 200 None
2026-03-20 22:06:28,213 - lava_callback - DEBUG - Processing node 69bb21da21a77312e22221e7: baseline-arm64-baylibre
2026-03-20 22:06:28,213 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb21da21a77312e22221e7
2026-03-20 22:06:28,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:06:28,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb21da21a77312e22221e7 HTTP/1.1" 200 None
2026-03-20 22:06:28,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:06:28,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None
2026-03-20 22:06:28,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:06:28,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb21da21a77312e22221e7 HTTP/1.1" 200 None
2026-03-20 22:06:28,273 - lava_callback - ERROR - Error processing callback for node 69bb21da21a77312e22221e7: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:35356 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39108 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37760 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35272 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35276 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55442 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:55458 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38894 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46552 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36956 - "GET / HTTP/1.0" 200 OK
2026-03-20 22:07:48,193 - lava_callback - INFO - Received callback for node 69bb222d21a77312e22221f4
INFO: 172.19.0.1:36958 - "POST /node/69bb222d21a77312e22221f4 HTTP/1.0" 202 Accepted
2026-03-20 22:07:48,198 - lava_callback - INFO - Starting async job submit for node 69bb222d21a77312e22221f4
2026-03-20 22:07:48,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:07:48,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb222d21a77312e22221f4 HTTP/1.1" 200 None
2026-03-20 22:07:48,214 - lava_callback - DEBUG - Processing node 69bb222d21a77312e22221f4: baseline-arm64-baylibre
2026-03-20 22:07:48,215 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb222d21a77312e22221f4
2026-03-20 22:07:48,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:07:48,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb222d21a77312e22221f4 HTTP/1.1" 200 None
2026-03-20 22:07:48,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:07:48,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None
2026-03-20 22:07:48,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:07:48,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb222d21a77312e22221f4 HTTP/1.1" 200 None
2026-03-20 22:07:48,269 - lava_callback - ERROR - Error processing callback for node 69bb222d21a77312e22221f4: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:54978 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34686 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34694 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49782 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:49786 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37744 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55228 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59546 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46772 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43714 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43716 - "GET / HTTP/1.0" 200 OK
2026-03-20 22:09:08,255 - lava_callback - INFO - Received callback for node 69bb227221a77312e22221f9
INFO: 172.19.0.1:43732 - "POST /node/69bb227221a77312e22221f9 HTTP/1.0" 202 Accepted
2026-03-20 22:09:08,260 - lava_callback - INFO - Starting async job submit for node 69bb227221a77312e22221f9
2026-03-20 22:09:08,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:09:08,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb227221a77312e22221f9 HTTP/1.1" 200 None
2026-03-20 22:09:08,277 - lava_callback - DEBUG - Processing node 69bb227221a77312e22221f9: baseline-arm-baylibre
2026-03-20 22:09:08,277 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb227221a77312e22221f9
2026-03-20 22:09:08,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:09:08,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb227221a77312e22221f9 HTTP/1.1" 200 None
2026-03-20 22:09:08,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:09:08,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd6400b80c8ffdcb829f HTTP/1.1" 200 None
2026-03-20 22:09:08,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:09:08,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb227221a77312e22221f9 HTTP/1.1" 200 None
2026-03-20 22:09:08,338 - lava_callback - ERROR - Error processing callback for node 69bb227221a77312e22221f9: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:38428 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:38430 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41384 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60908 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34224 - "GET / HTTP/1.0" 200 OK
2026-03-20 22:09:48,243 - lava_callback - INFO - Received callback for node 69bb229e21a77312e2222205
INFO: 172.19.0.1:34230 - "POST /node/69bb229e21a77312e2222205 HTTP/1.0" 202 Accepted
2026-03-20 22:09:48,249 - lava_callback - INFO - Starting async job submit for node 69bb229e21a77312e2222205
2026-03-20 22:09:48,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:09:48,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb229e21a77312e2222205 HTTP/1.1" 200 None
2026-03-20 22:09:48,265 - lava_callback - DEBUG - Processing node 69bb229e21a77312e2222205: baseline-arm-baylibre
2026-03-20 22:09:48,265 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb229e21a77312e2222205
2026-03-20 22:09:48,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:09:48,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb229e21a77312e2222205 HTTP/1.1" 200 None
2026-03-20 22:09:48,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:09:48,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd6400b80c8ffdcb829f HTTP/1.1" 200 None
2026-03-20 22:09:48,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:09:48,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb229e21a77312e2222205 HTTP/1.1" 200 None
2026-03-20 22:09:48,350 - lava_callback - ERROR - Error processing callback for node 69bb229e21a77312e2222205: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:52802 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46614 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46616 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35526 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:35534 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52866 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57952 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55810 - "GET / HTTP/1.0" 200 OK
2026-03-20 22:10:48,335 - lava_callback - INFO - Received callback for node 69bb22dc21a77312e2222211
INFO: 172.19.0.1:55822 - "POST /node/69bb22dc21a77312e2222211 HTTP/1.0" 202 Accepted
2026-03-20 22:10:48,340 - lava_callback - INFO - Starting async job submit for node 69bb22dc21a77312e2222211
2026-03-20 22:10:48,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:10:48,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb22dc21a77312e2222211 HTTP/1.1" 200 None
2026-03-20 22:10:48,356 - lava_callback - DEBUG - Processing node 69bb22dc21a77312e2222211: baseline-arm64-baylibre
2026-03-20 22:10:48,357 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb22dc21a77312e2222211
2026-03-20 22:10:48,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:10:48,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb22dc21a77312e2222211 HTTP/1.1" 200 None
2026-03-20 22:10:48,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:10:48,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None
2026-03-20 22:10:48,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:10:48,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb22dc21a77312e2222211 HTTP/1.1" 200 None
2026-03-20 22:10:48,415 - lava_callback - ERROR - Error processing callback for node 69bb22dc21a77312e2222211: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:38052 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33924 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33938 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46124 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:46132 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52780 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51180 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41724 - "GET / HTTP/1.0" 200 OK
2026-03-20 22:11:48,376 - lava_callback - INFO - Received callback for node 69bb232021a77312e222221f
INFO: 172.19.0.1:41736 - "POST /node/69bb232021a77312e222221f HTTP/1.0" 202 Accepted
2026-03-20 22:11:48,382 - lava_callback - INFO - Starting async job submit for node 69bb232021a77312e222221f
2026-03-20 22:11:48,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:11:48,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb232021a77312e222221f HTTP/1.1" 200 None
2026-03-20 22:11:48,398 - lava_callback - DEBUG - Processing node 69bb232021a77312e222221f: baseline-arm-baylibre
2026-03-20 22:11:48,398 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb232021a77312e222221f
2026-03-20 22:11:48,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:11:48,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb232021a77312e222221f HTTP/1.1" 200 None
2026-03-20 22:11:48,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:11:48,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd6400b80c8ffdcb829f HTTP/1.1" 200 None
2026-03-20 22:11:48,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:11:48,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb232021a77312e222221f HTTP/1.1" 200 None
2026-03-20 22:11:48,458 - lava_callback - ERROR - Error processing callback for node 69bb232021a77312e222221f: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:53296 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41812 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41828 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43224 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:43234 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55980 - "GET / HTTP/1.0" 200 OK
2026-03-20 22:12:28,429 - lava_callback - INFO - Received callback for node 69bb234821a77312e222222a
INFO: 172.19.0.1:55996 - "POST /node/69bb234821a77312e222222a HTTP/1.0" 202 Accepted
2026-03-20 22:12:28,436 - lava_callback - INFO - Starting async job submit for node 69bb234821a77312e222222a
2026-03-20 22:12:28,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:12:28,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb234821a77312e222222a HTTP/1.1" 200 None
2026-03-20 22:12:28,456 - lava_callback - DEBUG - Processing node 69bb234821a77312e222222a: baseline-arm-baylibre
2026-03-20 22:12:28,456 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb234821a77312e222222a
2026-03-20 22:12:28,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:12:28,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb234821a77312e222222a HTTP/1.1" 200 None
2026-03-20 22:12:28,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:12:28,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd6400b80c8ffdcb829f HTTP/1.1" 200 None
2026-03-20 22:12:28,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:12:28,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb234821a77312e222222a HTTP/1.1" 200 None
2026-03-20 22:12:28,512 - lava_callback - ERROR - Error processing callback for node 69bb234821a77312e222222a: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:39316 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55594 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42886 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48454 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48468 - "GET / HTTP/1.0" 200 OK
2026-03-20 22:13:08,446 - lava_callback - INFO - Received callback for node 69bb237121a77312e2222236
INFO: 172.19.0.1:48470 - "POST /node/69bb237121a77312e2222236 HTTP/1.0" 202 Accepted
2026-03-20 22:13:08,452 - lava_callback - INFO - Starting async job submit for node 69bb237121a77312e2222236
2026-03-20 22:13:08,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:13:08,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb237121a77312e2222236 HTTP/1.1" 200 None
2026-03-20 22:13:08,489 - lava_callback - DEBUG - Processing node 69bb237121a77312e2222236: baseline-arm-baylibre
2026-03-20 22:13:08,489 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb237121a77312e2222236
2026-03-20 22:13:08,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:13:08,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb237121a77312e2222236 HTTP/1.1" 200 None
2026-03-20 22:13:08,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:13:08,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd6400b80c8ffdcb829f HTTP/1.1" 200 None
2026-03-20 22:13:08,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:13:08,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb237121a77312e2222236 HTTP/1.1" 200 None
2026-03-20 22:13:08,544 - lava_callback - ERROR - Error processing callback for node 69bb237121a77312e2222236: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:37408 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:37416 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58416 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36884 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60994 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60998 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39708 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51016 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51032 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34010 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:34020 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47140 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40718 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47084 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55618 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48424 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48428 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53580 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:53592 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60670 - "GET / HTTP/1.0" 200 OK
2026-03-20 22:15:28,621 - lava_callback - INFO - Received callback for node 69bb23ed21a77312e2222252
INFO: 172.19.0.1:60684 - "POST /node/69bb23ed21a77312e2222252 HTTP/1.0" 202 Accepted
2026-03-20 22:15:28,627 - lava_callback - INFO - Starting async job submit for node 69bb23ed21a77312e2222252
2026-03-20 22:15:28,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:15:28,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb23ed21a77312e2222252 HTTP/1.1" 200 None
2026-03-20 22:15:28,642 - lava_callback - DEBUG - Processing node 69bb23ed21a77312e2222252: baseline-arm-baylibre
2026-03-20 22:15:28,643 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb23ed21a77312e2222252
2026-03-20 22:15:28,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:15:28,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb23ed21a77312e2222252 HTTP/1.1" 200 None
2026-03-20 22:15:28,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:15:28,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd6400b80c8ffdcb829f HTTP/1.1" 200 None
2026-03-20 22:15:28,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:15:28,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb23ed21a77312e2222252 HTTP/1.1" 200 None
2026-03-20 22:15:28,701 - lava_callback - ERROR - Error processing callback for node 69bb23ed21a77312e2222252: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:41002 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51158 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45600 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39452 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39460 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53050 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:53058 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47732 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42146 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34040 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60848 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42606 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42620 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43560 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:43570 - "GET / HTTP/1.0" 200 OK
2026-03-20 22:17:24,553 - lava_callback - INFO - Received callback for node 69bb246a21a77312e2222264
INFO: 172.19.0.1:36358 - "POST /node/69bb246a21a77312e2222264 HTTP/1.0" 202 Accepted
2026-03-20 22:17:24,558 - lava_callback - INFO - Starting async job submit for node 69bb246a21a77312e2222264
2026-03-20 22:17:24,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:17:24,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb246a21a77312e2222264 HTTP/1.1" 200 None
2026-03-20 22:17:24,574 - lava_callback - DEBUG - Processing node 69bb246a21a77312e2222264: baseline-arm-clabbe
2026-03-20 22:17:24,574 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb246a21a77312e2222264
2026-03-20 22:17:24,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:17:24,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb246a21a77312e2222264 HTTP/1.1" 200 None
2026-03-20 22:17:24,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:17:24,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd6400b80c8ffdcb829f HTTP/1.1" 200 None
2026-03-20 22:17:24,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:17:24,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb246a21a77312e2222264 HTTP/1.1" 200 None
2026-03-20 22:17:24,637 - lava_callback - ERROR - Error processing callback for node 69bb246a21a77312e2222264: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:36366 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59156 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41920 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60032 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50370 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50384 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34048 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:34062 - "GET / HTTP/1.0" 200 OK
2026-03-20 22:18:24,622 - lava_callback - INFO - Received callback for node 69bb24a121a77312e222226e
INFO: 172.19.0.1:51814 - "POST /node/69bb24a121a77312e222226e HTTP/1.0" 202 Accepted
2026-03-20 22:18:24,628 - lava_callback - INFO - Starting async job submit for node 69bb24a121a77312e222226e
2026-03-20 22:18:24,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:18:24,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb24a121a77312e222226e HTTP/1.1" 200 None
2026-03-20 22:18:24,661 - lava_callback - DEBUG - Processing node 69bb24a121a77312e222226e: baseline-arm64-clabbe
2026-03-20 22:18:24,661 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb24a121a77312e222226e
2026-03-20 22:18:24,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:18:24,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb24a121a77312e222226e HTTP/1.1" 200 None
2026-03-20 22:18:24,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:18:24,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None
2026-03-20 22:18:24,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:18:24,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb24a121a77312e222226e HTTP/1.1" 200 None
2026-03-20 22:18:24,718 - lava_callback - ERROR - Error processing callback for node 69bb24a121a77312e222226e: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:51818 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52866 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58912 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46060 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35894 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35910 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45370 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:45372 - "GET / HTTP/1.0" 200 OK
2026-03-20 22:19:24,631 - lava_callback - INFO - Received callback for node 69bb24e521a77312e2222273
INFO: 172.19.0.1:34886 - "POST /node/69bb24e521a77312e2222273 HTTP/1.0" 202 Accepted
2026-03-20 22:19:24,640 - lava_callback - INFO - Starting async job submit for node 69bb24e521a77312e2222273
2026-03-20 22:19:24,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:19:24,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb24e521a77312e2222273 HTTP/1.1" 200 None
2026-03-20 22:19:24,662 - lava_callback - DEBUG - Processing node 69bb24e521a77312e2222273: baseline-arm-clabbe
2026-03-20 22:19:24,662 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb24e521a77312e2222273
2026-03-20 22:19:24,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:19:24,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb24e521a77312e2222273 HTTP/1.1" 200 None
2026-03-20 22:19:24,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:19:24,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd6400b80c8ffdcb829f HTTP/1.1" 200 None
2026-03-20 22:19:24,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:19:24,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb24e521a77312e2222273 HTTP/1.1" 200 None
2026-03-20 22:19:24,728 - lava_callback - ERROR - Error processing callback for node 69bb24e521a77312e2222273: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:34896 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43468 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56226 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48498 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37928 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37944 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51226 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:51228 - "GET / HTTP/1.0" 200 OK
2026-03-20 22:20:24,686 - lava_callback - INFO - Received callback for node 69bb251d21a77312e2222282
INFO: 172.19.0.1:58510 - "POST /node/69bb251d21a77312e2222282 HTTP/1.0" 202 Accepted
2026-03-20 22:20:24,692 - lava_callback - INFO - Starting async job submit for node 69bb251d21a77312e2222282
2026-03-20 22:20:24,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:20:24,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb251d21a77312e2222282 HTTP/1.1" 200 None
2026-03-20 22:20:24,712 - lava_callback - DEBUG - Processing node 69bb251d21a77312e2222282: baseline-arm64-clabbe
2026-03-20 22:20:24,712 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb251d21a77312e2222282
2026-03-20 22:20:24,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:20:24,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb251d21a77312e2222282 HTTP/1.1" 200 None
2026-03-20 22:20:24,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:20:24,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None
2026-03-20 22:20:24,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:20:24,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb251d21a77312e2222282 HTTP/1.1" 200 None
2026-03-20 22:20:24,776 - lava_callback - ERROR - Error processing callback for node 69bb251d21a77312e2222282: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:58516 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45962 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59602 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57924 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33140 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33150 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48150 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:48162 - "GET / HTTP/1.0" 200 OK
2026-03-20 22:21:24,706 - lava_callback - INFO - Received callback for node 69bb256121a77312e222228c
INFO: 172.19.0.1:35576 - "POST /node/69bb256121a77312e222228c HTTP/1.0" 202 Accepted
2026-03-20 22:21:24,713 - lava_callback - INFO - Starting async job submit for node 69bb256121a77312e222228c
2026-03-20 22:21:24,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:21:24,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb256121a77312e222228c HTTP/1.1" 200 None
2026-03-20 22:21:24,730 - lava_callback - DEBUG - Processing node 69bb256121a77312e222228c: baseline-arm-clabbe
2026-03-20 22:21:24,730 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb256121a77312e222228c
2026-03-20 22:21:24,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:21:24,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb256121a77312e222228c HTTP/1.1" 200 None
2026-03-20 22:21:24,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:21:24,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd6400b80c8ffdcb829f HTTP/1.1" 200 None
2026-03-20 22:21:24,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:21:24,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb256121a77312e222228c HTTP/1.1" 200 None
2026-03-20 22:21:24,798 - lava_callback - ERROR - Error processing callback for node 69bb256121a77312e222228c: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:35582 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55464 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40126 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57110 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56860 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56876 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40836 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:40848 - "GET / HTTP/1.0" 200 OK
2026-03-20 22:22:24,785 - lava_callback - INFO - Received callback for node 69bb259821a77312e222229a
INFO: 172.19.0.1:33582 - "POST /node/69bb259821a77312e222229a HTTP/1.0" 202 Accepted
2026-03-20 22:22:24,790 - lava_callback - INFO - Starting async job submit for node 69bb259821a77312e222229a
2026-03-20 22:22:24,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:22:24,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb259821a77312e222229a HTTP/1.1" 200 None
2026-03-20 22:22:24,807 - lava_callback - DEBUG - Processing node 69bb259821a77312e222229a: baseline-arm64-clabbe
2026-03-20 22:22:24,807 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb259821a77312e222229a
2026-03-20 22:22:24,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:22:24,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb259821a77312e222229a HTTP/1.1" 200 None
2026-03-20 22:22:24,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:22:24,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None
2026-03-20 22:22:24,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:22:24,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb259821a77312e222229a HTTP/1.1" 200 None
2026-03-20 22:22:24,870 - lava_callback - ERROR - Error processing callback for node 69bb259821a77312e222229a: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:33592 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58304 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40034 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58754 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58300 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58304 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55872 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:55886 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52556 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41328 - "GET / HTTP/1.0" 200 OK
2026-03-20 22:23:44,837 - lava_callback - INFO - Received callback for node 69bb25dc21a77312e222229f
INFO: 172.19.0.1:58610 - "POST /node/69bb25dc21a77312e222229f HTTP/1.0" 202 Accepted
2026-03-20 22:23:44,843 - lava_callback - INFO - Starting async job submit for node 69bb25dc21a77312e222229f
2026-03-20 22:23:44,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:23:44,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb25dc21a77312e222229f HTTP/1.1" 200 None
2026-03-20 22:23:44,859 - lava_callback - DEBUG - Processing node 69bb25dc21a77312e222229f: baseline-arm-clabbe
2026-03-20 22:23:44,859 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb25dc21a77312e222229f
2026-03-20 22:23:44,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:23:44,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb25dc21a77312e222229f HTTP/1.1" 200 None
2026-03-20 22:23:44,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:23:44,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd6400b80c8ffdcb829f HTTP/1.1" 200 None
2026-03-20 22:23:44,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:23:44,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb25dc21a77312e222229f HTTP/1.1" 200 None
2026-03-20 22:23:44,942 - lava_callback - ERROR - Error processing callback for node 69bb25dc21a77312e222229f: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:58622 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40674 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58024 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58032 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41206 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:41212 - "GET / HTTP/1.0" 200 OK
2026-03-20 22:24:24,805 - lava_callback - INFO - Received callback for node 69bb260521a77312e22222a8
INFO: 172.19.0.1:36252 - "POST /node/69bb260521a77312e22222a8 HTTP/1.0" 202 Accepted
2026-03-20 22:24:24,813 - lava_callback - INFO - Starting async job submit for node 69bb260521a77312e22222a8
2026-03-20 22:24:24,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:24:24,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb260521a77312e22222a8 HTTP/1.1" 200 None
2026-03-20 22:24:24,836 - lava_callback - DEBUG - Processing node 69bb260521a77312e22222a8: baseline-arm-clabbe
2026-03-20 22:24:24,836 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb260521a77312e22222a8
2026-03-20 22:24:24,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:24:24,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb260521a77312e22222a8 HTTP/1.1" 200 None
2026-03-20 22:24:24,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:24:24,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd6400b80c8ffdcb829f HTTP/1.1" 200 None
2026-03-20 22:24:24,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:24:24,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb260521a77312e22222a8 HTTP/1.1" 200 None
2026-03-20 22:24:24,896 - lava_callback - ERROR - Error processing callback for node 69bb260521a77312e22222a8: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:36256 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35700 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59988 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47866 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43636 - "GET / HTTP/1.0" 200 OK
2026-03-20 22:25:05,004 - lava_callback - INFO - Received callback for node 69bb263c21a77312e22222b2
INFO: 172.19.0.1:43642 - "POST /node/69bb263c21a77312e22222b2 HTTP/1.0" 202 Accepted
2026-03-20 22:25:05,009 - lava_callback - INFO - Starting async job submit for node 69bb263c21a77312e22222b2
2026-03-20 22:25:05,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:25:05,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb263c21a77312e22222b2 HTTP/1.1" 200 None
2026-03-20 22:25:05,025 - lava_callback - DEBUG - Processing node 69bb263c21a77312e22222b2: baseline-arm64-clabbe
2026-03-20 22:25:05,025 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb263c21a77312e22222b2
2026-03-20 22:25:05,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:25:05,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb263c21a77312e22222b2 HTTP/1.1" 200 None
2026-03-20 22:25:05,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:25:05,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None
2026-03-20 22:25:05,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:25:05,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb263c21a77312e22222b2 HTTP/1.1" 200 None
2026-03-20 22:25:05,091 - lava_callback - ERROR - Error processing callback for node 69bb263c21a77312e22222b2: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:43648 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55234 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:55246 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47382 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35408 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35650 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59668 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57226 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57230 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47272 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:47284 - "GET / HTTP/1.0" 200 OK
2026-03-20 22:26:24,966 - lava_callback - INFO - Received callback for node 69bb268d21a77312e22222bc
INFO: 172.19.0.1:59520 - "POST /node/69bb268d21a77312e22222bc HTTP/1.0" 202 Accepted
2026-03-20 22:26:24,971 - lava_callback - INFO - Starting async job submit for node 69bb268d21a77312e22222bc
2026-03-20 22:26:24,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:26:24,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb268d21a77312e22222bc HTTP/1.1" 200 None
2026-03-20 22:26:24,990 - lava_callback - DEBUG - Processing node 69bb268d21a77312e22222bc: baseline-arm64-clabbe
2026-03-20 22:26:24,990 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb268d21a77312e22222bc
2026-03-20 22:26:24,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:26:25,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb268d21a77312e22222bc HTTP/1.1" 200 None
2026-03-20 22:26:25,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:26:25,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None
2026-03-20 22:26:25,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:26:25,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb268d21a77312e22222bc HTTP/1.1" 200 None
2026-03-20 22:26:25,049 - lava_callback - ERROR - Error processing callback for node 69bb268d21a77312e22222bc: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:59524 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44242 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45344 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52646 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46862 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46868 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54420 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:54432 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36548 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45420 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37774 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52894 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39530 - "GET / HTTP/1.0" 200 OK
2026-03-20 22:28:05,028 - lava_callback - INFO - Received callback for node 69bb26e021a77312e22222c4
INFO: 172.19.0.1:39534 - "POST /node/69bb26e021a77312e22222c4 HTTP/1.0" 202 Accepted
2026-03-20 22:28:05,033 - lava_callback - INFO - Starting async job submit for node 69bb26e021a77312e22222c4
2026-03-20 22:28:05,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:28:05,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb26e021a77312e22222c4 HTTP/1.1" 200 None
2026-03-20 22:28:05,054 - lava_callback - DEBUG - Processing node 69bb26e021a77312e22222c4: baseline-arm64-clabbe
2026-03-20 22:28:05,054 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb26e021a77312e22222c4
2026-03-20 22:28:05,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:28:05,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb26e021a77312e22222c4 HTTP/1.1" 200 None
2026-03-20 22:28:05,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:28:05,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None
2026-03-20 22:28:05,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:28:05,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb26e021a77312e22222c4 HTTP/1.1" 200 None
2026-03-20 22:28:05,110 - lava_callback - ERROR - Error processing callback for node 69bb26e021a77312e22222c4: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:39544 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48634 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:48642 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47294 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44536 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33252 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41236 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43818 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43822 - "GET / HTTP/1.0" 200 OK
2026-03-20 22:29:09,431 - lava_callback - INFO - Received callback for node 69bb272021a77312e22222c9
INFO: 172.19.0.1:43834 - "POST /node/69bb272021a77312e22222c9 HTTP/1.0" 202 Accepted
2026-03-20 22:29:09,437 - lava_callback - INFO - Starting async job submit for node 69bb272021a77312e22222c9
2026-03-20 22:29:09,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:29:09,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb272021a77312e22222c9 HTTP/1.1" 200 None
2026-03-20 22:29:09,453 - lava_callback - DEBUG - Processing node 69bb272021a77312e22222c9: baseline-arm-baylibre
2026-03-20 22:29:09,453 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb272021a77312e22222c9
2026-03-20 22:29:09,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:29:09,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb272021a77312e22222c9 HTTP/1.1" 200 None
2026-03-20 22:29:09,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:29:09,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd6400b80c8ffdcb829f HTTP/1.1" 200 None
2026-03-20 22:29:09,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:29:09,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb272021a77312e22222c9 HTTP/1.1" 200 None
2026-03-20 22:29:09,504 - lava_callback - ERROR - Error processing callback for node 69bb272021a77312e22222c9: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:51186 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:51196 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46704 - "GET / HTTP/1.0" 200 OK
2026-03-20 22:29:29,358 - lava_callback - INFO - Received callback for node 69bb274721a77312e22222d2
INFO: 172.19.0.1:46708 - "POST /node/69bb274721a77312e22222d2 HTTP/1.0" 202 Accepted
2026-03-20 22:29:29,363 - lava_callback - INFO - Starting async job submit for node 69bb274721a77312e22222d2
2026-03-20 22:29:29,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:29:29,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb274721a77312e22222d2 HTTP/1.1" 200 None
2026-03-20 22:29:29,379 - lava_callback - DEBUG - Processing node 69bb274721a77312e22222d2: baseline-arm-baylibre
2026-03-20 22:29:29,380 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb274721a77312e22222d2
2026-03-20 22:29:29,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:29:29,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb274721a77312e22222d2 HTTP/1.1" 200 None
2026-03-20 22:29:29,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:29:29,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd6400b80c8ffdcb829f HTTP/1.1" 200 None
2026-03-20 22:29:29,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:29:29,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb274721a77312e22222d2 HTTP/1.1" 200 None
2026-03-20 22:29:29,443 - lava_callback - ERROR - Error processing callback for node 69bb274721a77312e22222d2: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:59362 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44360 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52248 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36184 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36186 - "GET / HTTP/1.0" 200 OK
2026-03-20 22:30:09,415 - lava_callback - INFO - Received callback for node 69bb276e21a77312e22222db
INFO: 172.19.0.1:36200 - "POST /node/69bb276e21a77312e22222db HTTP/1.0" 202 Accepted
2026-03-20 22:30:09,421 - lava_callback - INFO - Starting async job submit for node 69bb276e21a77312e22222db
2026-03-20 22:30:09,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:30:09,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb276e21a77312e22222db HTTP/1.1" 200 None
2026-03-20 22:30:09,436 - lava_callback - DEBUG - Processing node 69bb276e21a77312e22222db: baseline-arm-baylibre
2026-03-20 22:30:09,436 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb276e21a77312e22222db
2026-03-20 22:30:09,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:30:09,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb276e21a77312e22222db HTTP/1.1" 200 None
2026-03-20 22:30:09,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:30:09,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd6400b80c8ffdcb829f HTTP/1.1" 200 None
2026-03-20 22:30:09,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:30:09,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb276e21a77312e22222db HTTP/1.1" 200 None
2026-03-20 22:30:09,498 - lava_callback - ERROR - Error processing callback for node 69bb276e21a77312e22222db: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:42502 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:42518 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57388 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37748 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43962 - "GET / HTTP/1.0" 200 OK
2026-03-20 22:30:49,525 - lava_callback - INFO - Received callback for node 69bb279521a77312e22222e4
INFO: 172.19.0.1:43964 - "POST /node/69bb279521a77312e22222e4 HTTP/1.0" 202 Accepted
2026-03-20 22:30:49,531 - lava_callback - INFO - Starting async job submit for node 69bb279521a77312e22222e4
2026-03-20 22:30:49,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:30:49,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb279521a77312e22222e4 HTTP/1.1" 200 None
2026-03-20 22:30:49,549 - lava_callback - DEBUG - Processing node 69bb279521a77312e22222e4: baseline-arm-baylibre
2026-03-20 22:30:49,549 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb279521a77312e22222e4
2026-03-20 22:30:49,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:30:49,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb279521a77312e22222e4 HTTP/1.1" 200 None
2026-03-20 22:30:49,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:30:49,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd6400b80c8ffdcb829f HTTP/1.1" 200 None
2026-03-20 22:30:49,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:30:49,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb279521a77312e22222e4 HTTP/1.1" 200 None
2026-03-20 22:30:49,608 - lava_callback - ERROR - Error processing callback for node 69bb279521a77312e22222e4: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:42564 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51072 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51078 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59048 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:59062 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57194 - "GET / HTTP/1.0" 200 OK
2026-03-20 22:31:29,443 - lava_callback - INFO - Received callback for node 69bb27bd21a77312e22222ed
INFO: 172.19.0.1:57202 - "POST /node/69bb27bd21a77312e22222ed HTTP/1.0" 202 Accepted
2026-03-20 22:31:29,448 - lava_callback - INFO - Starting async job submit for node 69bb27bd21a77312e22222ed
2026-03-20 22:31:29,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:31:29,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb27bd21a77312e22222ed HTTP/1.1" 200 None
2026-03-20 22:31:29,465 - lava_callback - DEBUG - Processing node 69bb27bd21a77312e22222ed: baseline-arm-baylibre
2026-03-20 22:31:29,465 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb27bd21a77312e22222ed
2026-03-20 22:31:29,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:31:29,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb27bd21a77312e22222ed HTTP/1.1" 200 None
2026-03-20 22:31:29,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:31:29,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd6400b80c8ffdcb829f HTTP/1.1" 200 None
2026-03-20 22:31:29,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:31:29,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb27bd21a77312e22222ed HTTP/1.1" 200 None
2026-03-20 22:31:29,524 - lava_callback - ERROR - Error processing callback for node 69bb27bd21a77312e22222ed: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:43036 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55414 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53438 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52602 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52604 - "GET / HTTP/1.0" 200 OK
2026-03-20 22:32:09,508 - lava_callback - INFO - Received callback for node 69bb27e321a77312e22222f6
INFO: 172.19.0.1:52616 - "POST /node/69bb27e321a77312e22222f6 HTTP/1.0" 202 Accepted
2026-03-20 22:32:09,514 - lava_callback - INFO - Starting async job submit for node 69bb27e321a77312e22222f6
2026-03-20 22:32:09,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:32:09,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb27e321a77312e22222f6 HTTP/1.1" 200 None
2026-03-20 22:32:09,529 - lava_callback - DEBUG - Processing node 69bb27e321a77312e22222f6: baseline-arm-baylibre
2026-03-20 22:32:09,529 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb27e321a77312e22222f6
2026-03-20 22:32:09,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:32:09,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb27e321a77312e22222f6 HTTP/1.1" 200 None
2026-03-20 22:32:09,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:32:09,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd6400b80c8ffdcb829f HTTP/1.1" 200 None
2026-03-20 22:32:09,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:32:09,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb27e321a77312e22222f6 HTTP/1.1" 200 None
2026-03-20 22:32:09,588 - lava_callback - ERROR - Error processing callback for node 69bb27e321a77312e22222f6: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:41310 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:41318 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36696 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49074 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50690 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41408 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54484 - "GET / HTTP/1.0" 200 OK
2026-03-20 22:33:05,215 - lava_callback - INFO - Received callback for node 69bb280c21a77312e2222301
INFO: 172.19.0.1:54492 - "POST /node/69bb280c21a77312e2222301 HTTP/1.0" 202 Accepted
2026-03-20 22:33:05,221 - lava_callback - INFO - Starting async job submit for node 69bb280c21a77312e2222301
2026-03-20 22:33:05,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:33:05,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb280c21a77312e2222301 HTTP/1.1" 200 None
2026-03-20 22:33:05,262 - lava_callback - DEBUG - Processing node 69bb280c21a77312e2222301: baseline-arm-clabbe
2026-03-20 22:33:05,263 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb280c21a77312e2222301
2026-03-20 22:33:05,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:33:05,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb280c21a77312e2222301 HTTP/1.1" 200 None
2026-03-20 22:33:05,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:33:05,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd6400b80c8ffdcb829f HTTP/1.1" 200 None
2026-03-20 22:33:05,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:33:05,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb280c21a77312e2222301 HTTP/1.1" 200 None
2026-03-20 22:33:05,323 - lava_callback - ERROR - Error processing callback for node 69bb280c21a77312e2222301: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:54506 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54740 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:54742 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52844 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53550 - "GET / HTTP/1.0" 200 OK
2026-03-20 22:33:45,224 - lava_callback - INFO - Received callback for node 69bb283321a77312e2222308
INFO: 172.19.0.1:54958 - "POST /node/69bb283321a77312e2222308 HTTP/1.0" 202 Accepted
2026-03-20 22:33:45,230 - lava_callback - INFO - Starting async job submit for node 69bb283321a77312e2222308
2026-03-20 22:33:45,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:33:45,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb283321a77312e2222308 HTTP/1.1" 200 None
2026-03-20 22:33:45,249 - lava_callback - DEBUG - Processing node 69bb283321a77312e2222308: baseline-arm-clabbe
2026-03-20 22:33:45,249 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb283321a77312e2222308
2026-03-20 22:33:45,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:33:45,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb283321a77312e2222308 HTTP/1.1" 200 None
2026-03-20 22:33:45,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:33:45,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd6400b80c8ffdcb829f HTTP/1.1" 200 None
2026-03-20 22:33:45,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:33:45,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb283321a77312e2222308 HTTP/1.1" 200 None
2026-03-20 22:33:45,304 - lava_callback - ERROR - Error processing callback for node 69bb283321a77312e2222308: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:54966 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41728 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49016 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49028 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43502 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:43508 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47546 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51676 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35556 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46764 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57044 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57052 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47898 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:47906 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53222 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37850 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55866 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51780 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56768 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56782 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49654 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:49656 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36260 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55516 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59182 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48334 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35772 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35780 - "GET / HTTP/1.0" 200 OK
2026-03-20 22:37:09,809 - lava_callback - INFO - Received callback for node 69bb291221a77312e2222313
INFO: 172.19.0.1:37934 - "POST /node/69bb291221a77312e2222313 HTTP/1.0" 202 Accepted
2026-03-20 22:37:09,815 - lava_callback - INFO - Starting async job submit for node 69bb291221a77312e2222313
2026-03-20 22:37:09,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:37:09,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb291221a77312e2222313 HTTP/1.1" 200 None
2026-03-20 22:37:09,831 - lava_callback - DEBUG - Processing node 69bb291221a77312e2222313: baseline-arm-baylibre
2026-03-20 22:37:09,832 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb291221a77312e2222313
2026-03-20 22:37:09,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:37:09,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb291221a77312e2222313 HTTP/1.1" 200 None
2026-03-20 22:37:09,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:37:09,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None
2026-03-20 22:37:09,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:37:09,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb291221a77312e2222313 HTTP/1.1" 200 None
2026-03-20 22:37:09,888 - lava_callback - ERROR - Error processing callback for node 69bb291221a77312e2222313: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:37942 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:37944 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58182 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58970 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60720 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36822 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49130 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49136 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43090 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:43106 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54342 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50472 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58802 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46882 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45126 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45128 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42416 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:42426 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44770 - "GET / HTTP/1.0" 200 OK
2026-03-20 22:39:29,970 - lava_callback - INFO - Received callback for node 69bb299a21a77312e2222365
INFO: 172.19.0.1:50578 - "POST /node/69bb299a21a77312e2222365 HTTP/1.0" 202 Accepted
2026-03-20 22:39:29,976 - lava_callback - INFO - Starting async job submit for node 69bb299a21a77312e2222365
2026-03-20 22:39:29,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:39:30,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb299a21a77312e2222365 HTTP/1.1" 200 None
2026-03-20 22:39:30,017 - lava_callback - DEBUG - Processing node 69bb299a21a77312e2222365: baseline-arm-baylibre
2026-03-20 22:39:30,017 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb299a21a77312e2222365
2026-03-20 22:39:30,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:39:30,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb299a21a77312e2222365 HTTP/1.1" 200 None
2026-03-20 22:39:30,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:39:30,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad09221a77312e2220ee1 HTTP/1.1" 200 None
2026-03-20 22:39:30,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:39:30,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb299a21a77312e2222365 HTTP/1.1" 200 None
2026-03-20 22:39:30,077 - lava_callback - ERROR - Error processing callback for node 69bb299a21a77312e2222365: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:50586 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33496 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52630 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57958 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57960 - "GET / HTTP/1.0" 200 OK
2026-03-20 22:40:09,950 - lava_callback - INFO - Received callback for node 69bb29c221a77312e2222371
INFO: 172.19.0.1:43222 - "POST /node/69bb29c221a77312e2222371 HTTP/1.0" 202 Accepted
2026-03-20 22:40:09,956 - lava_callback - INFO - Starting async job submit for node 69bb29c221a77312e2222371
2026-03-20 22:40:09,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:40:10,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb29c221a77312e2222371 HTTP/1.1" 200 None
2026-03-20 22:40:10,006 - lava_callback - DEBUG - Processing node 69bb29c221a77312e2222371: baseline-arm-baylibre
2026-03-20 22:40:10,007 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb29c221a77312e2222371
2026-03-20 22:40:10,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:40:10,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb29c221a77312e2222371 HTTP/1.1" 200 None
2026-03-20 22:40:10,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:40:10,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad09221a77312e2220ee1 HTTP/1.1" 200 None
2026-03-20 22:40:10,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:40:10,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb29c221a77312e2222371 HTTP/1.1" 200 None
2026-03-20 22:40:10,124 - lava_callback - ERROR - Error processing callback for node 69bb29c221a77312e2222371: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:43238 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:43244 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48100 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50230 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54684 - "GET / HTTP/1.0" 200 OK
2026-03-20 22:40:50,007 - lava_callback - INFO - Received callback for node 69bb29e921a77312e2222384
INFO: 172.19.0.1:33878 - "POST /node/69bb29e921a77312e2222384 HTTP/1.0" 202 Accepted
2026-03-20 22:40:50,013 - lava_callback - INFO - Starting async job submit for node 69bb29e921a77312e2222384
2026-03-20 22:40:50,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:40:50,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb29e921a77312e2222384 HTTP/1.1" 200 None
2026-03-20 22:40:50,029 - lava_callback - DEBUG - Processing node 69bb29e921a77312e2222384: baseline-arm-baylibre
2026-03-20 22:40:50,029 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb29e921a77312e2222384
2026-03-20 22:40:50,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:40:50,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb29e921a77312e2222384 HTTP/1.1" 200 None
2026-03-20 22:40:50,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:40:50,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad09221a77312e2220ee1 HTTP/1.1" 200 None
2026-03-20 22:40:50,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:40:50,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb29e921a77312e2222384 HTTP/1.1" 200 None
2026-03-20 22:40:50,089 - lava_callback - ERROR - Error processing callback for node 69bb29e921a77312e2222384: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:33892 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48412 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48418 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53198 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:53202 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53594 - "GET / HTTP/1.0" 200 OK
2026-03-20 22:41:30,008 - lava_callback - INFO - Received callback for node 69bb2a1021a77312e222238f
INFO: 172.19.0.1:41164 - "POST /node/69bb2a1021a77312e222238f HTTP/1.0" 202 Accepted
2026-03-20 22:41:30,014 - lava_callback - INFO - Starting async job submit for node 69bb2a1021a77312e222238f
2026-03-20 22:41:30,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:41:30,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2a1021a77312e222238f HTTP/1.1" 200 None
2026-03-20 22:41:30,030 - lava_callback - DEBUG - Processing node 69bb2a1021a77312e222238f: baseline-arm-baylibre
2026-03-20 22:41:30,030 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb2a1021a77312e222238f
2026-03-20 22:41:30,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:41:30,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2a1021a77312e222238f HTTP/1.1" 200 None
2026-03-20 22:41:30,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:41:30,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad09221a77312e2220ee1 HTTP/1.1" 200 None
2026-03-20 22:41:30,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:41:30,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb2a1021a77312e222238f HTTP/1.1" 200 None
2026-03-20 22:41:30,088 - lava_callback - ERROR - Error processing callback for node 69bb2a1021a77312e222238f: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:41174 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36946 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59214 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37536 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37550 - "GET / HTTP/1.0" 200 OK
2026-03-20 22:42:10,447 - lava_callback - INFO - Received callback for node 69bb2a3621a77312e222239b
INFO: 172.19.0.1:49340 - "POST /node/69bb2a3621a77312e222239b HTTP/1.0" 202 Accepted
2026-03-20 22:42:10,457 - lava_callback - INFO - Starting async job submit for node 69bb2a3621a77312e222239b
2026-03-20 22:42:10,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:42:10,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2a3621a77312e222239b HTTP/1.1" 200 None
2026-03-20 22:42:10,482 - lava_callback - DEBUG - Processing node 69bb2a3621a77312e222239b: baseline-arm-baylibre
2026-03-20 22:42:10,482 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb2a3621a77312e222239b
2026-03-20 22:42:10,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:42:10,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2a3621a77312e222239b HTTP/1.1" 200 None
2026-03-20 22:42:10,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:42:10,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None
2026-03-20 22:42:10,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:42:10,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb2a3621a77312e222239b HTTP/1.1" 200 None
2026-03-20 22:42:10,535 - lava_callback - ERROR - Error processing callback for node 69bb2a3621a77312e222239b: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:49352 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:49362 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55154 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52374 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60652 - "GET / HTTP/1.0" 200 OK
2026-03-20 22:42:50,132 - lava_callback - INFO - Received callback for node 69bb2a5e21a77312e22223a7
INFO: 172.19.0.1:60488 - "POST /node/69bb2a5e21a77312e22223a7 HTTP/1.0" 202 Accepted
2026-03-20 22:42:50,140 - lava_callback - INFO - Starting async job submit for node 69bb2a5e21a77312e22223a7
2026-03-20 22:42:50,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:42:50,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2a5e21a77312e22223a7 HTTP/1.1" 200 None
2026-03-20 22:42:50,167 - lava_callback - DEBUG - Processing node 69bb2a5e21a77312e22223a7: baseline-arm-baylibre
2026-03-20 22:42:50,167 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb2a5e21a77312e22223a7
2026-03-20 22:42:50,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:42:50,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2a5e21a77312e22223a7 HTTP/1.1" 200 None
2026-03-20 22:42:50,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:42:50,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad09221a77312e2220ee1 HTTP/1.1" 200 None
2026-03-20 22:42:50,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:42:50,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb2a5e21a77312e22223a7 HTTP/1.1" 200 None
2026-03-20 22:42:50,228 - lava_callback - ERROR - Error processing callback for node 69bb2a5e21a77312e22223a7: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:60500 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47148 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47160 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49272 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:49278 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48152 - "GET / HTTP/1.0" 200 OK
2026-03-20 22:43:30,311 - lava_callback - INFO - Received callback for node 69bb2a8521a77312e22223b4
INFO: 172.19.0.1:44104 - "POST /node/69bb2a8521a77312e22223b4 HTTP/1.0" 202 Accepted
2026-03-20 22:43:30,317 - lava_callback - INFO - Starting async job submit for node 69bb2a8521a77312e22223b4
2026-03-20 22:43:30,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:43:30,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2a8521a77312e22223b4 HTTP/1.1" 200 None
2026-03-20 22:43:30,342 - lava_callback - DEBUG - Processing node 69bb2a8521a77312e22223b4: baseline-arm-baylibre
2026-03-20 22:43:30,343 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb2a8521a77312e22223b4
2026-03-20 22:43:30,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:43:30,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2a8521a77312e22223b4 HTTP/1.1" 200 None
2026-03-20 22:43:30,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:43:30,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad09221a77312e2220ee1 HTTP/1.1" 200 None
2026-03-20 22:43:30,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:43:30,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb2a8521a77312e22223b4 HTTP/1.1" 200 None
2026-03-20 22:43:30,415 - lava_callback - ERROR - Error processing callback for node 69bb2a8521a77312e22223b4: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:44120 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50022 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51760 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40384 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40386 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58354 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:58360 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40902 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41352 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45708 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34942 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39654 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39666 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59572 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:59580 - "GET / HTTP/1.0" 200 OK
2026-03-20 22:45:25,782 - lava_callback - INFO - Received callback for node 69bb2af921a77312e22223dc
INFO: 172.19.0.1:47748 - "POST /node/69bb2af921a77312e22223dc HTTP/1.0" 202 Accepted
2026-03-20 22:45:25,790 - lava_callback - INFO - Starting async job submit for node 69bb2af921a77312e22223dc
2026-03-20 22:45:25,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:45:25,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2af921a77312e22223dc HTTP/1.1" 200 None
2026-03-20 22:45:25,808 - lava_callback - DEBUG - Processing node 69bb2af921a77312e22223dc: baseline-arm-clabbe
2026-03-20 22:45:25,808 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb2af921a77312e22223dc
2026-03-20 22:45:25,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:45:25,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2af921a77312e22223dc HTTP/1.1" 200 None
2026-03-20 22:45:25,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:45:25,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad09221a77312e2220ee1 HTTP/1.1" 200 None
2026-03-20 22:45:25,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:45:25,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb2af921a77312e22223dc HTTP/1.1" 200 None
2026-03-20 22:45:25,863 - lava_callback - ERROR - Error processing callback for node 69bb2af921a77312e22223dc: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:47758 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56228 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41958 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35512 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57624 - "GET / HTTP/1.0" 200 OK
2026-03-20 22:46:05,766 - lava_callback - INFO - Received callback for node 69bb2b2021a77312e22223e6
INFO: 172.19.0.1:57636 - "POST /node/69bb2b2021a77312e22223e6 HTTP/1.0" 202 Accepted
2026-03-20 22:46:05,772 - lava_callback - INFO - Starting async job submit for node 69bb2b2021a77312e22223e6
2026-03-20 22:46:05,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:46:05,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2b2021a77312e22223e6 HTTP/1.1" 200 None
2026-03-20 22:46:05,793 - lava_callback - DEBUG - Processing node 69bb2b2021a77312e22223e6: baseline-arm-clabbe
2026-03-20 22:46:05,793 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb2b2021a77312e22223e6
2026-03-20 22:46:05,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:46:05,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2b2021a77312e22223e6 HTTP/1.1" 200 None
2026-03-20 22:46:05,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:46:05,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad09221a77312e2220ee1 HTTP/1.1" 200 None
2026-03-20 22:46:05,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:46:05,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb2b2021a77312e22223e6 HTTP/1.1" 200 None
2026-03-20 22:46:05,849 - lava_callback - ERROR - Error processing callback for node 69bb2b2021a77312e22223e6: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:57640 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43916 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:43928 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55358 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35430 - "GET / HTTP/1.0" 200 OK
2026-03-20 22:46:45,811 - lava_callback - INFO - Received callback for node 69bb2b4721a77312e22223f1
INFO: 172.19.0.1:57920 - "POST /node/69bb2b4721a77312e22223f1 HTTP/1.0" 202 Accepted
2026-03-20 22:46:45,817 - lava_callback - INFO - Starting async job submit for node 69bb2b4721a77312e22223f1
2026-03-20 22:46:45,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:46:45,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2b4721a77312e22223f1 HTTP/1.1" 200 None
2026-03-20 22:46:45,839 - lava_callback - DEBUG - Processing node 69bb2b4721a77312e22223f1: baseline-arm-clabbe
2026-03-20 22:46:45,839 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb2b4721a77312e22223f1
2026-03-20 22:46:45,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:46:45,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2b4721a77312e22223f1 HTTP/1.1" 200 None
2026-03-20 22:46:45,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:46:45,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad09221a77312e2220ee1 HTTP/1.1" 200 None
2026-03-20 22:46:45,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:46:45,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb2b4721a77312e22223f1 HTTP/1.1" 200 None
2026-03-20 22:46:45,896 - lava_callback - ERROR - Error processing callback for node 69bb2b4721a77312e22223f1: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:57926 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40936 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53490 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53502 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49094 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:49098 - "GET / HTTP/1.0" 200 OK
2026-03-20 22:47:25,774 - lava_callback - INFO - Received callback for node 69bb2b6e21a77312e22223fe
INFO: 172.19.0.1:59958 - "POST /node/69bb2b6e21a77312e22223fe HTTP/1.0" 202 Accepted
2026-03-20 22:47:25,780 - lava_callback - INFO - Starting async job submit for node 69bb2b6e21a77312e22223fe
2026-03-20 22:47:25,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:47:25,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2b6e21a77312e22223fe HTTP/1.1" 200 None
2026-03-20 22:47:25,804 - lava_callback - DEBUG - Processing node 69bb2b6e21a77312e22223fe: baseline-arm-clabbe
2026-03-20 22:47:25,804 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb2b6e21a77312e22223fe
2026-03-20 22:47:25,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:47:25,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2b6e21a77312e22223fe HTTP/1.1" 200 None
2026-03-20 22:47:25,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:47:25,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad09221a77312e2220ee1 HTTP/1.1" 200 None
2026-03-20 22:47:25,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:47:25,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb2b6e21a77312e22223fe HTTP/1.1" 200 None
2026-03-20 22:47:25,855 - lava_callback - ERROR - Error processing callback for node 69bb2b6e21a77312e22223fe: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:59960 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59470 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:32900 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51252 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60230 - "GET / HTTP/1.0" 200 OK
2026-03-20 22:48:05,839 - lava_callback - INFO - Received callback for node 69bb2b9621a77312e2222405
INFO: 172.19.0.1:60246 - "POST /node/69bb2b9621a77312e2222405 HTTP/1.0" 202 Accepted
2026-03-20 22:48:05,844 - lava_callback - INFO - Starting async job submit for node 69bb2b9621a77312e2222405
2026-03-20 22:48:05,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:48:05,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2b9621a77312e2222405 HTTP/1.1" 200 None
2026-03-20 22:48:05,863 - lava_callback - DEBUG - Processing node 69bb2b9621a77312e2222405: baseline-arm-clabbe
2026-03-20 22:48:05,864 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb2b9621a77312e2222405
2026-03-20 22:48:05,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:48:05,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2b9621a77312e2222405 HTTP/1.1" 200 None
2026-03-20 22:48:05,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:48:05,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad09221a77312e2220ee1 HTTP/1.1" 200 None
2026-03-20 22:48:05,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:48:05,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb2b9621a77312e2222405 HTTP/1.1" 200 None
2026-03-20 22:48:05,924 - lava_callback - ERROR - Error processing callback for node 69bb2b9621a77312e2222405: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:60254 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49162 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:49174 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44706 - "GET / HTTP/1.0" 200 OK
2026-03-20 22:48:30,430 - lava_callback - INFO - Received callback for node 69bb2bb821a77312e2222410
INFO: 172.19.0.1:45016 - "POST /node/69bb2bb821a77312e2222410 HTTP/1.0" 202 Accepted
2026-03-20 22:48:30,436 - lava_callback - INFO - Starting async job submit for node 69bb2bb821a77312e2222410
2026-03-20 22:48:30,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:48:30,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2bb821a77312e2222410 HTTP/1.1" 200 None
2026-03-20 22:48:30,452 - lava_callback - DEBUG - Processing node 69bb2bb821a77312e2222410: baseline-arm-baylibre
2026-03-20 22:48:30,452 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb2bb821a77312e2222410
2026-03-20 22:48:30,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:48:30,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2bb821a77312e2222410 HTTP/1.1" 200 None
2026-03-20 22:48:30,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:48:30,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None
2026-03-20 22:48:30,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:48:30,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb2bb821a77312e2222410 HTTP/1.1" 200 None
2026-03-20 22:48:30,509 - lava_callback - ERROR - Error processing callback for node 69bb2bb821a77312e2222410: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:45018 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48182 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45474 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47556 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47564 - "GET / HTTP/1.0" 200 OK
2026-03-20 22:49:10,436 - lava_callback - INFO - Received callback for node 69bb2bdf21a77312e222241a
INFO: 172.19.0.1:44364 - "POST /node/69bb2bdf21a77312e222241a HTTP/1.0" 202 Accepted
2026-03-20 22:49:10,441 - lava_callback - INFO - Starting async job submit for node 69bb2bdf21a77312e222241a
2026-03-20 22:49:10,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:49:10,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2bdf21a77312e222241a HTTP/1.1" 200 None
2026-03-20 22:49:10,473 - lava_callback - DEBUG - Processing node 69bb2bdf21a77312e222241a: baseline-arm-baylibre
2026-03-20 22:49:10,473 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb2bdf21a77312e222241a
2026-03-20 22:49:10,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:49:10,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2bdf21a77312e222241a HTTP/1.1" 200 None
2026-03-20 22:49:10,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:49:10,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None
2026-03-20 22:49:10,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:49:10,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb2bdf21a77312e222241a HTTP/1.1" 200 None
2026-03-20 22:49:10,525 - lava_callback - ERROR - Error processing callback for node 69bb2bdf21a77312e222241a: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:44376 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:44392 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36722 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46240 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46302 - "GET / HTTP/1.0" 200 OK
2026-03-20 22:49:50,513 - lava_callback - INFO - Received callback for node 69bb2c0621a77312e2222427
INFO: 172.19.0.1:37438 - "POST /node/69bb2c0621a77312e2222427 HTTP/1.0" 202 Accepted
2026-03-20 22:49:50,519 - lava_callback - INFO - Starting async job submit for node 69bb2c0621a77312e2222427
2026-03-20 22:49:50,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:49:50,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2c0621a77312e2222427 HTTP/1.1" 200 None
2026-03-20 22:49:50,536 - lava_callback - DEBUG - Processing node 69bb2c0621a77312e2222427: baseline-arm-baylibre
2026-03-20 22:49:50,536 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb2c0621a77312e2222427
2026-03-20 22:49:50,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:49:50,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2c0621a77312e2222427 HTTP/1.1" 200 None
2026-03-20 22:49:50,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:49:50,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None
2026-03-20 22:49:50,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:49:50,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb2c0621a77312e2222427 HTTP/1.1" 200 None
2026-03-20 22:49:50,595 - lava_callback - ERROR - Error processing callback for node 69bb2c0621a77312e2222427: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:37440 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35996 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36000 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43264 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:43276 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34260 - "GET / HTTP/1.0" 200 OK
2026-03-20 22:50:30,503 - lava_callback - INFO - Received callback for node 69bb2c2c21a77312e222242f
INFO: 172.19.0.1:52606 - "POST /node/69bb2c2c21a77312e222242f HTTP/1.0" 202 Accepted
2026-03-20 22:50:30,509 - lava_callback - INFO - Starting async job submit for node 69bb2c2c21a77312e222242f
2026-03-20 22:50:30,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:50:30,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2c2c21a77312e222242f HTTP/1.1" 200 None
2026-03-20 22:50:30,533 - lava_callback - DEBUG - Processing node 69bb2c2c21a77312e222242f: baseline-arm-baylibre
2026-03-20 22:50:30,533 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb2c2c21a77312e222242f
2026-03-20 22:50:30,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:50:30,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2c2c21a77312e222242f HTTP/1.1" 200 None
2026-03-20 22:50:30,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:50:30,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None
2026-03-20 22:50:30,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:50:30,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb2c2c21a77312e222242f HTTP/1.1" 200 None
2026-03-20 22:50:30,597 - lava_callback - ERROR - Error processing callback for node 69bb2c2c21a77312e222242f: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:52622 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54478 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42492 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50598 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50608 - "GET / HTTP/1.0" 200 OK
2026-03-20 22:51:10,598 - lava_callback - INFO - Received callback for node 69bb2c5421a77312e2222438
INFO: 172.19.0.1:35642 - "POST /node/69bb2c5421a77312e2222438 HTTP/1.0" 202 Accepted
2026-03-20 22:51:10,603 - lava_callback - INFO - Starting async job submit for node 69bb2c5421a77312e2222438
2026-03-20 22:51:10,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:51:10,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2c5421a77312e2222438 HTTP/1.1" 200 None
2026-03-20 22:51:10,620 - lava_callback - DEBUG - Processing node 69bb2c5421a77312e2222438: baseline-arm-baylibre
2026-03-20 22:51:10,620 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb2c5421a77312e2222438
2026-03-20 22:51:10,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:51:10,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2c5421a77312e2222438 HTTP/1.1" 200 None
2026-03-20 22:51:10,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:51:10,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None
2026-03-20 22:51:10,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:51:10,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb2c5421a77312e2222438 HTTP/1.1" 200 None
2026-03-20 22:51:10,676 - lava_callback - ERROR - Error processing callback for node 69bb2c5421a77312e2222438: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:35646 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:35656 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39452 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38376 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54462 - "GET / HTTP/1.0" 200 OK
2026-03-20 22:51:50,581 - lava_callback - INFO - Received callback for node 69bb2c7c21a77312e2222443
INFO: 172.19.0.1:48768 - "POST /node/69bb2c7c21a77312e2222443 HTTP/1.0" 202 Accepted
2026-03-20 22:51:50,586 - lava_callback - INFO - Starting async job submit for node 69bb2c7c21a77312e2222443
2026-03-20 22:51:50,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:51:50,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2c7c21a77312e2222443 HTTP/1.1" 200 None
2026-03-20 22:51:50,607 - lava_callback - DEBUG - Processing node 69bb2c7c21a77312e2222443: baseline-arm-baylibre
2026-03-20 22:51:50,607 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb2c7c21a77312e2222443
2026-03-20 22:51:50,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:51:50,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2c7c21a77312e2222443 HTTP/1.1" 200 None
2026-03-20 22:51:50,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:51:50,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None
2026-03-20 22:51:50,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:51:50,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb2c7c21a77312e2222443 HTTP/1.1" 200 None
2026-03-20 22:51:50,662 - lava_callback - ERROR - Error processing callback for node 69bb2c7c21a77312e2222443: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:48772 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40206 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40222 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44100 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:44102 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58542 - "GET / HTTP/1.0" 200 OK
2026-03-20 22:52:30,709 - lava_callback - INFO - Received callback for node 69bb2ca221a77312e222244a
INFO: 172.19.0.1:60228 - "POST /node/69bb2ca221a77312e222244a HTTP/1.0" 202 Accepted
2026-03-20 22:52:30,714 - lava_callback - INFO - Starting async job submit for node 69bb2ca221a77312e222244a
2026-03-20 22:52:30,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:52:30,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2ca221a77312e222244a HTTP/1.1" 200 None
2026-03-20 22:52:30,731 - lava_callback - DEBUG - Processing node 69bb2ca221a77312e222244a: baseline-arm-baylibre
2026-03-20 22:52:30,731 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb2ca221a77312e222244a
2026-03-20 22:52:30,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:52:30,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2ca221a77312e222244a HTTP/1.1" 200 None
2026-03-20 22:52:30,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:52:30,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None
2026-03-20 22:52:30,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:52:30,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb2ca221a77312e222244a HTTP/1.1" 200 None
2026-03-20 22:52:30,786 - lava_callback - ERROR - Error processing callback for node 69bb2ca221a77312e222244a: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:60244 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51434 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55574 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44660 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44670 - "GET / HTTP/1.0" 200 OK
2026-03-20 22:53:10,656 - lava_callback - INFO - Received callback for node 69bb2ccb21a77312e2222453
INFO: 172.19.0.1:60876 - "POST /node/69bb2ccb21a77312e2222453 HTTP/1.0" 202 Accepted
2026-03-20 22:53:10,661 - lava_callback - INFO - Starting async job submit for node 69bb2ccb21a77312e2222453
2026-03-20 22:53:10,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:53:10,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2ccb21a77312e2222453 HTTP/1.1" 200 None
2026-03-20 22:53:10,701 - lava_callback - DEBUG - Processing node 69bb2ccb21a77312e2222453: baseline-arm-baylibre
2026-03-20 22:53:10,702 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb2ccb21a77312e2222453
2026-03-20 22:53:10,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:53:10,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2ccb21a77312e2222453 HTTP/1.1" 200 None
2026-03-20 22:53:10,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:53:10,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None
2026-03-20 22:53:10,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:53:10,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb2ccb21a77312e2222453 HTTP/1.1" 200 None
2026-03-20 22:53:10,765 - lava_callback - ERROR - Error processing callback for node 69bb2ccb21a77312e2222453: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:60882 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:60886 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51228 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35116 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40614 - "GET / HTTP/1.0" 200 OK
2026-03-20 22:53:50,766 - lava_callback - INFO - Received callback for node 69bb2cf121a77312e222245c
INFO: 172.19.0.1:50406 - "POST /node/69bb2cf121a77312e222245c HTTP/1.0" 202 Accepted
2026-03-20 22:53:50,771 - lava_callback - INFO - Starting async job submit for node 69bb2cf121a77312e222245c
2026-03-20 22:53:50,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:53:50,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2cf121a77312e222245c HTTP/1.1" 200 None
2026-03-20 22:53:50,799 - lava_callback - DEBUG - Processing node 69bb2cf121a77312e222245c: baseline-arm-baylibre
2026-03-20 22:53:50,799 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb2cf121a77312e222245c
2026-03-20 22:53:50,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:53:50,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2cf121a77312e222245c HTTP/1.1" 200 None
2026-03-20 22:53:50,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:53:50,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None
2026-03-20 22:53:50,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:53:50,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb2cf121a77312e222245c HTTP/1.1" 200 None
2026-03-20 22:53:50,852 - lava_callback - ERROR - Error processing callback for node 69bb2cf121a77312e222245c: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:50408 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36346 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36362 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60856 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:60860 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51970 - "GET / HTTP/1.0" 200 OK
2026-03-20 22:54:30,741 - lava_callback - INFO - Received callback for node 69bb2d1821a77312e2222465
INFO: 172.19.0.1:48558 - "POST /node/69bb2d1821a77312e2222465 HTTP/1.0" 202 Accepted
2026-03-20 22:54:30,747 - lava_callback - INFO - Starting async job submit for node 69bb2d1821a77312e2222465
2026-03-20 22:54:30,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:54:30,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2d1821a77312e2222465 HTTP/1.1" 200 None
2026-03-20 22:54:30,763 - lava_callback - DEBUG - Processing node 69bb2d1821a77312e2222465: baseline-arm-baylibre
2026-03-20 22:54:30,763 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb2d1821a77312e2222465
2026-03-20 22:54:30,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:54:30,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2d1821a77312e2222465 HTTP/1.1" 200 None
2026-03-20 22:54:30,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:54:30,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None
2026-03-20 22:54:30,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:54:30,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb2d1821a77312e2222465 HTTP/1.1" 200 None
2026-03-20 22:54:30,817 - lava_callback - ERROR - Error processing callback for node 69bb2d1821a77312e2222465: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:48574 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49068 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51864 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56410 - "GET / HTTP/1.0" 200 OK
2026-03-20 22:55:06,305 - lava_callback - INFO - Received callback for node 69bb2d4121a77312e222246e
INFO: 172.19.0.1:56424 - "POST /node/69bb2d4121a77312e222246e HTTP/1.0" 202 Accepted
2026-03-20 22:55:06,311 - lava_callback - INFO - Starting async job submit for node 69bb2d4121a77312e222246e
2026-03-20 22:55:06,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:55:06,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2d4121a77312e222246e HTTP/1.1" 200 None
2026-03-20 22:55:06,327 - lava_callback - DEBUG - Processing node 69bb2d4121a77312e222246e: baseline-arm-clabbe
2026-03-20 22:55:06,328 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb2d4121a77312e222246e
2026-03-20 22:55:06,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:55:06,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2d4121a77312e222246e HTTP/1.1" 200 None
2026-03-20 22:55:06,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:55:06,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None
2026-03-20 22:55:06,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:55:06,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb2d4121a77312e222246e HTTP/1.1" 200 None
2026-03-20 22:55:06,404 - lava_callback - ERROR - Error processing callback for node 69bb2d4121a77312e222246e: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:56432 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45012 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:45016 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49252 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59272 - "GET / HTTP/1.0" 200 OK
2026-03-20 22:55:46,223 - lava_callback - INFO - Received callback for node 69bb2d6a21a77312e2222477
INFO: 172.19.0.1:42962 - "POST /node/69bb2d6a21a77312e2222477 HTTP/1.0" 202 Accepted
2026-03-20 22:55:46,228 - lava_callback - INFO - Starting async job submit for node 69bb2d6a21a77312e2222477
2026-03-20 22:55:46,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:55:46,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2d6a21a77312e2222477 HTTP/1.1" 200 None
2026-03-20 22:55:46,250 - lava_callback - DEBUG - Processing node 69bb2d6a21a77312e2222477: baseline-arm-clabbe
2026-03-20 22:55:46,250 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb2d6a21a77312e2222477
2026-03-20 22:55:46,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:55:46,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2d6a21a77312e2222477 HTTP/1.1" 200 None
2026-03-20 22:55:46,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:55:46,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None
2026-03-20 22:55:46,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:55:46,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb2d6a21a77312e2222477 HTTP/1.1" 200 None
2026-03-20 22:55:46,304 - lava_callback - ERROR - Error processing callback for node 69bb2d6a21a77312e2222477: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:42966 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39360 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41718 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41730 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39224 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:39234 - "GET / HTTP/1.0" 200 OK
2026-03-20 22:56:26,245 - lava_callback - INFO - Received callback for node 69bb2d9121a77312e2222481
INFO: 172.19.0.1:53618 - "POST /node/69bb2d9121a77312e2222481 HTTP/1.0" 202 Accepted
2026-03-20 22:56:26,250 - lava_callback - INFO - Starting async job submit for node 69bb2d9121a77312e2222481
2026-03-20 22:56:26,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:56:26,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2d9121a77312e2222481 HTTP/1.1" 200 None
2026-03-20 22:56:26,266 - lava_callback - DEBUG - Processing node 69bb2d9121a77312e2222481: baseline-arm-clabbe
2026-03-20 22:56:26,266 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb2d9121a77312e2222481
2026-03-20 22:56:26,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:56:26,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2d9121a77312e2222481 HTTP/1.1" 200 None
2026-03-20 22:56:26,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:56:26,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None
2026-03-20 22:56:26,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:56:26,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb2d9121a77312e2222481 HTTP/1.1" 200 None
2026-03-20 22:56:26,377 - lava_callback - ERROR - Error processing callback for node 69bb2d9121a77312e2222481: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:53620 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45150 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34962 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52104 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52460 - "GET / HTTP/1.0" 200 OK
2026-03-20 22:57:06,247 - lava_callback - INFO - Received callback for node 69bb2db821a77312e2222489
INFO: 172.19.0.1:52464 - "POST /node/69bb2db821a77312e2222489 HTTP/1.0" 202 Accepted
2026-03-20 22:57:06,253 - lava_callback - INFO - Starting async job submit for node 69bb2db821a77312e2222489
2026-03-20 22:57:06,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:57:06,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2db821a77312e2222489 HTTP/1.1" 200 None
2026-03-20 22:57:06,268 - lava_callback - DEBUG - Processing node 69bb2db821a77312e2222489: baseline-arm-clabbe
2026-03-20 22:57:06,269 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb2db821a77312e2222489
2026-03-20 22:57:06,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:57:06,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2db821a77312e2222489 HTTP/1.1" 200 None
2026-03-20 22:57:06,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:57:06,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None
2026-03-20 22:57:06,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:57:06,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb2db821a77312e2222489 HTTP/1.1" 200 None
2026-03-20 22:57:06,340 - lava_callback - ERROR - Error processing callback for node 69bb2db821a77312e2222489: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:52478 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54630 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:54638 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59420 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54134 - "GET / HTTP/1.0" 200 OK
2026-03-20 22:57:46,331 - lava_callback - INFO - Received callback for node 69bb2ddf21a77312e2222492
INFO: 172.19.0.1:36108 - "POST /node/69bb2ddf21a77312e2222492 HTTP/1.0" 202 Accepted
2026-03-20 22:57:46,337 - lava_callback - INFO - Starting async job submit for node 69bb2ddf21a77312e2222492
2026-03-20 22:57:46,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:57:46,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2ddf21a77312e2222492 HTTP/1.1" 200 None
2026-03-20 22:57:46,352 - lava_callback - DEBUG - Processing node 69bb2ddf21a77312e2222492: baseline-arm-clabbe
2026-03-20 22:57:46,353 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb2ddf21a77312e2222492
2026-03-20 22:57:46,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:57:46,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2ddf21a77312e2222492 HTTP/1.1" 200 None
2026-03-20 22:57:46,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:57:46,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None
2026-03-20 22:57:46,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:57:46,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb2ddf21a77312e2222492 HTTP/1.1" 200 None
2026-03-20 22:57:46,403 - lava_callback - ERROR - Error processing callback for node 69bb2ddf21a77312e2222492: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:36112 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54502 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35240 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35254 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45068 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:45082 - "GET / HTTP/1.0" 200 OK
2026-03-20 22:58:26,276 - lava_callback - INFO - Received callback for node 69bb2e0621a77312e22224a1
INFO: 172.19.0.1:44630 - "POST /node/69bb2e0621a77312e22224a1 HTTP/1.0" 202 Accepted
2026-03-20 22:58:26,281 - lava_callback - INFO - Starting async job submit for node 69bb2e0621a77312e22224a1
2026-03-20 22:58:26,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:58:26,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2e0621a77312e22224a1 HTTP/1.1" 200 None
2026-03-20 22:58:26,297 - lava_callback - DEBUG - Processing node 69bb2e0621a77312e22224a1: baseline-arm-clabbe
2026-03-20 22:58:26,297 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb2e0621a77312e22224a1
2026-03-20 22:58:26,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:58:26,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2e0621a77312e22224a1 HTTP/1.1" 200 None
2026-03-20 22:58:26,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:58:26,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None
2026-03-20 22:58:26,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:58:26,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb2e0621a77312e22224a1 HTTP/1.1" 200 None
2026-03-20 22:58:26,364 - lava_callback - ERROR - Error processing callback for node 69bb2e0621a77312e22224a1: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:44644 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40594 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53390 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38140 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44074 - "GET / HTTP/1.0" 200 OK
2026-03-20 22:59:06,417 - lava_callback - INFO - Received callback for node 69bb2e2c21a77312e22224aa
INFO: 172.19.0.1:44088 - "POST /node/69bb2e2c21a77312e22224aa HTTP/1.0" 202 Accepted
2026-03-20 22:59:06,423 - lava_callback - INFO - Starting async job submit for node 69bb2e2c21a77312e22224aa
2026-03-20 22:59:06,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:59:06,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2e2c21a77312e22224aa HTTP/1.1" 200 None
2026-03-20 22:59:06,440 - lava_callback - DEBUG - Processing node 69bb2e2c21a77312e22224aa: baseline-arm-clabbe
2026-03-20 22:59:06,440 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb2e2c21a77312e22224aa
2026-03-20 22:59:06,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:59:06,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2e2c21a77312e22224aa HTTP/1.1" 200 None
2026-03-20 22:59:06,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:59:06,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None
2026-03-20 22:59:06,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:59:06,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb2e2c21a77312e22224aa HTTP/1.1" 200 None
2026-03-20 22:59:06,492 - lava_callback - ERROR - Error processing callback for node 69bb2e2c21a77312e22224aa: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:44102 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39124 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:39138 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58450 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35174 - "GET / HTTP/1.0" 200 OK
2026-03-20 22:59:46,493 - lava_callback - INFO - Received callback for node 69bb2e5321a77312e22224b3
INFO: 172.19.0.1:33712 - "POST /node/69bb2e5321a77312e22224b3 HTTP/1.0" 202 Accepted
2026-03-20 22:59:46,499 - lava_callback - INFO - Starting async job submit for node 69bb2e5321a77312e22224b3
2026-03-20 22:59:46,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
INFO: 172.19.0.1:33726 - "GET / HTTP/1.0" 200 OK
2026-03-20 22:59:46,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2e5321a77312e22224b3 HTTP/1.1" 200 None
2026-03-20 22:59:46,515 - lava_callback - DEBUG - Processing node 69bb2e5321a77312e22224b3: baseline-arm-clabbe
2026-03-20 22:59:46,516 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb2e5321a77312e22224b3
2026-03-20 22:59:46,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:59:46,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2e5321a77312e22224b3 HTTP/1.1" 200 None
2026-03-20 22:59:46,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:59:46,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None
2026-03-20 22:59:46,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 22:59:46,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb2e5321a77312e22224b3 HTTP/1.1" 200 None
2026-03-20 22:59:46,580 - lava_callback - ERROR - Error processing callback for node 69bb2e5321a77312e22224b3: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:56760 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58404 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58416 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58078 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:58084 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44072 - "GET / HTTP/1.0" 200 OK
2026-03-20 23:00:26,617 - lava_callback - INFO - Received callback for node 69bb2e7a21a77312e22224bc
INFO: 172.19.0.1:44082 - "POST /node/69bb2e7a21a77312e22224bc HTTP/1.0" 202 Accepted
2026-03-20 23:00:26,622 - lava_callback - INFO - Starting async job submit for node 69bb2e7a21a77312e22224bc
2026-03-20 23:00:26,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:00:26,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2e7a21a77312e22224bc HTTP/1.1" 200 None
2026-03-20 23:00:26,647 - lava_callback - DEBUG - Processing node 69bb2e7a21a77312e22224bc: baseline-arm-clabbe
2026-03-20 23:00:26,648 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb2e7a21a77312e22224bc
2026-03-20 23:00:26,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:00:26,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2e7a21a77312e22224bc HTTP/1.1" 200 None
2026-03-20 23:00:26,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:00:26,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None
2026-03-20 23:00:26,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:00:26,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb2e7a21a77312e22224bc HTTP/1.1" 200 None
2026-03-20 23:00:26,715 - lava_callback - ERROR - Error processing callback for node 69bb2e7a21a77312e22224bc: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:43982 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40286 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59424 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47262 - "GET / HTTP/1.0" 200 OK
2026-03-20 23:01:06,407 - lava_callback - INFO - Received callback for node 69bb2ea021a77312e22224c5
INFO: 172.19.0.1:47270 - "POST /node/69bb2ea021a77312e22224c5 HTTP/1.0" 202 Accepted
2026-03-20 23:01:06,412 - lava_callback - INFO - Starting async job submit for node 69bb2ea021a77312e22224c5
2026-03-20 23:01:06,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:01:06,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2ea021a77312e22224c5 HTTP/1.1" 200 None
2026-03-20 23:01:06,430 - lava_callback - DEBUG - Processing node 69bb2ea021a77312e22224c5: baseline-arm-clabbe
2026-03-20 23:01:06,430 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb2ea021a77312e22224c5
2026-03-20 23:01:06,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:01:06,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2ea021a77312e22224c5 HTTP/1.1" 200 None
2026-03-20 23:01:06,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:01:06,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None
2026-03-20 23:01:06,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:01:06,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb2ea021a77312e22224c5 HTTP/1.1" 200 None
2026-03-20 23:01:06,486 - lava_callback - ERROR - Error processing callback for node 69bb2ea021a77312e22224c5: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:47272 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38242 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:38258 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34254 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47098 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47296 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49940 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56184 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56190 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50378 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:50382 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55770 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60108 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34690 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35860 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41942 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41954 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46506 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:46514 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58036 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54768 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48976 - "GET / HTTP/1.0" 200 OK
2026-03-20 23:03:51,466 - lava_callback - INFO - Received callback for node 69bb2f4921a77312e22224f8
INFO: 172.19.0.1:49464 - "POST /node/69bb2f4921a77312e22224f8 HTTP/1.0" 202 Accepted
2026-03-20 23:03:51,471 - lava_callback - INFO - Starting async job submit for node 69bb2f4921a77312e22224f8
2026-03-20 23:03:51,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:03:51,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2f4921a77312e22224f8 HTTP/1.1" 200 None
2026-03-20 23:03:51,488 - lava_callback - DEBUG - Processing node 69bb2f4921a77312e22224f8: baseline-arm64-baylibre
2026-03-20 23:03:51,488 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb2f4921a77312e22224f8
2026-03-20 23:03:51,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:03:51,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2f4921a77312e22224f8 HTTP/1.1" 200 None
2026-03-20 23:03:51,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:03:51,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None
2026-03-20 23:03:51,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:03:51,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb2f4921a77312e22224f8 HTTP/1.1" 200 None
2026-03-20 23:03:51,540 - lava_callback - ERROR - Error processing callback for node 69bb2f4921a77312e22224f8: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:49468 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49368 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49370 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50648 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:50654 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41548 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41940 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46102 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51086 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44310 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44326 - "GET / HTTP/1.0" 200 OK
2026-03-20 23:05:11,335 - lava_callback - INFO - Received callback for node 69bb2f9821a77312e222252a
INFO: 172.19.0.1:33064 - "POST /node/69bb2f9821a77312e222252a HTTP/1.0" 202 Accepted
2026-03-20 23:05:11,341 - lava_callback - INFO - Starting async job submit for node 69bb2f9821a77312e222252a
2026-03-20 23:05:11,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:05:11,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2f9821a77312e222252a HTTP/1.1" 200 None
2026-03-20 23:05:11,362 - lava_callback - DEBUG - Processing node 69bb2f9821a77312e222252a: baseline-arm64-baylibre
2026-03-20 23:05:11,362 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb2f9821a77312e222252a
2026-03-20 23:05:11,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:05:11,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2f9821a77312e222252a HTTP/1.1" 200 None
2026-03-20 23:05:11,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:05:11,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None
2026-03-20 23:05:11,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:05:11,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb2f9821a77312e222252a HTTP/1.1" 200 None
2026-03-20 23:05:11,415 - lava_callback - ERROR - Error processing callback for node 69bb2f9821a77312e222252a: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:33078 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:33084 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53012 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57370 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55820 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43430 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36312 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36326 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54234 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:54242 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51630 - "GET / HTTP/1.0" 200 OK
2026-03-20 23:06:31,498 - lava_callback - INFO - Received callback for node 69bb2fea21a77312e2222547
INFO: 172.19.0.1:33960 - "POST /node/69bb2fea21a77312e2222547 HTTP/1.0" 202 Accepted
2026-03-20 23:06:31,504 - lava_callback - INFO - Starting async job submit for node 69bb2fea21a77312e2222547
2026-03-20 23:06:31,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:06:31,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2fea21a77312e2222547 HTTP/1.1" 200 None
2026-03-20 23:06:31,520 - lava_callback - DEBUG - Processing node 69bb2fea21a77312e2222547: baseline-arm64-baylibre
2026-03-20 23:06:31,520 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb2fea21a77312e2222547
2026-03-20 23:06:31,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:06:31,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2fea21a77312e2222547 HTTP/1.1" 200 None
2026-03-20 23:06:31,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:06:31,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None
2026-03-20 23:06:31,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:06:31,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb2fea21a77312e2222547 HTTP/1.1" 200 None
2026-03-20 23:06:31,577 - lava_callback - ERROR - Error processing callback for node 69bb2fea21a77312e2222547: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:33962 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42504 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47238 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49122 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49124 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38870 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:38874 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49600 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57970 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38574 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44970 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45108 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45110 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47102 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:47112 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48566 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33210 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42952 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44716 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42940 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42946 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39304 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:39316 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57742 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51054 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39426 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47960 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46562 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46564 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39004 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:39016 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52114 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58278 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34252 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40660 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33778 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33782 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35622 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:35628 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44592 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60588 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48422 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51938 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40286 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40302 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40204 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40218 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:40224 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55916 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40870 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59324 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52994 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46064 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46072 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44420 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:44426 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57864 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39842 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41968 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44324 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38314 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38330 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51474 - "GET /favicon.ico HTTP/1.0" 404 Not Found
INFO: 172.19.0.1:51480 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:51486 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38560 - "GET / HTTP/1.0" 200 OK
2026-03-20 23:14:31,840 - lava_callback - INFO - Received callback for node 69bb31c821a77312e222259b
INFO: 172.19.0.1:53322 - "POST /node/69bb31c821a77312e222259b HTTP/1.0" 202 Accepted
2026-03-20 23:14:31,846 - lava_callback - INFO - Starting async job submit for node 69bb31c821a77312e222259b
2026-03-20 23:14:31,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:14:31,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb31c821a77312e222259b HTTP/1.1" 200 None
2026-03-20 23:14:31,862 - lava_callback - DEBUG - Processing node 69bb31c821a77312e222259b: baseline-arm64-baylibre
2026-03-20 23:14:31,863 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb31c821a77312e222259b
2026-03-20 23:14:31,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:14:31,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb31c821a77312e222259b HTTP/1.1" 200 None
2026-03-20 23:14:31,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:14:31,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None
2026-03-20 23:14:31,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:14:31,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb31c821a77312e222259b HTTP/1.1" 200 None
2026-03-20 23:14:31,949 - lava_callback - ERROR - Error processing callback for node 69bb31c821a77312e222259b: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:53332 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58994 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55484 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53270 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53276 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58934 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:58950 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60802 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60896 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46564 - "GET / HTTP/1.0" 200 OK
2026-03-20 23:15:51,899 - lava_callback - INFO - Received callback for node 69bb321921a77312e22225ab
INFO: 172.19.0.1:51032 - "POST /node/69bb321921a77312e22225ab HTTP/1.0" 202 Accepted
2026-03-20 23:15:51,904 - lava_callback - INFO - Starting async job submit for node 69bb321921a77312e22225ab
2026-03-20 23:15:51,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:15:51,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb321921a77312e22225ab HTTP/1.1" 200 None
2026-03-20 23:15:51,922 - lava_callback - DEBUG - Processing node 69bb321921a77312e22225ab: baseline-arm64-baylibre
2026-03-20 23:15:51,923 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb321921a77312e22225ab
2026-03-20 23:15:51,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:15:51,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb321921a77312e22225ab HTTP/1.1" 200 None
2026-03-20 23:15:51,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:15:51,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None
2026-03-20 23:15:51,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:15:51,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb321921a77312e22225ab HTTP/1.1" 200 None
2026-03-20 23:15:51,981 - lava_callback - ERROR - Error processing callback for node 69bb321921a77312e22225ab: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:51048 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59224 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59234 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59550 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:59566 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47190 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42804 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51272 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43576 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35980 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35986 - "GET / HTTP/1.0" 200 OK
2026-03-20 23:17:11,940 - lava_callback - INFO - Received callback for node 69bb326721a77312e22225b7
INFO: 172.19.0.1:46780 - "POST /node/69bb326721a77312e22225b7 HTTP/1.0" 202 Accepted
2026-03-20 23:17:11,946 - lava_callback - INFO - Starting async job submit for node 69bb326721a77312e22225b7
2026-03-20 23:17:11,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:17:11,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb326721a77312e22225b7 HTTP/1.1" 200 None
2026-03-20 23:17:11,962 - lava_callback - DEBUG - Processing node 69bb326721a77312e22225b7: baseline-arm64-baylibre
2026-03-20 23:17:11,963 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb326721a77312e22225b7
2026-03-20 23:17:11,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:17:11,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb326721a77312e22225b7 HTTP/1.1" 200 None
2026-03-20 23:17:11,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:17:11,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad0a721a77312e2220ef1 HTTP/1.1" 200 None
2026-03-20 23:17:11,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:17:12,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb326721a77312e22225b7 HTTP/1.1" 200 None
2026-03-20 23:17:12,014 - lava_callback - ERROR - Error processing callback for node 69bb326721a77312e22225b7: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:46782 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:46784 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33842 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57530 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50652 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39220 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43476 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43478 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38864 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:38880 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53180 - "GET / HTTP/1.0" 200 OK
2026-03-20 23:18:32,062 - lava_callback - INFO - Received callback for node 69bb32b821a77312e22225c6
INFO: 172.19.0.1:39736 - "POST /node/69bb32b821a77312e22225c6 HTTP/1.0" 202 Accepted
2026-03-20 23:18:32,067 - lava_callback - INFO - Starting async job submit for node 69bb32b821a77312e22225c6
2026-03-20 23:18:32,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:18:32,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb32b821a77312e22225c6 HTTP/1.1" 200 None
2026-03-20 23:18:32,084 - lava_callback - DEBUG - Processing node 69bb32b821a77312e22225c6: baseline-arm64-baylibre
2026-03-20 23:18:32,085 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb32b821a77312e22225c6
2026-03-20 23:18:32,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:18:32,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb32b821a77312e22225c6 HTTP/1.1" 200 None
2026-03-20 23:18:32,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:18:32,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad0a721a77312e2220ef1 HTTP/1.1" 200 None
2026-03-20 23:18:32,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:18:32,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb32b821a77312e22225c6 HTTP/1.1" 200 None
2026-03-20 23:18:32,147 - lava_callback - ERROR - Error processing callback for node 69bb32b821a77312e22225c6: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:39742 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45734 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42284 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53196 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53212 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38662 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:38674 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56150 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53742 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:32948 - "GET / HTTP/1.0" 200 OK
2026-03-20 23:19:52,160 - lava_callback - INFO - Received callback for node 69bb330921a77312e22225ce
INFO: 172.19.0.1:39260 - "POST /node/69bb330921a77312e22225ce HTTP/1.0" 202 Accepted
2026-03-20 23:19:52,167 - lava_callback - INFO - Starting async job submit for node 69bb330921a77312e22225ce
2026-03-20 23:19:52,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:19:52,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb330921a77312e22225ce HTTP/1.1" 200 None
2026-03-20 23:19:52,186 - lava_callback - DEBUG - Processing node 69bb330921a77312e22225ce: baseline-arm64-baylibre
2026-03-20 23:19:52,186 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb330921a77312e22225ce
2026-03-20 23:19:52,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:19:52,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb330921a77312e22225ce HTTP/1.1" 200 None
2026-03-20 23:19:52,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:19:52,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad0a721a77312e2220ef1 HTTP/1.1" 200 None
2026-03-20 23:19:52,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:19:52,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb330921a77312e22225ce HTTP/1.1" 200 None
2026-03-20 23:19:52,241 - lava_callback - ERROR - Error processing callback for node 69bb330921a77312e22225ce: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:39262 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47610 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47622 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45940 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:45942 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54518 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39254 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44094 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43444 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57964 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57968 - "GET / HTTP/1.0" 200 OK
2026-03-20 23:21:12,486 - lava_callback - INFO - Received callback for node 69bb335c21a77312e22225d8
INFO: 172.19.0.1:51326 - "POST /node/69bb335c21a77312e22225d8 HTTP/1.0" 202 Accepted
2026-03-20 23:21:12,492 - lava_callback - INFO - Starting async job submit for node 69bb335c21a77312e22225d8
2026-03-20 23:21:12,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:21:12,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb335c21a77312e22225d8 HTTP/1.1" 200 None
2026-03-20 23:21:12,507 - lava_callback - DEBUG - Processing node 69bb335c21a77312e22225d8: baseline-arm64-baylibre
2026-03-20 23:21:12,507 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb335c21a77312e22225d8
2026-03-20 23:21:12,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:21:12,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb335c21a77312e22225d8 HTTP/1.1" 200 None
2026-03-20 23:21:12,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:21:12,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad0a721a77312e2220ef1 HTTP/1.1" 200 None
2026-03-20 23:21:12,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:21:12,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb335c21a77312e22225d8 HTTP/1.1" 200 None
2026-03-20 23:21:12,561 - lava_callback - ERROR - Error processing callback for node 69bb335c21a77312e22225d8: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:51328 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:51344 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55382 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35014 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41478 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42594 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35970 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35974 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43700 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:43708 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50994 - "GET / HTTP/1.0" 200 OK
2026-03-20 23:22:32,246 - lava_callback - INFO - Received callback for node 69bb33af21a77312e22225ec
INFO: 172.19.0.1:55676 - "POST /node/69bb33af21a77312e22225ec HTTP/1.0" 202 Accepted
2026-03-20 23:22:32,252 - lava_callback - INFO - Starting async job submit for node 69bb33af21a77312e22225ec
2026-03-20 23:22:32,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:22:32,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb33af21a77312e22225ec HTTP/1.1" 200 None
2026-03-20 23:22:32,267 - lava_callback - DEBUG - Processing node 69bb33af21a77312e22225ec: baseline-arm64-baylibre
2026-03-20 23:22:32,267 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb33af21a77312e22225ec
2026-03-20 23:22:32,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:22:32,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb33af21a77312e22225ec HTTP/1.1" 200 None
2026-03-20 23:22:32,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:22:32,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad0a721a77312e2220ef1 HTTP/1.1" 200 None
2026-03-20 23:22:32,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:22:32,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb33af21a77312e22225ec HTTP/1.1" 200 None
2026-03-20 23:22:32,332 - lava_callback - ERROR - Error processing callback for node 69bb33af21a77312e22225ec: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:55678 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55992 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33430 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51338 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51352 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48424 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:48430 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44384 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39456 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54950 - "GET / HTTP/1.0" 200 OK
2026-03-20 23:23:52,340 - lava_callback - INFO - Received callback for node 69bb340221a77312e2222603
INFO: 172.19.0.1:44186 - "POST /node/69bb340221a77312e2222603 HTTP/1.0" 202 Accepted
2026-03-20 23:23:52,345 - lava_callback - INFO - Starting async job submit for node 69bb340221a77312e2222603
2026-03-20 23:23:52,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:23:52,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb340221a77312e2222603 HTTP/1.1" 200 None
2026-03-20 23:23:52,368 - lava_callback - DEBUG - Processing node 69bb340221a77312e2222603: baseline-arm64-baylibre
2026-03-20 23:23:52,369 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb340221a77312e2222603
2026-03-20 23:23:52,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:23:52,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb340221a77312e2222603 HTTP/1.1" 200 None
2026-03-20 23:23:52,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:23:52,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad0a721a77312e2220ef1 HTTP/1.1" 200 None
2026-03-20 23:23:52,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:23:52,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb340221a77312e2222603 HTTP/1.1" 200 None
2026-03-20 23:23:52,422 - lava_callback - ERROR - Error processing callback for node 69bb340221a77312e2222603: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:44200 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54594 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54608 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47208 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:47210 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40520 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37366 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36904 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34278 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53104 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53114 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59736 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:59746 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57790 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50656 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38548 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34846 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56464 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56470 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53036 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:53040 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59574 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49470 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59762 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50110 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60456 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60468 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58762 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:58772 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40496 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54432 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60644 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51200 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60226 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60234 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40276 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:40282 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51912 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57504 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41212 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43338 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33130 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33132 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34630 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:34642 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58686 - "GET / HTTP/1.0" 200 OK
2026-03-20 23:29:27,650 - lava_callback - INFO - Received callback for node 69bb355421a77312e222262d
INFO: 172.19.0.1:58690 - "POST /node/69bb355421a77312e222262d HTTP/1.0" 202 Accepted
2026-03-20 23:29:27,656 - lava_callback - INFO - Starting async job submit for node 69bb355421a77312e222262d
2026-03-20 23:29:27,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:29:27,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb355421a77312e222262d HTTP/1.1" 200 None
2026-03-20 23:29:27,672 - lava_callback - DEBUG - Processing node 69bb355421a77312e222262d: baseline-arm64-clabbe
2026-03-20 23:29:27,672 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb355421a77312e222262d
2026-03-20 23:29:27,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:29:27,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb355421a77312e222262d HTTP/1.1" 200 None
2026-03-20 23:29:27,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:29:27,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad0a721a77312e2220ef1 HTTP/1.1" 200 None
2026-03-20 23:29:27,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:29:27,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb355421a77312e222262d HTTP/1.1" 200 None
2026-03-20 23:29:27,731 - lava_callback - ERROR - Error processing callback for node 69bb355421a77312e222262d: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:33266 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57762 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34184 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58420 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58432 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40250 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:40256 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44894 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41490 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37434 - "GET / HTTP/1.0" 200 OK
2026-03-20 23:30:52,848 - lava_callback - INFO - Received callback for node 69bb359f21a77312e222263a
INFO: 172.19.0.1:46648 - "POST /node/69bb359f21a77312e222263a HTTP/1.0" 202 Accepted
2026-03-20 23:30:52,854 - lava_callback - INFO - Starting async job submit for node 69bb359f21a77312e222263a
2026-03-20 23:30:52,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:30:52,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb359f21a77312e222263a HTTP/1.1" 200 None
2026-03-20 23:30:52,870 - lava_callback - DEBUG - Processing node 69bb359f21a77312e222263a: baseline-arm64-baylibre
2026-03-20 23:30:52,871 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb359f21a77312e222263a
2026-03-20 23:30:52,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:30:52,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb359f21a77312e222263a HTTP/1.1" 200 None
2026-03-20 23:30:52,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:30:52,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None
2026-03-20 23:30:52,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:30:52,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb359f21a77312e222263a HTTP/1.1" 200 None
2026-03-20 23:30:52,922 - lava_callback - ERROR - Error processing callback for node 69bb359f21a77312e222263a: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:46654 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43592 - "GET / HTTP/1.0" 200 OK
2026-03-20 23:31:05,688 - lava_callback - INFO - Received callback for node 69bd7ad60e93e2314723e728
INFO: 172.19.0.1:43596 - "POST /node/69bd7ad60e93e2314723e728 HTTP/1.0" 202 Accepted
2026-03-20 23:31:05,694 - lava_callback - INFO - Starting async job submit for node 69bd7ad60e93e2314723e728
2026-03-20 23:31:05,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:31:05,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7ad60e93e2314723e728 HTTP/1.1" 200 None
2026-03-20 23:31:05,761 - lava_callback - DEBUG - Processing node 69bd7ad60e93e2314723e728: baseline-arm64-broonie
2026-03-20 23:31:05,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 23:31:06,119 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 23:31:06,121 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bd7ad60e93e2314723e728/log.txt.gz
2026-03-20 23:31:06,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 23:31:06,473 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 23:31:06,475 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bd7ad60e93e2314723e728/lava-logs.yaml
2026-03-20 23:31:06,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
INFO: 172.19.0.1:43610 - "GET / HTTP/1.0" 200 OK
2026-03-20 23:31:06,636 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 23:31:06,637 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bd7ad60e93e2314723e728/lava_callback.json.gz
2026-03-20 23:31:06,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:31:06,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd7ad60e93e2314723e728 HTTP/1.1" 200 None
2026-03-20 23:31:06,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:31:06,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 23:31:06,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:31:06,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd7ad60e93e2314723e728 HTTP/1.1" 200 None
2026-03-20 23:31:06,756 - lava_callback - INFO - Completed processing callback for node 69bd7ad60e93e2314723e728
2026-03-20 23:31:11,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:31:11,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:54914 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:54928 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35078 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46916 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52224 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40610 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38538 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38552 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33254 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:33270 - "GET / HTTP/1.0" 200 OK
2026-03-20 23:32:25,935 - lava_callback - INFO - Received callback for node 69bdd5210e93e23147242cc5
INFO: 172.19.0.1:54330 - "POST /node/69bdd5210e93e23147242cc5 HTTP/1.0" 202 Accepted
2026-03-20 23:32:25,943 - lava_callback - INFO - Starting async job submit for node 69bdd5210e93e23147242cc5
2026-03-20 23:32:25,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:32:25,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bdd5210e93e23147242cc5 HTTP/1.1" 200 None
2026-03-20 23:32:25,981 - lava_callback - DEBUG - Processing node 69bdd5210e93e23147242cc5: baseline-arm64-broonie
2026-03-20 23:32:26,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 23:32:26,360 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 23:32:26,361 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bdd5210e93e23147242cc5/log.txt.gz
INFO: 172.19.0.1:54340 - "GET / HTTP/1.0" 200 OK
2026-03-20 23:32:26,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 23:32:26,780 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 23:32:26,782 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bdd5210e93e23147242cc5/lava-logs.yaml
2026-03-20 23:32:26,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443
2026-03-20 23:32:26,940 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0
2026-03-20 23:32:26,941 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bdd5210e93e23147242cc5/lava_callback.json.gz
2026-03-20 23:32:26,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:32:26,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bdd5210e93e23147242cc5 HTTP/1.1" 200 None
2026-03-20 23:32:26,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:32:27,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd73420e93e2314723e2c4 HTTP/1.1" 200 None
2026-03-20 23:32:27,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:32:27,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bdd5210e93e23147242cc5 HTTP/1.1" 200 None
2026-03-20 23:32:27,033 - lava_callback - INFO - Completed processing callback for node 69bdd5210e93e23147242cc5
2026-03-20 23:32:27,751 - lava_callback - INFO - Received callback for node 69bb35fb21a77312e2222654
INFO: 172.19.0.1:54344 - "POST /node/69bb35fb21a77312e2222654 HTTP/1.0" 202 Accepted
2026-03-20 23:32:27,756 - lava_callback - INFO - Starting async job submit for node 69bb35fb21a77312e2222654
2026-03-20 23:32:27,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:32:27,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb35fb21a77312e2222654 HTTP/1.1" 200 None
2026-03-20 23:32:27,779 - lava_callback - DEBUG - Processing node 69bb35fb21a77312e2222654: baseline-arm64-clabbe
2026-03-20 23:32:27,779 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb35fb21a77312e2222654
2026-03-20 23:32:27,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:32:27,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb35fb21a77312e2222654 HTTP/1.1" 200 None
2026-03-20 23:32:27,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:32:27,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad0a721a77312e2220ef1 HTTP/1.1" 200 None
2026-03-20 23:32:27,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:32:27,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb35fb21a77312e2222654 HTTP/1.1" 200 None
2026-03-20 23:32:27,835 - lava_callback - ERROR - Error processing callback for node 69bb35fb21a77312e2222654: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:47428 - "GET / HTTP/1.0" 200 OK
2026-03-20 23:32:41,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:32:41,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14
INFO: 172.19.0.1:33802 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60450 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59436 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59438 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35872 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:35878 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35426 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47324 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35124 - "GET / HTTP/1.0" 200 OK
2026-03-20 23:33:47,773 - lava_callback - INFO - Received callback for node 69bb364f21a77312e222265b
INFO: 172.19.0.1:35132 - "POST /node/69bb364f21a77312e222265b HTTP/1.0" 202 Accepted
2026-03-20 23:33:47,779 - lava_callback - INFO - Starting async job submit for node 69bb364f21a77312e222265b
2026-03-20 23:33:47,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:33:47,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb364f21a77312e222265b HTTP/1.1" 200 None
2026-03-20 23:33:47,795 - lava_callback - DEBUG - Processing node 69bb364f21a77312e222265b: baseline-arm64-clabbe
2026-03-20 23:33:47,795 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb364f21a77312e222265b
2026-03-20 23:33:47,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:33:47,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb364f21a77312e222265b HTTP/1.1" 200 None
2026-03-20 23:33:47,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:33:47,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad0a721a77312e2220ef1 HTTP/1.1" 200 None
2026-03-20 23:33:47,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:33:47,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb364f21a77312e222265b HTTP/1.1" 200 None
2026-03-20 23:33:47,868 - lava_callback - ERROR - Error processing callback for node 69bb364f21a77312e222265b: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:58462 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48136 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48146 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57252 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:57254 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47746 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46542 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48686 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39976 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57324 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57336 - "GET / HTTP/1.0" 200 OK
2026-03-20 23:35:07,900 - lava_callback - INFO - Received callback for node 69bb36a121a77312e2222667
INFO: 172.19.0.1:57346 - "POST /node/69bb36a121a77312e2222667 HTTP/1.0" 202 Accepted
2026-03-20 23:35:07,905 - lava_callback - INFO - Starting async job submit for node 69bb36a121a77312e2222667
2026-03-20 23:35:07,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:35:07,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb36a121a77312e2222667 HTTP/1.1" 200 None
2026-03-20 23:35:07,922 - lava_callback - DEBUG - Processing node 69bb36a121a77312e2222667: baseline-arm64-clabbe
2026-03-20 23:35:07,922 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb36a121a77312e2222667
2026-03-20 23:35:07,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:35:07,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb36a121a77312e2222667 HTTP/1.1" 200 None
2026-03-20 23:35:07,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:35:07,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad0a721a77312e2220ef1 HTTP/1.1" 200 None
2026-03-20 23:35:07,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:35:07,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb36a121a77312e2222667 HTTP/1.1" 200 None
2026-03-20 23:35:07,975 - lava_callback - ERROR - Error processing callback for node 69bb36a121a77312e2222667: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:44280 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:44294 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56106 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35702 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33582 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60900 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46830 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46834 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52632 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:52642 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42394 - "GET / HTTP/1.0" 200 OK
2026-03-20 23:36:27,903 - lava_callback - INFO - Received callback for node 69bb36f521a77312e2222673
INFO: 172.19.0.1:42398 - "POST /node/69bb36f521a77312e2222673 HTTP/1.0" 202 Accepted
2026-03-20 23:36:27,909 - lava_callback - INFO - Starting async job submit for node 69bb36f521a77312e2222673
2026-03-20 23:36:27,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:36:27,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb36f521a77312e2222673 HTTP/1.1" 200 None
2026-03-20 23:36:27,926 - lava_callback - DEBUG - Processing node 69bb36f521a77312e2222673: baseline-arm64-clabbe
2026-03-20 23:36:27,926 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb36f521a77312e2222673
2026-03-20 23:36:27,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:36:27,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb36f521a77312e2222673 HTTP/1.1" 200 None
2026-03-20 23:36:27,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:36:27,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad0a721a77312e2220ef1 HTTP/1.1" 200 None
2026-03-20 23:36:27,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:36:27,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb36f521a77312e2222673 HTTP/1.1" 200 None
2026-03-20 23:36:27,985 - lava_callback - ERROR - Error processing callback for node 69bb36f521a77312e2222673: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:46308 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54320 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47614 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52182 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52186 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54152 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:54160 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43492 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55024 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38506 - "GET / HTTP/1.0" 200 OK
2026-03-20 23:37:47,958 - lava_callback - INFO - Received callback for node 69bb374921a77312e222267c
INFO: 172.19.0.1:38522 - "POST /node/69bb374921a77312e222267c HTTP/1.0" 202 Accepted
2026-03-20 23:37:47,964 - lava_callback - INFO - Starting async job submit for node 69bb374921a77312e222267c
2026-03-20 23:37:47,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:37:47,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb374921a77312e222267c HTTP/1.1" 200 None
2026-03-20 23:37:47,979 - lava_callback - DEBUG - Processing node 69bb374921a77312e222267c: baseline-arm64-clabbe
2026-03-20 23:37:47,980 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb374921a77312e222267c
2026-03-20 23:37:47,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:37:47,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb374921a77312e222267c HTTP/1.1" 200 None
2026-03-20 23:37:47,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:37:48,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad0a721a77312e2220ef1 HTTP/1.1" 200 None
2026-03-20 23:37:48,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:37:48,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb374921a77312e222267c HTTP/1.1" 200 None
2026-03-20 23:37:48,057 - lava_callback - ERROR - Error processing callback for node 69bb374921a77312e222267c: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:55384 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46338 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46348 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53998 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:54010 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35308 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59568 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43966 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37222 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48852 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48860 - "GET / HTTP/1.0" 200 OK
2026-03-20 23:39:13,197 - lava_callback - INFO - Received callback for node 69bb379321a77312e2222686
INFO: 172.19.0.1:45642 - "POST /node/69bb379321a77312e2222686 HTTP/1.0" 202 Accepted
2026-03-20 23:39:13,202 - lava_callback - INFO - Starting async job submit for node 69bb379321a77312e2222686
2026-03-20 23:39:13,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:39:13,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb379321a77312e2222686 HTTP/1.1" 200 None
2026-03-20 23:39:13,219 - lava_callback - DEBUG - Processing node 69bb379321a77312e2222686: baseline-arm64-baylibre
2026-03-20 23:39:13,219 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb379321a77312e2222686
2026-03-20 23:39:13,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:39:13,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb379321a77312e2222686 HTTP/1.1" 200 None
2026-03-20 23:39:13,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:39:13,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None
2026-03-20 23:39:13,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:39:13,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb379321a77312e2222686 HTTP/1.1" 200 None
2026-03-20 23:39:13,286 - lava_callback - ERROR - Error processing callback for node 69bb379321a77312e2222686: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:45648 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:45654 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50174 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60986 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39976 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39826 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35046 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35056 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58860 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:58872 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55956 - "GET / HTTP/1.0" 200 OK
2026-03-20 23:40:33,220 - lava_callback - INFO - Received callback for node 69bb37e521a77312e2222694
INFO: 172.19.0.1:45378 - "POST /node/69bb37e521a77312e2222694 HTTP/1.0" 202 Accepted
2026-03-20 23:40:33,226 - lava_callback - INFO - Starting async job submit for node 69bb37e521a77312e2222694
2026-03-20 23:40:33,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:40:33,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb37e521a77312e2222694 HTTP/1.1" 200 None
2026-03-20 23:40:33,242 - lava_callback - DEBUG - Processing node 69bb37e521a77312e2222694: baseline-arm64-baylibre
2026-03-20 23:40:33,242 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb37e521a77312e2222694
2026-03-20 23:40:33,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:40:33,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb37e521a77312e2222694 HTTP/1.1" 200 None
2026-03-20 23:40:33,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:40:33,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None
2026-03-20 23:40:33,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:40:33,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb37e521a77312e2222694 HTTP/1.1" 200 None
2026-03-20 23:40:33,308 - lava_callback - ERROR - Error processing callback for node 69bb37e521a77312e2222694: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:45382 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:32974 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37910 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54942 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54956 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35440 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:35450 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38772 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45360 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38050 - "GET / HTTP/1.0" 200 OK
2026-03-20 23:41:53,307 - lava_callback - INFO - Received callback for node 69bb383721a77312e222269f
INFO: 172.19.0.1:38684 - "POST /node/69bb383721a77312e222269f HTTP/1.0" 202 Accepted
2026-03-20 23:41:53,312 - lava_callback - INFO - Starting async job submit for node 69bb383721a77312e222269f
2026-03-20 23:41:53,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:41:53,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb383721a77312e222269f HTTP/1.1" 200 None
2026-03-20 23:41:53,329 - lava_callback - DEBUG - Processing node 69bb383721a77312e222269f: baseline-arm64-baylibre
2026-03-20 23:41:53,329 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb383721a77312e222269f
2026-03-20 23:41:53,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:41:53,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb383721a77312e222269f HTTP/1.1" 200 None
2026-03-20 23:41:53,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:41:53,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None
2026-03-20 23:41:53,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:41:53,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb383721a77312e222269f HTTP/1.1" 200 None
2026-03-20 23:41:53,401 - lava_callback - ERROR - Error processing callback for node 69bb383721a77312e222269f: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:38688 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38842 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38850 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50496 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:50502 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47766 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58938 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44936 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33256 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57794 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57796 - "GET / HTTP/1.0" 200 OK
2026-03-20 23:43:13,965 - lava_callback - INFO - Received callback for node 69bb388921a77312e22226a8
INFO: 172.19.0.1:37126 - "POST /node/69bb388921a77312e22226a8 HTTP/1.0" 202 Accepted
2026-03-20 23:43:13,971 - lava_callback - INFO - Starting async job submit for node 69bb388921a77312e22226a8
2026-03-20 23:43:13,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:43:14,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb388921a77312e22226a8 HTTP/1.1" 200 None
2026-03-20 23:43:14,017 - lava_callback - DEBUG - Processing node 69bb388921a77312e22226a8: baseline-arm64-baylibre
2026-03-20 23:43:14,018 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb388921a77312e22226a8
2026-03-20 23:43:14,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:43:14,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb388921a77312e22226a8 HTTP/1.1" 200 None
2026-03-20 23:43:14,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:43:14,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None
2026-03-20 23:43:14,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:43:14,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb388921a77312e22226a8 HTTP/1.1" 200 None
2026-03-20 23:43:14,077 - lava_callback - ERROR - Error processing callback for node 69bb388921a77312e22226a8: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:37130 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:37140 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59108 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44722 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45734 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48622 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48038 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48050 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38966 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:38982 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38164 - "GET / HTTP/1.0" 200 OK
2026-03-20 23:44:33,497 - lava_callback - INFO - Received callback for node 69bb38db21a77312e22226b5
INFO: 172.19.0.1:49026 - "POST /node/69bb38db21a77312e22226b5 HTTP/1.0" 202 Accepted
2026-03-20 23:44:33,503 - lava_callback - INFO - Starting async job submit for node 69bb38db21a77312e22226b5
2026-03-20 23:44:33,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:44:33,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb38db21a77312e22226b5 HTTP/1.1" 200 None
2026-03-20 23:44:33,522 - lava_callback - DEBUG - Processing node 69bb38db21a77312e22226b5: baseline-arm64-baylibre
2026-03-20 23:44:33,522 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb38db21a77312e22226b5
2026-03-20 23:44:33,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:44:33,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb38db21a77312e22226b5 HTTP/1.1" 200 None
2026-03-20 23:44:33,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:44:33,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None
2026-03-20 23:44:33,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:44:33,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb38db21a77312e22226b5 HTTP/1.1" 200 None
2026-03-20 23:44:33,582 - lava_callback - ERROR - Error processing callback for node 69bb38db21a77312e22226b5: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:49032 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44850 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53660 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34950 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34966 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59786 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:59800 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39466 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60426 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40344 - "GET / HTTP/1.0" 200 OK
2026-03-20 23:45:53,543 - lava_callback - INFO - Received callback for node 69bb392f21a77312e22226c3
INFO: 172.19.0.1:49170 - "POST /node/69bb392f21a77312e22226c3 HTTP/1.0" 202 Accepted
2026-03-20 23:45:53,549 - lava_callback - INFO - Starting async job submit for node 69bb392f21a77312e22226c3
2026-03-20 23:45:53,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:45:53,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb392f21a77312e22226c3 HTTP/1.1" 200 None
2026-03-20 23:45:53,594 - lava_callback - DEBUG - Processing node 69bb392f21a77312e22226c3: baseline-arm64-baylibre
2026-03-20 23:45:53,594 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb392f21a77312e22226c3
2026-03-20 23:45:53,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:45:53,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb392f21a77312e22226c3 HTTP/1.1" 200 None
2026-03-20 23:45:53,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:45:53,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None
2026-03-20 23:45:53,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:45:53,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb392f21a77312e22226c3 HTTP/1.1" 200 None
2026-03-20 23:45:53,662 - lava_callback - ERROR - Error processing callback for node 69bb392f21a77312e22226c3: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:49180 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:32826 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:32842 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52568 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:52584 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47618 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50108 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50648 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52284 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44912 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44916 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52954 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:52962 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43264 - "GET / HTTP/1.0" 200 OK
2026-03-20 23:47:28,385 - lava_callback - INFO - Received callback for node 69bb398921a77312e22226ce
INFO: 172.19.0.1:43270 - "POST /node/69bb398921a77312e22226ce HTTP/1.0" 202 Accepted
2026-03-20 23:47:28,391 - lava_callback - INFO - Starting async job submit for node 69bb398921a77312e22226ce
2026-03-20 23:47:28,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:47:28,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb398921a77312e22226ce HTTP/1.1" 200 None
2026-03-20 23:47:28,406 - lava_callback - DEBUG - Processing node 69bb398921a77312e22226ce: baseline-arm64-clabbe
2026-03-20 23:47:28,407 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb398921a77312e22226ce
2026-03-20 23:47:28,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:47:28,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb398921a77312e22226ce HTTP/1.1" 200 None
2026-03-20 23:47:28,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:47:28,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None
2026-03-20 23:47:28,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:47:28,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb398921a77312e22226ce HTTP/1.1" 200 None
2026-03-20 23:47:28,468 - lava_callback - ERROR - Error processing callback for node 69bb398921a77312e22226ce: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:39754 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35650 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51744 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44586 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44602 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53240 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:53256 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56582 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45850 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43626 - "GET / HTTP/1.0" 200 OK
2026-03-20 23:48:48,406 - lava_callback - INFO - Received callback for node 69bb39db21a77312e22226da
INFO: 172.19.0.1:43636 - "POST /node/69bb39db21a77312e22226da HTTP/1.0" 202 Accepted
2026-03-20 23:48:48,411 - lava_callback - INFO - Starting async job submit for node 69bb39db21a77312e22226da
2026-03-20 23:48:48,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:48:48,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb39db21a77312e22226da HTTP/1.1" 200 None
2026-03-20 23:48:48,436 - lava_callback - DEBUG - Processing node 69bb39db21a77312e22226da: baseline-arm64-clabbe
2026-03-20 23:48:48,436 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb39db21a77312e22226da
2026-03-20 23:48:48,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:48:48,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb39db21a77312e22226da HTTP/1.1" 200 None
2026-03-20 23:48:48,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:48:48,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None
2026-03-20 23:48:48,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:48:48,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb39db21a77312e22226da HTTP/1.1" 200 None
2026-03-20 23:48:48,490 - lava_callback - ERROR - Error processing callback for node 69bb39db21a77312e22226da: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:46294 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49458 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49460 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50288 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:50304 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37702 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45444 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58618 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35794 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44542 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44558 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33626 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:33640 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54810 - "GET / HTTP/1.0" 200 OK
2026-03-20 23:50:28,500 - lava_callback - INFO - Received callback for node 69bb3a2e21a77312e22226e1
INFO: 172.19.0.1:54822 - "POST /node/69bb3a2e21a77312e22226e1 HTTP/1.0" 202 Accepted
2026-03-20 23:50:28,506 - lava_callback - INFO - Starting async job submit for node 69bb3a2e21a77312e22226e1
2026-03-20 23:50:28,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:50:28,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb3a2e21a77312e22226e1 HTTP/1.1" 200 None
2026-03-20 23:50:28,528 - lava_callback - DEBUG - Processing node 69bb3a2e21a77312e22226e1: baseline-arm64-clabbe
2026-03-20 23:50:28,528 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb3a2e21a77312e22226e1
2026-03-20 23:50:28,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:50:28,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb3a2e21a77312e22226e1 HTTP/1.1" 200 None
2026-03-20 23:50:28,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:50:28,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None
2026-03-20 23:50:28,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:50:28,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb3a2e21a77312e22226e1 HTTP/1.1" 200 None
2026-03-20 23:50:28,581 - lava_callback - ERROR - Error processing callback for node 69bb3a2e21a77312e22226e1: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:56844 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33726 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36954 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56230 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56238 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38222 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:38226 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40812 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36572 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47264 - "GET / HTTP/1.0" 200 OK
2026-03-20 23:51:48,508 - lava_callback - INFO - Received callback for node 69bb3a8021a77312e22226ef
INFO: 172.19.0.1:47272 - "POST /node/69bb3a8021a77312e22226ef HTTP/1.0" 202 Accepted
2026-03-20 23:51:48,514 - lava_callback - INFO - Starting async job submit for node 69bb3a8021a77312e22226ef
2026-03-20 23:51:48,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:51:48,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb3a8021a77312e22226ef HTTP/1.1" 200 None
2026-03-20 23:51:48,535 - lava_callback - DEBUG - Processing node 69bb3a8021a77312e22226ef: baseline-arm64-clabbe
2026-03-20 23:51:48,535 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb3a8021a77312e22226ef
2026-03-20 23:51:48,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:51:48,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb3a8021a77312e22226ef HTTP/1.1" 200 None
2026-03-20 23:51:48,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:51:48,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None
2026-03-20 23:51:48,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:51:48,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb3a8021a77312e22226ef HTTP/1.1" 200 None
2026-03-20 23:51:48,628 - lava_callback - ERROR - Error processing callback for node 69bb3a8021a77312e22226ef: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:60428 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60932 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60942 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60946 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40116 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:40122 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46532 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42406 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:36266 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49140 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41438 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41442 - "GET / HTTP/1.0" 200 OK
2026-03-20 23:53:08,586 - lava_callback - INFO - Received callback for node 69bb3ad221a77312e22226fd
INFO: 172.19.0.1:41450 - "POST /node/69bb3ad221a77312e22226fd HTTP/1.0" 202 Accepted
2026-03-20 23:53:08,591 - lava_callback - INFO - Starting async job submit for node 69bb3ad221a77312e22226fd
2026-03-20 23:53:08,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:53:08,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb3ad221a77312e22226fd HTTP/1.1" 200 None
2026-03-20 23:53:08,607 - lava_callback - DEBUG - Processing node 69bb3ad221a77312e22226fd: baseline-arm64-clabbe
2026-03-20 23:53:08,608 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb3ad221a77312e22226fd
2026-03-20 23:53:08,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:53:08,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb3ad221a77312e22226fd HTTP/1.1" 200 None
2026-03-20 23:53:08,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:53:08,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None
2026-03-20 23:53:08,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:53:08,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb3ad221a77312e22226fd HTTP/1.1" 200 None
2026-03-20 23:53:08,663 - lava_callback - ERROR - Error processing callback for node 69bb3ad221a77312e22226fd: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:51756 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:51758 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59532 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34838 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45462 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47662 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51778 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51786 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33926 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:33934 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60328 - "GET / HTTP/1.0" 200 OK
2026-03-20 23:54:28,654 - lava_callback - INFO - Received callback for node 69bb3b2421a77312e2222706
INFO: 172.19.0.1:60332 - "POST /node/69bb3b2421a77312e2222706 HTTP/1.0" 202 Accepted
2026-03-20 23:54:28,660 - lava_callback - INFO - Starting async job submit for node 69bb3b2421a77312e2222706
2026-03-20 23:54:28,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:54:28,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb3b2421a77312e2222706 HTTP/1.1" 200 None
2026-03-20 23:54:28,695 - lava_callback - DEBUG - Processing node 69bb3b2421a77312e2222706: baseline-arm64-clabbe
2026-03-20 23:54:28,695 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb3b2421a77312e2222706
2026-03-20 23:54:28,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:54:28,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb3b2421a77312e2222706 HTTP/1.1" 200 None
2026-03-20 23:54:28,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:54:28,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None
2026-03-20 23:54:28,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:54:28,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb3b2421a77312e2222706 HTTP/1.1" 200 None
2026-03-20 23:54:28,760 - lava_callback - ERROR - Error processing callback for node 69bb3b2421a77312e2222706: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:44808 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59268 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42342 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43680 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43688 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41942 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:41954 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34622 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47032 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43304 - "GET / HTTP/1.0" 200 OK
2026-03-20 23:55:48,689 - lava_callback - INFO - Received callback for node 69bb3b7521a77312e2222713
INFO: 172.19.0.1:43316 - "POST /node/69bb3b7521a77312e2222713 HTTP/1.0" 202 Accepted
2026-03-20 23:55:48,695 - lava_callback - INFO - Starting async job submit for node 69bb3b7521a77312e2222713
2026-03-20 23:55:48,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:55:48,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb3b7521a77312e2222713 HTTP/1.1" 200 None
2026-03-20 23:55:48,711 - lava_callback - DEBUG - Processing node 69bb3b7521a77312e2222713: baseline-arm64-clabbe
2026-03-20 23:55:48,712 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb3b7521a77312e2222713
2026-03-20 23:55:48,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:55:48,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb3b7521a77312e2222713 HTTP/1.1" 200 None
2026-03-20 23:55:48,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:55:48,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None
2026-03-20 23:55:48,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:55:48,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb3b7521a77312e2222713 HTTP/1.1" 200 None
2026-03-20 23:55:48,764 - lava_callback - ERROR - Error processing callback for node 69bb3b7521a77312e2222713: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:56982 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50880 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50884 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48802 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:48808 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52094 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52148 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39678 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46416 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53416 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53426 - "GET / HTTP/1.0" 200 OK
2026-03-20 23:57:08,756 - lava_callback - INFO - Received callback for node 69bb3bc621a77312e2222722
INFO: 172.19.0.1:53438 - "POST /node/69bb3bc621a77312e2222722 HTTP/1.0" 202 Accepted
2026-03-20 23:57:08,762 - lava_callback - INFO - Starting async job submit for node 69bb3bc621a77312e2222722
2026-03-20 23:57:08,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:57:08,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb3bc621a77312e2222722 HTTP/1.1" 200 None
2026-03-20 23:57:08,779 - lava_callback - DEBUG - Processing node 69bb3bc621a77312e2222722: baseline-arm64-clabbe
2026-03-20 23:57:08,779 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb3bc621a77312e2222722
2026-03-20 23:57:08,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:57:08,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb3bc621a77312e2222722 HTTP/1.1" 200 None
2026-03-20 23:57:08,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:57:08,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None
2026-03-20 23:57:08,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:57:08,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb3bc621a77312e2222722 HTTP/1.1" 200 None
2026-03-20 23:57:08,848 - lava_callback - ERROR - Error processing callback for node 69bb3bc621a77312e2222722: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:45370 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:45376 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44188 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57198 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60176 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34612 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42436 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42452 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55202 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:55210 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45684 - "GET / HTTP/1.0" 200 OK
2026-03-20 23:58:28,839 - lava_callback - INFO - Received callback for node 69bb3c1721a77312e222272f
INFO: 172.19.0.1:45698 - "POST /node/69bb3c1721a77312e222272f HTTP/1.0" 202 Accepted
2026-03-20 23:58:28,844 - lava_callback - INFO - Starting async job submit for node 69bb3c1721a77312e222272f
2026-03-20 23:58:28,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:58:28,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb3c1721a77312e222272f HTTP/1.1" 200 None
2026-03-20 23:58:28,860 - lava_callback - DEBUG - Processing node 69bb3c1721a77312e222272f: baseline-arm64-clabbe
2026-03-20 23:58:28,860 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb3c1721a77312e222272f
2026-03-20 23:58:28,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:58:28,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb3c1721a77312e222272f HTTP/1.1" 200 None
2026-03-20 23:58:28,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:58:28,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None
2026-03-20 23:58:28,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:58:28,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb3c1721a77312e222272f HTTP/1.1" 200 None
2026-03-20 23:58:28,944 - lava_callback - ERROR - Error processing callback for node 69bb3c1721a77312e222272f: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:56416 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50162 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40458 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46588 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46590 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40812 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:40814 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51572 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35568 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51880 - "GET / HTTP/1.0" 200 OK
2026-03-20 23:59:49,120 - lava_callback - INFO - Received callback for node 69bb3c6921a77312e2222738
INFO: 172.19.0.1:51884 - "POST /node/69bb3c6921a77312e2222738 HTTP/1.0" 202 Accepted
2026-03-20 23:59:49,126 - lava_callback - INFO - Starting async job submit for node 69bb3c6921a77312e2222738
2026-03-20 23:59:49,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:59:49,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb3c6921a77312e2222738 HTTP/1.1" 200 None
2026-03-20 23:59:49,142 - lava_callback - DEBUG - Processing node 69bb3c6921a77312e2222738: baseline-arm64-clabbe
2026-03-20 23:59:49,142 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb3c6921a77312e2222738
2026-03-20 23:59:49,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:59:49,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb3c6921a77312e2222738 HTTP/1.1" 200 None
2026-03-20 23:59:49,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:59:49,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None
2026-03-20 23:59:49,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-20 23:59:49,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb3c6921a77312e2222738 HTTP/1.1" 200 None
2026-03-20 23:59:49,202 - lava_callback - ERROR - Error processing callback for node 69bb3c6921a77312e2222738: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:59380 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37314 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37328 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43232 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:43234 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52402 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58702 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58242 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42584 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51554 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51562 - "GET / HTTP/1.0" 200 OK
2026-03-21 00:01:08,935 - lava_callback - INFO - Received callback for node 69bb3cc021a77312e2222746
INFO: 172.19.0.1:51568 - "POST /node/69bb3cc021a77312e2222746 HTTP/1.0" 202 Accepted
2026-03-21 00:01:08,943 - lava_callback - INFO - Starting async job submit for node 69bb3cc021a77312e2222746
2026-03-21 00:01:08,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-21 00:01:08,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb3cc021a77312e2222746 HTTP/1.1" 200 None
2026-03-21 00:01:08,968 - lava_callback - DEBUG - Processing node 69bb3cc021a77312e2222746: baseline-arm64-clabbe
2026-03-21 00:01:08,968 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb3cc021a77312e2222746
2026-03-21 00:01:08,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-21 00:01:09,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb3cc021a77312e2222746 HTTP/1.1" 200 None
2026-03-21 00:01:09,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-21 00:01:09,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None
2026-03-21 00:01:09,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-21 00:01:09,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb3cc021a77312e2222746 HTTP/1.1" 200 None
2026-03-21 00:01:09,070 - lava_callback - ERROR - Error processing callback for node 69bb3cc021a77312e2222746: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:55178 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:55186 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42344 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58842 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35782 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33638 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40340 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:40346 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47028 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:47042 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:32824 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35078 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:50654 - "GET / HTTP/1.0" 200 OK
2026-03-21 00:02:49,032 - lava_callback - INFO - Received callback for node 69bb3d1421a77312e2222753
INFO: 172.19.0.1:50668 - "POST /node/69bb3d1421a77312e2222753 HTTP/1.0" 202 Accepted
2026-03-21 00:02:49,037 - lava_callback - INFO - Starting async job submit for node 69bb3d1421a77312e2222753
2026-03-21 00:02:49,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-21 00:02:49,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb3d1421a77312e2222753 HTTP/1.1" 200 None
2026-03-21 00:02:49,057 - lava_callback - DEBUG - Processing node 69bb3d1421a77312e2222753: baseline-arm64-clabbe
2026-03-21 00:02:49,057 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb3d1421a77312e2222753
2026-03-21 00:02:49,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-21 00:02:49,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb3d1421a77312e2222753 HTTP/1.1" 200 None
2026-03-21 00:02:49,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-21 00:02:49,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None
2026-03-21 00:02:49,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-21 00:02:49,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb3d1421a77312e2222753 HTTP/1.1" 200 None
2026-03-21 00:02:49,126 - lava_callback - ERROR - Error processing callback for node 69bb3d1421a77312e2222753: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:53202 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52120 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52136 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51016 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:51024 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:55462 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59776 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38788 - "GET / HTTP/1.0" 200 OK
2026-03-21 00:03:54,702 - lava_callback - INFO - Received callback for node 69bb3d5b21a77312e222275c
INFO: 172.19.0.1:53664 - "POST /node/69bb3d5b21a77312e222275c HTTP/1.0" 202 Accepted
2026-03-21 00:03:54,708 - lava_callback - INFO - Starting async job submit for node 69bb3d5b21a77312e222275c
2026-03-21 00:03:54,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-21 00:03:54,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb3d5b21a77312e222275c HTTP/1.1" 200 None
2026-03-21 00:03:54,725 - lava_callback - DEBUG - Processing node 69bb3d5b21a77312e222275c: baseline-arm64-baylibre
2026-03-21 00:03:54,725 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb3d5b21a77312e222275c
2026-03-21 00:03:54,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-21 00:03:54,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb3d5b21a77312e222275c HTTP/1.1" 200 None
2026-03-21 00:03:54,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-21 00:03:54,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None
2026-03-21 00:03:54,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-21 00:03:54,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb3d5b21a77312e222275c HTTP/1.1" 200 None
2026-03-21 00:03:54,779 - lava_callback - ERROR - Error processing callback for node 69bb3d5b21a77312e222275c: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:53680 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56690 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56704 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43378 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:43386 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33632 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46468 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53786 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33936 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35154 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35164 - "GET / HTTP/1.0" 200 OK
2026-03-21 00:05:14,618 - lava_callback - INFO - Received callback for node 69bb3dac21a77312e2222769
INFO: 172.19.0.1:40580 - "POST /node/69bb3dac21a77312e2222769 HTTP/1.0" 202 Accepted
2026-03-21 00:05:14,624 - lava_callback - INFO - Starting async job submit for node 69bb3dac21a77312e2222769
2026-03-21 00:05:14,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-21 00:05:14,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb3dac21a77312e2222769 HTTP/1.1" 200 None
2026-03-21 00:05:14,640 - lava_callback - DEBUG - Processing node 69bb3dac21a77312e2222769: baseline-arm64-baylibre
2026-03-21 00:05:14,640 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb3dac21a77312e2222769
2026-03-21 00:05:14,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-21 00:05:14,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb3dac21a77312e2222769 HTTP/1.1" 200 None
2026-03-21 00:05:14,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-21 00:05:14,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None
2026-03-21 00:05:14,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-21 00:05:14,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb3dac21a77312e2222769 HTTP/1.1" 200 None
2026-03-21 00:05:14,706 - lava_callback - ERROR - Error processing callback for node 69bb3dac21a77312e2222769: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:40586 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:40600 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49914 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:56640 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39116 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:48428 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37016 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:37020 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:46626 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:46630 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47784 - "GET / HTTP/1.0" 200 OK
2026-03-21 00:06:34,730 - lava_callback - INFO - Received callback for node 69bb3dff21a77312e2222775
INFO: 172.19.0.1:60348 - "POST /node/69bb3dff21a77312e2222775 HTTP/1.0" 202 Accepted
2026-03-21 00:06:34,736 - lava_callback - INFO - Starting async job submit for node 69bb3dff21a77312e2222775
2026-03-21 00:06:34,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-21 00:06:34,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb3dff21a77312e2222775 HTTP/1.1" 200 None
2026-03-21 00:06:34,752 - lava_callback - DEBUG - Processing node 69bb3dff21a77312e2222775: baseline-arm64-baylibre
2026-03-21 00:06:34,752 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb3dff21a77312e2222775
2026-03-21 00:06:34,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-21 00:06:34,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb3dff21a77312e2222775 HTTP/1.1" 200 None
2026-03-21 00:06:34,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-21 00:06:34,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None
2026-03-21 00:06:34,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-21 00:06:34,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb3dff21a77312e2222775 HTTP/1.1" 200 None
2026-03-21 00:06:34,819 - lava_callback - ERROR - Error processing callback for node 69bb3dff21a77312e2222775: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:60364 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:44664 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34750 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33782 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:33784 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38414 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:38428 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54378 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58472 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49582 - "GET / HTTP/1.0" 200 OK
2026-03-21 00:07:54,802 - lava_callback - INFO - Received callback for node 69bb3e5421a77312e2222781
INFO: 172.19.0.1:46144 - "POST /node/69bb3e5421a77312e2222781 HTTP/1.0" 202 Accepted
2026-03-21 00:07:54,808 - lava_callback - INFO - Starting async job submit for node 69bb3e5421a77312e2222781
2026-03-21 00:07:54,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-21 00:07:54,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb3e5421a77312e2222781 HTTP/1.1" 200 None
2026-03-21 00:07:54,826 - lava_callback - DEBUG - Processing node 69bb3e5421a77312e2222781: baseline-arm64-baylibre
2026-03-21 00:07:54,826 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb3e5421a77312e2222781
2026-03-21 00:07:54,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-21 00:07:54,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb3e5421a77312e2222781 HTTP/1.1" 200 None
2026-03-21 00:07:54,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-21 00:07:54,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None
2026-03-21 00:07:54,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-21 00:07:54,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb3e5421a77312e2222781 HTTP/1.1" 200 None
2026-03-21 00:07:54,878 - lava_callback - ERROR - Error processing callback for node 69bb3e5421a77312e2222781: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:46158 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47934 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47938 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:45520 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:45524 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60650 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:51684 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:52090 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:43952 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57522 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:57526 - "GET / HTTP/1.0" 200 OK
2026-03-21 00:09:14,864 - lava_callback - INFO - Received callback for node 69bb3ea521a77312e2222786
INFO: 172.19.0.1:48126 - "POST /node/69bb3ea521a77312e2222786 HTTP/1.0" 202 Accepted
2026-03-21 00:09:14,870 - lava_callback - INFO - Starting async job submit for node 69bb3ea521a77312e2222786
2026-03-21 00:09:14,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-21 00:09:14,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb3ea521a77312e2222786 HTTP/1.1" 200 None
2026-03-21 00:09:14,886 - lava_callback - DEBUG - Processing node 69bb3ea521a77312e2222786: baseline-arm64-baylibre
2026-03-21 00:09:14,887 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb3ea521a77312e2222786
2026-03-21 00:09:14,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-21 00:09:14,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb3ea521a77312e2222786 HTTP/1.1" 200 None
2026-03-21 00:09:14,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-21 00:09:14,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None
2026-03-21 00:09:14,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-21 00:09:14,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb3ea521a77312e2222786 HTTP/1.1" 200 None
2026-03-21 00:09:14,942 - lava_callback - ERROR - Error processing callback for node 69bb3ea521a77312e2222786: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:48138 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:48140 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:53750 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:49616 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:42640 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41634 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60866 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60878 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:59202 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:59206 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58158 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:60432 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:41136 - "GET / HTTP/1.0" 200 OK
2026-03-21 00:10:54,991 - lava_callback - INFO - Received callback for node 69bb3efb21a77312e2222792
INFO: 172.19.0.1:59198 - "POST /node/69bb3efb21a77312e2222792 HTTP/1.0" 202 Accepted
2026-03-21 00:10:54,997 - lava_callback - INFO - Starting async job submit for node 69bb3efb21a77312e2222792
2026-03-21 00:10:54,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-21 00:10:55,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb3efb21a77312e2222792 HTTP/1.1" 200 None
2026-03-21 00:10:55,013 - lava_callback - DEBUG - Processing node 69bb3efb21a77312e2222792: baseline-arm64-baylibre
2026-03-21 00:10:55,013 - lava_callback - WARNING - No log data found in callback
Job failure metadata not found for node: 69bb3efb21a77312e2222792
2026-03-21 00:10:55,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-21 00:10:55,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb3efb21a77312e2222792 HTTP/1.1" 200 None
2026-03-21 00:10:55,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-21 00:10:55,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None
2026-03-21 00:10:55,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000
2026-03-21 00:10:55,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb3efb21a77312e2222792 HTTP/1.1" 200 None
2026-03-21 00:10:55,081 - lava_callback - ERROR - Error processing callback for node 69bb3efb21a77312e2222792: 'lava'
Traceback (most recent call last):
File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit
_emit_callback_telemetry(
File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry
is_infra = job_callback.is_infra_error() if job_node.get(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error
lava_yaml = self._data['results']['lava']
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
KeyError: 'lava'
INFO: 172.19.0.1:59210 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58610 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:58612 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:34334 - "GET /api/metrics HTTP/1.0" 200 OK
INFO: 172.19.0.1:34346 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:54262 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:38048 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:39936 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:47424 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35348 - "GET / HTTP/1.0" 200 OK
INFO: 172.19.0.1:35360 - "GET / HTTP/1.0" 200 OK
INFO: Shutting down
INFO: Waiting for application shutdown.
INFO: Application shutdown complete.
INFO: Finished server process [1]