INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.21.0.1:33872 - "GET /node/69ab075727cb11dcdfc75b3d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:33880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36026 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:15:53,182 - lava_callback - INFO - Received callback for node 69ce25a3cb08ea23a1f68041 2026-04-04 08:15:53,193 - lava_callback - INFO - Starting async job submit for node 69ce25a3cb08ea23a1f68041 INFO: 172.21.0.1:41906 - "POST /node/69ce25a3cb08ea23a1f68041 HTTP/1.0" 202 Accepted 2026-04-04 08:15:53,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:15:53,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce25a3cb08ea23a1f68041 HTTP/1.1" 200 None 2026-04-04 08:15:53,229 - lava_callback - DEBUG - Processing node 69ce25a3cb08ea23a1f68041: baseline-arm64-clabbe 2026-04-04 08:15:53,230 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce25a3cb08ea23a1f68041 2026-04-04 08:15:53,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:15:53,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce25a3cb08ea23a1f68041 HTTP/1.1" 200 None 2026-04-04 08:15:53,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:15:53,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f7ef41e4fb6a3782f4d HTTP/1.1" 200 None 2026-04-04 08:15:53,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:15:53,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce25a3cb08ea23a1f68041 HTTP/1.1" 200 None 2026-04-04 08:15:53,319 - lava_callback - ERROR - Error processing callback for node 69ce25a3cb08ea23a1f68041: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44072 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60862 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:17:13,182 - lava_callback - INFO - Received callback for node 69ce25f7cb08ea23a1f6804e INFO: 172.21.0.1:60864 - "POST /node/69ce25f7cb08ea23a1f6804e HTTP/1.0" 202 Accepted 2026-04-04 08:17:13,188 - lava_callback - INFO - Starting async job submit for node 69ce25f7cb08ea23a1f6804e 2026-04-04 08:17:13,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:17:13,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce25f7cb08ea23a1f6804e HTTP/1.1" 200 None 2026-04-04 08:17:13,205 - lava_callback - DEBUG - Processing node 69ce25f7cb08ea23a1f6804e: baseline-arm64-clabbe 2026-04-04 08:17:13,205 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce25f7cb08ea23a1f6804e 2026-04-04 08:17:13,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:17:13,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce25f7cb08ea23a1f6804e HTTP/1.1" 200 None 2026-04-04 08:17:13,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:17:13,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f7ef41e4fb6a3782f4d HTTP/1.1" 200 None 2026-04-04 08:17:13,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:17:13,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce25f7cb08ea23a1f6804e HTTP/1.1" 200 None 2026-04-04 08:17:13,262 - lava_callback - ERROR - Error processing callback for node 69ce25f7cb08ea23a1f6804e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44878 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:18:53,270 - lava_callback - INFO - Received callback for node 69ce2658cb08ea23a1f6805b INFO: 172.21.0.1:43090 - "POST /node/69ce2658cb08ea23a1f6805b HTTP/1.0" 202 Accepted 2026-04-04 08:18:53,277 - lava_callback - INFO - Starting async job submit for node 69ce2658cb08ea23a1f6805b 2026-04-04 08:18:53,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:18:53,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2658cb08ea23a1f6805b HTTP/1.1" 200 None 2026-04-04 08:18:53,293 - lava_callback - DEBUG - Processing node 69ce2658cb08ea23a1f6805b: baseline-arm64-clabbe 2026-04-04 08:18:53,293 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce2658cb08ea23a1f6805b 2026-04-04 08:18:53,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:18:53,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2658cb08ea23a1f6805b HTTP/1.1" 200 None 2026-04-04 08:18:53,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:18:53,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f7ef41e4fb6a3782f4d HTTP/1.1" 200 None 2026-04-04 08:18:53,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:18:53,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2658cb08ea23a1f6805b HTTP/1.1" 200 None 2026-04-04 08:18:53,389 - lava_callback - ERROR - Error processing callback for node 69ce2658cb08ea23a1f6805b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51606 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53976 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43532 - "GET /node/6983777466dc8a56088a5053%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:45852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47388 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41996 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33254 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38922 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:32:54,574 - lava_callback - INFO - Received callback for node 69d0cc2e691bac272b322fa7 INFO: 172.21.0.1:58768 - "POST /node/69d0cc2e691bac272b322fa7 HTTP/1.0" 202 Accepted 2026-04-04 08:32:54,580 - lava_callback - INFO - Starting async job submit for node 69d0cc2e691bac272b322fa7 2026-04-04 08:32:54,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:32:54,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cc2e691bac272b322fa7 HTTP/1.1" 200 None 2026-04-04 08:32:54,642 - lava_callback - DEBUG - Processing node 69d0cc2e691bac272b322fa7: baseline-arm 2026-04-04 08:32:54,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:32:55,195 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:32:55,197 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d0cc2e691bac272b322fa7/log.txt.gz 2026-04-04 08:32:55,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:32:55,556 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:32:55,558 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d0cc2e691bac272b322fa7/lava-logs.yaml 2026-04-04 08:32:55,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:32:55,732 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:32:55,734 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d0cc2e691bac272b322fa7/lava_callback.json.gz 2026-04-04 08:32:55,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:32:55,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cc2e691bac272b322fa7 HTTP/1.1" 200 None 2026-04-04 08:32:55,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:32:55,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c908691bac272b322d8f HTTP/1.1" 200 None 2026-04-04 08:32:55,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:32:55,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cc2e691bac272b322fa7 HTTP/1.1" 200 None 2026-04-04 08:32:55,825 - lava_callback - INFO - Completed processing callback for node 69d0cc2e691bac272b322fa7 INFO: 172.21.0.1:58770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56012 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56022 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:33:23,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:33:23,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40064 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:35:54,661 - lava_callback - INFO - Received callback for node 69d0cd48691bac272b322fd2 INFO: 172.21.0.1:56914 - "POST /node/69d0cd48691bac272b322fd2 HTTP/1.0" 202 Accepted 2026-04-04 08:35:54,670 - lava_callback - INFO - Starting async job submit for node 69d0cd48691bac272b322fd2 2026-04-04 08:35:54,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:35:54,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cd48691bac272b322fd2 HTTP/1.1" 200 None 2026-04-04 08:35:54,721 - lava_callback - DEBUG - Processing node 69d0cd48691bac272b322fd2: baseline-x86 2026-04-04 08:35:54,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:35:55,102 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:35:55,104 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69d0cd48691bac272b322fd2/log.txt.gz 2026-04-04 08:35:55,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:35:55,447 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:35:55,449 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69d0cd48691bac272b322fd2/lava-logs.yaml 2026-04-04 08:35:55,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:35:55,606 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:35:55,608 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69d0cd48691bac272b322fd2/lava_callback.json.gz 2026-04-04 08:35:55,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:35:55,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cd48691bac272b322fd2 HTTP/1.1" 200 None 2026-04-04 08:35:55,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:35:55,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c922691bac272b322db3 HTTP/1.1" 200 None 2026-04-04 08:35:55,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:35:55,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cd48691bac272b322fd2 HTTP/1.1" 200 None 2026-04-04 08:35:55,683 - lava_callback - INFO - Completed processing callback for node 69d0cd48691bac272b322fd2 2026-04-04 08:35:56,107 - lava_callback - INFO - Received callback for node 69d0cd46691bac272b322fc8 INFO: 172.21.0.1:56930 - "POST /node/69d0cd46691bac272b322fc8 HTTP/1.0" 202 Accepted 2026-04-04 08:35:56,113 - lava_callback - INFO - Starting async job submit for node 69d0cd46691bac272b322fc8 2026-04-04 08:35:56,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:35:56,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cd46691bac272b322fc8 HTTP/1.1" 200 None 2026-04-04 08:35:56,146 - lava_callback - DEBUG - Processing node 69d0cd46691bac272b322fc8: baseline-x86 2026-04-04 08:35:56,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:35:56,440 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:35:56,441 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69d0cd46691bac272b322fc8/log.txt.gz INFO: 172.21.0.1:56946 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:35:56,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:35:56,724 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:35:56,726 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69d0cd46691bac272b322fc8/lava-logs.yaml 2026-04-04 08:35:56,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:35:56,888 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:35:56,890 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69d0cd46691bac272b322fc8/lava_callback.json.gz 2026-04-04 08:35:56,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:35:56,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cd46691bac272b322fc8 HTTP/1.1" 200 None 2026-04-04 08:35:56,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:35:56,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c922691bac272b322db3 HTTP/1.1" 200 None 2026-04-04 08:35:56,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:35:56,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cd46691bac272b322fc8 HTTP/1.1" 200 None 2026-04-04 08:35:56,992 - lava_callback - INFO - Completed processing callback for node 69d0cd46691bac272b322fc8 INFO: 172.21.0.1:41770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58668 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58684 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:36:23,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:36:23,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60390 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:36:31,972 - lava_callback - INFO - Received callback for node 69d0cd47691bac272b322fcc INFO: 172.21.0.1:54986 - "POST /node/69d0cd47691bac272b322fcc HTTP/1.0" 202 Accepted 2026-04-04 08:36:31,982 - lava_callback - INFO - Starting async job submit for node 69d0cd47691bac272b322fcc 2026-04-04 08:36:32,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:36:32,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cd47691bac272b322fcc HTTP/1.1" 200 None 2026-04-04 08:36:32,028 - lava_callback - DEBUG - Processing node 69d0cd47691bac272b322fcc: baseline-x86 2026-04-04 08:36:32,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:36:32,449 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:36:32,451 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69d0cd47691bac272b322fcc/log.txt.gz 2026-04-04 08:36:32,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:36:32,814 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:36:32,816 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69d0cd47691bac272b322fcc/lava-logs.yaml 2026-04-04 08:36:32,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:36:32,976 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:36:32,978 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69d0cd47691bac272b322fcc/lava_callback.json.gz 2026-04-04 08:36:32,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:36:33,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cd47691bac272b322fcc HTTP/1.1" 200 None 2026-04-04 08:36:33,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:36:33,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c922691bac272b322db3 HTTP/1.1" 200 None 2026-04-04 08:36:33,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:36:33,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cd47691bac272b322fcc HTTP/1.1" 200 None 2026-04-04 08:36:33,053 - lava_callback - INFO - Completed processing callback for node 69d0cd47691bac272b322fcc INFO: 172.21.0.1:54990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56680 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:36:51,890 - lava_callback - INFO - Received callback for node 69d0cd47691bac272b322fcf INFO: 172.21.0.1:60846 - "POST /node/69d0cd47691bac272b322fcf HTTP/1.0" 202 Accepted 2026-04-04 08:36:51,899 - lava_callback - INFO - Starting async job submit for node 69d0cd47691bac272b322fcf 2026-04-04 08:36:51,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:36:51,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cd47691bac272b322fcf HTTP/1.1" 200 None 2026-04-04 08:36:51,971 - lava_callback - DEBUG - Processing node 69d0cd47691bac272b322fcf: baseline-x86 2026-04-04 08:36:52,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:36:52,732 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:36:52,735 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69d0cd47691bac272b322fcf/log.txt.gz 2026-04-04 08:36:52,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:36:53,301 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:36:53,303 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69d0cd47691bac272b322fcf/lava-logs.yaml 2026-04-04 08:36:53,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:36:53,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:36:53,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-04 08:36:53,553 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:36:53,555 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69d0cd47691bac272b322fcf/lava_callback.json.gz 2026-04-04 08:36:53,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:36:53,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cd47691bac272b322fcf HTTP/1.1" 200 None 2026-04-04 08:36:53,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:36:53,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c922691bac272b322db3 HTTP/1.1" 200 None 2026-04-04 08:36:53,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:36:53,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cd47691bac272b322fcf HTTP/1.1" 200 None 2026-04-04 08:36:53,672 - lava_callback - INFO - Completed processing callback for node 69d0cd47691bac272b322fcf INFO: 172.21.0.1:60848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40360 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40364 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:37:18,031 - lava_callback - INFO - Received callback for node 69ce2ab2cb08ea23a1f68295 INFO: 172.21.0.1:40380 - "POST /node/69ce2ab2cb08ea23a1f68295 HTTP/1.0" 202 Accepted 2026-04-04 08:37:18,040 - lava_callback - INFO - Starting async job submit for node 69ce2ab2cb08ea23a1f68295 2026-04-04 08:37:18,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:37:18,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2ab2cb08ea23a1f68295 HTTP/1.1" 200 None 2026-04-04 08:37:18,068 - lava_callback - DEBUG - Processing node 69ce2ab2cb08ea23a1f68295: baseline-arm-baylibre 2026-04-04 08:37:18,068 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce2ab2cb08ea23a1f68295 2026-04-04 08:37:18,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:37:18,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2ab2cb08ea23a1f68295 HTTP/1.1" 200 None 2026-04-04 08:37:18,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:37:18,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-04 08:37:18,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:37:18,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2ab2cb08ea23a1f68295 HTTP/1.1" 200 None 2026-04-04 08:37:18,167 - lava_callback - ERROR - Error processing callback for node 69ce2ab2cb08ea23a1f68295: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-04 08:37:23,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:37:23,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57862 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:37:57,883 - lava_callback - INFO - Received callback for node 69ce2adccb08ea23a1f682b6 INFO: 172.21.0.1:57870 - "POST /node/69ce2adccb08ea23a1f682b6 HTTP/1.0" 202 Accepted 2026-04-04 08:37:57,890 - lava_callback - INFO - Starting async job submit for node 69ce2adccb08ea23a1f682b6 2026-04-04 08:37:57,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:37:57,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2adccb08ea23a1f682b6 HTTP/1.1" 200 None 2026-04-04 08:37:57,906 - lava_callback - DEBUG - Processing node 69ce2adccb08ea23a1f682b6: baseline-arm-baylibre 2026-04-04 08:37:57,906 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce2adccb08ea23a1f682b6 2026-04-04 08:37:57,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:37:57,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2adccb08ea23a1f682b6 HTTP/1.1" 200 None 2026-04-04 08:37:57,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:37:57,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-04 08:37:57,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:37:57,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2adccb08ea23a1f682b6 HTTP/1.1" 200 None 2026-04-04 08:37:57,966 - lava_callback - ERROR - Error processing callback for node 69ce2adccb08ea23a1f682b6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39264 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33854 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:38:38,007 - lava_callback - INFO - Received callback for node 69ce2b07cb08ea23a1f682c0 INFO: 172.21.0.1:33866 - "POST /node/69ce2b07cb08ea23a1f682c0 HTTP/1.0" 202 Accepted 2026-04-04 08:38:38,016 - lava_callback - INFO - Starting async job submit for node 69ce2b07cb08ea23a1f682c0 2026-04-04 08:38:38,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:38:38,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b07cb08ea23a1f682c0 HTTP/1.1" 200 None 2026-04-04 08:38:38,035 - lava_callback - DEBUG - Processing node 69ce2b07cb08ea23a1f682c0: baseline-arm-baylibre 2026-04-04 08:38:38,035 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce2b07cb08ea23a1f682c0 2026-04-04 08:38:38,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:38:38,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b07cb08ea23a1f682c0 HTTP/1.1" 200 None 2026-04-04 08:38:38,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:38:38,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-04 08:38:38,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:38:38,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b07cb08ea23a1f682c0 HTTP/1.1" 200 None 2026-04-04 08:38:38,101 - lava_callback - ERROR - Error processing callback for node 69ce2b07cb08ea23a1f682c0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-04 08:38:41,807 - lava_callback - INFO - Received callback for node 69d0cdf8691bac272b323032 INFO: 172.21.0.1:39364 - "POST /node/69d0cdf8691bac272b323032 HTTP/1.0" 202 Accepted 2026-04-04 08:38:41,813 - lava_callback - INFO - Starting async job submit for node 69d0cdf8691bac272b323032 2026-04-04 08:38:41,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:38:41,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cdf8691bac272b323032 HTTP/1.1" 200 None 2026-04-04 08:38:41,833 - lava_callback - DEBUG - Processing node 69d0cdf8691bac272b323032: baseline-arm 2026-04-04 08:38:41,839 - lava_callback - WARNING - Failed to upload log 2026-04-04 08:38:41,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:38:41,985 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:38:41,987 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d0cdf8691bac272b323032/lava-logs.yaml 2026-04-04 08:38:41,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:38:42,117 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:38:42,119 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d0cdf8691bac272b323032/lava_callback.json.gz 2026-04-04 08:38:42,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:38:42,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cdf8691bac272b323032 HTTP/1.1" 200 None 2026-04-04 08:38:42,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:38:42,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-04 08:38:42,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:38:42,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cdf8691bac272b323032 HTTP/1.1" 200 None 2026-04-04 08:38:42,196 - lava_callback - INFO - Completed processing callback for node 69d0cdf8691bac272b323032 INFO: 172.21.0.1:39374 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:38:53,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:38:53,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39470 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:38:57,960 - lava_callback - INFO - Received callback for node 69ce2b0ecb08ea23a1f682ec INFO: 172.21.0.1:39486 - "POST /node/69ce2b0ecb08ea23a1f682ec HTTP/1.0" 202 Accepted 2026-04-04 08:38:57,969 - lava_callback - INFO - Starting async job submit for node 69ce2b0ecb08ea23a1f682ec 2026-04-04 08:38:57,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:38:57,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b0ecb08ea23a1f682ec HTTP/1.1" 200 None 2026-04-04 08:38:57,994 - lava_callback - DEBUG - Processing node 69ce2b0ecb08ea23a1f682ec: baseline-arm-baylibre 2026-04-04 08:38:57,994 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce2b0ecb08ea23a1f682ec 2026-04-04 08:38:57,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:38:58,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b0ecb08ea23a1f682ec HTTP/1.1" 200 None 2026-04-04 08:38:58,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:38:58,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-04 08:38:58,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:38:58,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b0ecb08ea23a1f682ec HTTP/1.1" 200 None 2026-04-04 08:38:58,084 - lava_callback - ERROR - Error processing callback for node 69ce2b0ecb08ea23a1f682ec: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-04 08:38:58,611 - lava_callback - INFO - Received callback for node 69ce2b12cb08ea23a1f682ef INFO: 172.21.0.1:39488 - "POST /node/69ce2b12cb08ea23a1f682ef HTTP/1.0" 202 Accepted 2026-04-04 08:38:58,620 - lava_callback - INFO - Starting async job submit for node 69ce2b12cb08ea23a1f682ef 2026-04-04 08:38:58,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:38:58,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b12cb08ea23a1f682ef HTTP/1.1" 200 None 2026-04-04 08:38:58,643 - lava_callback - DEBUG - Processing node 69ce2b12cb08ea23a1f682ef: baseline-arm-baylibre 2026-04-04 08:38:58,643 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce2b12cb08ea23a1f682ef 2026-04-04 08:38:58,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:38:58,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b12cb08ea23a1f682ef HTTP/1.1" 200 None 2026-04-04 08:38:58,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:38:58,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-04 08:38:58,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:38:58,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b12cb08ea23a1f682ef HTTP/1.1" 200 None 2026-04-04 08:38:58,712 - lava_callback - ERROR - Error processing callback for node 69ce2b12cb08ea23a1f682ef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-04 08:38:59,286 - lava_callback - INFO - Received callback for node 69ce2b13cb08ea23a1f682f2 INFO: 172.21.0.1:39498 - "POST /node/69ce2b13cb08ea23a1f682f2 HTTP/1.0" 202 Accepted 2026-04-04 08:38:59,292 - lava_callback - INFO - Starting async job submit for node 69ce2b13cb08ea23a1f682f2 2026-04-04 08:38:59,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:38:59,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b13cb08ea23a1f682f2 HTTP/1.1" 200 None 2026-04-04 08:38:59,313 - lava_callback - DEBUG - Processing node 69ce2b13cb08ea23a1f682f2: baseline-arm-baylibre 2026-04-04 08:38:59,314 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce2b13cb08ea23a1f682f2 2026-04-04 08:38:59,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:38:59,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b13cb08ea23a1f682f2 HTTP/1.1" 200 None 2026-04-04 08:38:59,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:38:59,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-04 08:38:59,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:38:59,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b13cb08ea23a1f682f2 HTTP/1.1" 200 None 2026-04-04 08:38:59,398 - lava_callback - ERROR - Error processing callback for node 69ce2b13cb08ea23a1f682f2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-04 08:38:59,954 - lava_callback - INFO - Received callback for node 69ce2b16cb08ea23a1f682fd INFO: 172.21.0.1:46468 - "POST /node/69ce2b16cb08ea23a1f682fd HTTP/1.0" 202 Accepted 2026-04-04 08:38:59,959 - lava_callback - INFO - Starting async job submit for node 69ce2b16cb08ea23a1f682fd 2026-04-04 08:38:59,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:38:59,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b16cb08ea23a1f682fd HTTP/1.1" 200 None 2026-04-04 08:38:59,977 - lava_callback - DEBUG - Processing node 69ce2b16cb08ea23a1f682fd: baseline-arm-baylibre 2026-04-04 08:38:59,978 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce2b16cb08ea23a1f682fd 2026-04-04 08:38:59,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:38:59,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b16cb08ea23a1f682fd HTTP/1.1" 200 None 2026-04-04 08:38:59,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:00,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-04 08:39:00,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:00,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b16cb08ea23a1f682fd HTTP/1.1" 200 None 2026-04-04 08:39:00,047 - lava_callback - ERROR - Error processing callback for node 69ce2b16cb08ea23a1f682fd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-04 08:39:00,619 - lava_callback - INFO - Received callback for node 69ce2b18cb08ea23a1f68300 INFO: 172.21.0.1:46484 - "POST /node/69ce2b18cb08ea23a1f68300 HTTP/1.0" 202 Accepted 2026-04-04 08:39:00,629 - lava_callback - INFO - Starting async job submit for node 69ce2b18cb08ea23a1f68300 2026-04-04 08:39:00,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:00,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b18cb08ea23a1f68300 HTTP/1.1" 200 None 2026-04-04 08:39:00,662 - lava_callback - DEBUG - Processing node 69ce2b18cb08ea23a1f68300: baseline-arm-baylibre 2026-04-04 08:39:00,662 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce2b18cb08ea23a1f68300 2026-04-04 08:39:00,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:00,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b18cb08ea23a1f68300 HTTP/1.1" 200 None 2026-04-04 08:39:00,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:00,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-04 08:39:00,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:00,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b18cb08ea23a1f68300 HTTP/1.1" 200 None 2026-04-04 08:39:00,739 - lava_callback - ERROR - Error processing callback for node 69ce2b18cb08ea23a1f68300: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46488 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:39:06,760 - lava_callback - INFO - Received callback for node 69d0cdf9691bac272b323035 INFO: 172.21.0.1:46498 - "POST /node/69d0cdf9691bac272b323035 HTTP/1.0" 202 Accepted 2026-04-04 08:39:06,812 - lava_callback - INFO - Starting async job submit for node 69d0cdf9691bac272b323035 2026-04-04 08:39:06,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:06,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cdf9691bac272b323035 HTTP/1.1" 200 None 2026-04-04 08:39:06,853 - lava_callback - DEBUG - Processing node 69d0cdf9691bac272b323035: baseline-arm 2026-04-04 08:39:06,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:39:07,088 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:39:07,089 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d0cdf9691bac272b323035/log.txt.gz 2026-04-04 08:39:07,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:39:07,325 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:39:07,327 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d0cdf9691bac272b323035/lava-logs.yaml 2026-04-04 08:39:07,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:39:07,444 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:39:07,446 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d0cdf9691bac272b323035/lava_callback.json.gz 2026-04-04 08:39:07,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:07,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cdf9691bac272b323035 HTTP/1.1" 200 None 2026-04-04 08:39:07,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:07,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-04 08:39:07,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:07,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cdf9691bac272b323035 HTTP/1.1" 200 None 2026-04-04 08:39:07,535 - lava_callback - INFO - Completed processing callback for node 69d0cdf9691bac272b323035 INFO: 172.21.0.1:37538 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:39:14,006 - lava_callback - INFO - Received callback for node 69ce2b20cb08ea23a1f68318 INFO: 172.21.0.1:37552 - "POST /node/69ce2b20cb08ea23a1f68318 HTTP/1.0" 202 Accepted 2026-04-04 08:39:14,011 - lava_callback - INFO - Starting async job submit for node 69ce2b20cb08ea23a1f68318 2026-04-04 08:39:14,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:14,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b20cb08ea23a1f68318 HTTP/1.1" 200 None 2026-04-04 08:39:14,033 - lava_callback - DEBUG - Processing node 69ce2b20cb08ea23a1f68318: baseline-arm-clabbe 2026-04-04 08:39:14,033 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce2b20cb08ea23a1f68318 2026-04-04 08:39:14,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:14,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b20cb08ea23a1f68318 HTTP/1.1" 200 None 2026-04-04 08:39:14,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:14,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-04 08:39:14,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:14,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b20cb08ea23a1f68318 HTTP/1.1" 200 None 2026-04-04 08:39:14,097 - lava_callback - ERROR - Error processing callback for node 69ce2b20cb08ea23a1f68318: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-04 08:39:14,657 - lava_callback - INFO - Received callback for node 69ce2b22cb08ea23a1f6831e INFO: 172.21.0.1:37554 - "POST /node/69ce2b22cb08ea23a1f6831e HTTP/1.0" 202 Accepted 2026-04-04 08:39:14,663 - lava_callback - INFO - Starting async job submit for node 69ce2b22cb08ea23a1f6831e 2026-04-04 08:39:14,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:14,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b22cb08ea23a1f6831e HTTP/1.1" 200 None 2026-04-04 08:39:14,681 - lava_callback - DEBUG - Processing node 69ce2b22cb08ea23a1f6831e: baseline-arm-clabbe 2026-04-04 08:39:14,681 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce2b22cb08ea23a1f6831e 2026-04-04 08:39:14,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:14,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b22cb08ea23a1f6831e HTTP/1.1" 200 None 2026-04-04 08:39:14,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:14,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-04 08:39:14,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:14,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b22cb08ea23a1f6831e HTTP/1.1" 200 None 2026-04-04 08:39:14,743 - lava_callback - ERROR - Error processing callback for node 69ce2b22cb08ea23a1f6831e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37570 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-04 08:39:15,347 - lava_callback - INFO - Received callback for node 69ce2b24cb08ea23a1f68325 INFO: 172.21.0.1:37584 - "POST /node/69ce2b24cb08ea23a1f68325 HTTP/1.0" 202 Accepted 2026-04-04 08:39:15,355 - lava_callback - INFO - Starting async job submit for node 69ce2b24cb08ea23a1f68325 2026-04-04 08:39:15,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:15,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b24cb08ea23a1f68325 HTTP/1.1" 200 None 2026-04-04 08:39:15,379 - lava_callback - DEBUG - Processing node 69ce2b24cb08ea23a1f68325: baseline-arm-clabbe 2026-04-04 08:39:15,380 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce2b24cb08ea23a1f68325 2026-04-04 08:39:15,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:15,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b24cb08ea23a1f68325 HTTP/1.1" 200 None 2026-04-04 08:39:15,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:15,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-04 08:39:15,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:15,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b24cb08ea23a1f68325 HTTP/1.1" 200 None 2026-04-04 08:39:15,441 - lava_callback - ERROR - Error processing callback for node 69ce2b24cb08ea23a1f68325: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-04 08:39:16,022 - lava_callback - INFO - Received callback for node 69ce2b25cb08ea23a1f68328 INFO: 172.21.0.1:37590 - "POST /node/69ce2b25cb08ea23a1f68328 HTTP/1.0" 202 Accepted 2026-04-04 08:39:16,028 - lava_callback - INFO - Starting async job submit for node 69ce2b25cb08ea23a1f68328 2026-04-04 08:39:16,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:16,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b25cb08ea23a1f68328 HTTP/1.1" 200 None 2026-04-04 08:39:16,048 - lava_callback - DEBUG - Processing node 69ce2b25cb08ea23a1f68328: baseline-arm-clabbe 2026-04-04 08:39:16,049 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce2b25cb08ea23a1f68328 2026-04-04 08:39:16,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:16,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b25cb08ea23a1f68328 HTTP/1.1" 200 None 2026-04-04 08:39:16,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:16,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-04 08:39:16,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:16,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b25cb08ea23a1f68328 HTTP/1.1" 200 None 2026-04-04 08:39:16,120 - lava_callback - ERROR - Error processing callback for node 69ce2b25cb08ea23a1f68328: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37592 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:39:16,669 - lava_callback - INFO - Received callback for node 69ce2b26cb08ea23a1f6832b INFO: 172.21.0.1:37606 - "POST /node/69ce2b26cb08ea23a1f6832b HTTP/1.0" 202 Accepted 2026-04-04 08:39:16,675 - lava_callback - INFO - Starting async job submit for node 69ce2b26cb08ea23a1f6832b 2026-04-04 08:39:16,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:16,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b26cb08ea23a1f6832b HTTP/1.1" 200 None 2026-04-04 08:39:16,697 - lava_callback - DEBUG - Processing node 69ce2b26cb08ea23a1f6832b: baseline-arm-clabbe 2026-04-04 08:39:16,697 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce2b26cb08ea23a1f6832b 2026-04-04 08:39:16,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:16,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b26cb08ea23a1f6832b HTTP/1.1" 200 None 2026-04-04 08:39:16,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:16,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-04 08:39:16,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:16,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b26cb08ea23a1f6832b HTTP/1.1" 200 None 2026-04-04 08:39:16,769 - lava_callback - ERROR - Error processing callback for node 69ce2b26cb08ea23a1f6832b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-04 08:39:16,992 - lava_callback - INFO - Received callback for node 69d0cdfc691bac272b323049 INFO: 172.21.0.1:37622 - "POST /node/69d0cdfc691bac272b323049 HTTP/1.0" 202 Accepted 2026-04-04 08:39:17,040 - lava_callback - INFO - Starting async job submit for node 69d0cdfc691bac272b323049 2026-04-04 08:39:17,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:17,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cdfc691bac272b323049 HTTP/1.1" 200 None 2026-04-04 08:39:17,100 - lava_callback - DEBUG - Processing node 69d0cdfc691bac272b323049: baseline-arm 2026-04-04 08:39:17,328 - lava_callback - INFO - Received callback for node 69ce2b28cb08ea23a1f68334 2026-04-04 08:39:17,339 - lava_callback - INFO - Starting async job submit for node 69ce2b28cb08ea23a1f68334 INFO: 172.21.0.1:37636 - "POST /node/69ce2b28cb08ea23a1f68334 HTTP/1.0" 202 Accepted 2026-04-04 08:39:17,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:17,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:39:17,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b28cb08ea23a1f68334 HTTP/1.1" 200 None 2026-04-04 08:39:17,366 - lava_callback - DEBUG - Processing node 69ce2b28cb08ea23a1f68334: baseline-arm-clabbe 2026-04-04 08:39:17,366 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce2b28cb08ea23a1f68334 2026-04-04 08:39:17,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:17,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b28cb08ea23a1f68334 HTTP/1.1" 200 None 2026-04-04 08:39:17,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:17,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-04 08:39:17,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:17,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b28cb08ea23a1f68334 HTTP/1.1" 200 None 2026-04-04 08:39:17,431 - lava_callback - ERROR - Error processing callback for node 69ce2b28cb08ea23a1f68334: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-04 08:39:17,586 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:39:17,589 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d0cdfc691bac272b323049/log.txt.gz 2026-04-04 08:39:17,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:39:17,945 - lava_callback - INFO - Received callback for node 69ce2b31cb08ea23a1f68376 INFO: 172.21.0.1:37638 - "POST /node/69ce2b31cb08ea23a1f68376 HTTP/1.0" 202 Accepted 2026-04-04 08:39:17,952 - lava_callback - INFO - Starting async job submit for node 69ce2b31cb08ea23a1f68376 2026-04-04 08:39:17,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:17,959 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:39:17,961 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d0cdfc691bac272b323049/lava-logs.yaml 2026-04-04 08:39:17,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:39:17,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b31cb08ea23a1f68376 HTTP/1.1" 200 None 2026-04-04 08:39:17,984 - lava_callback - DEBUG - Processing node 69ce2b31cb08ea23a1f68376: baseline-arm-baylibre 2026-04-04 08:39:17,984 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce2b31cb08ea23a1f68376 2026-04-04 08:39:17,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:18,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b31cb08ea23a1f68376 HTTP/1.1" 200 None 2026-04-04 08:39:18,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:18,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-04 08:39:18,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:18,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b31cb08ea23a1f68376 HTTP/1.1" 200 None 2026-04-04 08:39:18,072 - lava_callback - ERROR - Error processing callback for node 69ce2b31cb08ea23a1f68376: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-04 08:39:18,157 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:39:18,159 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d0cdfc691bac272b323049/lava_callback.json.gz 2026-04-04 08:39:18,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:18,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cdfc691bac272b323049 HTTP/1.1" 200 None 2026-04-04 08:39:18,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:18,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-04 08:39:18,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:18,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cdfc691bac272b323049 HTTP/1.1" 200 None 2026-04-04 08:39:18,274 - lava_callback - INFO - Completed processing callback for node 69d0cdfc691bac272b323049 2026-04-04 08:39:23,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:23,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60226 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:39:33,447 - lava_callback - INFO - Received callback for node 69d0cdf8691bac272b32302f INFO: 172.21.0.1:39384 - "POST /node/69d0cdf8691bac272b32302f HTTP/1.0" 202 Accepted 2026-04-04 08:39:33,453 - lava_callback - INFO - Starting async job submit for node 69d0cdf8691bac272b32302f 2026-04-04 08:39:33,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:33,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cdf8691bac272b32302f HTTP/1.1" 200 None 2026-04-04 08:39:33,497 - lava_callback - DEBUG - Processing node 69d0cdf8691bac272b32302f: baseline-arm 2026-04-04 08:39:33,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:39:33,864 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:39:33,866 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d0cdf8691bac272b32302f/log.txt.gz 2026-04-04 08:39:33,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:39:34,169 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:39:34,171 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d0cdf8691bac272b32302f/lava-logs.yaml 2026-04-04 08:39:34,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:39:34,306 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:39:34,307 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d0cdf8691bac272b32302f/lava_callback.json.gz 2026-04-04 08:39:34,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:34,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cdf8691bac272b32302f HTTP/1.1" 200 None 2026-04-04 08:39:34,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:34,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-04 08:39:34,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:34,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cdf8691bac272b32302f HTTP/1.1" 200 None 2026-04-04 08:39:34,396 - lava_callback - INFO - Completed processing callback for node 69d0cdf8691bac272b32302f INFO: 172.21.0.1:39394 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:39:44,939 - lava_callback - INFO - Received callback for node 69d0cdfb691bac272b323046 INFO: 172.21.0.1:38812 - "POST /node/69d0cdfb691bac272b323046 HTTP/1.0" 202 Accepted 2026-04-04 08:39:44,945 - lava_callback - INFO - Starting async job submit for node 69d0cdfb691bac272b323046 2026-04-04 08:39:44,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:44,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cdfb691bac272b323046 HTTP/1.1" 200 None 2026-04-04 08:39:44,986 - lava_callback - DEBUG - Processing node 69d0cdfb691bac272b323046: baseline-arm 2026-04-04 08:39:45,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:39:45,384 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:39:45,386 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d0cdfb691bac272b323046/log.txt.gz 2026-04-04 08:39:45,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:39:45,753 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:39:45,756 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d0cdfb691bac272b323046/lava-logs.yaml 2026-04-04 08:39:45,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:39:45,945 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:39:45,948 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d0cdfb691bac272b323046/lava_callback.json.gz 2026-04-04 08:39:45,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:45,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cdfb691bac272b323046 HTTP/1.1" 200 None 2026-04-04 08:39:45,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:46,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-04 08:39:46,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:46,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cdfb691bac272b323046 HTTP/1.1" 200 None 2026-04-04 08:39:46,052 - lava_callback - INFO - Completed processing callback for node 69d0cdfb691bac272b323046 INFO: 172.21.0.1:38828 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:39:50,064 - lava_callback - INFO - Received callback for node 69d0ce1a691bac272b3230c3 INFO: 172.21.0.1:47464 - "POST /node/69d0ce1a691bac272b3230c3 HTTP/1.0" 202 Accepted 2026-04-04 08:39:50,072 - lava_callback - INFO - Starting async job submit for node 69d0ce1a691bac272b3230c3 2026-04-04 08:39:50,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:50,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ce1a691bac272b3230c3 HTTP/1.1" 200 None 2026-04-04 08:39:50,119 - lava_callback - DEBUG - Processing node 69d0ce1a691bac272b3230c3: baseline-arm-pengutronix 2026-04-04 08:39:50,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:39:50,439 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:39:50,441 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d0ce1a691bac272b3230c3/log.txt.gz 2026-04-04 08:39:50,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:39:50,749 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:39:50,751 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d0ce1a691bac272b3230c3/lava-logs.yaml 2026-04-04 08:39:50,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:39:50,913 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:39:50,915 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d0ce1a691bac272b3230c3/lava_callback.json.gz 2026-04-04 08:39:50,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:50,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ce1a691bac272b3230c3 HTTP/1.1" 200 None 2026-04-04 08:39:50,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:50,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-04 08:39:50,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:50,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0ce1a691bac272b3230c3 HTTP/1.1" 200 None 2026-04-04 08:39:51,001 - lava_callback - INFO - Completed processing callback for node 69d0ce1a691bac272b3230c3 2026-04-04 08:39:53,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:53,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-04 08:39:54,897 - lava_callback - INFO - Received callback for node 69d0ce08691bac272b323063 INFO: 172.21.0.1:47474 - "POST /node/69d0ce08691bac272b323063 HTTP/1.0" 202 Accepted 2026-04-04 08:39:54,904 - lava_callback - INFO - Starting async job submit for node 69d0ce08691bac272b323063 2026-04-04 08:39:54,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:54,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ce08691bac272b323063 HTTP/1.1" 200 None 2026-04-04 08:39:54,943 - lava_callback - DEBUG - Processing node 69d0ce08691bac272b323063: baseline-arm-broonie 2026-04-04 08:39:55,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:39:55,278 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:39:55,280 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d0ce08691bac272b323063/log.txt.gz 2026-04-04 08:39:55,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:39:55,590 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:39:55,592 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d0ce08691bac272b323063/lava-logs.yaml 2026-04-04 08:39:55,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:39:55,739 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:39:55,741 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d0ce08691bac272b323063/lava_callback.json.gz 2026-04-04 08:39:55,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:55,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ce08691bac272b323063 HTTP/1.1" 200 None 2026-04-04 08:39:55,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:55,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-04 08:39:55,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:55,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0ce08691bac272b323063 HTTP/1.1" 200 None 2026-04-04 08:39:55,850 - lava_callback - INFO - Completed processing callback for node 69d0ce08691bac272b323063 2026-04-04 08:39:56,391 - lava_callback - INFO - Received callback for node 69d0ce09691bac272b323066 INFO: 172.21.0.1:47486 - "POST /node/69d0ce09691bac272b323066 HTTP/1.0" 202 Accepted 2026-04-04 08:39:56,400 - lava_callback - INFO - Starting async job submit for node 69d0ce09691bac272b323066 2026-04-04 08:39:56,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:56,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ce09691bac272b323066 HTTP/1.1" 200 None 2026-04-04 08:39:56,449 - lava_callback - DEBUG - Processing node 69d0ce09691bac272b323066: baseline-arm-broonie INFO: 172.21.0.1:47498 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:39:56,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:39:56,859 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:39:56,861 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d0ce09691bac272b323066/log.txt.gz 2026-04-04 08:39:57,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:39:57,204 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:39:57,206 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d0ce09691bac272b323066/lava-logs.yaml 2026-04-04 08:39:57,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:39:57,381 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:39:57,383 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d0ce09691bac272b323066/lava_callback.json.gz 2026-04-04 08:39:57,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:57,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ce09691bac272b323066 HTTP/1.1" 200 None 2026-04-04 08:39:57,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:57,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-04 08:39:57,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:57,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0ce09691bac272b323066 HTTP/1.1" 200 None 2026-04-04 08:39:57,488 - lava_callback - INFO - Completed processing callback for node 69d0ce09691bac272b323066 2026-04-04 08:39:58,051 - lava_callback - INFO - Received callback for node 69ce2b5ccb08ea23a1f683bc INFO: 172.21.0.1:47514 - "POST /node/69ce2b5ccb08ea23a1f683bc HTTP/1.0" 202 Accepted 2026-04-04 08:39:58,060 - lava_callback - INFO - Starting async job submit for node 69ce2b5ccb08ea23a1f683bc 2026-04-04 08:39:58,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:58,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b5ccb08ea23a1f683bc HTTP/1.1" 200 None 2026-04-04 08:39:58,080 - lava_callback - DEBUG - Processing node 69ce2b5ccb08ea23a1f683bc: baseline-arm-baylibre 2026-04-04 08:39:58,080 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce2b5ccb08ea23a1f683bc 2026-04-04 08:39:58,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:58,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b5ccb08ea23a1f683bc HTTP/1.1" 200 None 2026-04-04 08:39:58,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:58,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-04 08:39:58,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:39:58,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b5ccb08ea23a1f683bc HTTP/1.1" 200 None 2026-04-04 08:39:58,150 - lava_callback - ERROR - Error processing callback for node 69ce2b5ccb08ea23a1f683bc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-04 08:40:01,107 - lava_callback - INFO - Received callback for node 69d0ce1e691bac272b3230cd INFO: 172.21.0.1:48812 - "POST /node/69d0ce1e691bac272b3230cd HTTP/1.0" 202 Accepted 2026-04-04 08:40:01,154 - lava_callback - INFO - Starting async job submit for node 69d0ce1e691bac272b3230cd 2026-04-04 08:40:01,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:40:01,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ce1e691bac272b3230cd HTTP/1.1" 200 None 2026-04-04 08:40:01,203 - lava_callback - DEBUG - Processing node 69d0ce1e691bac272b3230cd: baseline-arm-pengutronix 2026-04-04 08:40:01,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:40:01,568 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:40:01,570 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d0ce1e691bac272b3230cd/log.txt.gz 2026-04-04 08:40:01,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:40:01,924 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:40:01,926 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d0ce1e691bac272b3230cd/lava-logs.yaml 2026-04-04 08:40:01,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:40:02,059 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:40:02,061 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d0ce1e691bac272b3230cd/lava_callback.json.gz 2026-04-04 08:40:02,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:40:02,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ce1e691bac272b3230cd HTTP/1.1" 200 None 2026-04-04 08:40:02,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:40:02,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-04 08:40:02,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:40:02,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0ce1e691bac272b3230cd HTTP/1.1" 200 None 2026-04-04 08:40:02,177 - lava_callback - INFO - Completed processing callback for node 69d0ce1e691bac272b3230cd INFO: 172.21.0.1:48822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34090 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34100 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:40:17,339 - lava_callback - INFO - Received callback for node 69d0ce0f691bac272b32307f INFO: 172.21.0.1:34112 - "POST /node/69d0ce0f691bac272b32307f HTTP/1.0" 202 Accepted 2026-04-04 08:40:17,349 - lava_callback - INFO - Starting async job submit for node 69d0ce0f691bac272b32307f 2026-04-04 08:40:17,377 - lava_callback - INFO - Received callback for node 69d0ce16691bac272b323096 INFO: 172.21.0.1:34114 - "POST /node/69d0ce16691bac272b323096 HTTP/1.0" 202 Accepted 2026-04-04 08:40:17,408 - lava_callback - INFO - Starting async job submit for node 69d0ce16691bac272b323096 2026-04-04 08:40:17,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:40:17,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:40:17,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ce0f691bac272b32307f HTTP/1.1" 200 None 2026-04-04 08:40:17,495 - lava_callback - DEBUG - Processing node 69d0ce0f691bac272b32307f: baseline-arm-clabbe 2026-04-04 08:40:17,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ce16691bac272b323096 HTTP/1.1" 200 None 2026-04-04 08:40:17,528 - lava_callback - DEBUG - Processing node 69d0ce16691bac272b323096: baseline-arm-kontron 2026-04-04 08:40:18,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:40:18,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:40:18,402 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:40:18,404 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69d0ce0f691bac272b32307f/log.txt.gz 2026-04-04 08:40:18,417 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:40:18,419 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69d0ce16691bac272b323096/log.txt.gz 2026-04-04 08:40:18,699 - lava_callback - INFO - Received callback for node 69d0ce18691bac272b323099 2026-04-04 08:40:18,728 - lava_callback - INFO - Starting async job submit for node 69d0ce18691bac272b323099 INFO: 172.21.0.1:34122 - "POST /node/69d0ce18691bac272b323099 HTTP/1.0" 202 Accepted 2026-04-04 08:40:18,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:40:18,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:40:18,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:40:18,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ce18691bac272b323099 HTTP/1.1" 200 None 2026-04-04 08:40:18,928 - lava_callback - DEBUG - Processing node 69d0ce18691bac272b323099: baseline-arm-kontron 2026-04-04 08:40:19,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:40:19,327 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:40:19,329 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69d0ce16691bac272b323096/lava-logs.yaml 2026-04-04 08:40:19,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:40:19,338 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:40:19,341 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69d0ce0f691bac272b32307f/lava-logs.yaml 2026-04-04 08:40:19,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:40:19,410 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:40:19,412 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69d0ce18691bac272b323099/log.txt.gz 2026-04-04 08:40:19,527 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:40:19,529 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69d0ce0f691bac272b32307f/lava_callback.json.gz 2026-04-04 08:40:19,539 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:40:19,541 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69d0ce16691bac272b323096/lava_callback.json.gz 2026-04-04 08:40:19,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:40:19,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:40:19,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ce16691bac272b323096 HTTP/1.1" 200 None 2026-04-04 08:40:19,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:40:19,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:40:19,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-04 08:40:19,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:40:19,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ce0f691bac272b32307f HTTP/1.1" 200 None 2026-04-04 08:40:19,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:40:19,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-04 08:40:19,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:40:19,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0ce16691bac272b323096 HTTP/1.1" 200 None 2026-04-04 08:40:19,805 - lava_callback - INFO - Completed processing callback for node 69d0ce16691bac272b323096 2026-04-04 08:40:19,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0ce0f691bac272b32307f HTTP/1.1" 200 None 2026-04-04 08:40:19,893 - lava_callback - INFO - Completed processing callback for node 69d0ce0f691bac272b32307f 2026-04-04 08:40:20,317 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:40:20,319 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69d0ce18691bac272b323099/lava-logs.yaml 2026-04-04 08:40:20,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:40:20,492 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:40:20,494 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69d0ce18691bac272b323099/lava_callback.json.gz 2026-04-04 08:40:20,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:40:20,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ce18691bac272b323099 HTTP/1.1" 200 None 2026-04-04 08:40:20,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:40:20,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-04 08:40:20,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:40:20,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0ce18691bac272b323099 HTTP/1.1" 200 None 2026-04-04 08:40:20,640 - lava_callback - INFO - Completed processing callback for node 69d0ce18691bac272b323099 2026-04-04 08:40:23,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:40:23,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:59514 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:40:35,648 - lava_callback - INFO - Received callback for node 69d0ce06691bac272b323060 INFO: 172.21.0.1:59846 - "POST /node/69d0ce06691bac272b323060 HTTP/1.0" 202 Accepted 2026-04-04 08:40:35,658 - lava_callback - INFO - Starting async job submit for node 69d0ce06691bac272b323060 2026-04-04 08:40:35,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:40:35,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ce06691bac272b323060 HTTP/1.1" 200 None 2026-04-04 08:40:35,742 - lava_callback - DEBUG - Processing node 69d0ce06691bac272b323060: baseline-arm-broonie 2026-04-04 08:40:36,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:40:36,208 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:40:36,210 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d0ce06691bac272b323060/log.txt.gz 2026-04-04 08:40:36,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:59858 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:40:36,892 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:40:36,895 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d0ce06691bac272b323060/lava-logs.yaml 2026-04-04 08:40:36,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:40:37,038 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:40:37,040 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d0ce06691bac272b323060/lava_callback.json.gz 2026-04-04 08:40:37,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:40:37,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ce06691bac272b323060 HTTP/1.1" 200 None 2026-04-04 08:40:37,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:40:37,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-04 08:40:37,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:40:37,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0ce06691bac272b323060 HTTP/1.1" 200 None 2026-04-04 08:40:37,181 - lava_callback - INFO - Completed processing callback for node 69d0ce06691bac272b323060 INFO: 172.21.0.1:33320 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:40:52,999 - lava_callback - INFO - Received callback for node 69d0ce1b691bac272b3230c6 INFO: 172.21.0.1:59466 - "POST /node/69d0ce1b691bac272b3230c6 HTTP/1.0" 202 Accepted 2026-04-04 08:40:53,011 - lava_callback - INFO - Starting async job submit for node 69d0ce1b691bac272b3230c6 2026-04-04 08:40:53,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:40:53,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ce1b691bac272b3230c6 HTTP/1.1" 200 None 2026-04-04 08:40:53,076 - lava_callback - DEBUG - Processing node 69d0ce1b691bac272b3230c6: baseline-arm-pengutronix 2026-04-04 08:40:53,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:40:53,455 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:40:53,457 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d0ce1b691bac272b3230c6/log.txt.gz 2026-04-04 08:40:53,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:40:53,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-04 08:40:53,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:40:54,032 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:40:54,035 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d0ce1b691bac272b3230c6/lava-logs.yaml 2026-04-04 08:40:54,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:40:54,221 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:40:54,223 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d0ce1b691bac272b3230c6/lava_callback.json.gz 2026-04-04 08:40:54,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:40:54,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ce1b691bac272b3230c6 HTTP/1.1" 200 None 2026-04-04 08:40:54,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:40:54,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-04 08:40:54,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:40:54,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0ce1b691bac272b3230c6 HTTP/1.1" 200 None 2026-04-04 08:40:54,470 - lava_callback - INFO - Completed processing callback for node 69d0ce1b691bac272b3230c6 INFO: 172.21.0.1:59468 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:41:01,334 - lava_callback - INFO - Received callback for node 69d0ce35691bac272b3230f9 INFO: 172.21.0.1:39178 - "POST /node/69d0ce35691bac272b3230f9 HTTP/1.0" 202 Accepted 2026-04-04 08:41:01,345 - lava_callback - INFO - Starting async job submit for node 69d0ce35691bac272b3230f9 2026-04-04 08:41:01,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:41:01,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ce35691bac272b3230f9 HTTP/1.1" 200 None 2026-04-04 08:41:01,425 - lava_callback - DEBUG - Processing node 69d0ce35691bac272b3230f9: ltp-dio 2026-04-04 08:41:02,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:41:02,607 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:41:02,609 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-69d0ce35691bac272b3230f9/log.txt.gz 2026-04-04 08:41:02,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:41:03,534 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:41:03,537 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-69d0ce35691bac272b3230f9/lava-logs.yaml 2026-04-04 08:41:03,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:41:03,818 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:41:03,820 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-69d0ce35691bac272b3230f9/lava_callback.json.gz 2026-04-04 08:41:03,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:41:03,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ce35691bac272b3230f9 HTTP/1.1" 200 None 2026-04-04 08:41:03,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:41:03,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-04 08:41:03,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:41:03,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0ce35691bac272b3230f9 HTTP/1.1" 200 None 2026-04-04 08:41:03,928 - lava_callback - INFO - Completed processing callback for node 69d0ce35691bac272b3230f9 INFO: 172.21.0.1:39192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59564 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59576 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:41:23,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:41:23,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57916 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:41:38,106 - lava_callback - INFO - Received callback for node 69ce2bb8cb08ea23a1f68420 INFO: 172.21.0.1:57932 - "POST /node/69ce2bb8cb08ea23a1f68420 HTTP/1.0" 202 Accepted 2026-04-04 08:41:38,115 - lava_callback - INFO - Starting async job submit for node 69ce2bb8cb08ea23a1f68420 2026-04-04 08:41:38,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:41:38,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2bb8cb08ea23a1f68420 HTTP/1.1" 200 None 2026-04-04 08:41:38,137 - lava_callback - DEBUG - Processing node 69ce2bb8cb08ea23a1f68420: baseline-arm-baylibre 2026-04-04 08:41:38,137 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce2bb8cb08ea23a1f68420 2026-04-04 08:41:38,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:41:38,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2bb8cb08ea23a1f68420 HTTP/1.1" 200 None 2026-04-04 08:41:38,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:41:38,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-04 08:41:38,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:41:38,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2bb8cb08ea23a1f68420 HTTP/1.1" 200 None 2026-04-04 08:41:38,201 - lava_callback - ERROR - Error processing callback for node 69ce2bb8cb08ea23a1f68420: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46622 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:41:56,241 - lava_callback - INFO - Received callback for node 69d0ce13691bac272b32308d INFO: 172.21.0.1:49408 - "POST /node/69d0ce13691bac272b32308d HTTP/1.0" 202 Accepted 2026-04-04 08:41:56,252 - lava_callback - INFO - Starting async job submit for node 69d0ce13691bac272b32308d 2026-04-04 08:41:56,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:41:56,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ce13691bac272b32308d HTTP/1.1" 200 None 2026-04-04 08:41:56,326 - lava_callback - DEBUG - Processing node 69d0ce13691bac272b32308d: baseline-arm-clabbe INFO: 172.21.0.1:49412 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:41:56,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:41:57,039 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:41:57,041 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69d0ce13691bac272b32308d/log.txt.gz 2026-04-04 08:41:57,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:41:57,839 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:41:57,841 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69d0ce13691bac272b32308d/lava-logs.yaml 2026-04-04 08:41:57,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:41:58,058 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:41:58,060 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69d0ce13691bac272b32308d/lava_callback.json.gz 2026-04-04 08:41:58,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:41:58,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ce13691bac272b32308d HTTP/1.1" 200 None 2026-04-04 08:41:58,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:41:58,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-04 08:41:58,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:41:58,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0ce13691bac272b32308d HTTP/1.1" 200 None 2026-04-04 08:41:58,164 - lava_callback - INFO - Completed processing callback for node 69d0ce13691bac272b32308d INFO: 172.21.0.1:42810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42044 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:42:23,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:42:23,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35108 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:42:34,201 - lava_callback - INFO - Received callback for node 69ce2be7cb08ea23a1f68450 INFO: 172.21.0.1:47836 - "POST /node/69ce2be7cb08ea23a1f68450 HTTP/1.0" 202 Accepted 2026-04-04 08:42:34,214 - lava_callback - INFO - Starting async job submit for node 69ce2be7cb08ea23a1f68450 2026-04-04 08:42:34,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:42:34,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2be7cb08ea23a1f68450 HTTP/1.1" 200 None 2026-04-04 08:42:34,243 - lava_callback - DEBUG - Processing node 69ce2be7cb08ea23a1f68450: baseline-arm-clabbe 2026-04-04 08:42:34,243 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce2be7cb08ea23a1f68450 2026-04-04 08:42:34,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:42:34,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2be7cb08ea23a1f68450 HTTP/1.1" 200 None 2026-04-04 08:42:34,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:42:34,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-04 08:42:34,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:42:34,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2be7cb08ea23a1f68450 HTTP/1.1" 200 None 2026-04-04 08:42:34,318 - lava_callback - ERROR - Error processing callback for node 69ce2be7cb08ea23a1f68450: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45702 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:42:56,491 - lava_callback - INFO - Received callback for node 69d0ce3d691bac272b32313d INFO: 172.21.0.1:53480 - "POST /node/69d0ce3d691bac272b32313d HTTP/1.0" 202 Accepted 2026-04-04 08:42:56,507 - lava_callback - INFO - Starting async job submit for node 69d0ce3d691bac272b32313d INFO: 172.21.0.1:53486 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:42:56,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:42:56,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ce3d691bac272b32313d HTTP/1.1" 200 None 2026-04-04 08:42:56,594 - lava_callback - DEBUG - Processing node 69d0ce3d691bac272b32313d: ltp-syscalls 2026-04-04 08:42:57,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:42:58,393 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:42:58,395 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-69d0ce3d691bac272b32313d/log.txt.gz 2026-04-04 08:42:59,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:43:00,168 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:43:00,171 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-69d0ce3d691bac272b32313d/lava-logs.yaml 2026-04-04 08:43:00,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:43:00,991 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:43:00,993 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-69d0ce3d691bac272b32313d/lava_callback.json.gz 2026-04-04 08:43:01,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:43:01,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ce3d691bac272b32313d HTTP/1.1" 200 None 2026-04-04 08:43:01,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:43:01,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-04 08:43:01,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:43:01,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0ce3d691bac272b32313d HTTP/1.1" 200 None 2026-04-04 08:43:01,154 - lava_callback - INFO - Completed processing callback for node 69d0ce3d691bac272b32313d INFO: 172.21.0.1:60800 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:43:09,034 - lava_callback - INFO - Received callback for node 69d0cf05691bac272b323284 INFO: 172.21.0.1:60816 - "POST /node/69d0cf05691bac272b323284 HTTP/1.0" 202 Accepted 2026-04-04 08:43:09,046 - lava_callback - INFO - Starting async job submit for node 69d0cf05691bac272b323284 2026-04-04 08:43:09,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:43:09,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cf05691bac272b323284 HTTP/1.1" 200 None 2026-04-04 08:43:09,090 - lava_callback - DEBUG - Processing node 69d0cf05691bac272b323284: baseline-arm 2026-04-04 08:43:09,099 - lava_callback - WARNING - Failed to upload log 2026-04-04 08:43:09,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:43:09,460 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:43:09,463 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d0cf05691bac272b323284/lava-logs.yaml 2026-04-04 08:43:09,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:43:09,740 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:43:09,742 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d0cf05691bac272b323284/lava_callback.json.gz 2026-04-04 08:43:09,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:43:09,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cf05691bac272b323284 HTTP/1.1" 200 None 2026-04-04 08:43:09,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:43:09,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-04 08:43:09,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:43:09,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cf05691bac272b323284 HTTP/1.1" 200 None 2026-04-04 08:43:09,852 - lava_callback - INFO - Completed processing callback for node 69d0cf05691bac272b323284 INFO: 172.21.0.1:56370 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:43:14,270 - lava_callback - INFO - Received callback for node 69ce2c13cb08ea23a1f68485 INFO: 172.21.0.1:56384 - "POST /node/69ce2c13cb08ea23a1f68485 HTTP/1.0" 202 Accepted 2026-04-04 08:43:14,280 - lava_callback - INFO - Starting async job submit for node 69ce2c13cb08ea23a1f68485 2026-04-04 08:43:14,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:43:14,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2c13cb08ea23a1f68485 HTTP/1.1" 200 None 2026-04-04 08:43:14,311 - lava_callback - DEBUG - Processing node 69ce2c13cb08ea23a1f68485: baseline-arm-clabbe 2026-04-04 08:43:14,312 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce2c13cb08ea23a1f68485 2026-04-04 08:43:14,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:43:14,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2c13cb08ea23a1f68485 HTTP/1.1" 200 None 2026-04-04 08:43:14,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:43:14,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-04 08:43:14,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:43:14,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2c13cb08ea23a1f68485 HTTP/1.1" 200 None 2026-04-04 08:43:14,416 - lava_callback - ERROR - Error processing callback for node 69ce2c13cb08ea23a1f68485: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56392 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-04 08:43:16,011 - lava_callback - INFO - Received callback for node 69d0ce2f691bac272b3230e5 INFO: 172.21.0.1:56406 - "POST /node/69d0ce2f691bac272b3230e5 HTTP/1.0" 202 Accepted 2026-04-04 08:43:16,022 - lava_callback - INFO - Starting async job submit for node 69d0ce2f691bac272b3230e5 2026-04-04 08:43:16,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:43:16,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ce2f691bac272b3230e5 HTTP/1.1" 200 None 2026-04-04 08:43:16,110 - lava_callback - DEBUG - Processing node 69d0ce2f691bac272b3230e5: ltp-containers INFO: 172.21.0.1:56416 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:43:16,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:43:17,076 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:43:17,079 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-containers-69d0ce2f691bac272b3230e5/log.txt.gz 2026-04-04 08:43:17,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:43:18,075 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:43:18,077 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-containers-69d0ce2f691bac272b3230e5/lava-logs.yaml 2026-04-04 08:43:18,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:43:18,691 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:43:18,693 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-containers-69d0ce2f691bac272b3230e5/lava_callback.json.gz 2026-04-04 08:43:18,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:43:18,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ce2f691bac272b3230e5 HTTP/1.1" 200 None 2026-04-04 08:43:18,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:43:18,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-04 08:43:18,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:43:18,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0ce2f691bac272b3230e5 HTTP/1.1" 200 None 2026-04-04 08:43:18,848 - lava_callback - INFO - Completed processing callback for node 69d0ce2f691bac272b3230e5 2026-04-04 08:43:23,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:43:23,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43760 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:43:34,991 - lava_callback - INFO - Received callback for node 69d0ce33691bac272b3230f1 INFO: 172.21.0.1:46054 - "POST /node/69d0ce33691bac272b3230f1 HTTP/1.0" 202 Accepted 2026-04-04 08:43:35,002 - lava_callback - INFO - Starting async job submit for node 69d0ce33691bac272b3230f1 2026-04-04 08:43:35,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:43:35,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ce33691bac272b3230f1 HTTP/1.1" 200 None 2026-04-04 08:43:35,081 - lava_callback - DEBUG - Processing node 69d0ce33691bac272b3230f1: ltp-cve 2026-04-04 08:43:35,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:43:36,175 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:43:36,177 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cve-69d0ce33691bac272b3230f1/log.txt.gz 2026-04-04 08:43:36,220 - lava_callback - INFO - Received callback for node 69d0ce31691bac272b3230e8 INFO: 172.21.0.1:46066 - "POST /node/69d0ce31691bac272b3230e8 HTTP/1.0" 202 Accepted 2026-04-04 08:43:36,231 - lava_callback - INFO - Starting async job submit for node 69d0ce31691bac272b3230e8 2026-04-04 08:43:36,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:43:36,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ce31691bac272b3230e8 HTTP/1.1" 200 None 2026-04-04 08:43:36,369 - lava_callback - DEBUG - Processing node 69d0ce31691bac272b3230e8: ltp-controllers INFO: 172.21.0.1:46070 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:43:36,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:43:37,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:43:37,860 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:43:37,862 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cve-69d0ce33691bac272b3230f1/lava-logs.yaml 2026-04-04 08:43:37,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:43:38,011 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:43:38,014 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-controllers-69d0ce31691bac272b3230e8/log.txt.gz 2026-04-04 08:43:38,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:43:39,188 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:43:39,190 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cve-69d0ce33691bac272b3230f1/lava_callback.json.gz 2026-04-04 08:43:39,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:43:39,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ce33691bac272b3230f1 HTTP/1.1" 200 None 2026-04-04 08:43:39,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:43:39,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-04 08:43:39,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:43:39,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0ce33691bac272b3230f1 HTTP/1.1" 200 None 2026-04-04 08:43:39,338 - lava_callback - INFO - Completed processing callback for node 69d0ce33691bac272b3230f1 2026-04-04 08:43:39,889 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:43:39,891 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-controllers-69d0ce31691bac272b3230e8/lava-logs.yaml 2026-04-04 08:43:39,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:43:40,915 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:43:40,918 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-controllers-69d0ce31691bac272b3230e8/lava_callback.json.gz 2026-04-04 08:43:40,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:43:40,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ce31691bac272b3230e8 HTTP/1.1" 200 None 2026-04-04 08:43:40,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:43:41,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-04 08:43:41,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:43:41,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0ce31691bac272b3230e8 HTTP/1.1" 200 None 2026-04-04 08:43:41,057 - lava_callback - INFO - Completed processing callback for node 69d0ce31691bac272b3230e8 INFO: 172.21.0.1:56656 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:43:53,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:43:53,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-04 08:43:54,262 - lava_callback - INFO - Received callback for node 69ce2c3ecb08ea23a1f684a4 INFO: 172.21.0.1:52246 - "POST /node/69ce2c3ecb08ea23a1f684a4 HTTP/1.0" 202 Accepted 2026-04-04 08:43:54,270 - lava_callback - INFO - Starting async job submit for node 69ce2c3ecb08ea23a1f684a4 2026-04-04 08:43:54,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:43:54,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2c3ecb08ea23a1f684a4 HTTP/1.1" 200 None 2026-04-04 08:43:54,294 - lava_callback - DEBUG - Processing node 69ce2c3ecb08ea23a1f684a4: baseline-arm-clabbe 2026-04-04 08:43:54,294 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce2c3ecb08ea23a1f684a4 2026-04-04 08:43:54,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:43:54,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2c3ecb08ea23a1f684a4 HTTP/1.1" 200 None 2026-04-04 08:43:54,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:43:54,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-04 08:43:54,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:43:54,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2c3ecb08ea23a1f684a4 HTTP/1.1" 200 None 2026-04-04 08:43:54,386 - lava_callback - ERROR - Error processing callback for node 69ce2c3ecb08ea23a1f684a4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59502 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:44:34,308 - lava_callback - INFO - Received callback for node 69ce2c6dcb08ea23a1f684c6 INFO: 172.21.0.1:39886 - "POST /node/69ce2c6dcb08ea23a1f684c6 HTTP/1.0" 202 Accepted 2026-04-04 08:44:34,317 - lava_callback - INFO - Starting async job submit for node 69ce2c6dcb08ea23a1f684c6 2026-04-04 08:44:34,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:44:34,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2c6dcb08ea23a1f684c6 HTTP/1.1" 200 None 2026-04-04 08:44:34,339 - lava_callback - DEBUG - Processing node 69ce2c6dcb08ea23a1f684c6: baseline-arm-clabbe 2026-04-04 08:44:34,339 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce2c6dcb08ea23a1f684c6 2026-04-04 08:44:34,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:44:34,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2c6dcb08ea23a1f684c6 HTTP/1.1" 200 None 2026-04-04 08:44:34,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:44:34,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-04 08:44:34,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:44:34,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2c6dcb08ea23a1f684c6 HTTP/1.1" 200 None 2026-04-04 08:44:34,427 - lava_callback - ERROR - Error processing callback for node 69ce2c6dcb08ea23a1f684c6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58646 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:44:56,084 - lava_callback - INFO - Received callback for node 69d0ce41691bac272b323148 INFO: 172.21.0.1:55844 - "POST /node/69d0ce41691bac272b323148 HTTP/1.0" 202 Accepted 2026-04-04 08:44:56,098 - lava_callback - INFO - Starting async job submit for node 69d0ce41691bac272b323148 2026-04-04 08:44:56,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:44:56,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ce41691bac272b323148 HTTP/1.1" 200 None 2026-04-04 08:44:56,171 - lava_callback - DEBUG - Processing node 69d0ce41691bac272b323148: ltp-watchqueue INFO: 172.21.0.1:55846 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:44:56,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:44:57,246 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:44:57,248 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69d0ce41691bac272b323148/log.txt.gz 2026-04-04 08:44:57,541 - lava_callback - INFO - Received callback for node 69d0cea4691bac272b3231eb INFO: 172.21.0.1:55848 - "POST /node/69d0cea4691bac272b3231eb HTTP/1.0" 202 Accepted 2026-04-04 08:44:57,555 - lava_callback - INFO - Starting async job submit for node 69d0cea4691bac272b3231eb 2026-04-04 08:44:57,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:44:57,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:44:57,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cea4691bac272b3231eb HTTP/1.1" 200 None 2026-04-04 08:44:57,605 - lava_callback - DEBUG - Processing node 69d0cea4691bac272b3231eb: baseline-arm-broonie 2026-04-04 08:44:58,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:44:58,312 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:44:58,314 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69d0ce41691bac272b323148/lava-logs.yaml 2026-04-04 08:44:58,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:44:58,647 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:44:58,649 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d0cea4691bac272b3231eb/log.txt.gz 2026-04-04 08:44:58,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:44:59,020 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:44:59,022 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69d0ce41691bac272b323148/lava_callback.json.gz 2026-04-04 08:44:59,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:44:59,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ce41691bac272b323148 HTTP/1.1" 200 None 2026-04-04 08:44:59,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:44:59,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-04 08:44:59,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:44:59,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0ce41691bac272b323148 HTTP/1.1" 200 None 2026-04-04 08:44:59,176 - lava_callback - INFO - Completed processing callback for node 69d0ce41691bac272b323148 2026-04-04 08:44:59,669 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:44:59,671 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d0cea4691bac272b3231eb/lava-logs.yaml 2026-04-04 08:44:59,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:45:00,285 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:45:00,288 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d0cea4691bac272b3231eb/lava_callback.json.gz 2026-04-04 08:45:00,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:45:00,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cea4691bac272b3231eb HTTP/1.1" 200 None 2026-04-04 08:45:00,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:45:00,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-04 08:45:00,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:45:00,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cea4691bac272b3231eb HTTP/1.1" 200 None 2026-04-04 08:45:00,446 - lava_callback - INFO - Completed processing callback for node 69d0cea4691bac272b3231eb INFO: 172.21.0.1:44692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52456 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:45:14,290 - lava_callback - INFO - Received callback for node 69ce2c97cb08ea23a1f684de INFO: 172.21.0.1:52464 - "POST /node/69ce2c97cb08ea23a1f684de HTTP/1.0" 202 Accepted 2026-04-04 08:45:14,298 - lava_callback - INFO - Starting async job submit for node 69ce2c97cb08ea23a1f684de 2026-04-04 08:45:14,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:45:14,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2c97cb08ea23a1f684de HTTP/1.1" 200 None 2026-04-04 08:45:14,323 - lava_callback - DEBUG - Processing node 69ce2c97cb08ea23a1f684de: baseline-arm-clabbe 2026-04-04 08:45:14,323 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce2c97cb08ea23a1f684de 2026-04-04 08:45:14,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:45:14,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2c97cb08ea23a1f684de HTTP/1.1" 200 None 2026-04-04 08:45:14,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:45:14,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-04 08:45:14,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:45:14,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2c97cb08ea23a1f684de HTTP/1.1" 200 None 2026-04-04 08:45:14,415 - lava_callback - ERROR - Error processing callback for node 69ce2c97cb08ea23a1f684de: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52476 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:45:23,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:45:23,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35818 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:45:44,448 - lava_callback - INFO - Received callback for node 69d0cf9d691bac272b323366 INFO: 172.21.0.1:48030 - "POST /node/69d0cf9d691bac272b323366 HTTP/1.0" 202 Accepted 2026-04-04 08:45:44,459 - lava_callback - INFO - Starting async job submit for node 69d0cf9d691bac272b323366 2026-04-04 08:45:44,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:45:44,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cf9d691bac272b323366 HTTP/1.1" 200 None 2026-04-04 08:45:44,519 - lava_callback - DEBUG - Processing node 69d0cf9d691bac272b323366: baseline-arm64 2026-04-04 08:45:44,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:45:45,103 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:45:45,105 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0cf9d691bac272b323366/log.txt.gz 2026-04-04 08:45:45,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:45:45,497 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:45:45,499 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0cf9d691bac272b323366/lava-logs.yaml 2026-04-04 08:45:45,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:45:45,703 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:45:45,706 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0cf9d691bac272b323366/lava_callback.json.gz 2026-04-04 08:45:45,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:45:45,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cf9d691bac272b323366 HTTP/1.1" 200 None 2026-04-04 08:45:45,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:45:45,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 08:45:45,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:45:45,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cf9d691bac272b323366 HTTP/1.1" 200 None 2026-04-04 08:45:45,836 - lava_callback - INFO - Completed processing callback for node 69d0cf9d691bac272b323366 INFO: 172.21.0.1:48036 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:45:53,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:45:53,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-04 08:45:55,406 - lava_callback - INFO - Received callback for node 69d0cfaa691bac272b3233b6 INFO: 172.21.0.1:51162 - "POST /node/69d0cfaa691bac272b3233b6 HTTP/1.0" 202 Accepted 2026-04-04 08:45:55,415 - lava_callback - INFO - Starting async job submit for node 69d0cfaa691bac272b3233b6 2026-04-04 08:45:55,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:45:55,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfaa691bac272b3233b6 HTTP/1.1" 200 None 2026-04-04 08:45:55,486 - lava_callback - DEBUG - Processing node 69d0cfaa691bac272b3233b6: baseline-arm64 2026-04-04 08:45:55,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:45:55,959 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:45:55,962 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0cfaa691bac272b3233b6/log.txt.gz 2026-04-04 08:45:56,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:45:56,348 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:45:56,350 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0cfaa691bac272b3233b6/lava-logs.yaml 2026-04-04 08:45:56,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:51166 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:45:56,690 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:45:56,692 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0cfaa691bac272b3233b6/lava_callback.json.gz 2026-04-04 08:45:56,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:45:56,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfaa691bac272b3233b6 HTTP/1.1" 200 None 2026-04-04 08:45:56,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:45:56,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 08:45:56,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:45:56,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cfaa691bac272b3233b6 HTTP/1.1" 200 None 2026-04-04 08:45:56,817 - lava_callback - INFO - Completed processing callback for node 69d0cfaa691bac272b3233b6 INFO: 172.21.0.1:38318 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:46:13,044 - lava_callback - INFO - Received callback for node 69d0cfba691bac272b323415 INFO: 172.21.0.1:37122 - "POST /node/69d0cfba691bac272b323415 HTTP/1.0" 202 Accepted 2026-04-04 08:46:13,051 - lava_callback - INFO - Starting async job submit for node 69d0cfba691bac272b323415 2026-04-04 08:46:13,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:46:13,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfba691bac272b323415 HTTP/1.1" 200 None 2026-04-04 08:46:13,077 - lava_callback - DEBUG - Processing node 69d0cfba691bac272b323415: baseline-nfs-arm64 2026-04-04 08:46:13,079 - lava_callback - WARNING - Failed to upload log 2026-04-04 08:46:13,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:46:13,250 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:46:13,252 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d0cfba691bac272b323415/lava-logs.yaml 2026-04-04 08:46:13,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:46:13,453 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:46:13,455 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d0cfba691bac272b323415/lava_callback.json.gz 2026-04-04 08:46:13,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:46:13,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfba691bac272b323415 HTTP/1.1" 200 None 2026-04-04 08:46:13,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:37124 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:46:13,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 08:46:13,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:46:13,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cfba691bac272b323415 HTTP/1.1" 200 None 2026-04-04 08:46:13,577 - lava_callback - INFO - Completed processing callback for node 69d0cfba691bac272b323415 INFO: 172.21.0.1:37128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37136 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:46:23,372 - lava_callback - INFO - Received callback for node 69d0cf9e691bac272b32336c INFO: 172.21.0.1:39314 - "POST /node/69d0cf9e691bac272b32336c HTTP/1.0" 202 Accepted 2026-04-04 08:46:23,380 - lava_callback - INFO - Starting async job submit for node 69d0cf9e691bac272b32336c 2026-04-04 08:46:23,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:46:23,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cf9e691bac272b32336c HTTP/1.1" 200 None 2026-04-04 08:46:23,445 - lava_callback - DEBUG - Processing node 69d0cf9e691bac272b32336c: baseline-arm64 2026-04-04 08:46:23,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:46:23,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:46:23,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-04 08:46:23,940 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:46:23,942 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0cf9e691bac272b32336c/log.txt.gz 2026-04-04 08:46:24,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:46:24,636 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:46:24,638 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0cf9e691bac272b32336c/lava-logs.yaml 2026-04-04 08:46:24,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:46:24,819 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:46:24,821 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0cf9e691bac272b32336c/lava_callback.json.gz 2026-04-04 08:46:24,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:46:24,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cf9e691bac272b32336c HTTP/1.1" 200 None 2026-04-04 08:46:24,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:46:24,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 08:46:24,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:46:24,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cf9e691bac272b32336c HTTP/1.1" 200 None 2026-04-04 08:46:24,973 - lava_callback - INFO - Completed processing callback for node 69d0cf9e691bac272b32336c INFO: 172.21.0.1:39330 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:46:31,852 - lava_callback - INFO - Received callback for node 69d0cfa6691bac272b3233ac INFO: 172.21.0.1:47254 - "POST /node/69d0cfa6691bac272b3233ac HTTP/1.0" 202 Accepted 2026-04-04 08:46:31,859 - lava_callback - INFO - Starting async job submit for node 69d0cfa6691bac272b3233ac 2026-04-04 08:46:31,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:46:31,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfa6691bac272b3233ac HTTP/1.1" 200 None 2026-04-04 08:46:31,915 - lava_callback - DEBUG - Processing node 69d0cfa6691bac272b3233ac: baseline-arm64 2026-04-04 08:46:32,254 - lava_callback - INFO - Received callback for node 69d0cfa5691bac272b3233a7 INFO: 172.21.0.1:47262 - "POST /node/69d0cfa5691bac272b3233a7 HTTP/1.0" 202 Accepted 2026-04-04 08:46:32,271 - lava_callback - INFO - Starting async job submit for node 69d0cfa5691bac272b3233a7 2026-04-04 08:46:32,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:46:32,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfa5691bac272b3233a7 HTTP/1.1" 200 None 2026-04-04 08:46:32,428 - lava_callback - DEBUG - Processing node 69d0cfa5691bac272b3233a7: baseline-arm64 2026-04-04 08:46:32,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:46:33,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:46:33,118 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:46:33,119 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0cfa6691bac272b3233ac/log.txt.gz 2026-04-04 08:46:33,341 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:46:33,373 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0cfa5691bac272b3233a7/log.txt.gz 2026-04-04 08:46:33,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:46:33,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:46:34,211 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:46:34,213 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0cfa5691bac272b3233a7/lava-logs.yaml 2026-04-04 08:46:34,216 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:46:34,219 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0cfa6691bac272b3233ac/lava-logs.yaml 2026-04-04 08:46:34,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:46:34,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:46:34,393 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:46:34,395 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0cfa5691bac272b3233a7/lava_callback.json.gz 2026-04-04 08:46:34,416 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:46:34,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:46:34,420 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0cfa6691bac272b3233ac/lava_callback.json.gz 2026-04-04 08:46:34,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:46:34,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfa5691bac272b3233a7 HTTP/1.1" 200 None 2026-04-04 08:46:34,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:46:34,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfa6691bac272b3233ac HTTP/1.1" 200 None 2026-04-04 08:46:34,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:46:34,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 08:46:34,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:46:34,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 08:46:34,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:46:34,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cfa5691bac272b3233a7 HTTP/1.1" 200 None 2026-04-04 08:46:34,506 - lava_callback - INFO - Completed processing callback for node 69d0cfa5691bac272b3233a7 2026-04-04 08:46:34,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cfa6691bac272b3233ac HTTP/1.1" 200 None 2026-04-04 08:46:34,528 - lava_callback - INFO - Completed processing callback for node 69d0cfa6691bac272b3233ac 2026-04-04 08:46:35,556 - lava_callback - INFO - Received callback for node 69d0cfa2691bac272b32339b INFO: 172.21.0.1:47264 - "POST /node/69d0cfa2691bac272b32339b HTTP/1.0" 202 Accepted 2026-04-04 08:46:35,565 - lava_callback - INFO - Starting async job submit for node 69d0cfa2691bac272b32339b 2026-04-04 08:46:35,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:46:35,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfa2691bac272b32339b HTTP/1.1" 200 None 2026-04-04 08:46:35,635 - lava_callback - DEBUG - Processing node 69d0cfa2691bac272b32339b: baseline-arm64 2026-04-04 08:46:35,844 - lava_callback - WARNING - Failed to upload log 2026-04-04 08:46:35,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:46:36,419 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:46:36,421 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0cfa2691bac272b32339b/lava-logs.yaml 2026-04-04 08:46:36,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:46:36,500 - lava_callback - INFO - Received callback for node 69d0ce2e691bac272b3230e2 INFO: 172.21.0.1:47274 - "POST /node/69d0ce2e691bac272b3230e2 HTTP/1.0" 202 Accepted 2026-04-04 08:46:36,512 - lava_callback - INFO - Starting async job submit for node 69d0ce2e691bac272b3230e2 INFO: 172.21.0.1:47276 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:46:36,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:46:36,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ce2e691bac272b3230e2 HTTP/1.1" 200 None 2026-04-04 08:46:36,599 - lava_callback - DEBUG - Processing node 69d0ce2e691bac272b3230e2: ltp-cap_bounds 2026-04-04 08:46:36,716 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:46:36,724 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0cfa2691bac272b32339b/lava_callback.json.gz 2026-04-04 08:46:36,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:46:36,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfa2691bac272b32339b HTTP/1.1" 200 None 2026-04-04 08:46:36,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:46:37,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 08:46:37,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:46:37,094 - lava_callback - INFO - Received callback for node 69d0cfa1691bac272b323397 INFO: 172.21.0.1:47292 - "POST /node/69d0cfa1691bac272b323397 HTTP/1.0" 202 Accepted 2026-04-04 08:46:37,117 - lava_callback - INFO - Starting async job submit for node 69d0cfa1691bac272b323397 2026-04-04 08:46:37,183 - lava_callback - INFO - Received callback for node 69d0cfa0691bac272b323394 2026-04-04 08:46:37,211 - lava_callback - INFO - Starting async job submit for node 69d0cfa0691bac272b323394 INFO: 172.21.0.1:47298 - "POST /node/69d0cfa0691bac272b323394 HTTP/1.0" 202 Accepted 2026-04-04 08:46:37,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:46:37,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cfa2691bac272b32339b HTTP/1.1" 200 None 2026-04-04 08:46:37,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:46:37,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfa1691bac272b323397 HTTP/1.1" 200 None 2026-04-04 08:46:37,426 - lava_callback - DEBUG - Processing node 69d0cfa1691bac272b323397: baseline-arm64 2026-04-04 08:46:37,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfa0691bac272b323394 HTTP/1.1" 200 None 2026-04-04 08:46:37,462 - lava_callback - DEBUG - Processing node 69d0cfa0691bac272b323394: baseline-arm64 2026-04-04 08:46:37,566 - lava_callback - INFO - Completed processing callback for node 69d0cfa2691bac272b32339b 2026-04-04 08:46:38,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:46:38,269 - lava_callback - WARNING - Failed to upload log 2026-04-04 08:46:38,485 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:46:38,539 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69d0ce2e691bac272b3230e2/log.txt.gz 2026-04-04 08:46:38,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:46:38,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:46:38,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:46:39,327 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:46:39,330 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0cfa0691bac272b323394/log.txt.gz 2026-04-04 08:46:39,420 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:46:39,422 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0cfa1691bac272b323397/lava-logs.yaml 2026-04-04 08:46:39,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:46:39,593 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:46:39,595 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69d0ce2e691bac272b3230e2/lava-logs.yaml 2026-04-04 08:46:39,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:46:39,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:46:39,786 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:46:39,788 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0cfa1691bac272b323397/lava_callback.json.gz 2026-04-04 08:46:39,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:46:39,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfa1691bac272b323397 HTTP/1.1" 200 None 2026-04-04 08:46:39,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:46:39,915 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:46:39,917 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69d0ce2e691bac272b3230e2/lava_callback.json.gz 2026-04-04 08:46:39,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 08:46:39,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:46:39,980 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:46:39,983 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0cfa0691bac272b323394/lava-logs.yaml 2026-04-04 08:46:39,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cfa1691bac272b323397 HTTP/1.1" 200 None 2026-04-04 08:46:40,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:46:40,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:46:40,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ce2e691bac272b3230e2 HTTP/1.1" 200 None 2026-04-04 08:46:40,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:46:40,190 - lava_callback - INFO - Completed processing callback for node 69d0cfa1691bac272b323397 2026-04-04 08:46:40,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-04 08:46:40,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:46:40,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0ce2e691bac272b3230e2 HTTP/1.1" 200 None 2026-04-04 08:46:40,301 - lava_callback - INFO - Completed processing callback for node 69d0ce2e691bac272b3230e2 2026-04-04 08:46:40,837 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:46:40,839 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0cfa0691bac272b323394/lava_callback.json.gz 2026-04-04 08:46:40,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:46:40,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfa0691bac272b323394 HTTP/1.1" 200 None 2026-04-04 08:46:40,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:46:40,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 08:46:40,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:46:40,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cfa0691bac272b323394 HTTP/1.1" 200 None 2026-04-04 08:46:40,989 - lava_callback - INFO - Completed processing callback for node 69d0cfa0691bac272b323394 INFO: 172.21.0.1:46802 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:46:50,057 - lava_callback - INFO - Received callback for node 69d0cfae691bac272b3233bf INFO: 172.21.0.1:34516 - "POST /node/69d0cfae691bac272b3233bf HTTP/1.0" 202 Accepted 2026-04-04 08:46:50,069 - lava_callback - INFO - Starting async job submit for node 69d0cfae691bac272b3233bf 2026-04-04 08:46:50,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:46:50,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfae691bac272b3233bf HTTP/1.1" 200 None 2026-04-04 08:46:50,136 - lava_callback - DEBUG - Processing node 69d0cfae691bac272b3233bf: baseline-arm64 2026-04-04 08:46:50,675 - lava_callback - INFO - Received callback for node 69d0cfab691bac272b3233b9 INFO: 172.21.0.1:34528 - "POST /node/69d0cfab691bac272b3233b9 HTTP/1.0" 202 Accepted 2026-04-04 08:46:50,699 - lava_callback - INFO - Starting async job submit for node 69d0cfab691bac272b3233b9 2026-04-04 08:46:50,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:46:50,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:46:50,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfab691bac272b3233b9 HTTP/1.1" 200 None 2026-04-04 08:46:50,800 - lava_callback - DEBUG - Processing node 69d0cfab691bac272b3233b9: baseline-arm64 2026-04-04 08:46:51,034 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:46:51,053 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0cfae691bac272b3233bf/log.txt.gz 2026-04-04 08:46:51,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:46:51,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:46:52,015 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:46:52,018 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0cfab691bac272b3233b9/log.txt.gz 2026-04-04 08:46:52,144 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:46:52,147 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0cfae691bac272b3233bf/lava-logs.yaml 2026-04-04 08:46:52,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:46:52,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:46:52,483 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:46:52,485 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0cfae691bac272b3233bf/lava_callback.json.gz 2026-04-04 08:46:52,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:46:52,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfae691bac272b3233bf HTTP/1.1" 200 None 2026-04-04 08:46:52,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:46:52,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 08:46:52,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:46:52,601 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:46:52,604 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0cfab691bac272b3233b9/lava-logs.yaml 2026-04-04 08:46:52,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:46:52,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cfae691bac272b3233bf HTTP/1.1" 200 None 2026-04-04 08:46:52,618 - lava_callback - INFO - Completed processing callback for node 69d0cfae691bac272b3233bf 2026-04-04 08:46:53,135 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:46:53,138 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0cfab691bac272b3233b9/lava_callback.json.gz 2026-04-04 08:46:53,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:46:53,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfab691bac272b3233b9 HTTP/1.1" 200 None 2026-04-04 08:46:53,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:46:53,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 08:46:53,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:46:53,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cfab691bac272b3233b9 HTTP/1.1" 200 None 2026-04-04 08:46:53,284 - lava_callback - INFO - Completed processing callback for node 69d0cfab691bac272b3233b9 2026-04-04 08:46:53,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:46:53,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:34542 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:46:58,198 - lava_callback - INFO - Received callback for node 69d0cfb8691bac272b32340a INFO: 172.21.0.1:34554 - "POST /node/69d0cfb8691bac272b32340a HTTP/1.0" 202 Accepted 2026-04-04 08:46:58,209 - lava_callback - INFO - Starting async job submit for node 69d0cfb8691bac272b32340a 2026-04-04 08:46:58,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:46:58,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfb8691bac272b32340a HTTP/1.1" 200 None 2026-04-04 08:46:58,281 - lava_callback - DEBUG - Processing node 69d0cfb8691bac272b32340a: baseline-nfs-arm64 2026-04-04 08:46:58,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:46:59,152 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:46:59,155 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d0cfb8691bac272b32340a/log.txt.gz 2026-04-04 08:46:59,379 - lava_callback - INFO - Received callback for node 69d0cfbe691bac272b323439 INFO: 172.21.0.1:34566 - "POST /node/69d0cfbe691bac272b323439 HTTP/1.0" 202 Accepted 2026-04-04 08:46:59,395 - lava_callback - INFO - Starting async job submit for node 69d0cfbe691bac272b323439 2026-04-04 08:46:59,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:46:59,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfbe691bac272b323439 HTTP/1.1" 200 None 2026-04-04 08:46:59,519 - lava_callback - DEBUG - Processing node 69d0cfbe691bac272b323439: baseline-nfs-arm64 2026-04-04 08:46:59,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:47:00,010 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:47:00,069 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d0cfb8691bac272b32340a/lava-logs.yaml 2026-04-04 08:47:00,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:47:00,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:47:00,384 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:47:00,386 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d0cfbe691bac272b323439/log.txt.gz 2026-04-04 08:47:00,404 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:47:00,416 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d0cfb8691bac272b32340a/lava_callback.json.gz 2026-04-04 08:47:00,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:00,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfb8691bac272b32340a HTTP/1.1" 200 None 2026-04-04 08:47:00,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:00,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 08:47:00,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:00,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cfb8691bac272b32340a HTTP/1.1" 200 None 2026-04-04 08:47:00,712 - lava_callback - INFO - Completed processing callback for node 69d0cfb8691bac272b32340a 2026-04-04 08:47:00,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:47:01,263 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:47:01,266 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d0cfbe691bac272b323439/lava-logs.yaml 2026-04-04 08:47:01,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:47:01,480 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:47:01,483 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d0cfbe691bac272b323439/lava_callback.json.gz 2026-04-04 08:47:01,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:01,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfbe691bac272b323439 HTTP/1.1" 200 None 2026-04-04 08:47:01,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:01,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 08:47:01,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:01,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cfbe691bac272b323439 HTTP/1.1" 200 None 2026-04-04 08:47:01,591 - lava_callback - INFO - Completed processing callback for node 69d0cfbe691bac272b323439 INFO: 172.21.0.1:34814 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:47:13,097 - lava_callback - INFO - Received callback for node 69d0cf9e691bac272b323369 INFO: 172.21.0.1:52612 - "POST /node/69d0cf9e691bac272b323369 HTTP/1.0" 202 Accepted 2026-04-04 08:47:13,108 - lava_callback - INFO - Starting async job submit for node 69d0cf9e691bac272b323369 2026-04-04 08:47:13,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:13,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cf9e691bac272b323369 HTTP/1.1" 200 None 2026-04-04 08:47:13,158 - lava_callback - DEBUG - Processing node 69d0cf9e691bac272b323369: baseline-arm64 2026-04-04 08:47:13,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:52620 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:47:13,611 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:47:13,613 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0cf9e691bac272b323369/log.txt.gz 2026-04-04 08:47:13,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:47:14,034 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:47:14,036 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0cf9e691bac272b323369/lava-logs.yaml 2026-04-04 08:47:14,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:47:14,240 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:47:14,243 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0cf9e691bac272b323369/lava_callback.json.gz 2026-04-04 08:47:14,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:14,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cf9e691bac272b323369 HTTP/1.1" 200 None 2026-04-04 08:47:14,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:14,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 08:47:14,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:14,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cf9e691bac272b323369 HTTP/1.1" 200 None 2026-04-04 08:47:14,347 - lava_callback - INFO - Completed processing callback for node 69d0cf9e691bac272b323369 INFO: 172.21.0.1:52628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52642 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:47:17,578 - lava_callback - INFO - Received callback for node 69d0cfe5691bac272b3234c1 INFO: 172.21.0.1:52654 - "POST /node/69d0cfe5691bac272b3234c1 HTTP/1.0" 202 Accepted 2026-04-04 08:47:17,587 - lava_callback - INFO - Starting async job submit for node 69d0cfe5691bac272b3234c1 2026-04-04 08:47:17,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:17,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfe5691bac272b3234c1 HTTP/1.1" 200 None 2026-04-04 08:47:17,645 - lava_callback - DEBUG - Processing node 69d0cfe5691bac272b3234c1: baseline-arm64-kontron 2026-04-04 08:47:17,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:47:18,025 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:47:18,028 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69d0cfe5691bac272b3234c1/log.txt.gz 2026-04-04 08:47:18,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:47:18,506 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:47:18,509 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69d0cfe5691bac272b3234c1/lava-logs.yaml 2026-04-04 08:47:18,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:47:18,558 - lava_callback - INFO - Received callback for node 69d0cfc0691bac272b323440 INFO: 172.21.0.1:52658 - "POST /node/69d0cfc0691bac272b323440 HTTP/1.0" 202 Accepted 2026-04-04 08:47:18,576 - lava_callback - INFO - Starting async job submit for node 69d0cfc0691bac272b323440 2026-04-04 08:47:18,596 - lava_callback - INFO - Received callback for node 69d0cfa7691bac272b3233b0 2026-04-04 08:47:18,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:52660 - "POST /node/69d0cfa7691bac272b3233b0 HTTP/1.0" 202 Accepted 2026-04-04 08:47:18,719 - lava_callback - INFO - Starting async job submit for node 69d0cfa7691bac272b3233b0 2026-04-04 08:47:18,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:18,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfc0691bac272b323440 HTTP/1.1" 200 None 2026-04-04 08:47:18,774 - lava_callback - DEBUG - Processing node 69d0cfc0691bac272b323440: baseline-nfs-arm64 2026-04-04 08:47:18,801 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:47:18,809 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69d0cfe5691bac272b3234c1/lava_callback.json.gz 2026-04-04 08:47:18,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfa7691bac272b3233b0 HTTP/1.1" 200 None 2026-04-04 08:47:18,858 - lava_callback - DEBUG - Processing node 69d0cfa7691bac272b3233b0: baseline-arm64 2026-04-04 08:47:18,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:19,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfe5691bac272b3234c1 HTTP/1.1" 200 None 2026-04-04 08:47:19,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:19,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 08:47:19,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:19,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cfe5691bac272b3234c1 HTTP/1.1" 200 None 2026-04-04 08:47:19,415 - lava_callback - INFO - Completed processing callback for node 69d0cfe5691bac272b3234c1 2026-04-04 08:47:20,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:47:20,381 - lava_callback - INFO - Received callback for node 69d0cfbb691bac272b323418 INFO: 172.21.0.1:53910 - "POST /node/69d0cfbb691bac272b323418 HTTP/1.0" 202 Accepted 2026-04-04 08:47:20,397 - lava_callback - INFO - Starting async job submit for node 69d0cfbb691bac272b323418 2026-04-04 08:47:20,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:20,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfbb691bac272b323418 HTTP/1.1" 200 None 2026-04-04 08:47:20,571 - lava_callback - DEBUG - Processing node 69d0cfbb691bac272b323418: baseline-nfs-arm64 2026-04-04 08:47:20,710 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:47:20,712 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d0cfc0691bac272b323440/log.txt.gz 2026-04-04 08:47:21,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:47:22,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:47:22,420 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:47:22,422 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d0cfbb691bac272b323418/log.txt.gz 2026-04-04 08:47:22,617 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:47:22,630 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d0cfc0691bac272b323440/lava-logs.yaml 2026-04-04 08:47:22,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:47:23,071 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:47:23,074 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d0cfc0691bac272b323440/lava_callback.json.gz 2026-04-04 08:47:23,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:23,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:47:23,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfc0691bac272b323440 HTTP/1.1" 200 None 2026-04-04 08:47:23,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:23,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 08:47:23,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:23,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cfc0691bac272b323440 HTTP/1.1" 200 None 2026-04-04 08:47:23,486 - lava_callback - INFO - Completed processing callback for node 69d0cfc0691bac272b323440 2026-04-04 08:47:23,797 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:47:23,799 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d0cfbb691bac272b323418/lava-logs.yaml 2026-04-04 08:47:23,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:47:23,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:23,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-04 08:47:24,051 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:47:24,088 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d0cfbb691bac272b323418/lava_callback.json.gz 2026-04-04 08:47:24,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:24,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfbb691bac272b323418 HTTP/1.1" 200 None 2026-04-04 08:47:24,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:24,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 08:47:24,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:24,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cfbb691bac272b323418 HTTP/1.1" 200 None 2026-04-04 08:47:24,441 - lava_callback - INFO - Completed processing callback for node 69d0cfbb691bac272b323418 2026-04-04 08:47:25,608 - lava_callback - INFO - Received callback for node 69d0cfe8691bac272b3234c9 INFO: 172.21.0.1:53916 - "POST /node/69d0cfe8691bac272b3234c9 HTTP/1.0" 202 Accepted 2026-04-04 08:47:25,674 - lava_callback - INFO - Starting async job submit for node 69d0cfe8691bac272b3234c9 2026-04-04 08:47:25,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:25,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfe8691bac272b3234c9 HTTP/1.1" 200 None 2026-04-04 08:47:25,834 - lava_callback - DEBUG - Processing node 69d0cfe8691bac272b3234c9: baseline-arm64-pengutronix INFO: 172.21.0.1:53920 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:47:26,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:47:26,861 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:47:26,914 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69d0cfe8691bac272b3234c9/log.txt.gz 2026-04-04 08:47:27,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:47:27,505 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:47:27,569 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69d0cfe8691bac272b3234c9/lava-logs.yaml 2026-04-04 08:47:27,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:47:28,022 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:47:28,069 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69d0cfe8691bac272b3234c9/lava_callback.json.gz 2026-04-04 08:47:28,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:28,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfe8691bac272b3234c9 HTTP/1.1" 200 None 2026-04-04 08:47:28,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:28,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 08:47:28,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:28,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cfe8691bac272b3234c9 HTTP/1.1" 200 None 2026-04-04 08:47:28,466 - lava_callback - INFO - Completed processing callback for node 69d0cfe8691bac272b3234c9 2026-04-04 08:47:29,342 - lava_callback - INFO - Received callback for node 69d0cfed691bac272b3234db INFO: 172.21.0.1:53926 - "POST /node/69d0cfed691bac272b3234db HTTP/1.0" 202 Accepted 2026-04-04 08:47:29,370 - lava_callback - INFO - Starting async job submit for node 69d0cfed691bac272b3234db 2026-04-04 08:47:29,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:29,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfed691bac272b3234db HTTP/1.1" 200 None 2026-04-04 08:47:29,585 - lava_callback - DEBUG - Processing node 69d0cfed691bac272b3234db: baseline-arm64-foundriesio 2026-04-04 08:47:30,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:47:30,761 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:47:30,804 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d0cfed691bac272b3234db/log.txt.gz 2026-04-04 08:47:31,305 - lava_callback - INFO - Received callback for node 69d0cfb0691bac272b3233c6 INFO: 172.21.0.1:43616 - "POST /node/69d0cfb0691bac272b3233c6 HTTP/1.0" 202 Accepted 2026-04-04 08:47:31,423 - lava_callback - INFO - Starting async job submit for node 69d0cfb0691bac272b3233c6 2026-04-04 08:47:31,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:31,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:47:31,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfb0691bac272b3233c6 HTTP/1.1" 200 None 2026-04-04 08:47:31,729 - lava_callback - DEBUG - Processing node 69d0cfb0691bac272b3233c6: baseline-arm64 2026-04-04 08:47:32,436 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:47:32,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:47:32,544 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d0cfed691bac272b3234db/lava-logs.yaml 2026-04-04 08:47:32,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:47:32,724 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:47:32,767 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0cfb0691bac272b3233c6/log.txt.gz 2026-04-04 08:47:32,946 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:47:33,442 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d0cfed691bac272b3234db/lava_callback.json.gz 2026-04-04 08:47:33,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:33,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:47:33,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfed691bac272b3234db HTTP/1.1" 200 None 2026-04-04 08:47:33,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:33,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 08:47:33,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:33,826 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:47:33,848 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0cfb0691bac272b3233c6/lava-logs.yaml 2026-04-04 08:47:33,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cfed691bac272b3234db HTTP/1.1" 200 None 2026-04-04 08:47:33,891 - lava_callback - INFO - Completed processing callback for node 69d0cfed691bac272b3234db 2026-04-04 08:47:33,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:47:34,173 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:47:34,226 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0cfb0691bac272b3233c6/lava_callback.json.gz 2026-04-04 08:47:34,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:34,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfb0691bac272b3233c6 HTTP/1.1" 200 None 2026-04-04 08:47:34,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:34,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 08:47:34,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:34,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cfb0691bac272b3233c6 HTTP/1.1" 200 None 2026-04-04 08:47:34,786 - lava_callback - INFO - Completed processing callback for node 69d0cfb0691bac272b3233c6 2026-04-04 08:47:35,062 - lava_callback - INFO - Received callback for node 69d0cfce691bac272b323463 INFO: 172.21.0.1:43630 - "POST /node/69d0cfce691bac272b323463 HTTP/1.0" 202 Accepted 2026-04-04 08:47:35,087 - lava_callback - INFO - Starting async job submit for node 69d0cfce691bac272b323463 2026-04-04 08:47:35,134 - lava_callback - INFO - Received callback for node 69d0cfeb691bac272b3234d8 2026-04-04 08:47:35,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:43632 - "POST /node/69d0cfeb691bac272b3234d8 HTTP/1.0" 202 Accepted 2026-04-04 08:47:35,170 - lava_callback - INFO - Starting async job submit for node 69d0cfeb691bac272b3234d8 2026-04-04 08:47:35,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:35,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfce691bac272b323463 HTTP/1.1" 200 None 2026-04-04 08:47:35,310 - lava_callback - DEBUG - Processing node 69d0cfce691bac272b323463: baseline-arm64-broonie 2026-04-04 08:47:35,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfeb691bac272b3234d8 HTTP/1.1" 200 None 2026-04-04 08:47:35,332 - lava_callback - DEBUG - Processing node 69d0cfeb691bac272b3234d8: baseline-arm64-foundriesio 2026-04-04 08:47:36,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:43648 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:47:36,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:47:36,651 - lava_callback - INFO - Received callback for node 69d0cfd6691bac272b323474 2026-04-04 08:47:36,667 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 INFO: 172.21.0.1:43652 - "POST /node/69d0cfd6691bac272b323474 HTTP/1.0" 202 Accepted 2026-04-04 08:47:36,670 - lava_callback - INFO - Starting async job submit for node 69d0cfd6691bac272b323474 2026-04-04 08:47:36,737 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d0cfce691bac272b323463/log.txt.gz 2026-04-04 08:47:36,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:36,849 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:47:36,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfd6691bac272b323474 HTTP/1.1" 200 None 2026-04-04 08:47:36,971 - lava_callback - DEBUG - Processing node 69d0cfd6691bac272b323474: baseline-arm64-broonie 2026-04-04 08:47:37,089 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d0cfeb691bac272b3234d8/log.txt.gz 2026-04-04 08:47:37,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:47:37,422 - lava_callback - INFO - Received callback for node 69d0cfea691bac272b3234cd 2026-04-04 08:47:37,454 - lava_callback - INFO - Starting async job submit for node 69d0cfea691bac272b3234cd INFO: 172.21.0.1:43656 - "POST /node/69d0cfea691bac272b3234cd HTTP/1.0" 202 Accepted 2026-04-04 08:47:37,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:47:37,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:37,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:47:37,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfea691bac272b3234cd HTTP/1.1" 200 None 2026-04-04 08:47:37,713 - lava_callback - DEBUG - Processing node 69d0cfea691bac272b3234cd: baseline-arm64-pengutronix 2026-04-04 08:47:37,994 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:47:38,002 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d0cfce691bac272b323463/lava-logs.yaml 2026-04-04 08:47:38,003 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:47:38,006 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d0cfeb691bac272b3234d8/lava-logs.yaml 2026-04-04 08:47:38,041 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:47:38,043 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d0cfd6691bac272b323474/log.txt.gz 2026-04-04 08:47:38,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:47:38,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:47:38,483 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:47:38,527 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d0cfce691bac272b323463/lava_callback.json.gz 2026-04-04 08:47:38,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:47:38,672 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:47:38,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:38,694 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d0cfeb691bac272b3234d8/lava_callback.json.gz 2026-04-04 08:47:38,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:38,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:47:38,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfce691bac272b323463 HTTP/1.1" 200 None 2026-04-04 08:47:38,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:38,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfeb691bac272b3234d8 HTTP/1.1" 200 None 2026-04-04 08:47:38,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:38,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 08:47:38,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 08:47:38,979 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:47:39,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:39,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:39,009 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69d0cfea691bac272b3234cd/log.txt.gz 2026-04-04 08:47:39,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cfce691bac272b323463 HTTP/1.1" 200 None 2026-04-04 08:47:39,148 - lava_callback - INFO - Completed processing callback for node 69d0cfce691bac272b323463 2026-04-04 08:47:39,149 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:47:39,151 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d0cfd6691bac272b323474/lava-logs.yaml 2026-04-04 08:47:39,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cfeb691bac272b3234d8 HTTP/1.1" 200 None 2026-04-04 08:47:39,267 - lava_callback - INFO - Completed processing callback for node 69d0cfeb691bac272b3234d8 2026-04-04 08:47:39,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:47:39,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:47:39,554 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:47:39,557 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d0cfd6691bac272b323474/lava_callback.json.gz 2026-04-04 08:47:40,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:40,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfd6691bac272b323474 HTTP/1.1" 200 None 2026-04-04 08:47:40,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:40,220 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:47:40,283 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69d0cfea691bac272b3234cd/lava-logs.yaml 2026-04-04 08:47:40,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 08:47:40,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:40,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:47:40,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cfd6691bac272b323474 HTTP/1.1" 200 None 2026-04-04 08:47:40,507 - lava_callback - INFO - Completed processing callback for node 69d0cfd6691bac272b323474 2026-04-04 08:47:40,773 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:47:40,791 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69d0cfea691bac272b3234cd/lava_callback.json.gz 2026-04-04 08:47:40,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:40,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfea691bac272b3234cd HTTP/1.1" 200 None 2026-04-04 08:47:40,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:41,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 08:47:41,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:41,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cfea691bac272b3234cd HTTP/1.1" 200 None 2026-04-04 08:47:41,215 - lava_callback - INFO - Completed processing callback for node 69d0cfea691bac272b3234cd 2026-04-04 08:47:44,023 - lava_callback - INFO - Received callback for node 69d0cfb5691bac272b323404 INFO: 172.21.0.1:33066 - "POST /node/69d0cfb5691bac272b323404 HTTP/1.0" 202 Accepted 2026-04-04 08:47:44,077 - lava_callback - INFO - Starting async job submit for node 69d0cfb5691bac272b323404 2026-04-04 08:47:44,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:44,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfb5691bac272b323404 HTTP/1.1" 200 None 2026-04-04 08:47:44,216 - lava_callback - DEBUG - Processing node 69d0cfb5691bac272b323404: baseline-nfs-arm64 2026-04-04 08:47:45,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:47:45,402 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:47:45,455 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d0cfb5691bac272b323404/log.txt.gz 2026-04-04 08:47:46,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:47:46,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:47:46,416 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:47:46,419 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0cfa7691bac272b3233b0/log.txt.gz 2026-04-04 08:47:46,455 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:47:46,498 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d0cfb5691bac272b323404/lava-logs.yaml INFO: 172.21.0.1:33078 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:47:46,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:47:46,882 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:47:46,919 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d0cfb5691bac272b323404/lava_callback.json.gz 2026-04-04 08:47:46,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:47,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfb5691bac272b323404 HTTP/1.1" 200 None 2026-04-04 08:47:47,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:47,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 08:47:47,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:47,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cfb5691bac272b323404 HTTP/1.1" 200 None 2026-04-04 08:47:47,604 - lava_callback - INFO - Completed processing callback for node 69d0cfb5691bac272b323404 2026-04-04 08:47:53,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:54,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-04 08:47:55,699 - lava_callback - INFO - Received callback for node 69d0cfe1691bac272b3234b8 INFO: 172.21.0.1:59258 - "POST /node/69d0cfe1691bac272b3234b8 HTTP/1.0" 202 Accepted 2026-04-04 08:47:55,756 - lava_callback - INFO - Starting async job submit for node 69d0cfe1691bac272b3234b8 2026-04-04 08:47:55,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:55,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfe1691bac272b3234b8 HTTP/1.1" 200 None 2026-04-04 08:47:55,887 - lava_callback - DEBUG - Processing node 69d0cfe1691bac272b3234b8: baseline-arm64-clabbe INFO: 172.21.0.1:59268 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:47:56,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:47:56,817 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:47:56,856 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69d0cfe1691bac272b3234b8/log.txt.gz 2026-04-04 08:47:57,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:47:57,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:47:57,509 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:47:57,511 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69d0cfe1691bac272b3234b8/lava-logs.yaml 2026-04-04 08:47:57,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:47:57,600 - lava_callback - INFO - Received callback for node 69d0cfe7691bac272b3234c4 INFO: 172.21.0.1:59284 - "POST /node/69d0cfe7691bac272b3234c4 HTTP/1.0" 202 Accepted 2026-04-04 08:47:57,608 - lava_callback - INFO - Starting async job submit for node 69d0cfe7691bac272b3234c4 2026-04-04 08:47:57,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:57,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfe7691bac272b3234c4 HTTP/1.1" 200 None 2026-04-04 08:47:57,649 - lava_callback - DEBUG - Processing node 69d0cfe7691bac272b3234c4: baseline-arm64-kontron 2026-04-04 08:47:57,669 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:47:57,711 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69d0cfe1691bac272b3234b8/lava_callback.json.gz 2026-04-04 08:47:57,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:57,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfe1691bac272b3234b8 HTTP/1.1" 200 None 2026-04-04 08:47:57,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:57,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 08:47:57,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:47:57,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:58,005 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:47:58,020 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0cfa7691bac272b3233b0/lava-logs.yaml 2026-04-04 08:47:58,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cfe1691bac272b3234b8 HTTP/1.1" 200 None 2026-04-04 08:47:58,089 - lava_callback - INFO - Completed processing callback for node 69d0cfe1691bac272b3234b8 2026-04-04 08:47:58,166 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:47:58,168 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69d0cfe7691bac272b3234c4/log.txt.gz 2026-04-04 08:47:58,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:47:58,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:47:58,647 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:47:58,649 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69d0cfe7691bac272b3234c4/lava-logs.yaml 2026-04-04 08:47:58,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:47:58,662 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:47:58,664 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0cfa7691bac272b3233b0/lava_callback.json.gz 2026-04-04 08:47:58,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:58,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfa7691bac272b3233b0 HTTP/1.1" 200 None 2026-04-04 08:47:58,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:58,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 08:47:58,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:58,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cfa7691bac272b3233b0 HTTP/1.1" 200 None 2026-04-04 08:47:58,850 - lava_callback - INFO - Completed processing callback for node 69d0cfa7691bac272b3233b0 2026-04-04 08:47:58,876 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:47:58,879 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69d0cfe7691bac272b3234c4/lava_callback.json.gz 2026-04-04 08:47:58,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:58,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfe7691bac272b3234c4 HTTP/1.1" 200 None 2026-04-04 08:47:58,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:58,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 08:47:58,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:47:59,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cfe7691bac272b3234c4 HTTP/1.1" 200 None 2026-04-04 08:47:59,009 - lava_callback - INFO - Completed processing callback for node 69d0cfe7691bac272b3234c4 2026-04-04 08:48:01,655 - lava_callback - INFO - Received callback for node 69d0cfb3691bac272b3233cc INFO: 172.21.0.1:57222 - "POST /node/69d0cfb3691bac272b3233cc HTTP/1.0" 202 Accepted 2026-04-04 08:48:01,662 - lava_callback - INFO - Starting async job submit for node 69d0cfb3691bac272b3233cc 2026-04-04 08:48:01,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:48:01,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfb3691bac272b3233cc HTTP/1.1" 200 None 2026-04-04 08:48:01,703 - lava_callback - DEBUG - Processing node 69d0cfb3691bac272b3233cc: baseline-nfs-arm64 2026-04-04 08:48:02,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:48:02,191 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:48:02,193 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d0cfb3691bac272b3233cc/log.txt.gz 2026-04-04 08:48:02,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:48:02,651 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:48:02,654 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d0cfb3691bac272b3233cc/lava-logs.yaml 2026-04-04 08:48:02,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:48:02,846 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:48:02,848 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d0cfb3691bac272b3233cc/lava_callback.json.gz 2026-04-04 08:48:02,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:48:02,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfb3691bac272b3233cc HTTP/1.1" 200 None 2026-04-04 08:48:02,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:48:02,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 08:48:02,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:48:02,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cfb3691bac272b3233cc HTTP/1.1" 200 None 2026-04-04 08:48:02,949 - lava_callback - INFO - Completed processing callback for node 69d0cfb3691bac272b3233cc INFO: 172.21.0.1:57228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50728 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-04 08:48:15,233 - lava_callback - INFO - Received callback for node 69d0cfdb691bac272b3234a1 INFO: 172.21.0.1:50740 - "POST /node/69d0cfdb691bac272b3234a1 HTTP/1.0" 202 Accepted 2026-04-04 08:48:15,240 - lava_callback - INFO - Starting async job submit for node 69d0cfdb691bac272b3234a1 2026-04-04 08:48:15,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:48:15,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfdb691bac272b3234a1 HTTP/1.1" 200 None 2026-04-04 08:48:15,280 - lava_callback - DEBUG - Processing node 69d0cfdb691bac272b3234a1: baseline-arm64-broonie 2026-04-04 08:48:15,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:48:15,689 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:48:15,691 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d0cfdb691bac272b3234a1/log.txt.gz 2026-04-04 08:48:15,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:48:15,957 - lava_callback - INFO - Received callback for node 69d0cfd1691bac272b323469 INFO: 172.21.0.1:50754 - "POST /node/69d0cfd1691bac272b323469 HTTP/1.0" 202 Accepted 2026-04-04 08:48:15,966 - lava_callback - INFO - Starting async job submit for node 69d0cfd1691bac272b323469 2026-04-04 08:48:15,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:48:16,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfd1691bac272b323469 HTTP/1.1" 200 None 2026-04-04 08:48:16,010 - lava_callback - DEBUG - Processing node 69d0cfd1691bac272b323469: baseline-arm64-broonie 2026-04-04 08:48:16,042 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:48:16,084 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d0cfdb691bac272b3234a1/lava-logs.yaml 2026-04-04 08:48:16,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:48:16,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:48:16,405 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:48:16,407 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d0cfd1691bac272b323469/log.txt.gz 2026-04-04 08:48:16,418 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:48:16,450 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d0cfdb691bac272b3234a1/lava_callback.json.gz 2026-04-04 08:48:16,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:50758 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:48:16,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfdb691bac272b3234a1 HTTP/1.1" 200 None 2026-04-04 08:48:16,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:48:16,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:48:16,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 08:48:16,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:48:16,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cfdb691bac272b3234a1 HTTP/1.1" 200 None 2026-04-04 08:48:16,707 - lava_callback - INFO - Completed processing callback for node 69d0cfdb691bac272b3234a1 2026-04-04 08:48:16,874 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:48:16,876 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d0cfd1691bac272b323469/lava-logs.yaml 2026-04-04 08:48:16,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:48:17,043 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:48:17,045 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d0cfd1691bac272b323469/lava_callback.json.gz 2026-04-04 08:48:17,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:48:17,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfd1691bac272b323469 HTTP/1.1" 200 None 2026-04-04 08:48:17,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:48:17,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 08:48:17,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:48:17,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cfd1691bac272b323469 HTTP/1.1" 200 None 2026-04-04 08:48:17,151 - lava_callback - INFO - Completed processing callback for node 69d0cfd1691bac272b323469 2026-04-04 08:48:17,413 - lava_callback - INFO - Received callback for node 69d0cfd3691bac272b32346c INFO: 172.21.0.1:50772 - "POST /node/69d0cfd3691bac272b32346c HTTP/1.0" 202 Accepted 2026-04-04 08:48:17,423 - lava_callback - INFO - Starting async job submit for node 69d0cfd3691bac272b32346c 2026-04-04 08:48:17,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:48:17,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfd3691bac272b32346c HTTP/1.1" 200 None 2026-04-04 08:48:17,476 - lava_callback - DEBUG - Processing node 69d0cfd3691bac272b32346c: baseline-arm64-broonie 2026-04-04 08:48:17,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:48:17,947 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:48:17,949 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d0cfd3691bac272b32346c/log.txt.gz 2026-04-04 08:48:18,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:48:18,328 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:48:18,330 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d0cfd3691bac272b32346c/lava-logs.yaml 2026-04-04 08:48:18,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:48:18,491 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:48:18,493 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d0cfd3691bac272b32346c/lava_callback.json.gz 2026-04-04 08:48:18,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:48:18,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfd3691bac272b32346c HTTP/1.1" 200 None 2026-04-04 08:48:18,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:48:18,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 08:48:18,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:48:18,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cfd3691bac272b32346c HTTP/1.1" 200 None 2026-04-04 08:48:18,587 - lava_callback - INFO - Completed processing callback for node 69d0cfd3691bac272b32346c 2026-04-04 08:48:18,980 - lava_callback - INFO - Received callback for node 69d0cfd9691bac272b32347a INFO: 172.21.0.1:50774 - "POST /node/69d0cfd9691bac272b32347a HTTP/1.0" 202 Accepted 2026-04-04 08:48:18,989 - lava_callback - INFO - Starting async job submit for node 69d0cfd9691bac272b32347a 2026-04-04 08:48:19,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:48:19,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfd9691bac272b32347a HTTP/1.1" 200 None 2026-04-04 08:48:19,031 - lava_callback - DEBUG - Processing node 69d0cfd9691bac272b32347a: baseline-arm64-broonie 2026-04-04 08:48:19,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:48:19,460 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:48:19,462 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d0cfd9691bac272b32347a/log.txt.gz 2026-04-04 08:48:19,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:48:19,806 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:48:19,808 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d0cfd9691bac272b32347a/lava-logs.yaml 2026-04-04 08:48:19,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:48:19,956 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:48:19,958 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d0cfd9691bac272b32347a/lava_callback.json.gz 2026-04-04 08:48:19,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:48:19,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfd9691bac272b32347a HTTP/1.1" 200 None 2026-04-04 08:48:19,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:48:20,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 08:48:20,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:48:20,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cfd9691bac272b32347a HTTP/1.1" 200 None 2026-04-04 08:48:20,042 - lava_callback - INFO - Completed processing callback for node 69d0cfd9691bac272b32347a 2026-04-04 08:48:24,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:48:24,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:45712 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:48:36,056 - lava_callback - INFO - Received callback for node 69d0cfd7691bac272b323477 INFO: 172.21.0.1:44412 - "POST /node/69d0cfd7691bac272b323477 HTTP/1.0" 202 Accepted 2026-04-04 08:48:36,063 - lava_callback - INFO - Starting async job submit for node 69d0cfd7691bac272b323477 2026-04-04 08:48:36,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:48:36,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfd7691bac272b323477 HTTP/1.1" 200 None 2026-04-04 08:48:36,107 - lava_callback - DEBUG - Processing node 69d0cfd7691bac272b323477: baseline-arm64-broonie 2026-04-04 08:48:36,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:48:36,509 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:48:36,511 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d0cfd7691bac272b323477/log.txt.gz INFO: 172.21.0.1:44420 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:48:36,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:48:36,859 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:48:36,861 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d0cfd7691bac272b323477/lava-logs.yaml 2026-04-04 08:48:36,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:48:37,006 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:48:37,008 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d0cfd7691bac272b323477/lava_callback.json.gz 2026-04-04 08:48:37,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:48:37,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfd7691bac272b323477 HTTP/1.1" 200 None 2026-04-04 08:48:37,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:48:37,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 08:48:37,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:48:37,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cfd7691bac272b323477 HTTP/1.1" 200 None 2026-04-04 08:48:37,116 - lava_callback - INFO - Completed processing callback for node 69d0cfd7691bac272b323477 INFO: 172.21.0.1:33378 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:48:54,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:48:54,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-04 08:48:55,060 - lava_callback - INFO - Received callback for node 69d0cfcf691bac272b323466 INFO: 172.21.0.1:50762 - "POST /node/69d0cfcf691bac272b323466 HTTP/1.0" 202 Accepted 2026-04-04 08:48:55,068 - lava_callback - INFO - Starting async job submit for node 69d0cfcf691bac272b323466 2026-04-04 08:48:55,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:48:55,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfcf691bac272b323466 HTTP/1.1" 200 None 2026-04-04 08:48:55,117 - lava_callback - DEBUG - Processing node 69d0cfcf691bac272b323466: baseline-arm64-broonie 2026-04-04 08:48:55,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:48:55,504 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:48:55,506 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d0cfcf691bac272b323466/log.txt.gz 2026-04-04 08:48:55,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:48:55,888 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:48:55,890 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d0cfcf691bac272b323466/lava-logs.yaml 2026-04-04 08:48:55,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:48:56,058 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:48:56,060 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d0cfcf691bac272b323466/lava_callback.json.gz 2026-04-04 08:48:56,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:48:56,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfcf691bac272b323466 HTTP/1.1" 200 None 2026-04-04 08:48:56,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:48:56,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 08:48:56,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:48:56,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cfcf691bac272b323466 HTTP/1.1" 200 None 2026-04-04 08:48:56,146 - lava_callback - INFO - Completed processing callback for node 69d0cfcf691bac272b323466 INFO: 172.21.0.1:50774 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:48:56,687 - lava_callback - INFO - Received callback for node 69d0cfa3691bac272b3233a4 INFO: 172.21.0.1:50786 - "POST /node/69d0cfa3691bac272b3233a4 HTTP/1.0" 202 Accepted 2026-04-04 08:48:56,693 - lava_callback - INFO - Starting async job submit for node 69d0cfa3691bac272b3233a4 2026-04-04 08:48:56,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:48:56,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfa3691bac272b3233a4 HTTP/1.1" 200 None 2026-04-04 08:48:56,724 - lava_callback - DEBUG - Processing node 69d0cfa3691bac272b3233a4: baseline-arm64 2026-04-04 08:48:57,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:48:57,189 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:48:57,191 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0cfa3691bac272b3233a4/log.txt.gz 2026-04-04 08:48:57,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:48:57,628 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:48:57,630 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0cfa3691bac272b3233a4/lava-logs.yaml 2026-04-04 08:48:57,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:48:57,805 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:48:57,807 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0cfa3691bac272b3233a4/lava_callback.json.gz 2026-04-04 08:48:57,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:48:57,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfa3691bac272b3233a4 HTTP/1.1" 200 None 2026-04-04 08:48:57,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:48:57,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 08:48:57,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:48:57,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cfa3691bac272b3233a4 HTTP/1.1" 200 None 2026-04-04 08:48:57,904 - lava_callback - INFO - Completed processing callback for node 69d0cfa3691bac272b3233a4 INFO: 172.21.0.1:52492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57918 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57928 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:49:24,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:49:24,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42012 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:49:54,918 - lava_callback - INFO - Received callback for node 69d0cfd4691bac272b32346f INFO: 172.21.0.1:42702 - "POST /node/69d0cfd4691bac272b32346f HTTP/1.0" 202 Accepted 2026-04-04 08:49:54,926 - lava_callback - INFO - Starting async job submit for node 69d0cfd4691bac272b32346f 2026-04-04 08:49:54,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:49:54,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfd4691bac272b32346f HTTP/1.1" 200 None 2026-04-04 08:49:54,979 - lava_callback - DEBUG - Processing node 69d0cfd4691bac272b32346f: baseline-arm64-broonie 2026-04-04 08:49:55,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:49:55,468 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:49:55,470 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d0cfd4691bac272b32346f/log.txt.gz 2026-04-04 08:49:55,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:49:55,861 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:49:55,863 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d0cfd4691bac272b32346f/lava-logs.yaml 2026-04-04 08:49:55,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:49:56,053 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:49:56,055 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d0cfd4691bac272b32346f/lava_callback.json.gz 2026-04-04 08:49:56,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:49:56,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfd4691bac272b32346f HTTP/1.1" 200 None 2026-04-04 08:49:56,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:49:56,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 08:49:56,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:49:56,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cfd4691bac272b32346f HTTP/1.1" 200 None 2026-04-04 08:49:56,161 - lava_callback - INFO - Completed processing callback for node 69d0cfd4691bac272b32346f INFO: 172.21.0.1:42704 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:50:01,988 - lava_callback - INFO - Received callback for node 69d0cfb4691bac272b3233cf INFO: 172.21.0.1:50898 - "POST /node/69d0cfb4691bac272b3233cf HTTP/1.0" 202 Accepted 2026-04-04 08:50:01,997 - lava_callback - INFO - Starting async job submit for node 69d0cfb4691bac272b3233cf 2026-04-04 08:50:02,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:50:02,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfb4691bac272b3233cf HTTP/1.1" 200 None 2026-04-04 08:50:02,035 - lava_callback - DEBUG - Processing node 69d0cfb4691bac272b3233cf: baseline-nfs-arm64 2026-04-04 08:50:02,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:50:02,585 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:50:02,587 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d0cfb4691bac272b3233cf/log.txt.gz 2026-04-04 08:50:02,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:50:03,066 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:50:03,068 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d0cfb4691bac272b3233cf/lava-logs.yaml 2026-04-04 08:50:03,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:50:03,232 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:50:03,234 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d0cfb4691bac272b3233cf/lava_callback.json.gz 2026-04-04 08:50:03,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:50:03,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfb4691bac272b3233cf HTTP/1.1" 200 None 2026-04-04 08:50:03,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:50:03,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 08:50:03,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:50:03,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cfb4691bac272b3233cf HTTP/1.1" 200 None 2026-04-04 08:50:03,310 - lava_callback - INFO - Completed processing callback for node 69d0cfb4691bac272b3233cf INFO: 172.21.0.1:50902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53180 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:50:24,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:50:24,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47634 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:50:55,308 - lava_callback - INFO - Received callback for node 69d0cc30691bac272b322fac INFO: 172.21.0.1:38088 - "POST /node/69d0cc30691bac272b322fac HTTP/1.0" 202 Accepted 2026-04-04 08:50:55,315 - lava_callback - INFO - Starting async job submit for node 69d0cc30691bac272b322fac 2026-04-04 08:50:55,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:50:55,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cc30691bac272b322fac HTTP/1.1" 200 None 2026-04-04 08:50:55,388 - lava_callback - DEBUG - Processing node 69d0cc30691bac272b322fac: ltp-smoke 2026-04-04 08:50:55,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:50:56,066 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:50:56,068 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69d0cc30691bac272b322fac/log.txt.gz 2026-04-04 08:50:56,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:38092 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:50:56,554 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:50:56,556 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69d0cc30691bac272b322fac/lava-logs.yaml 2026-04-04 08:50:56,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:50:56,747 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:50:56,749 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69d0cc30691bac272b322fac/lava_callback.json.gz 2026-04-04 08:50:56,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:50:56,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cc30691bac272b322fac HTTP/1.1" 200 None 2026-04-04 08:50:56,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:50:56,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c908691bac272b322d8f HTTP/1.1" 200 None 2026-04-04 08:50:56,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:50:57,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cc30691bac272b322fac HTTP/1.1" 200 None 2026-04-04 08:50:57,139 - lava_callback - INFO - Completed processing callback for node 69d0cc30691bac272b322fac INFO: 172.21.0.1:48250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51844 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:51:24,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:51:24,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37334 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:52:14,663 - lava_callback - INFO - Received callback for node 69ce2e29cb08ea23a1f6857d INFO: 172.21.0.1:37338 - "POST /node/69ce2e29cb08ea23a1f6857d HTTP/1.0" 202 Accepted 2026-04-04 08:52:14,670 - lava_callback - INFO - Starting async job submit for node 69ce2e29cb08ea23a1f6857d 2026-04-04 08:52:14,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:52:14,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2e29cb08ea23a1f6857d HTTP/1.1" 200 None 2026-04-04 08:52:14,686 - lava_callback - DEBUG - Processing node 69ce2e29cb08ea23a1f6857d: baseline-arm-clabbe 2026-04-04 08:52:14,686 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce2e29cb08ea23a1f6857d 2026-04-04 08:52:14,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:52:14,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2e29cb08ea23a1f6857d HTTP/1.1" 200 None 2026-04-04 08:52:14,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:52:14,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-04 08:52:14,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:52:14,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2e29cb08ea23a1f6857d HTTP/1.1" 200 None 2026-04-04 08:52:14,761 - lava_callback - ERROR - Error processing callback for node 69ce2e29cb08ea23a1f6857d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37340 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40694 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:52:38,802 - lava_callback - INFO - Received callback for node 69ce2e51cb08ea23a1f68589 INFO: 172.21.0.1:40704 - "POST /node/69ce2e51cb08ea23a1f68589 HTTP/1.0" 202 Accepted 2026-04-04 08:52:38,808 - lava_callback - INFO - Starting async job submit for node 69ce2e51cb08ea23a1f68589 2026-04-04 08:52:38,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:52:38,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2e51cb08ea23a1f68589 HTTP/1.1" 200 None 2026-04-04 08:52:38,824 - lava_callback - DEBUG - Processing node 69ce2e51cb08ea23a1f68589: baseline-arm-baylibre 2026-04-04 08:52:38,824 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce2e51cb08ea23a1f68589 2026-04-04 08:52:38,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:52:38,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2e51cb08ea23a1f68589 HTTP/1.1" 200 None 2026-04-04 08:52:38,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:52:38,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-04 08:52:38,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:52:38,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2e51cb08ea23a1f68589 HTTP/1.1" 200 None 2026-04-04 08:52:38,917 - lava_callback - ERROR - Error processing callback for node 69ce2e51cb08ea23a1f68589: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51770 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:53:04,889 - lava_callback - INFO - Received callback for node 69d0cfa8691bac272b3233b3 INFO: 172.21.0.1:49616 - "POST /node/69d0cfa8691bac272b3233b3 HTTP/1.0" 202 Accepted 2026-04-04 08:53:04,896 - lava_callback - INFO - Starting async job submit for node 69d0cfa8691bac272b3233b3 2026-04-04 08:53:04,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:53:04,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfa8691bac272b3233b3 HTTP/1.1" 200 None 2026-04-04 08:53:04,954 - lava_callback - DEBUG - Processing node 69d0cfa8691bac272b3233b3: baseline-arm64 2026-04-04 08:53:05,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:53:05,978 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:53:05,980 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0cfa8691bac272b3233b3/log.txt.gz 2026-04-04 08:53:06,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:49628 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:53:06,620 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:53:06,622 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0cfa8691bac272b3233b3/lava-logs.yaml 2026-04-04 08:53:06,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:53:06,795 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:53:06,797 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0cfa8691bac272b3233b3/lava_callback.json.gz 2026-04-04 08:53:06,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:53:06,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfa8691bac272b3233b3 HTTP/1.1" 200 None 2026-04-04 08:53:06,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:53:06,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 08:53:06,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:53:06,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cfa8691bac272b3233b3 HTTP/1.1" 200 None 2026-04-04 08:53:06,896 - lava_callback - INFO - Completed processing callback for node 69d0cfa8691bac272b3233b3 INFO: 172.21.0.1:59316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59318 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59320 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:53:24,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:53:24,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56110 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:53:33,147 - lava_callback - INFO - Received callback for node 69d0cfb1691bac272b3233c9 INFO: 172.21.0.1:38406 - "POST /node/69d0cfb1691bac272b3233c9 HTTP/1.0" 202 Accepted 2026-04-04 08:53:33,155 - lava_callback - INFO - Starting async job submit for node 69d0cfb1691bac272b3233c9 2026-04-04 08:53:33,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:53:33,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfb1691bac272b3233c9 HTTP/1.1" 200 None 2026-04-04 08:53:33,211 - lava_callback - DEBUG - Processing node 69d0cfb1691bac272b3233c9: baseline-arm64 2026-04-04 08:53:33,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:53:33,793 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:53:33,795 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0cfb1691bac272b3233c9/log.txt.gz 2026-04-04 08:53:34,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:53:34,294 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:53:34,297 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0cfb1691bac272b3233c9/lava-logs.yaml 2026-04-04 08:53:34,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:53:34,518 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:53:34,519 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0cfb1691bac272b3233c9/lava_callback.json.gz DEBUG: Setup failed for 69d0cfb1691bac272b3233c9. Transitting job node result: incomplete -> fail 2026-04-04 08:53:34,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:53:34,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfb1691bac272b3233c9 HTTP/1.1" 200 None 2026-04-04 08:53:34,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:53:34,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 08:53:34,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:53:34,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cfb1691bac272b3233c9 HTTP/1.1" 200 None 2026-04-04 08:53:34,748 - lava_callback - INFO - Completed processing callback for node 69d0cfb1691bac272b3233c9 2026-04-04 08:53:34,765 - lava_callback - INFO - Received callback for node 69ce2e7dcb08ea23a1f68599 INFO: 172.21.0.1:38422 - "POST /node/69ce2e7dcb08ea23a1f68599 HTTP/1.0" 202 Accepted 2026-04-04 08:53:34,775 - lava_callback - INFO - Starting async job submit for node 69ce2e7dcb08ea23a1f68599 2026-04-04 08:53:34,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:53:34,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2e7dcb08ea23a1f68599 HTTP/1.1" 200 None 2026-04-04 08:53:34,794 - lava_callback - DEBUG - Processing node 69ce2e7dcb08ea23a1f68599: baseline-arm-clabbe 2026-04-04 08:53:34,794 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce2e7dcb08ea23a1f68599 2026-04-04 08:53:34,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:53:34,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2e7dcb08ea23a1f68599 HTTP/1.1" 200 None 2026-04-04 08:53:34,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:53:34,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-04 08:53:34,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:53:34,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2e7dcb08ea23a1f68599 HTTP/1.1" 200 None 2026-04-04 08:53:34,886 - lava_callback - ERROR - Error processing callback for node 69ce2e7dcb08ea23a1f68599: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41720 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:53:54,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:53:54,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49922 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60596 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:55:03,768 - lava_callback - INFO - Received callback for node 69d0cdfa691bac272b323038 INFO: 172.21.0.1:45700 - "POST /node/69d0cdfa691bac272b323038 HTTP/1.0" 202 Accepted 2026-04-04 08:55:03,775 - lava_callback - INFO - Starting async job submit for node 69d0cdfa691bac272b323038 2026-04-04 08:55:03,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:55:03,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cdfa691bac272b323038 HTTP/1.1" 200 None 2026-04-04 08:55:03,843 - lava_callback - DEBUG - Processing node 69d0cdfa691bac272b323038: baseline-arm 2026-04-04 08:55:04,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:55:04,627 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:55:04,628 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d0cdfa691bac272b323038/log.txt.gz 2026-04-04 08:55:05,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:55:05,307 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:55:05,310 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d0cdfa691bac272b323038/lava-logs.yaml 2026-04-04 08:55:05,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:55:05,490 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:55:05,492 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d0cdfa691bac272b323038/lava_callback.json.gz DEBUG: Setup failed for 69d0cdfa691bac272b323038. Transitting job node result: incomplete -> fail 2026-04-04 08:55:05,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:55:05,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cdfa691bac272b323038 HTTP/1.1" 200 None 2026-04-04 08:55:05,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:55:05,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-04 08:55:05,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:55:05,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cdfa691bac272b323038 HTTP/1.1" 200 None 2026-04-04 08:55:05,784 - lava_callback - INFO - Completed processing callback for node 69d0cdfa691bac272b323038 INFO: 172.21.0.1:45712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48482 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:55:18,890 - lava_callback - INFO - Received callback for node 69ce2ee2cb08ea23a1f685c0 INFO: 172.21.0.1:48498 - "POST /node/69ce2ee2cb08ea23a1f685c0 HTTP/1.0" 202 Accepted 2026-04-04 08:55:18,897 - lava_callback - INFO - Starting async job submit for node 69ce2ee2cb08ea23a1f685c0 2026-04-04 08:55:18,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:55:18,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2ee2cb08ea23a1f685c0 HTTP/1.1" 200 None 2026-04-04 08:55:18,913 - lava_callback - DEBUG - Processing node 69ce2ee2cb08ea23a1f685c0: baseline-arm-baylibre 2026-04-04 08:55:18,913 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce2ee2cb08ea23a1f685c0 2026-04-04 08:55:18,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:55:18,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2ee2cb08ea23a1f685c0 HTTP/1.1" 200 None 2026-04-04 08:55:18,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:55:18,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-04 08:55:18,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:55:18,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2ee2cb08ea23a1f685c0 HTTP/1.1" 200 None 2026-04-04 08:55:18,979 - lava_callback - ERROR - Error processing callback for node 69ce2ee2cb08ea23a1f685c0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-04 08:55:24,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:55:24,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41356 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:55:55,102 - lava_callback - INFO - Received callback for node 69ce2f0dcb08ea23a1f685da INFO: 172.21.0.1:49798 - "POST /node/69ce2f0dcb08ea23a1f685da HTTP/1.0" 202 Accepted 2026-04-04 08:55:55,110 - lava_callback - INFO - Starting async job submit for node 69ce2f0dcb08ea23a1f685da 2026-04-04 08:55:55,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:55:55,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2f0dcb08ea23a1f685da HTTP/1.1" 200 None 2026-04-04 08:55:55,129 - lava_callback - DEBUG - Processing node 69ce2f0dcb08ea23a1f685da: baseline-arm-clabbe 2026-04-04 08:55:55,130 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce2f0dcb08ea23a1f685da 2026-04-04 08:55:55,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:55:55,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2f0dcb08ea23a1f685da HTTP/1.1" 200 None 2026-04-04 08:55:55,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:55:55,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-04 08:55:55,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:55:55,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2f0dcb08ea23a1f685da HTTP/1.1" 200 None 2026-04-04 08:55:55,198 - lava_callback - ERROR - Error processing callback for node 69ce2f0dcb08ea23a1f685da: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46654 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:56:26,053 - lava_callback - INFO - Received callback for node 69d0cfac691bac272b3233bc INFO: 172.21.0.1:38810 - "POST /node/69d0cfac691bac272b3233bc HTTP/1.0" 202 Accepted 2026-04-04 08:56:26,060 - lava_callback - INFO - Starting async job submit for node 69d0cfac691bac272b3233bc 2026-04-04 08:56:26,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:56:26,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfac691bac272b3233bc HTTP/1.1" 200 None 2026-04-04 08:56:26,102 - lava_callback - DEBUG - Processing node 69d0cfac691bac272b3233bc: baseline-arm64 INFO: 172.21.0.1:38812 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:56:26,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:56:26,767 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:56:26,769 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0cfac691bac272b3233bc/log.txt.gz 2026-04-04 08:56:27,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:56:27,279 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:56:27,282 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0cfac691bac272b3233bc/lava-logs.yaml 2026-04-04 08:56:27,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:56:27,462 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:56:27,464 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0cfac691bac272b3233bc/lava_callback.json.gz 2026-04-04 08:56:27,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:56:27,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfac691bac272b3233bc HTTP/1.1" 200 None 2026-04-04 08:56:27,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:56:27,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 08:56:27,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:56:27,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cfac691bac272b3233bc HTTP/1.1" 200 None 2026-04-04 08:56:27,620 - lava_callback - INFO - Completed processing callback for node 69d0cfac691bac272b3233bc 2026-04-04 08:56:34,841 - lava_callback - INFO - Received callback for node 69ce2f35cb08ea23a1f685f9 INFO: 172.21.0.1:57216 - "POST /node/69ce2f35cb08ea23a1f685f9 HTTP/1.0" 202 Accepted 2026-04-04 08:56:34,846 - lava_callback - INFO - Starting async job submit for node 69ce2f35cb08ea23a1f685f9 2026-04-04 08:56:34,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:56:34,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2f35cb08ea23a1f685f9 HTTP/1.1" 200 None 2026-04-04 08:56:34,862 - lava_callback - DEBUG - Processing node 69ce2f35cb08ea23a1f685f9: baseline-arm-clabbe 2026-04-04 08:56:34,862 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce2f35cb08ea23a1f685f9 2026-04-04 08:56:34,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:56:34,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2f35cb08ea23a1f685f9 HTTP/1.1" 200 None 2026-04-04 08:56:34,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:56:34,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-04 08:56:34,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:56:34,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2f35cb08ea23a1f685f9 HTTP/1.1" 200 None 2026-04-04 08:56:34,919 - lava_callback - ERROR - Error processing callback for node 69ce2f35cb08ea23a1f685f9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-04 08:56:36,468 - lava_callback - INFO - Received callback for node 69d0d149691bac272b323762 INFO: 172.21.0.1:57228 - "POST /node/69d0d149691bac272b323762 HTTP/1.0" 202 Accepted 2026-04-04 08:56:36,477 - lava_callback - INFO - Starting async job submit for node 69d0d149691bac272b323762 2026-04-04 08:56:36,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:56:36,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d149691bac272b323762 HTTP/1.1" 200 None 2026-04-04 08:56:36,519 - lava_callback - DEBUG - Processing node 69d0d149691bac272b323762: ltp-fsx INFO: 172.21.0.1:57238 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:56:36,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:56:37,075 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:56:37,077 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fsx-69d0d149691bac272b323762/log.txt.gz 2026-04-04 08:56:37,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:56:37,560 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:56:37,563 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fsx-69d0d149691bac272b323762/lava-logs.yaml 2026-04-04 08:56:37,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:56:37,765 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:56:37,767 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fsx-69d0d149691bac272b323762/lava_callback.json.gz 2026-04-04 08:56:37,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:56:37,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d149691bac272b323762 HTTP/1.1" 200 None 2026-04-04 08:56:37,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:56:37,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-04 08:56:37,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:56:37,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0d149691bac272b323762 HTTP/1.1" 200 None 2026-04-04 08:56:37,849 - lava_callback - INFO - Completed processing callback for node 69d0d149691bac272b323762 2026-04-04 08:56:38,177 - lava_callback - INFO - Received callback for node 69d0cfbd691bac272b32341b INFO: 172.21.0.1:57248 - "POST /node/69d0cfbd691bac272b32341b HTTP/1.0" 202 Accepted 2026-04-04 08:56:38,183 - lava_callback - INFO - Starting async job submit for node 69d0cfbd691bac272b32341b 2026-04-04 08:56:38,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:56:38,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfbd691bac272b32341b HTTP/1.1" 200 None 2026-04-04 08:56:38,226 - lava_callback - DEBUG - Processing node 69d0cfbd691bac272b32341b: baseline-nfs-arm64 2026-04-04 08:56:38,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:56:38,821 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:56:38,822 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d0cfbd691bac272b32341b/log.txt.gz 2026-04-04 08:56:39,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:56:39,375 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:56:39,377 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d0cfbd691bac272b32341b/lava-logs.yaml 2026-04-04 08:56:39,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:56:39,553 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:56:39,555 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d0cfbd691bac272b32341b/lava_callback.json.gz 2026-04-04 08:56:39,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:56:39,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfbd691bac272b32341b HTTP/1.1" 200 None 2026-04-04 08:56:39,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:56:39,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 08:56:39,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:56:39,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cfbd691bac272b32341b HTTP/1.1" 200 None 2026-04-04 08:56:39,724 - lava_callback - INFO - Completed processing callback for node 69d0cfbd691bac272b32341b INFO: 172.21.0.1:44322 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:56:54,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:56:54,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49728 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:56:56,822 - lava_callback - INFO - Received callback for node 69d0d127691bac272b323744 INFO: 172.21.0.1:49734 - "POST /node/69d0d127691bac272b323744 HTTP/1.0" 202 Accepted 2026-04-04 08:56:56,832 - lava_callback - INFO - Starting async job submit for node 69d0d127691bac272b323744 2026-04-04 08:56:56,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:56:56,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d127691bac272b323744 HTTP/1.1" 200 None 2026-04-04 08:56:56,875 - lava_callback - DEBUG - Processing node 69d0d127691bac272b323744: ltp-fs_bind 2026-04-04 08:56:57,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:56:57,473 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:56:57,475 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69d0d127691bac272b323744/log.txt.gz 2026-04-04 08:56:57,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:56:57,992 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:56:57,994 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69d0d127691bac272b323744/lava-logs.yaml 2026-04-04 08:56:58,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:56:58,157 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:56:58,159 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69d0d127691bac272b323744/lava_callback.json.gz 2026-04-04 08:56:58,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:56:58,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d127691bac272b323744 HTTP/1.1" 200 None 2026-04-04 08:56:58,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:56:58,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-04 08:56:58,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:56:58,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0d127691bac272b323744 HTTP/1.1" 200 None 2026-04-04 08:56:58,261 - lava_callback - INFO - Completed processing callback for node 69d0d127691bac272b323744 INFO: 172.21.0.1:48670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34982 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:57:14,952 - lava_callback - INFO - Received callback for node 69ce2f5ccb08ea23a1f6860b INFO: 172.21.0.1:34992 - "POST /node/69ce2f5ccb08ea23a1f6860b HTTP/1.0" 202 Accepted 2026-04-04 08:57:14,958 - lava_callback - INFO - Starting async job submit for node 69ce2f5ccb08ea23a1f6860b 2026-04-04 08:57:14,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:57:14,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2f5ccb08ea23a1f6860b HTTP/1.1" 200 None 2026-04-04 08:57:14,977 - lava_callback - DEBUG - Processing node 69ce2f5ccb08ea23a1f6860b: baseline-arm-clabbe 2026-04-04 08:57:14,977 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce2f5ccb08ea23a1f6860b 2026-04-04 08:57:14,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:57:14,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2f5ccb08ea23a1f6860b HTTP/1.1" 200 None 2026-04-04 08:57:14,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:57:15,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-04 08:57:15,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:57:15,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2f5ccb08ea23a1f6860b HTTP/1.1" 200 None 2026-04-04 08:57:15,044 - lava_callback - ERROR - Error processing callback for node 69ce2f5ccb08ea23a1f6860b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35020 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:57:16,750 - lava_callback - INFO - Received callback for node 69d0d16c691bac272b323775 INFO: 172.21.0.1:35026 - "POST /node/69d0d16c691bac272b323775 HTTP/1.0" 202 Accepted 2026-04-04 08:57:16,757 - lava_callback - INFO - Starting async job submit for node 69d0d16c691bac272b323775 2026-04-04 08:57:16,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:57:16,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d16c691bac272b323775 HTTP/1.1" 200 None 2026-04-04 08:57:16,797 - lava_callback - DEBUG - Processing node 69d0d16c691bac272b323775: ltp-input 2026-04-04 08:57:17,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:57:17,273 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:57:17,275 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-input-69d0d16c691bac272b323775/log.txt.gz 2026-04-04 08:57:17,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:57:17,697 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:57:17,700 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-input-69d0d16c691bac272b323775/lava-logs.yaml 2026-04-04 08:57:17,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:57:17,902 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:57:17,904 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-input-69d0d16c691bac272b323775/lava_callback.json.gz 2026-04-04 08:57:17,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:57:17,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d16c691bac272b323775 HTTP/1.1" 200 None 2026-04-04 08:57:17,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:57:17,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-04 08:57:17,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:57:17,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0d16c691bac272b323775 HTTP/1.1" 200 None 2026-04-04 08:57:17,991 - lava_callback - INFO - Completed processing callback for node 69d0d16c691bac272b323775 2026-04-04 08:57:24,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:57:24,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38326 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:58:14,465 - lava_callback - INFO - Received callback for node 69d0ce1d691bac272b3230c9 INFO: 172.21.0.1:38336 - "POST /node/69d0ce1d691bac272b3230c9 HTTP/1.0" 202 Accepted 2026-04-04 08:58:14,513 - lava_callback - INFO - Starting async job submit for node 69d0ce1d691bac272b3230c9 2026-04-04 08:58:14,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:58:14,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ce1d691bac272b3230c9 HTTP/1.1" 200 None 2026-04-04 08:58:14,600 - lava_callback - DEBUG - Processing node 69d0ce1d691bac272b3230c9: baseline-arm-pengutronix 2026-04-04 08:58:14,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:58:14,889 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:58:14,890 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d0ce1d691bac272b3230c9/log.txt.gz 2026-04-04 08:58:14,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:58:15,137 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:58:15,140 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d0ce1d691bac272b3230c9/lava-logs.yaml 2026-04-04 08:58:15,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:38350 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-04 08:58:15,281 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:58:15,283 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d0ce1d691bac272b3230c9/lava_callback.json.gz DEBUG: Setup failed for 69d0ce1d691bac272b3230c9. Transitting job node result: incomplete -> fail 2026-04-04 08:58:15,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:58:15,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ce1d691bac272b3230c9 HTTP/1.1" 200 None 2026-04-04 08:58:15,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:58:15,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-04 08:58:15,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:58:15,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0ce1d691bac272b3230c9 HTTP/1.1" 200 None 2026-04-04 08:58:15,478 - lava_callback - INFO - Completed processing callback for node 69d0ce1d691bac272b3230c9 2026-04-04 08:58:16,507 - lava_callback - INFO - Received callback for node 69d0d191691bac272b323796 INFO: 172.21.0.1:38358 - "POST /node/69d0d191691bac272b323796 HTTP/1.0" 202 Accepted 2026-04-04 08:58:16,513 - lava_callback - INFO - Starting async job submit for node 69d0d191691bac272b323796 2026-04-04 08:58:16,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:38374 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:58:16,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d191691bac272b323796 HTTP/1.1" 200 None 2026-04-04 08:58:16,554 - lava_callback - DEBUG - Processing node 69d0d191691bac272b323796: ltp-ipc 2026-04-04 08:58:16,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:58:17,131 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:58:17,133 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-ipc-69d0d191691bac272b323796/log.txt.gz 2026-04-04 08:58:17,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:58:17,629 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:58:17,631 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-ipc-69d0d191691bac272b323796/lava-logs.yaml 2026-04-04 08:58:17,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:58:17,883 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:58:17,884 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-ipc-69d0d191691bac272b323796/lava_callback.json.gz 2026-04-04 08:58:17,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:58:17,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d191691bac272b323796 HTTP/1.1" 200 None 2026-04-04 08:58:17,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:58:17,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-04 08:58:17,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:58:17,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0d191691bac272b323796 HTTP/1.1" 200 None 2026-04-04 08:58:17,970 - lava_callback - INFO - Completed processing callback for node 69d0d191691bac272b323796 2026-04-04 08:58:24,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:58:24,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48816 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:58:56,312 - lava_callback - INFO - Received callback for node 69d0d1d0691bac272b3237e2 INFO: 172.21.0.1:58884 - "POST /node/69d0d1d0691bac272b3237e2 HTTP/1.0" 202 Accepted 2026-04-04 08:58:56,319 - lava_callback - INFO - Starting async job submit for node 69d0d1d0691bac272b3237e2 2026-04-04 08:58:56,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:58:56,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d1d0691bac272b3237e2 HTTP/1.1" 200 None 2026-04-04 08:58:56,361 - lava_callback - DEBUG - Processing node 69d0d1d0691bac272b3237e2: ltp-sched INFO: 172.21.0.1:58886 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:58:56,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:58:56,889 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:58:56,891 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-sched-69d0d1d0691bac272b3237e2/log.txt.gz 2026-04-04 08:58:57,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:58:57,321 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:58:57,323 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-sched-69d0d1d0691bac272b3237e2/lava-logs.yaml 2026-04-04 08:58:57,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:58:57,492 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:58:57,494 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-sched-69d0d1d0691bac272b3237e2/lava_callback.json.gz 2026-04-04 08:58:57,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:58:57,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d1d0691bac272b3237e2 HTTP/1.1" 200 None 2026-04-04 08:58:57,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:58:57,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-04 08:58:57,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:58:57,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0d1d0691bac272b3237e2 HTTP/1.1" 200 None 2026-04-04 08:58:57,581 - lava_callback - INFO - Completed processing callback for node 69d0d1d0691bac272b3237e2 INFO: 172.21.0.1:48248 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:59:07,048 - lava_callback - INFO - Received callback for node 69d0d298691bac272b323903 INFO: 172.21.0.1:48254 - "POST /node/69d0d298691bac272b323903 HTTP/1.0" 202 Accepted 2026-04-04 08:59:07,054 - lava_callback - INFO - Starting async job submit for node 69d0d298691bac272b323903 2026-04-04 08:59:07,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:59:07,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d298691bac272b323903 HTTP/1.1" 200 None 2026-04-04 08:59:07,088 - lava_callback - DEBUG - Processing node 69d0d298691bac272b323903: baseline-arm-pengutronix 2026-04-04 08:59:07,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:59:07,436 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:59:07,438 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d0d298691bac272b323903/log.txt.gz 2026-04-04 08:59:07,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:59:07,717 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:59:07,719 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d0d298691bac272b323903/lava-logs.yaml 2026-04-04 08:59:07,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 08:59:07,859 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 08:59:07,861 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d0d298691bac272b323903/lava_callback.json.gz 2026-04-04 08:59:07,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:59:07,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d298691bac272b323903 HTTP/1.1" 200 None 2026-04-04 08:59:07,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:59:07,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-04 08:59:07,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:59:07,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0d298691bac272b323903 HTTP/1.1" 200 None 2026-04-04 08:59:07,969 - lava_callback - INFO - Completed processing callback for node 69d0d298691bac272b323903 INFO: 172.21.0.1:57120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57136 - "GET / HTTP/1.0" 200 OK 2026-04-04 08:59:24,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 08:59:24,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40350 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:00:09,721 - lava_callback - INFO - Received callback for node 69d0d30f691bac272b3239a6 INFO: 172.21.0.1:46776 - "POST /node/69d0d30f691bac272b3239a6 HTTP/1.0" 202 Accepted 2026-04-04 09:00:09,729 - lava_callback - INFO - Starting async job submit for node 69d0d30f691bac272b3239a6 2026-04-04 09:00:09,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:00:09,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d30f691bac272b3239a6 HTTP/1.1" 200 None 2026-04-04 09:00:09,754 - lava_callback - DEBUG - Processing node 69d0d30f691bac272b3239a6: baseline-arm 2026-04-04 09:00:09,759 - lava_callback - WARNING - Failed to upload log 2026-04-04 09:00:09,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:00:09,932 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:00:09,934 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d0d30f691bac272b3239a6/lava-logs.yaml 2026-04-04 09:00:09,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:00:10,085 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:00:10,087 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d0d30f691bac272b3239a6/lava_callback.json.gz 2026-04-04 09:00:10,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:00:10,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d30f691bac272b3239a6 HTTP/1.1" 200 None 2026-04-04 09:00:10,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:00:10,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-04 09:00:10,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:00:10,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0d30f691bac272b3239a6 HTTP/1.1" 200 None 2026-04-04 09:00:10,175 - lava_callback - INFO - Completed processing callback for node 69d0d30f691bac272b3239a6 INFO: 172.21.0.1:46780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46794 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:00:24,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:00:24,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54724 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:00:56,734 - lava_callback - INFO - Received callback for node 69d0d22b691bac272b323871 INFO: 172.21.0.1:54736 - "POST /node/69d0d22b691bac272b323871 HTTP/1.0" 202 Accepted 2026-04-04 09:00:56,741 - lava_callback - INFO - Starting async job submit for node 69d0d22b691bac272b323871 2026-04-04 09:00:56,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:00:56,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d22b691bac272b323871 HTTP/1.1" 200 None 2026-04-04 09:00:56,803 - lava_callback - DEBUG - Processing node 69d0d22b691bac272b323871: ltp-timers 2026-04-04 09:00:57,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:00:57,312 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:00:57,314 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-timers-69d0d22b691bac272b323871/log.txt.gz 2026-04-04 09:00:57,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:00:57,723 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:00:57,725 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-timers-69d0d22b691bac272b323871/lava-logs.yaml 2026-04-04 09:00:57,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:00:57,912 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:00:57,914 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-timers-69d0d22b691bac272b323871/lava_callback.json.gz 2026-04-04 09:00:57,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:00:57,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d22b691bac272b323871 HTTP/1.1" 200 None 2026-04-04 09:00:57,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:00:57,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-04 09:00:57,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:00:57,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0d22b691bac272b323871 HTTP/1.1" 200 None 2026-04-04 09:00:58,000 - lava_callback - INFO - Completed processing callback for node 69d0d22b691bac272b323871 2026-04-04 09:00:59,192 - lava_callback - INFO - Received callback for node 69ce3047cb08ea23a1f6866d INFO: 172.21.0.1:54740 - "POST /node/69ce3047cb08ea23a1f6866d HTTP/1.0" 202 Accepted 2026-04-04 09:00:59,197 - lava_callback - INFO - Starting async job submit for node 69ce3047cb08ea23a1f6866d 2026-04-04 09:00:59,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:00:59,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3047cb08ea23a1f6866d HTTP/1.1" 200 None 2026-04-04 09:00:59,214 - lava_callback - DEBUG - Processing node 69ce3047cb08ea23a1f6866d: baseline-arm-baylibre 2026-04-04 09:00:59,214 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce3047cb08ea23a1f6866d 2026-04-04 09:00:59,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:00:59,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3047cb08ea23a1f6866d HTTP/1.1" 200 None 2026-04-04 09:00:59,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:00:59,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-04 09:00:59,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:00:59,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce3047cb08ea23a1f6866d HTTP/1.1" 200 None 2026-04-04 09:00:59,279 - lava_callback - ERROR - Error processing callback for node 69ce3047cb08ea23a1f6866d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37394 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:01:24,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:01:24,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40838 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:02:19,278 - lava_callback - INFO - Received callback for node 69ce3094cb08ea23a1f6868f INFO: 172.21.0.1:40842 - "POST /node/69ce3094cb08ea23a1f6868f HTTP/1.0" 202 Accepted 2026-04-04 09:02:19,284 - lava_callback - INFO - Starting async job submit for node 69ce3094cb08ea23a1f6868f 2026-04-04 09:02:19,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:02:19,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3094cb08ea23a1f6868f HTTP/1.1" 200 None 2026-04-04 09:02:19,299 - lava_callback - DEBUG - Processing node 69ce3094cb08ea23a1f6868f: baseline-arm-baylibre 2026-04-04 09:02:19,300 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce3094cb08ea23a1f6868f 2026-04-04 09:02:19,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:02:19,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3094cb08ea23a1f6868f HTTP/1.1" 200 None 2026-04-04 09:02:19,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:02:19,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-04 09:02:19,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:02:19,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce3094cb08ea23a1f6868f HTTP/1.1" 200 None 2026-04-04 09:02:19,365 - lava_callback - ERROR - Error processing callback for node 69ce3094cb08ea23a1f6868f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54072 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37804 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:03:39,619 - lava_callback - INFO - Received callback for node 69ce30e5cb08ea23a1f686b1 INFO: 172.21.0.1:37820 - "POST /node/69ce30e5cb08ea23a1f686b1 HTTP/1.0" 202 Accepted 2026-04-04 09:03:39,625 - lava_callback - INFO - Starting async job submit for node 69ce30e5cb08ea23a1f686b1 2026-04-04 09:03:39,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:03:39,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce30e5cb08ea23a1f686b1 HTTP/1.1" 200 None 2026-04-04 09:03:39,641 - lava_callback - DEBUG - Processing node 69ce30e5cb08ea23a1f686b1: baseline-arm-baylibre 2026-04-04 09:03:39,642 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce30e5cb08ea23a1f686b1 2026-04-04 09:03:39,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:03:39,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce30e5cb08ea23a1f686b1 HTTP/1.1" 200 None 2026-04-04 09:03:39,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:03:39,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-04 09:03:39,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:03:39,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce30e5cb08ea23a1f686b1 HTTP/1.1" 200 None 2026-04-04 09:03:39,697 - lava_callback - ERROR - Error processing callback for node 69ce30e5cb08ea23a1f686b1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44394 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:04:19,319 - lava_callback - INFO - Received callback for node 69ce310dcb08ea23a1f686bf INFO: 172.21.0.1:44400 - "POST /node/69ce310dcb08ea23a1f686bf HTTP/1.0" 202 Accepted 2026-04-04 09:04:19,324 - lava_callback - INFO - Starting async job submit for node 69ce310dcb08ea23a1f686bf 2026-04-04 09:04:19,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:04:19,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce310dcb08ea23a1f686bf HTTP/1.1" 200 None 2026-04-04 09:04:19,345 - lava_callback - DEBUG - Processing node 69ce310dcb08ea23a1f686bf: baseline-arm-baylibre 2026-04-04 09:04:19,346 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce310dcb08ea23a1f686bf 2026-04-04 09:04:19,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:04:19,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce310dcb08ea23a1f686bf HTTP/1.1" 200 None 2026-04-04 09:04:19,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:04:19,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-04 09:04:19,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:04:19,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce310dcb08ea23a1f686bf HTTP/1.1" 200 None 2026-04-04 09:04:19,400 - lava_callback - ERROR - Error processing callback for node 69ce310dcb08ea23a1f686bf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36388 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:04:59,426 - lava_callback - INFO - Received callback for node 69ce3133cb08ea23a1f686cb INFO: 172.21.0.1:36390 - "POST /node/69ce3133cb08ea23a1f686cb HTTP/1.0" 202 Accepted 2026-04-04 09:04:59,431 - lava_callback - INFO - Starting async job submit for node 69ce3133cb08ea23a1f686cb 2026-04-04 09:04:59,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:04:59,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3133cb08ea23a1f686cb HTTP/1.1" 200 None 2026-04-04 09:04:59,448 - lava_callback - DEBUG - Processing node 69ce3133cb08ea23a1f686cb: baseline-arm-baylibre 2026-04-04 09:04:59,448 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce3133cb08ea23a1f686cb 2026-04-04 09:04:59,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:04:59,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3133cb08ea23a1f686cb HTTP/1.1" 200 None 2026-04-04 09:04:59,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:04:59,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-04 09:04:59,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:04:59,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce3133cb08ea23a1f686cb HTTP/1.1" 200 None 2026-04-04 09:04:59,511 - lava_callback - ERROR - Error processing callback for node 69ce3133cb08ea23a1f686cb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48786 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:05:40,663 - lava_callback - INFO - Received callback for node 69d0cfb7691bac272b323407 INFO: 172.21.0.1:59710 - "POST /node/69d0cfb7691bac272b323407 HTTP/1.0" 202 Accepted 2026-04-04 09:05:40,680 - lava_callback - INFO - Starting async job submit for node 69d0cfb7691bac272b323407 2026-04-04 09:05:40,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:05:40,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfb7691bac272b323407 HTTP/1.1" 200 None 2026-04-04 09:05:40,810 - lava_callback - DEBUG - Processing node 69d0cfb7691bac272b323407: baseline-nfs-arm64 2026-04-04 09:05:42,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:05:42,679 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:05:42,681 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d0cfb7691bac272b323407/log.txt.gz 2026-04-04 09:05:43,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:05:44,036 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:05:44,039 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d0cfb7691bac272b323407/lava-logs.yaml 2026-04-04 09:05:44,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:05:44,460 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:05:44,462 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d0cfb7691bac272b323407/lava_callback.json.gz DEBUG: Setup failed for 69d0cfb7691bac272b323407. Transitting job node result: incomplete -> fail 2026-04-04 09:05:44,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:05:44,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfb7691bac272b323407 HTTP/1.1" 200 None 2026-04-04 09:05:44,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:05:44,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 09:05:44,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:05:44,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cfb7691bac272b323407 HTTP/1.1" 200 None 2026-04-04 09:05:44,763 - lava_callback - INFO - Completed processing callback for node 69d0cfb7691bac272b323407 2026-04-04 09:05:45,160 - lava_callback - INFO - Received callback for node 69d0cfb9691bac272b32340e INFO: 172.21.0.1:59718 - "POST /node/69d0cfb9691bac272b32340e HTTP/1.0" 202 Accepted 2026-04-04 09:05:45,178 - lava_callback - INFO - Starting async job submit for node 69d0cfb9691bac272b32340e 2026-04-04 09:05:45,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:05:45,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfb9691bac272b32340e HTTP/1.1" 200 None 2026-04-04 09:05:45,297 - lava_callback - DEBUG - Processing node 69d0cfb9691bac272b32340e: baseline-nfs-arm64 INFO: 172.21.0.1:59732 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:05:46,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:05:47,456 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:05:47,459 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d0cfb9691bac272b32340e/log.txt.gz 2026-04-04 09:05:48,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:05:48,864 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:05:48,867 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d0cfb9691bac272b32340e/lava-logs.yaml 2026-04-04 09:05:48,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:05:49,456 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:05:49,458 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d0cfb9691bac272b32340e/lava_callback.json.gz DEBUG: Setup failed for 69d0cfb9691bac272b32340e. Transitting job node result: incomplete -> fail 2026-04-04 09:05:49,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:05:49,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfb9691bac272b32340e HTTP/1.1" 200 None 2026-04-04 09:05:49,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:05:49,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 09:05:49,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:05:49,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cfb9691bac272b32340e HTTP/1.1" 200 None 2026-04-04 09:05:49,789 - lava_callback - INFO - Completed processing callback for node 69d0cfb9691bac272b32340e 2026-04-04 09:05:54,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:05:54,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35856 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:59336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38602 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:07:19,595 - lava_callback - INFO - Received callback for node 69ce31c2cb08ea23a1f68715 INFO: 172.21.0.1:38614 - "POST /node/69ce31c2cb08ea23a1f68715 HTTP/1.0" 202 Accepted 2026-04-04 09:07:19,605 - lava_callback - INFO - Starting async job submit for node 69ce31c2cb08ea23a1f68715 2026-04-04 09:07:19,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:07:19,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce31c2cb08ea23a1f68715 HTTP/1.1" 200 None 2026-04-04 09:07:19,622 - lava_callback - DEBUG - Processing node 69ce31c2cb08ea23a1f68715: baseline-arm-baylibre 2026-04-04 09:07:19,622 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce31c2cb08ea23a1f68715 2026-04-04 09:07:19,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:07:19,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce31c2cb08ea23a1f68715 HTTP/1.1" 200 None 2026-04-04 09:07:19,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:07:19,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-04 09:07:19,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:07:19,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce31c2cb08ea23a1f68715 HTTP/1.1" 200 None 2026-04-04 09:07:19,691 - lava_callback - ERROR - Error processing callback for node 69ce31c2cb08ea23a1f68715: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39284 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39288 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:08:19,538 - lava_callback - INFO - Received callback for node 69ce31efcb08ea23a1f68725 INFO: 172.21.0.1:39304 - "POST /node/69ce31efcb08ea23a1f68725 HTTP/1.0" 202 Accepted 2026-04-04 09:08:19,544 - lava_callback - INFO - Starting async job submit for node 69ce31efcb08ea23a1f68725 2026-04-04 09:08:19,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:08:19,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce31efcb08ea23a1f68725 HTTP/1.1" 200 None 2026-04-04 09:08:19,563 - lava_callback - DEBUG - Processing node 69ce31efcb08ea23a1f68725: baseline-arm64-baylibre 2026-04-04 09:08:19,563 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce31efcb08ea23a1f68725 2026-04-04 09:08:19,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:08:19,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce31efcb08ea23a1f68725 HTTP/1.1" 200 None 2026-04-04 09:08:19,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:08:19,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-04 09:08:19,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:08:19,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce31efcb08ea23a1f68725 HTTP/1.1" 200 None 2026-04-04 09:08:19,633 - lava_callback - ERROR - Error processing callback for node 69ce31efcb08ea23a1f68725: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-04 09:08:20,470 - lava_callback - INFO - Received callback for node 69d0d4fb691bac272b323b27 INFO: 172.21.0.1:34164 - "POST /node/69d0d4fb691bac272b323b27 HTTP/1.0" 202 Accepted 2026-04-04 09:08:20,478 - lava_callback - INFO - Starting async job submit for node 69d0d4fb691bac272b323b27 2026-04-04 09:08:20,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:08:20,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d4fb691bac272b323b27 HTTP/1.1" 200 None 2026-04-04 09:08:20,502 - lava_callback - DEBUG - Processing node 69d0d4fb691bac272b323b27: baseline-nfs-arm64 2026-04-04 09:08:20,504 - lava_callback - WARNING - Failed to upload log 2026-04-04 09:08:20,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:08:20,633 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:08:20,635 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d0d4fb691bac272b323b27/lava-logs.yaml 2026-04-04 09:08:20,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:08:20,760 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:08:20,762 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d0d4fb691bac272b323b27/lava_callback.json.gz 2026-04-04 09:08:20,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:08:20,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d4fb691bac272b323b27 HTTP/1.1" 200 None 2026-04-04 09:08:20,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:08:20,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 09:08:20,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:08:20,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0d4fb691bac272b323b27 HTTP/1.1" 200 None 2026-04-04 09:08:20,823 - lava_callback - INFO - Completed processing callback for node 69d0d4fb691bac272b323b27 2026-04-04 09:08:24,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:08:24,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40556 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:09:40,147 - lava_callback - INFO - Received callback for node 69ce323fcb08ea23a1f68732 INFO: 172.21.0.1:42348 - "POST /node/69ce323fcb08ea23a1f68732 HTTP/1.0" 202 Accepted 2026-04-04 09:09:40,153 - lava_callback - INFO - Starting async job submit for node 69ce323fcb08ea23a1f68732 2026-04-04 09:09:40,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:09:40,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce323fcb08ea23a1f68732 HTTP/1.1" 200 None 2026-04-04 09:09:40,169 - lava_callback - DEBUG - Processing node 69ce323fcb08ea23a1f68732: baseline-arm64-baylibre 2026-04-04 09:09:40,170 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce323fcb08ea23a1f68732 2026-04-04 09:09:40,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:09:40,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce323fcb08ea23a1f68732 HTTP/1.1" 200 None 2026-04-04 09:09:40,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:09:40,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-04 09:09:40,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:09:40,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce323fcb08ea23a1f68732 HTTP/1.1" 200 None 2026-04-04 09:09:40,228 - lava_callback - ERROR - Error processing callback for node 69ce323fcb08ea23a1f68732: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42354 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:09:51,332 - lava_callback - INFO - Received callback for node 69d0d534691bac272b323b7a INFO: 172.21.0.1:52426 - "POST /node/69d0d534691bac272b323b7a HTTP/1.0" 202 Accepted 2026-04-04 09:09:51,339 - lava_callback - INFO - Starting async job submit for node 69d0d534691bac272b323b7a 2026-04-04 09:09:51,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:09:51,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d534691bac272b323b7a HTTP/1.1" 200 None 2026-04-04 09:09:51,384 - lava_callback - DEBUG - Processing node 69d0d534691bac272b323b7a: baseline-arm64 2026-04-04 09:09:51,522 - lava_callback - WARNING - Failed to upload log 2026-04-04 09:09:51,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:09:51,818 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:09:51,820 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0d534691bac272b323b7a/lava-logs.yaml 2026-04-04 09:09:51,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:09:51,975 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:09:51,977 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0d534691bac272b323b7a/lava_callback.json.gz 2026-04-04 09:09:52,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:09:52,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d534691bac272b323b7a HTTP/1.1" 200 None 2026-04-04 09:09:52,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:09:52,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 09:09:52,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:09:52,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0d534691bac272b323b7a HTTP/1.1" 200 None 2026-04-04 09:09:52,161 - lava_callback - INFO - Completed processing callback for node 69d0d534691bac272b323b7a 2026-04-04 09:09:54,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:09:54,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51068 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:10:59,743 - lava_callback - INFO - Received callback for node 69ce3291cb08ea23a1f68746 INFO: 172.21.0.1:43380 - "POST /node/69ce3291cb08ea23a1f68746 HTTP/1.0" 202 Accepted 2026-04-04 09:10:59,751 - lava_callback - INFO - Starting async job submit for node 69ce3291cb08ea23a1f68746 2026-04-04 09:10:59,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:10:59,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3291cb08ea23a1f68746 HTTP/1.1" 200 None 2026-04-04 09:10:59,776 - lava_callback - DEBUG - Processing node 69ce3291cb08ea23a1f68746: baseline-arm64-baylibre 2026-04-04 09:10:59,776 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce3291cb08ea23a1f68746 2026-04-04 09:10:59,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:10:59,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3291cb08ea23a1f68746 HTTP/1.1" 200 None 2026-04-04 09:10:59,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:10:59,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-04 09:10:59,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:10:59,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce3291cb08ea23a1f68746 HTTP/1.1" 200 None 2026-04-04 09:10:59,827 - lava_callback - ERROR - Error processing callback for node 69ce3291cb08ea23a1f68746: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48050 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:11:19,019 - lava_callback - INFO - Received callback for node 69d0d578691bac272b323ba4 INFO: 172.21.0.1:48058 - "POST /node/69d0d578691bac272b323ba4 HTTP/1.0" 202 Accepted 2026-04-04 09:11:19,026 - lava_callback - INFO - Starting async job submit for node 69d0d578691bac272b323ba4 2026-04-04 09:11:19,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:11:19,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d578691bac272b323ba4 HTTP/1.1" 200 None 2026-04-04 09:11:19,070 - lava_callback - DEBUG - Processing node 69d0d578691bac272b323ba4: baseline-arm64 2026-04-04 09:11:19,203 - lava_callback - WARNING - Failed to upload log 2026-04-04 09:11:19,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:11:19,458 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:11:19,460 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0d578691bac272b323ba4/lava-logs.yaml 2026-04-04 09:11:19,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:11:19,599 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:11:19,601 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0d578691bac272b323ba4/lava_callback.json.gz 2026-04-04 09:11:19,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:11:19,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d578691bac272b323ba4 HTTP/1.1" 200 None 2026-04-04 09:11:19,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:11:19,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 09:11:19,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:11:19,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0d578691bac272b323ba4 HTTP/1.1" 200 None 2026-04-04 09:11:19,800 - lava_callback - INFO - Completed processing callback for node 69d0d578691bac272b323ba4 2026-04-04 09:11:24,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:11:24,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36386 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:12:19,883 - lava_callback - INFO - Received callback for node 69ce32e1cb08ea23a1f6874d INFO: 172.21.0.1:40640 - "POST /node/69ce32e1cb08ea23a1f6874d HTTP/1.0" 202 Accepted 2026-04-04 09:12:19,889 - lava_callback - INFO - Starting async job submit for node 69ce32e1cb08ea23a1f6874d 2026-04-04 09:12:19,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:12:19,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce32e1cb08ea23a1f6874d HTTP/1.1" 200 None 2026-04-04 09:12:19,904 - lava_callback - DEBUG - Processing node 69ce32e1cb08ea23a1f6874d: baseline-arm64-baylibre 2026-04-04 09:12:19,904 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce32e1cb08ea23a1f6874d 2026-04-04 09:12:19,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:12:19,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce32e1cb08ea23a1f6874d HTTP/1.1" 200 None 2026-04-04 09:12:19,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:12:19,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-04 09:12:19,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:12:19,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce32e1cb08ea23a1f6874d HTTP/1.1" 200 None 2026-04-04 09:12:19,957 - lava_callback - ERROR - Error processing callback for node 69ce32e1cb08ea23a1f6874d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40654 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:12:27,223 - lava_callback - INFO - Received callback for node 69d0d5c1691bac272b323bfb INFO: 172.21.0.1:40662 - "POST /node/69d0d5c1691bac272b323bfb HTTP/1.0" 202 Accepted 2026-04-04 09:12:27,229 - lava_callback - INFO - Starting async job submit for node 69d0d5c1691bac272b323bfb 2026-04-04 09:12:27,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:12:27,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d5c1691bac272b323bfb HTTP/1.1" 200 None 2026-04-04 09:12:27,264 - lava_callback - DEBUG - Processing node 69d0d5c1691bac272b323bfb: baseline-arm64 2026-04-04 09:12:27,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:12:27,786 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:12:27,788 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0d5c1691bac272b323bfb/log.txt.gz 2026-04-04 09:12:27,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:12:28,241 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:12:28,244 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0d5c1691bac272b323bfb/lava-logs.yaml 2026-04-04 09:12:28,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:12:28,413 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:12:28,415 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0d5c1691bac272b323bfb/lava_callback.json.gz 2026-04-04 09:12:28,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:12:28,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d5c1691bac272b323bfb HTTP/1.1" 200 None 2026-04-04 09:12:28,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:12:28,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 09:12:28,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:12:28,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0d5c1691bac272b323bfb HTTP/1.1" 200 None 2026-04-04 09:12:28,509 - lava_callback - INFO - Completed processing callback for node 69d0d5c1691bac272b323bfb INFO: 172.21.0.1:35496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33804 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:12:54,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:12:54,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54574 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:13:39,907 - lava_callback - INFO - Received callback for node 69ce332fcb08ea23a1f6875b INFO: 172.21.0.1:48716 - "POST /node/69ce332fcb08ea23a1f6875b HTTP/1.0" 202 Accepted 2026-04-04 09:13:39,913 - lava_callback - INFO - Starting async job submit for node 69ce332fcb08ea23a1f6875b 2026-04-04 09:13:39,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:13:39,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce332fcb08ea23a1f6875b HTTP/1.1" 200 None 2026-04-04 09:13:39,940 - lava_callback - DEBUG - Processing node 69ce332fcb08ea23a1f6875b: baseline-arm64-baylibre 2026-04-04 09:13:39,940 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce332fcb08ea23a1f6875b 2026-04-04 09:13:39,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:13:39,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce332fcb08ea23a1f6875b HTTP/1.1" 200 None 2026-04-04 09:13:39,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:13:39,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-04 09:13:39,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:13:40,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce332fcb08ea23a1f6875b HTTP/1.1" 200 None 2026-04-04 09:13:40,019 - lava_callback - ERROR - Error processing callback for node 69ce332fcb08ea23a1f6875b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48722 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:13:55,167 - lava_callback - INFO - Received callback for node 69d0d606691bac272b323c1c INFO: 172.21.0.1:52778 - "POST /node/69d0d606691bac272b323c1c HTTP/1.0" 202 Accepted 2026-04-04 09:13:55,173 - lava_callback - INFO - Starting async job submit for node 69d0d606691bac272b323c1c 2026-04-04 09:13:55,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:13:55,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d606691bac272b323c1c HTTP/1.1" 200 None 2026-04-04 09:13:55,218 - lava_callback - DEBUG - Processing node 69d0d606691bac272b323c1c: baseline-arm64 2026-04-04 09:13:55,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:13:55,836 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:13:55,838 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0d606691bac272b323c1c/log.txt.gz 2026-04-04 09:13:56,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:13:56,279 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:13:56,282 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0d606691bac272b323c1c/lava-logs.yaml 2026-04-04 09:13:56,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:13:56,451 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:13:56,453 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0d606691bac272b323c1c/lava_callback.json.gz 2026-04-04 09:13:56,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:52780 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:13:56,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d606691bac272b323c1c HTTP/1.1" 200 None 2026-04-04 09:13:56,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:13:56,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 09:13:56,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:13:56,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0d606691bac272b323c1c HTTP/1.1" 200 None 2026-04-04 09:13:56,636 - lava_callback - INFO - Completed processing callback for node 69d0d606691bac272b323c1c INFO: 172.21.0.1:37654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46384 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:14:24,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:14:24,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59396 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:14:39,892 - lava_callback - INFO - Received callback for node 69ce337ecb08ea23a1f68764 INFO: 172.21.0.1:39784 - "POST /node/69ce337ecb08ea23a1f68764 HTTP/1.0" 202 Accepted 2026-04-04 09:14:39,901 - lava_callback - INFO - Starting async job submit for node 69ce337ecb08ea23a1f68764 2026-04-04 09:14:39,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:14:39,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce337ecb08ea23a1f68764 HTTP/1.1" 200 None 2026-04-04 09:14:39,921 - lava_callback - DEBUG - Processing node 69ce337ecb08ea23a1f68764: baseline-arm64-baylibre 2026-04-04 09:14:39,921 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce337ecb08ea23a1f68764 2026-04-04 09:14:39,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:14:39,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce337ecb08ea23a1f68764 HTTP/1.1" 200 None 2026-04-04 09:14:39,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:14:39,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-04 09:14:39,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:14:39,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce337ecb08ea23a1f68764 HTTP/1.1" 200 None 2026-04-04 09:14:39,987 - lava_callback - ERROR - Error processing callback for node 69ce337ecb08ea23a1f68764: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36722 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-04 09:16:15,875 - lava_callback - INFO - Received callback for node 69ce33d4cb08ea23a1f6876f INFO: 172.21.0.1:36736 - "POST /node/69ce33d4cb08ea23a1f6876f HTTP/1.0" 202 Accepted 2026-04-04 09:16:15,884 - lava_callback - INFO - Starting async job submit for node 69ce33d4cb08ea23a1f6876f 2026-04-04 09:16:15,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:16:15,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce33d4cb08ea23a1f6876f HTTP/1.1" 200 None 2026-04-04 09:16:15,905 - lava_callback - DEBUG - Processing node 69ce33d4cb08ea23a1f6876f: baseline-arm64-clabbe 2026-04-04 09:16:15,905 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce33d4cb08ea23a1f6876f 2026-04-04 09:16:15,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:16:15,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce33d4cb08ea23a1f6876f HTTP/1.1" 200 None 2026-04-04 09:16:15,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:16:15,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-04 09:16:15,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:16:15,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce33d4cb08ea23a1f6876f HTTP/1.1" 200 None 2026-04-04 09:16:15,972 - lava_callback - ERROR - Error processing callback for node 69ce33d4cb08ea23a1f6876f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49674 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:17:35,891 - lava_callback - INFO - Received callback for node 69ce3423cb08ea23a1f6877c INFO: 172.21.0.1:46034 - "POST /node/69ce3423cb08ea23a1f6877c HTTP/1.0" 202 Accepted 2026-04-04 09:17:35,900 - lava_callback - INFO - Starting async job submit for node 69ce3423cb08ea23a1f6877c 2026-04-04 09:17:35,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:17:35,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3423cb08ea23a1f6877c HTTP/1.1" 200 None 2026-04-04 09:17:35,917 - lava_callback - DEBUG - Processing node 69ce3423cb08ea23a1f6877c: baseline-arm64-clabbe 2026-04-04 09:17:35,917 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce3423cb08ea23a1f6877c 2026-04-04 09:17:35,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:17:35,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3423cb08ea23a1f6877c HTTP/1.1" 200 None 2026-04-04 09:17:35,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:17:35,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-04 09:17:35,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:17:35,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce3423cb08ea23a1f6877c HTTP/1.1" 200 None 2026-04-04 09:17:36,003 - lava_callback - ERROR - Error processing callback for node 69ce3423cb08ea23a1f6877c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55540 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33344 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:18:55,928 - lava_callback - INFO - Received callback for node 69ce3477cb08ea23a1f6878d INFO: 172.21.0.1:35184 - "POST /node/69ce3477cb08ea23a1f6878d HTTP/1.0" 202 Accepted 2026-04-04 09:18:55,935 - lava_callback - INFO - Starting async job submit for node 69ce3477cb08ea23a1f6878d 2026-04-04 09:18:55,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:18:55,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3477cb08ea23a1f6878d HTTP/1.1" 200 None 2026-04-04 09:18:55,953 - lava_callback - DEBUG - Processing node 69ce3477cb08ea23a1f6878d: baseline-arm64-clabbe 2026-04-04 09:18:55,953 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce3477cb08ea23a1f6878d 2026-04-04 09:18:55,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:18:55,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3477cb08ea23a1f6878d HTTP/1.1" 200 None 2026-04-04 09:18:55,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:18:55,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-04 09:18:55,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:18:56,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce3477cb08ea23a1f6878d HTTP/1.1" 200 None 2026-04-04 09:18:56,018 - lava_callback - ERROR - Error processing callback for node 69ce3477cb08ea23a1f6878d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55648 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:20:03,387 - lava_callback - INFO - Received callback for node 69d0d68b691bac272b323cbf INFO: 172.21.0.1:35794 - "POST /node/69d0d68b691bac272b323cbf HTTP/1.0" 202 Accepted 2026-04-04 09:20:03,395 - lava_callback - INFO - Starting async job submit for node 69d0d68b691bac272b323cbf 2026-04-04 09:20:03,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:20:03,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d68b691bac272b323cbf HTTP/1.1" 200 None 2026-04-04 09:20:03,444 - lava_callback - DEBUG - Processing node 69d0d68b691bac272b323cbf: baseline-arm64 2026-04-04 09:20:03,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:20:04,028 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:20:04,029 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0d68b691bac272b323cbf/log.txt.gz 2026-04-04 09:20:04,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:20:04,455 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:20:04,457 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0d68b691bac272b323cbf/lava-logs.yaml 2026-04-04 09:20:04,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:20:04,662 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:20:04,664 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0d68b691bac272b323cbf/lava_callback.json.gz DEBUG: Setup failed for 69d0d68b691bac272b323cbf. Transitting job node result: incomplete -> fail 2026-04-04 09:20:04,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:20:04,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d68b691bac272b323cbf HTTP/1.1" 200 None 2026-04-04 09:20:04,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:20:04,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 09:20:04,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:20:04,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0d68b691bac272b323cbf HTTP/1.1" 200 None 2026-04-04 09:20:04,908 - lava_callback - INFO - Completed processing callback for node 69d0d68b691bac272b323cbf INFO: 172.21.0.1:35804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46702 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-04 09:20:15,883 - lava_callback - INFO - Received callback for node 69ce34c9cb08ea23a1f687d2 INFO: 172.21.0.1:46708 - "POST /node/69ce34c9cb08ea23a1f687d2 HTTP/1.0" 202 Accepted 2026-04-04 09:20:15,888 - lava_callback - INFO - Starting async job submit for node 69ce34c9cb08ea23a1f687d2 2026-04-04 09:20:15,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:20:15,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34c9cb08ea23a1f687d2 HTTP/1.1" 200 None 2026-04-04 09:20:15,906 - lava_callback - DEBUG - Processing node 69ce34c9cb08ea23a1f687d2: baseline-arm64-clabbe 2026-04-04 09:20:15,906 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce34c9cb08ea23a1f687d2 2026-04-04 09:20:15,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:20:15,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34c9cb08ea23a1f687d2 HTTP/1.1" 200 None 2026-04-04 09:20:15,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:20:15,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-04 09:20:15,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:20:15,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34c9cb08ea23a1f687d2 HTTP/1.1" 200 None 2026-04-04 09:20:15,971 - lava_callback - ERROR - Error processing callback for node 69ce34c9cb08ea23a1f687d2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46722 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:20:24,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:20:24,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48214 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:20:40,267 - lava_callback - INFO - Received callback for node 69ce34e2cb08ea23a1f68818 INFO: 172.21.0.1:47376 - "POST /node/69ce34e2cb08ea23a1f68818 HTTP/1.0" 202 Accepted 2026-04-04 09:20:40,275 - lava_callback - INFO - Starting async job submit for node 69ce34e2cb08ea23a1f68818 2026-04-04 09:20:40,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:20:40,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34e2cb08ea23a1f68818 HTTP/1.1" 200 None 2026-04-04 09:20:40,293 - lava_callback - DEBUG - Processing node 69ce34e2cb08ea23a1f68818: baseline-arm64-baylibre 2026-04-04 09:20:40,294 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce34e2cb08ea23a1f68818 2026-04-04 09:20:40,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:20:40,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34e2cb08ea23a1f68818 HTTP/1.1" 200 None 2026-04-04 09:20:40,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:20:40,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-04 09:20:40,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:20:40,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34e2cb08ea23a1f68818 HTTP/1.1" 200 None 2026-04-04 09:20:40,354 - lava_callback - ERROR - Error processing callback for node 69ce34e2cb08ea23a1f68818: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-04 09:20:40,966 - lava_callback - INFO - Received callback for node 69ce34e3cb08ea23a1f6881b INFO: 172.21.0.1:47378 - "POST /node/69ce34e3cb08ea23a1f6881b HTTP/1.0" 202 Accepted 2026-04-04 09:20:40,972 - lava_callback - INFO - Starting async job submit for node 69ce34e3cb08ea23a1f6881b 2026-04-04 09:20:40,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:20:40,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34e3cb08ea23a1f6881b HTTP/1.1" 200 None 2026-04-04 09:20:40,988 - lava_callback - DEBUG - Processing node 69ce34e3cb08ea23a1f6881b: baseline-arm64-baylibre 2026-04-04 09:20:40,988 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce34e3cb08ea23a1f6881b 2026-04-04 09:20:40,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:20:41,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34e3cb08ea23a1f6881b HTTP/1.1" 200 None 2026-04-04 09:20:41,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:20:41,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-04 09:20:41,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:20:41,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34e3cb08ea23a1f6881b HTTP/1.1" 200 None 2026-04-04 09:20:41,041 - lava_callback - ERROR - Error processing callback for node 69ce34e3cb08ea23a1f6881b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-04 09:20:41,650 - lava_callback - INFO - Received callback for node 69ce34e5cb08ea23a1f6881e INFO: 172.21.0.1:47390 - "POST /node/69ce34e5cb08ea23a1f6881e HTTP/1.0" 202 Accepted 2026-04-04 09:20:41,656 - lava_callback - INFO - Starting async job submit for node 69ce34e5cb08ea23a1f6881e 2026-04-04 09:20:41,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:20:41,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34e5cb08ea23a1f6881e HTTP/1.1" 200 None 2026-04-04 09:20:41,671 - lava_callback - DEBUG - Processing node 69ce34e5cb08ea23a1f6881e: baseline-arm64-baylibre 2026-04-04 09:20:41,671 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce34e5cb08ea23a1f6881e 2026-04-04 09:20:41,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:20:41,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34e5cb08ea23a1f6881e HTTP/1.1" 200 None 2026-04-04 09:20:41,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:20:41,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-04 09:20:41,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:20:41,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34e5cb08ea23a1f6881e HTTP/1.1" 200 None 2026-04-04 09:20:41,736 - lava_callback - ERROR - Error processing callback for node 69ce34e5cb08ea23a1f6881e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41972 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:21:00,222 - lava_callback - INFO - Received callback for node 69ce34e7cb08ea23a1f68840 INFO: 172.21.0.1:55254 - "POST /node/69ce34e7cb08ea23a1f68840 HTTP/1.0" 202 Accepted 2026-04-04 09:21:00,231 - lava_callback - INFO - Starting async job submit for node 69ce34e7cb08ea23a1f68840 2026-04-04 09:21:00,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:21:00,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34e7cb08ea23a1f68840 HTTP/1.1" 200 None 2026-04-04 09:21:00,247 - lava_callback - DEBUG - Processing node 69ce34e7cb08ea23a1f68840: baseline-arm64-baylibre 2026-04-04 09:21:00,248 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce34e7cb08ea23a1f68840 2026-04-04 09:21:00,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:21:00,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34e7cb08ea23a1f68840 HTTP/1.1" 200 None 2026-04-04 09:21:00,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:21:00,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-04 09:21:00,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:21:00,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34e7cb08ea23a1f68840 HTTP/1.1" 200 None 2026-04-04 09:21:00,325 - lava_callback - ERROR - Error processing callback for node 69ce34e7cb08ea23a1f68840: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-04 09:21:00,927 - lava_callback - INFO - Received callback for node 69ce34e9cb08ea23a1f68843 INFO: 172.21.0.1:55256 - "POST /node/69ce34e9cb08ea23a1f68843 HTTP/1.0" 202 Accepted 2026-04-04 09:21:00,933 - lava_callback - INFO - Starting async job submit for node 69ce34e9cb08ea23a1f68843 2026-04-04 09:21:00,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:21:00,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34e9cb08ea23a1f68843 HTTP/1.1" 200 None 2026-04-04 09:21:00,949 - lava_callback - DEBUG - Processing node 69ce34e9cb08ea23a1f68843: baseline-arm64-baylibre 2026-04-04 09:21:00,949 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce34e9cb08ea23a1f68843 2026-04-04 09:21:00,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:21:00,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34e9cb08ea23a1f68843 HTTP/1.1" 200 None 2026-04-04 09:21:00,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:21:00,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-04 09:21:00,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:21:01,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34e9cb08ea23a1f68843 HTTP/1.1" 200 None 2026-04-04 09:21:01,013 - lava_callback - ERROR - Error processing callback for node 69ce34e9cb08ea23a1f68843: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-04 09:21:01,621 - lava_callback - INFO - Received callback for node 69ce34eacb08ea23a1f6884a INFO: 172.21.0.1:55262 - "POST /node/69ce34eacb08ea23a1f6884a HTTP/1.0" 202 Accepted 2026-04-04 09:21:01,627 - lava_callback - INFO - Starting async job submit for node 69ce34eacb08ea23a1f6884a 2026-04-04 09:21:01,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:21:01,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34eacb08ea23a1f6884a HTTP/1.1" 200 None 2026-04-04 09:21:01,643 - lava_callback - DEBUG - Processing node 69ce34eacb08ea23a1f6884a: baseline-arm64-baylibre 2026-04-04 09:21:01,643 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce34eacb08ea23a1f6884a 2026-04-04 09:21:01,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:21:01,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34eacb08ea23a1f6884a HTTP/1.1" 200 None 2026-04-04 09:21:01,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:21:01,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-04 09:21:01,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:21:01,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34eacb08ea23a1f6884a HTTP/1.1" 200 None 2026-04-04 09:21:01,735 - lava_callback - ERROR - Error processing callback for node 69ce34eacb08ea23a1f6884a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43670 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-04 09:21:16,011 - lava_callback - INFO - Received callback for node 69ce34facb08ea23a1f6886e INFO: 172.21.0.1:43676 - "POST /node/69ce34facb08ea23a1f6886e HTTP/1.0" 202 Accepted 2026-04-04 09:21:16,018 - lava_callback - INFO - Starting async job submit for node 69ce34facb08ea23a1f6886e 2026-04-04 09:21:16,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:21:16,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34facb08ea23a1f6886e HTTP/1.1" 200 None 2026-04-04 09:21:16,033 - lava_callback - DEBUG - Processing node 69ce34facb08ea23a1f6886e: baseline-arm64-clabbe 2026-04-04 09:21:16,034 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce34facb08ea23a1f6886e 2026-04-04 09:21:16,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:21:16,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34facb08ea23a1f6886e HTTP/1.1" 200 None 2026-04-04 09:21:16,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:21:16,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-04 09:21:16,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:21:16,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34facb08ea23a1f6886e HTTP/1.1" 200 None 2026-04-04 09:21:16,098 - lava_callback - ERROR - Error processing callback for node 69ce34facb08ea23a1f6886e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43682 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:21:16,700 - lava_callback - INFO - Received callback for node 69ce34fccb08ea23a1f68871 INFO: 172.21.0.1:43686 - "POST /node/69ce34fccb08ea23a1f68871 HTTP/1.0" 202 Accepted 2026-04-04 09:21:16,706 - lava_callback - INFO - Starting async job submit for node 69ce34fccb08ea23a1f68871 2026-04-04 09:21:16,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:21:16,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34fccb08ea23a1f68871 HTTP/1.1" 200 None 2026-04-04 09:21:16,724 - lava_callback - DEBUG - Processing node 69ce34fccb08ea23a1f68871: baseline-arm64-clabbe 2026-04-04 09:21:16,724 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce34fccb08ea23a1f68871 2026-04-04 09:21:16,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:21:16,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34fccb08ea23a1f68871 HTTP/1.1" 200 None 2026-04-04 09:21:16,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:21:16,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-04 09:21:16,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:21:16,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34fccb08ea23a1f68871 HTTP/1.1" 200 None 2026-04-04 09:21:16,785 - lava_callback - ERROR - Error processing callback for node 69ce34fccb08ea23a1f68871: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-04 09:21:17,384 - lava_callback - INFO - Received callback for node 69ce34fdcb08ea23a1f68874 INFO: 172.21.0.1:43692 - "POST /node/69ce34fdcb08ea23a1f68874 HTTP/1.0" 202 Accepted 2026-04-04 09:21:17,389 - lava_callback - INFO - Starting async job submit for node 69ce34fdcb08ea23a1f68874 2026-04-04 09:21:17,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:21:17,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34fdcb08ea23a1f68874 HTTP/1.1" 200 None 2026-04-04 09:21:17,405 - lava_callback - DEBUG - Processing node 69ce34fdcb08ea23a1f68874: baseline-arm64-clabbe 2026-04-04 09:21:17,405 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce34fdcb08ea23a1f68874 2026-04-04 09:21:17,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:21:17,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34fdcb08ea23a1f68874 HTTP/1.1" 200 None 2026-04-04 09:21:17,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:21:17,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-04 09:21:17,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:21:17,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34fdcb08ea23a1f68874 HTTP/1.1" 200 None 2026-04-04 09:21:17,456 - lava_callback - ERROR - Error processing callback for node 69ce34fdcb08ea23a1f68874: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-04 09:21:17,463 - lava_callback - INFO - Received callback for node 69d0d710691bac272b323cf6 INFO: 172.21.0.1:43706 - "POST /node/69d0d710691bac272b323cf6 HTTP/1.0" 202 Accepted 2026-04-04 09:21:17,486 - lava_callback - INFO - Starting async job submit for node 69d0d710691bac272b323cf6 2026-04-04 09:21:17,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:21:17,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d710691bac272b323cf6 HTTP/1.1" 200 None 2026-04-04 09:21:17,558 - lava_callback - DEBUG - Processing node 69d0d710691bac272b323cf6: ltp-pty 2026-04-04 09:21:17,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:21:18,068 - lava_callback - INFO - Received callback for node 69ce34fdcb08ea23a1f68877 INFO: 172.21.0.1:43710 - "POST /node/69ce34fdcb08ea23a1f68877 HTTP/1.0" 202 Accepted 2026-04-04 09:21:18,074 - lava_callback - INFO - Starting async job submit for node 69ce34fdcb08ea23a1f68877 2026-04-04 09:21:18,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:21:18,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34fdcb08ea23a1f68877 HTTP/1.1" 200 None 2026-04-04 09:21:18,090 - lava_callback - DEBUG - Processing node 69ce34fdcb08ea23a1f68877: baseline-arm64-clabbe 2026-04-04 09:21:18,091 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce34fdcb08ea23a1f68877 2026-04-04 09:21:18,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:21:18,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34fdcb08ea23a1f68877 HTTP/1.1" 200 None 2026-04-04 09:21:18,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:21:18,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-04 09:21:18,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:21:18,130 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:21:18,132 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-pty-69d0d710691bac272b323cf6/log.txt.gz 2026-04-04 09:21:18,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34fdcb08ea23a1f68877 HTTP/1.1" 200 None 2026-04-04 09:21:18,206 - lava_callback - ERROR - Error processing callback for node 69ce34fdcb08ea23a1f68877: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-04 09:21:18,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:21:18,736 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:21:18,738 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-pty-69d0d710691bac272b323cf6/lava-logs.yaml 2026-04-04 09:21:18,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:21:18,765 - lava_callback - INFO - Received callback for node 69ce34ffcb08ea23a1f6887d INFO: 172.21.0.1:43724 - "POST /node/69ce34ffcb08ea23a1f6887d HTTP/1.0" 202 Accepted 2026-04-04 09:21:18,772 - lava_callback - INFO - Starting async job submit for node 69ce34ffcb08ea23a1f6887d 2026-04-04 09:21:18,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:21:18,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34ffcb08ea23a1f6887d HTTP/1.1" 200 None 2026-04-04 09:21:18,788 - lava_callback - DEBUG - Processing node 69ce34ffcb08ea23a1f6887d: baseline-arm64-clabbe 2026-04-04 09:21:18,789 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce34ffcb08ea23a1f6887d 2026-04-04 09:21:18,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:21:18,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34ffcb08ea23a1f6887d HTTP/1.1" 200 None 2026-04-04 09:21:18,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:21:18,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-04 09:21:18,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:21:18,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34ffcb08ea23a1f6887d HTTP/1.1" 200 None 2026-04-04 09:21:18,854 - lava_callback - ERROR - Error processing callback for node 69ce34ffcb08ea23a1f6887d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-04 09:21:18,991 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:21:18,993 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-pty-69d0d710691bac272b323cf6/lava_callback.json.gz 2026-04-04 09:21:19,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:21:19,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d710691bac272b323cf6 HTTP/1.1" 200 None 2026-04-04 09:21:19,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:21:19,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-04 09:21:19,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:21:19,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0d710691bac272b323cf6 HTTP/1.1" 200 None 2026-04-04 09:21:19,136 - lava_callback - INFO - Completed processing callback for node 69d0d710691bac272b323cf6 2026-04-04 09:21:19,441 - lava_callback - INFO - Received callback for node 69ce3500cb08ea23a1f68880 INFO: 172.21.0.1:43740 - "POST /node/69ce3500cb08ea23a1f68880 HTTP/1.0" 202 Accepted 2026-04-04 09:21:19,450 - lava_callback - INFO - Starting async job submit for node 69ce3500cb08ea23a1f68880 2026-04-04 09:21:19,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:21:19,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3500cb08ea23a1f68880 HTTP/1.1" 200 None 2026-04-04 09:21:19,473 - lava_callback - DEBUG - Processing node 69ce3500cb08ea23a1f68880: baseline-arm64-clabbe 2026-04-04 09:21:19,474 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce3500cb08ea23a1f68880 2026-04-04 09:21:19,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:21:19,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3500cb08ea23a1f68880 HTTP/1.1" 200 None 2026-04-04 09:21:19,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:21:19,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-04 09:21:19,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:21:19,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce3500cb08ea23a1f68880 HTTP/1.1" 200 None 2026-04-04 09:21:19,555 - lava_callback - ERROR - Error processing callback for node 69ce3500cb08ea23a1f68880: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-04 09:21:24,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:21:24,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40930 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:21:36,015 - lava_callback - INFO - Received callback for node 69ce3518cb08ea23a1f688ad INFO: 172.21.0.1:42386 - "POST /node/69ce3518cb08ea23a1f688ad HTTP/1.0" 202 Accepted 2026-04-04 09:21:36,021 - lava_callback - INFO - Starting async job submit for node 69ce3518cb08ea23a1f688ad 2026-04-04 09:21:36,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:21:36,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3518cb08ea23a1f688ad HTTP/1.1" 200 None 2026-04-04 09:21:36,036 - lava_callback - DEBUG - Processing node 69ce3518cb08ea23a1f688ad: baseline-arm64-clabbe 2026-04-04 09:21:36,036 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce3518cb08ea23a1f688ad 2026-04-04 09:21:36,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:21:36,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3518cb08ea23a1f688ad HTTP/1.1" 200 None 2026-04-04 09:21:36,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:21:36,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-04 09:21:36,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:21:36,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce3518cb08ea23a1f688ad HTTP/1.1" 200 None 2026-04-04 09:21:36,094 - lava_callback - ERROR - Error processing callback for node 69ce3518cb08ea23a1f688ad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51640 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:22:16,751 - lava_callback - INFO - Received callback for node 69d0d74f691bac272b323d44 INFO: 172.21.0.1:51646 - "POST /node/69d0d74f691bac272b323d44 HTTP/1.0" 202 Accepted 2026-04-04 09:22:16,758 - lava_callback - INFO - Starting async job submit for node 69d0d74f691bac272b323d44 2026-04-04 09:22:16,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:22:16,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d74f691bac272b323d44 HTTP/1.1" 200 None 2026-04-04 09:22:16,798 - lava_callback - DEBUG - Processing node 69d0d74f691bac272b323d44: ltp-smoke 2026-04-04 09:22:17,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:22:17,333 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:22:17,336 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69d0d74f691bac272b323d44/log.txt.gz 2026-04-04 09:22:17,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:22:17,849 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:22:17,851 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69d0d74f691bac272b323d44/lava-logs.yaml 2026-04-04 09:22:17,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:22:18,042 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:22:18,044 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69d0d74f691bac272b323d44/lava_callback.json.gz 2026-04-04 09:22:18,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:22:18,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d74f691bac272b323d44 HTTP/1.1" 200 None 2026-04-04 09:22:18,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:22:18,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-04 09:22:18,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:22:18,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0d74f691bac272b323d44 HTTP/1.1" 200 None 2026-04-04 09:22:18,157 - lava_callback - INFO - Completed processing callback for node 69d0d74f691bac272b323d44 2026-04-04 09:22:24,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:22:24,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57884 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:22:56,097 - lava_callback - INFO - Received callback for node 69ce3568cb08ea23a1f68908 INFO: 172.21.0.1:53588 - "POST /node/69ce3568cb08ea23a1f68908 HTTP/1.0" 202 Accepted 2026-04-04 09:22:56,103 - lava_callback - INFO - Starting async job submit for node 69ce3568cb08ea23a1f68908 2026-04-04 09:22:56,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:22:56,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3568cb08ea23a1f68908 HTTP/1.1" 200 None 2026-04-04 09:22:56,122 - lava_callback - DEBUG - Processing node 69ce3568cb08ea23a1f68908: baseline-arm64-clabbe 2026-04-04 09:22:56,122 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce3568cb08ea23a1f68908 2026-04-04 09:22:56,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:22:56,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3568cb08ea23a1f68908 HTTP/1.1" 200 None 2026-04-04 09:22:56,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:22:56,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-04 09:22:56,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:22:56,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce3568cb08ea23a1f68908 HTTP/1.1" 200 None 2026-04-04 09:22:56,182 - lava_callback - ERROR - Error processing callback for node 69ce3568cb08ea23a1f68908: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43006 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:23:56,179 - lava_callback - INFO - Received callback for node 69ce35a8cb08ea23a1f68985 INFO: 172.21.0.1:48938 - "POST /node/69ce35a8cb08ea23a1f68985 HTTP/1.0" 202 Accepted 2026-04-04 09:23:56,188 - lava_callback - INFO - Starting async job submit for node 69ce35a8cb08ea23a1f68985 2026-04-04 09:23:56,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:23:56,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce35a8cb08ea23a1f68985 HTTP/1.1" 200 None 2026-04-04 09:23:56,204 - lava_callback - DEBUG - Processing node 69ce35a8cb08ea23a1f68985: baseline-arm-clabbe 2026-04-04 09:23:56,204 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce35a8cb08ea23a1f68985 2026-04-04 09:23:56,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:23:56,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce35a8cb08ea23a1f68985 HTTP/1.1" 200 None 2026-04-04 09:23:56,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:23:56,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-04 09:23:56,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:23:56,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce35a8cb08ea23a1f68985 HTTP/1.1" 200 None 2026-04-04 09:23:56,263 - lava_callback - ERROR - Error processing callback for node 69ce35a8cb08ea23a1f68985: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44616 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-04 09:25:16,213 - lava_callback - INFO - Received callback for node 69ce35f1cb08ea23a1f689d0 INFO: 172.21.0.1:44622 - "POST /node/69ce35f1cb08ea23a1f689d0 HTTP/1.0" 202 Accepted 2026-04-04 09:25:16,218 - lava_callback - INFO - Starting async job submit for node 69ce35f1cb08ea23a1f689d0 2026-04-04 09:25:16,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:25:16,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce35f1cb08ea23a1f689d0 HTTP/1.1" 200 None 2026-04-04 09:25:16,234 - lava_callback - DEBUG - Processing node 69ce35f1cb08ea23a1f689d0: baseline-arm-clabbe 2026-04-04 09:25:16,234 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce35f1cb08ea23a1f689d0 2026-04-04 09:25:16,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:25:16,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce35f1cb08ea23a1f689d0 HTTP/1.1" 200 None 2026-04-04 09:25:16,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:25:16,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-04 09:25:16,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:25:16,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce35f1cb08ea23a1f689d0 HTTP/1.1" 200 None 2026-04-04 09:25:16,310 - lava_callback - ERROR - Error processing callback for node 69ce35f1cb08ea23a1f689d0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34532 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:25:30,361 - lava_callback - INFO - Received callback for node 69d0d8f5691bac272b323f1c INFO: 172.21.0.1:53394 - "POST /node/69d0d8f5691bac272b323f1c HTTP/1.0" 202 Accepted 2026-04-04 09:25:30,366 - lava_callback - INFO - Starting async job submit for node 69d0d8f5691bac272b323f1c 2026-04-04 09:25:30,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:25:30,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d8f5691bac272b323f1c HTTP/1.1" 200 None 2026-04-04 09:25:30,385 - lava_callback - DEBUG - Processing node 69d0d8f5691bac272b323f1c: baseline-arm 2026-04-04 09:25:30,390 - lava_callback - WARNING - Failed to upload log 2026-04-04 09:25:30,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:25:30,524 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:25:30,526 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d0d8f5691bac272b323f1c/lava-logs.yaml 2026-04-04 09:25:30,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:25:30,649 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:25:30,651 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d0d8f5691bac272b323f1c/lava_callback.json.gz 2026-04-04 09:25:30,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:25:30,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d8f5691bac272b323f1c HTTP/1.1" 200 None 2026-04-04 09:25:30,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:25:30,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-04 09:25:30,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:25:30,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0d8f5691bac272b323f1c HTTP/1.1" 200 None 2026-04-04 09:25:30,734 - lava_callback - INFO - Completed processing callback for node 69d0d8f5691bac272b323f1c INFO: 172.21.0.1:53406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42020 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:25:54,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:25:54,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50266 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-04 09:27:16,261 - lava_callback - INFO - Received callback for node 69ce3662cb08ea23a1f68a00 INFO: 172.21.0.1:50270 - "POST /node/69ce3662cb08ea23a1f68a00 HTTP/1.0" 202 Accepted 2026-04-04 09:27:16,267 - lava_callback - INFO - Starting async job submit for node 69ce3662cb08ea23a1f68a00 2026-04-04 09:27:16,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:27:16,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3662cb08ea23a1f68a00 HTTP/1.1" 200 None 2026-04-04 09:27:16,285 - lava_callback - DEBUG - Processing node 69ce3662cb08ea23a1f68a00: baseline-arm-clabbe 2026-04-04 09:27:16,285 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce3662cb08ea23a1f68a00 2026-04-04 09:27:16,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:27:16,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3662cb08ea23a1f68a00 HTTP/1.1" 200 None 2026-04-04 09:27:16,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:27:16,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-04 09:27:16,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:27:16,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce3662cb08ea23a1f68a00 HTTP/1.1" 200 None 2026-04-04 09:27:16,363 - lava_callback - ERROR - Error processing callback for node 69ce3662cb08ea23a1f68a00: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52330 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:28:36,321 - lava_callback - INFO - Received callback for node 69ce36aecb08ea23a1f68a1c INFO: 172.21.0.1:58438 - "POST /node/69ce36aecb08ea23a1f68a1c HTTP/1.0" 202 Accepted 2026-04-04 09:28:36,326 - lava_callback - INFO - Starting async job submit for node 69ce36aecb08ea23a1f68a1c 2026-04-04 09:28:36,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:28:36,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce36aecb08ea23a1f68a1c HTTP/1.1" 200 None 2026-04-04 09:28:36,348 - lava_callback - DEBUG - Processing node 69ce36aecb08ea23a1f68a1c: baseline-arm-clabbe 2026-04-04 09:28:36,348 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce36aecb08ea23a1f68a1c 2026-04-04 09:28:36,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:28:36,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce36aecb08ea23a1f68a1c HTTP/1.1" 200 None 2026-04-04 09:28:36,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:28:36,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-04 09:28:36,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:28:36,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce36aecb08ea23a1f68a1c HTTP/1.1" 200 None 2026-04-04 09:28:36,427 - lava_callback - ERROR - Error processing callback for node 69ce36aecb08ea23a1f68a1c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57728 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:29:36,384 - lava_callback - INFO - Received callback for node 69ce36f9cb08ea23a1f68a35 INFO: 172.21.0.1:60440 - "POST /node/69ce36f9cb08ea23a1f68a35 HTTP/1.0" 202 Accepted 2026-04-04 09:29:36,389 - lava_callback - INFO - Starting async job submit for node 69ce36f9cb08ea23a1f68a35 2026-04-04 09:29:36,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:29:36,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce36f9cb08ea23a1f68a35 HTTP/1.1" 200 None 2026-04-04 09:29:36,406 - lava_callback - DEBUG - Processing node 69ce36f9cb08ea23a1f68a35: baseline-arm-clabbe 2026-04-04 09:29:36,406 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce36f9cb08ea23a1f68a35 2026-04-04 09:29:36,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:29:36,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce36f9cb08ea23a1f68a35 HTTP/1.1" 200 None 2026-04-04 09:29:36,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:29:36,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-04 09:29:36,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:29:36,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce36f9cb08ea23a1f68a35 HTTP/1.1" 200 None 2026-04-04 09:29:36,464 - lava_callback - ERROR - Error processing callback for node 69ce36f9cb08ea23a1f68a35: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40954 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:31:00,938 - lava_callback - INFO - Received callback for node 69ce374bcb08ea23a1f68a5b INFO: 172.21.0.1:53666 - "POST /node/69ce374bcb08ea23a1f68a5b HTTP/1.0" 202 Accepted 2026-04-04 09:31:00,945 - lava_callback - INFO - Starting async job submit for node 69ce374bcb08ea23a1f68a5b 2026-04-04 09:31:00,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:31:00,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce374bcb08ea23a1f68a5b HTTP/1.1" 200 None 2026-04-04 09:31:00,968 - lava_callback - DEBUG - Processing node 69ce374bcb08ea23a1f68a5b: baseline-arm64-baylibre 2026-04-04 09:31:00,968 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce374bcb08ea23a1f68a5b 2026-04-04 09:31:00,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:31:00,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce374bcb08ea23a1f68a5b HTTP/1.1" 200 None 2026-04-04 09:31:00,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:31:01,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-04 09:31:01,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:31:01,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce374bcb08ea23a1f68a5b HTTP/1.1" 200 None 2026-04-04 09:31:01,047 - lava_callback - ERROR - Error processing callback for node 69ce374bcb08ea23a1f68a5b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41708 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:31:17,366 - lava_callback - INFO - Received callback for node 69d0d640691bac272b323c59 INFO: 172.21.0.1:41716 - "POST /node/69d0d640691bac272b323c59 HTTP/1.0" 202 Accepted 2026-04-04 09:31:17,373 - lava_callback - INFO - Starting async job submit for node 69d0d640691bac272b323c59 2026-04-04 09:31:17,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:31:17,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d640691bac272b323c59 HTTP/1.1" 200 None 2026-04-04 09:31:17,449 - lava_callback - DEBUG - Processing node 69d0d640691bac272b323c59: ltp-smoke 2026-04-04 09:31:17,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:31:18,083 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:31:18,085 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69d0d640691bac272b323c59/log.txt.gz 2026-04-04 09:31:18,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:31:18,608 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:31:18,611 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69d0d640691bac272b323c59/lava-logs.yaml 2026-04-04 09:31:18,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:31:18,837 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:31:18,840 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69d0d640691bac272b323c59/lava_callback.json.gz 2026-04-04 09:31:18,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:31:19,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d640691bac272b323c59 HTTP/1.1" 200 None 2026-04-04 09:31:19,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:31:19,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c908691bac272b322d8f HTTP/1.1" 200 None 2026-04-04 09:31:19,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:31:19,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0d640691bac272b323c59 HTTP/1.1" 200 None 2026-04-04 09:31:19,193 - lava_callback - INFO - Completed processing callback for node 69d0d640691bac272b323c59 2026-04-04 09:31:24,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:31:24,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57778 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:31:31,970 - lava_callback - INFO - Received callback for node 69d0d715691bac272b323cf9 INFO: 172.21.0.1:43820 - "POST /node/69d0d715691bac272b323cf9 HTTP/1.0" 202 Accepted 2026-04-04 09:31:31,977 - lava_callback - INFO - Starting async job submit for node 69d0d715691bac272b323cf9 2026-04-04 09:31:32,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:31:32,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d715691bac272b323cf9 HTTP/1.1" 200 None 2026-04-04 09:31:32,049 - lava_callback - DEBUG - Processing node 69d0d715691bac272b323cf9: baseline-arm 2026-04-04 09:31:32,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:31:32,783 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:31:32,785 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d0d715691bac272b323cf9/log.txt.gz 2026-04-04 09:31:33,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:31:33,321 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:31:33,323 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d0d715691bac272b323cf9/lava-logs.yaml 2026-04-04 09:31:33,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:31:33,491 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:31:33,493 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d0d715691bac272b323cf9/lava_callback.json.gz DEBUG: Setup failed for 69d0d715691bac272b323cf9. Transitting job node result: incomplete -> fail 2026-04-04 09:31:33,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:31:33,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d715691bac272b323cf9 HTTP/1.1" 200 None 2026-04-04 09:31:33,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:31:33,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-04 09:31:33,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:31:33,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0d715691bac272b323cf9 HTTP/1.1" 200 None 2026-04-04 09:31:33,779 - lava_callback - INFO - Completed processing callback for node 69d0d715691bac272b323cf9 INFO: 172.21.0.1:43828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58478 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:31:54,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:31:54,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33164 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:33:00,979 - lava_callback - INFO - Received callback for node 69ce37bdcb08ea23a1f68a74 INFO: 172.21.0.1:49914 - "POST /node/69ce37bdcb08ea23a1f68a74 HTTP/1.0" 202 Accepted 2026-04-04 09:33:00,988 - lava_callback - INFO - Starting async job submit for node 69ce37bdcb08ea23a1f68a74 2026-04-04 09:33:00,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:33:01,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce37bdcb08ea23a1f68a74 HTTP/1.1" 200 None 2026-04-04 09:33:01,006 - lava_callback - DEBUG - Processing node 69ce37bdcb08ea23a1f68a74: baseline-arm64-baylibre 2026-04-04 09:33:01,006 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce37bdcb08ea23a1f68a74 2026-04-04 09:33:01,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:33:01,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce37bdcb08ea23a1f68a74 HTTP/1.1" 200 None 2026-04-04 09:33:01,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:33:01,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-04 09:33:01,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:33:01,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce37bdcb08ea23a1f68a74 HTTP/1.1" 200 None 2026-04-04 09:33:01,074 - lava_callback - ERROR - Error processing callback for node 69ce37bdcb08ea23a1f68a74: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34368 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:33:56,736 - lava_callback - INFO - Received callback for node 69d0d7b4691bac272b323dad INFO: 172.21.0.1:34372 - "POST /node/69d0d7b4691bac272b323dad HTTP/1.0" 202 Accepted 2026-04-04 09:33:56,743 - lava_callback - INFO - Starting async job submit for node 69d0d7b4691bac272b323dad 2026-04-04 09:33:56,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:33:56,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d7b4691bac272b323dad HTTP/1.1" 200 None 2026-04-04 09:33:56,785 - lava_callback - DEBUG - Processing node 69d0d7b4691bac272b323dad: baseline-arm64 2026-04-04 09:33:57,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:33:58,152 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:33:58,155 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0d7b4691bac272b323dad/log.txt.gz 2026-04-04 09:33:58,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:33:58,725 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:33:58,727 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0d7b4691bac272b323dad/lava-logs.yaml 2026-04-04 09:33:58,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:33:58,899 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:33:58,900 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0d7b4691bac272b323dad/lava_callback.json.gz 2026-04-04 09:33:58,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:33:58,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d7b4691bac272b323dad HTTP/1.1" 200 None 2026-04-04 09:33:58,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:33:58,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 09:33:58,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:33:59,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0d7b4691bac272b323dad HTTP/1.1" 200 None 2026-04-04 09:33:59,107 - lava_callback - INFO - Completed processing callback for node 69d0d7b4691bac272b323dad INFO: 172.21.0.1:53042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54400 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54414 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:34:21,008 - lava_callback - INFO - Received callback for node 69ce380dcb08ea23a1f68a7c INFO: 172.21.0.1:55488 - "POST /node/69ce380dcb08ea23a1f68a7c HTTP/1.0" 202 Accepted 2026-04-04 09:34:21,018 - lava_callback - INFO - Starting async job submit for node 69ce380dcb08ea23a1f68a7c 2026-04-04 09:34:21,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:34:21,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce380dcb08ea23a1f68a7c HTTP/1.1" 200 None 2026-04-04 09:34:21,045 - lava_callback - DEBUG - Processing node 69ce380dcb08ea23a1f68a7c: baseline-arm64-baylibre 2026-04-04 09:34:21,046 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce380dcb08ea23a1f68a7c 2026-04-04 09:34:21,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:34:21,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce380dcb08ea23a1f68a7c HTTP/1.1" 200 None 2026-04-04 09:34:21,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:34:21,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-04 09:34:21,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:34:21,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce380dcb08ea23a1f68a7c HTTP/1.1" 200 None 2026-04-04 09:34:21,120 - lava_callback - ERROR - Error processing callback for node 69ce380dcb08ea23a1f68a7c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-04 09:34:24,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:34:24,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47904 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:34:51,620 - lava_callback - INFO - Received callback for node 69d0d820691bac272b323e3e INFO: 172.21.0.1:40976 - "POST /node/69d0d820691bac272b323e3e HTTP/1.0" 202 Accepted 2026-04-04 09:34:51,628 - lava_callback - INFO - Starting async job submit for node 69d0d820691bac272b323e3e 2026-04-04 09:34:51,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:34:51,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d820691bac272b323e3e HTTP/1.1" 200 None 2026-04-04 09:34:51,676 - lava_callback - DEBUG - Processing node 69d0d820691bac272b323e3e: baseline-nfs-arm64 2026-04-04 09:34:52,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:34:53,123 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:34:53,125 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d0d820691bac272b323e3e/log.txt.gz 2026-04-04 09:34:53,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:34:53,703 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:34:53,705 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d0d820691bac272b323e3e/lava-logs.yaml 2026-04-04 09:34:53,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:34:54,561 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:34:54,563 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d0d820691bac272b323e3e/lava_callback.json.gz 2026-04-04 09:34:54,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:34:54,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d820691bac272b323e3e HTTP/1.1" 200 None 2026-04-04 09:34:54,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:34:54,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 09:34:54,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:34:54,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0d820691bac272b323e3e HTTP/1.1" 200 None 2026-04-04 09:34:54,798 - lava_callback - INFO - Completed processing callback for node 69d0d820691bac272b323e3e 2026-04-04 09:34:55,557 - lava_callback - INFO - Received callback for node 69d0db20691bac272b3240d2 INFO: 172.21.0.1:40990 - "POST /node/69d0db20691bac272b3240d2 HTTP/1.0" 202 Accepted 2026-04-04 09:34:55,566 - lava_callback - INFO - Starting async job submit for node 69d0db20691bac272b3240d2 2026-04-04 09:34:55,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:34:55,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0db20691bac272b3240d2 HTTP/1.1" 200 None 2026-04-04 09:34:55,595 - lava_callback - DEBUG - Processing node 69d0db20691bac272b3240d2: baseline-nfs-arm64 2026-04-04 09:34:55,597 - lava_callback - WARNING - Failed to upload log 2026-04-04 09:34:55,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:34:56,338 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:34:56,340 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d0db20691bac272b3240d2/lava-logs.yaml 2026-04-04 09:34:56,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:40994 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:34:56,602 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:34:56,604 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d0db20691bac272b3240d2/lava_callback.json.gz 2026-04-04 09:34:56,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:34:56,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0db20691bac272b3240d2 HTTP/1.1" 200 None 2026-04-04 09:34:56,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:34:56,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 09:34:56,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:34:56,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0db20691bac272b3240d2 HTTP/1.1" 200 None 2026-04-04 09:34:56,673 - lava_callback - INFO - Completed processing callback for node 69d0db20691bac272b3240d2 INFO: 172.21.0.1:44064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35436 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35446 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:35:24,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:35:24,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52512 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:35:41,111 - lava_callback - INFO - Received callback for node 69ce3859cb08ea23a1f68a8f INFO: 172.21.0.1:57528 - "POST /node/69ce3859cb08ea23a1f68a8f HTTP/1.0" 202 Accepted 2026-04-04 09:35:41,120 - lava_callback - INFO - Starting async job submit for node 69ce3859cb08ea23a1f68a8f 2026-04-04 09:35:41,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:35:41,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3859cb08ea23a1f68a8f HTTP/1.1" 200 None 2026-04-04 09:35:41,153 - lava_callback - DEBUG - Processing node 69ce3859cb08ea23a1f68a8f: baseline-arm64-baylibre 2026-04-04 09:35:41,154 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce3859cb08ea23a1f68a8f 2026-04-04 09:35:41,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:35:41,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3859cb08ea23a1f68a8f HTTP/1.1" 200 None 2026-04-04 09:35:41,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:35:41,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-04 09:35:41,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:35:41,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce3859cb08ea23a1f68a8f HTTP/1.1" 200 None 2026-04-04 09:35:41,260 - lava_callback - ERROR - Error processing callback for node 69ce3859cb08ea23a1f68a8f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49086 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-04 09:37:16,394 - lava_callback - INFO - Received callback for node 69d0db9b691bac272b324168 INFO: 172.21.0.1:49098 - "POST /node/69d0db9b691bac272b324168 HTTP/1.0" 202 Accepted 2026-04-04 09:37:16,405 - lava_callback - INFO - Starting async job submit for node 69d0db9b691bac272b324168 2026-04-04 09:37:16,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:37:16,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0db9b691bac272b324168 HTTP/1.1" 200 None 2026-04-04 09:37:16,450 - lava_callback - DEBUG - Processing node 69d0db9b691bac272b324168: baseline-arm64 INFO: 172.21.0.1:49102 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:37:16,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:37:16,730 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:37:16,732 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0db9b691bac272b324168/log.txt.gz 2026-04-04 09:37:16,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:37:16,975 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:37:16,977 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0db9b691bac272b324168/lava-logs.yaml 2026-04-04 09:37:16,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:37:17,128 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:37:17,130 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0db9b691bac272b324168/lava_callback.json.gz 2026-04-04 09:37:17,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:37:17,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0db9b691bac272b324168 HTTP/1.1" 200 None 2026-04-04 09:37:17,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:37:17,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 09:37:17,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:37:17,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0db9b691bac272b324168 HTTP/1.1" 200 None 2026-04-04 09:37:17,317 - lava_callback - INFO - Completed processing callback for node 69d0db9b691bac272b324168 2026-04-04 09:37:24,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:37:24,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41186 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:39:01,282 - lava_callback - INFO - Received callback for node 69ce3931cb08ea23a1f68ab1 INFO: 172.21.0.1:55066 - "POST /node/69ce3931cb08ea23a1f68ab1 HTTP/1.0" 202 Accepted 2026-04-04 09:39:01,288 - lava_callback - INFO - Starting async job submit for node 69ce3931cb08ea23a1f68ab1 2026-04-04 09:39:01,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:39:01,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3931cb08ea23a1f68ab1 HTTP/1.1" 200 None 2026-04-04 09:39:01,303 - lava_callback - DEBUG - Processing node 69ce3931cb08ea23a1f68ab1: baseline-arm64-baylibre 2026-04-04 09:39:01,303 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce3931cb08ea23a1f68ab1 2026-04-04 09:39:01,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:39:01,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3931cb08ea23a1f68ab1 HTTP/1.1" 200 None 2026-04-04 09:39:01,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:39:01,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-04 09:39:01,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:39:01,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce3931cb08ea23a1f68ab1 HTTP/1.1" 200 None 2026-04-04 09:39:01,361 - lava_callback - ERROR - Error processing callback for node 69ce3931cb08ea23a1f68ab1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46786 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:39:47,387 - lava_callback - INFO - Received callback for node 69d0dc28691bac272b324185 INFO: 172.21.0.1:46796 - "POST /node/69d0dc28691bac272b324185 HTTP/1.0" 202 Accepted 2026-04-04 09:39:47,411 - lava_callback - INFO - Starting async job submit for node 69d0dc28691bac272b324185 2026-04-04 09:39:47,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:39:47,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0dc28691bac272b324185 HTTP/1.1" 200 None 2026-04-04 09:39:47,460 - lava_callback - DEBUG - Processing node 69d0dc28691bac272b324185: baseline-arm64 2026-04-04 09:39:47,617 - lava_callback - WARNING - Failed to upload log 2026-04-04 09:39:47,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:39:47,857 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:39:47,859 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0dc28691bac272b324185/lava-logs.yaml 2026-04-04 09:39:47,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:39:47,999 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:39:48,002 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0dc28691bac272b324185/lava_callback.json.gz 2026-04-04 09:39:48,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:39:48,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0dc28691bac272b324185 HTTP/1.1" 200 None 2026-04-04 09:39:48,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:39:48,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 09:39:48,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:39:48,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0dc28691bac272b324185 HTTP/1.1" 200 None 2026-04-04 09:39:48,156 - lava_callback - INFO - Completed processing callback for node 69d0dc28691bac272b324185 2026-04-04 09:39:54,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:39:54,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42988 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:40:36,817 - lava_callback - INFO - Received callback for node 69ce3984cb08ea23a1f68ac1 INFO: 172.21.0.1:42992 - "POST /node/69ce3984cb08ea23a1f68ac1 HTTP/1.0" 202 Accepted 2026-04-04 09:40:36,824 - lava_callback - INFO - Starting async job submit for node 69ce3984cb08ea23a1f68ac1 2026-04-04 09:40:36,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:40:36,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3984cb08ea23a1f68ac1 HTTP/1.1" 200 None 2026-04-04 09:40:36,844 - lava_callback - DEBUG - Processing node 69ce3984cb08ea23a1f68ac1: baseline-arm64-clabbe 2026-04-04 09:40:36,844 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce3984cb08ea23a1f68ac1 2026-04-04 09:40:36,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:40:36,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3984cb08ea23a1f68ac1 HTTP/1.1" 200 None 2026-04-04 09:40:36,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:40:36,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-04 09:40:36,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:40:36,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce3984cb08ea23a1f68ac1 HTTP/1.1" 200 None 2026-04-04 09:40:36,907 - lava_callback - ERROR - Error processing callback for node 69ce3984cb08ea23a1f68ac1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48712 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:41:56,813 - lava_callback - INFO - Received callback for node 69ce39d1cb08ea23a1f68acb INFO: 172.21.0.1:48722 - "POST /node/69ce39d1cb08ea23a1f68acb HTTP/1.0" 202 Accepted 2026-04-04 09:41:56,819 - lava_callback - INFO - Starting async job submit for node 69ce39d1cb08ea23a1f68acb 2026-04-04 09:41:56,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:41:56,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce39d1cb08ea23a1f68acb HTTP/1.1" 200 None 2026-04-04 09:41:56,841 - lava_callback - DEBUG - Processing node 69ce39d1cb08ea23a1f68acb: baseline-arm64-clabbe 2026-04-04 09:41:56,841 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce39d1cb08ea23a1f68acb 2026-04-04 09:41:56,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:41:56,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce39d1cb08ea23a1f68acb HTTP/1.1" 200 None 2026-04-04 09:41:56,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:41:56,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-04 09:41:56,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:41:56,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce39d1cb08ea23a1f68acb HTTP/1.1" 200 None 2026-04-04 09:41:56,914 - lava_callback - ERROR - Error processing callback for node 69ce39d1cb08ea23a1f68acb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38414 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:42:56,893 - lava_callback - INFO - Received callback for node 69ce3a1ccb08ea23a1f68ad8 INFO: 172.21.0.1:38426 - "POST /node/69ce3a1ccb08ea23a1f68ad8 HTTP/1.0" 202 Accepted 2026-04-04 09:42:56,899 - lava_callback - INFO - Starting async job submit for node 69ce3a1ccb08ea23a1f68ad8 2026-04-04 09:42:56,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:42:56,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3a1ccb08ea23a1f68ad8 HTTP/1.1" 200 None 2026-04-04 09:42:56,915 - lava_callback - DEBUG - Processing node 69ce3a1ccb08ea23a1f68ad8: baseline-arm64-clabbe 2026-04-04 09:42:56,915 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce3a1ccb08ea23a1f68ad8 2026-04-04 09:42:56,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:42:56,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3a1ccb08ea23a1f68ad8 HTTP/1.1" 200 None 2026-04-04 09:42:56,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:42:56,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-04 09:42:56,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:42:56,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce3a1ccb08ea23a1f68ad8 HTTP/1.1" 200 None 2026-04-04 09:42:56,984 - lava_callback - ERROR - Error processing callback for node 69ce3a1ccb08ea23a1f68ad8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42536 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:43:08,930 - lava_callback - INFO - Received callback for node 69d0dcea691bac272b32427a INFO: 172.21.0.1:42550 - "POST /node/69d0dcea691bac272b32427a HTTP/1.0" 202 Accepted 2026-04-04 09:43:08,936 - lava_callback - INFO - Starting async job submit for node 69d0dcea691bac272b32427a 2026-04-04 09:43:08,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:43:08,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0dcea691bac272b32427a HTTP/1.1" 200 None 2026-04-04 09:43:08,973 - lava_callback - DEBUG - Processing node 69d0dcea691bac272b32427a: baseline-arm64 2026-04-04 09:43:09,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:43:09,425 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:43:09,428 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0dcea691bac272b32427a/log.txt.gz 2026-04-04 09:43:09,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:43:09,840 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:43:09,842 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0dcea691bac272b32427a/lava-logs.yaml 2026-04-04 09:43:09,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:43:10,000 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:43:10,002 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0dcea691bac272b32427a/lava_callback.json.gz 2026-04-04 09:43:10,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:43:10,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0dcea691bac272b32427a HTTP/1.1" 200 None 2026-04-04 09:43:10,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:43:10,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 09:43:10,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:43:10,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0dcea691bac272b32427a HTTP/1.1" 200 None 2026-04-04 09:43:10,167 - lava_callback - INFO - Completed processing callback for node 69d0dcea691bac272b32427a INFO: 172.21.0.1:51096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51102 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:43:24,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:43:24,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35972 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:43:51,160 - lava_callback - INFO - Received callback for node 69d0d8c2691bac272b323eed INFO: 172.21.0.1:56664 - "POST /node/69d0d8c2691bac272b323eed HTTP/1.0" 202 Accepted 2026-04-04 09:43:51,212 - lava_callback - INFO - Starting async job submit for node 69d0d8c2691bac272b323eed 2026-04-04 09:43:51,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:43:51,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d8c2691bac272b323eed HTTP/1.1" 200 None 2026-04-04 09:43:51,264 - lava_callback - DEBUG - Processing node 69d0d8c2691bac272b323eed: baseline-arm-pengutronix 2026-04-04 09:43:51,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:43:51,559 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:43:51,561 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d0d8c2691bac272b323eed/log.txt.gz 2026-04-04 09:43:51,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:43:51,784 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:43:51,786 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d0d8c2691bac272b323eed/lava-logs.yaml 2026-04-04 09:43:51,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:43:51,935 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:43:51,937 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d0d8c2691bac272b323eed/lava_callback.json.gz DEBUG: Setup failed for 69d0d8c2691bac272b323eed. Transitting job node result: incomplete -> fail 2026-04-04 09:43:51,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:43:52,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d8c2691bac272b323eed HTTP/1.1" 200 None 2026-04-04 09:43:52,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:43:52,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-04 09:43:52,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:43:52,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0d8c2691bac272b323eed HTTP/1.1" 200 None 2026-04-04 09:43:52,162 - lava_callback - INFO - Completed processing callback for node 69d0d8c2691bac272b323eed 2026-04-04 09:43:54,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:43:54,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-04 09:43:55,880 - lava_callback - INFO - Received callback for node 69d0da08691bac272b324005 INFO: 172.21.0.1:56676 - "POST /node/69d0da08691bac272b324005 HTTP/1.0" 202 Accepted 2026-04-04 09:43:55,888 - lava_callback - INFO - Starting async job submit for node 69d0da08691bac272b324005 2026-04-04 09:43:55,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:43:55,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0da08691bac272b324005 HTTP/1.1" 200 None 2026-04-04 09:43:55,948 - lava_callback - DEBUG - Processing node 69d0da08691bac272b324005: baseline-nfs-arm64 INFO: 172.21.0.1:56680 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:43:57,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:43:57,388 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:43:57,390 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d0da08691bac272b324005/log.txt.gz 2026-04-04 09:43:58,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:43:58,500 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:43:58,503 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d0da08691bac272b324005/lava-logs.yaml 2026-04-04 09:43:58,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:43:58,749 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:43:58,751 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d0da08691bac272b324005/lava_callback.json.gz 2026-04-04 09:43:58,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:43:58,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0da08691bac272b324005 HTTP/1.1" 200 None 2026-04-04 09:43:58,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:43:58,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 09:43:58,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:43:58,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0da08691bac272b324005 HTTP/1.1" 200 None 2026-04-04 09:43:58,871 - lava_callback - INFO - Completed processing callback for node 69d0da08691bac272b324005 INFO: 172.21.0.1:51252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51100 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:44:16,922 - lava_callback - INFO - Received callback for node 69ce3a68cb08ea23a1f68adf INFO: 172.21.0.1:51106 - "POST /node/69ce3a68cb08ea23a1f68adf HTTP/1.0" 202 Accepted 2026-04-04 09:44:16,928 - lava_callback - INFO - Starting async job submit for node 69ce3a68cb08ea23a1f68adf 2026-04-04 09:44:16,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:44:16,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3a68cb08ea23a1f68adf HTTP/1.1" 200 None 2026-04-04 09:44:16,943 - lava_callback - DEBUG - Processing node 69ce3a68cb08ea23a1f68adf: baseline-arm64-clabbe 2026-04-04 09:44:16,944 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce3a68cb08ea23a1f68adf 2026-04-04 09:44:16,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:44:16,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3a68cb08ea23a1f68adf HTTP/1.1" 200 None 2026-04-04 09:44:16,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:44:16,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-04 09:44:16,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:44:17,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce3a68cb08ea23a1f68adf HTTP/1.1" 200 None 2026-04-04 09:44:17,003 - lava_callback - ERROR - Error processing callback for node 69ce3a68cb08ea23a1f68adf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-04 09:44:24,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:44:24,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57254 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:45:36,999 - lava_callback - INFO - Received callback for node 69ce3ab5cb08ea23a1f68aeb INFO: 172.21.0.1:57256 - "POST /node/69ce3ab5cb08ea23a1f68aeb HTTP/1.0" 202 Accepted 2026-04-04 09:45:37,006 - lava_callback - INFO - Starting async job submit for node 69ce3ab5cb08ea23a1f68aeb 2026-04-04 09:45:37,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:45:37,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3ab5cb08ea23a1f68aeb HTTP/1.1" 200 None 2026-04-04 09:45:37,025 - lava_callback - DEBUG - Processing node 69ce3ab5cb08ea23a1f68aeb: baseline-arm64-clabbe 2026-04-04 09:45:37,025 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce3ab5cb08ea23a1f68aeb 2026-04-04 09:45:37,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:45:37,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3ab5cb08ea23a1f68aeb HTTP/1.1" 200 None 2026-04-04 09:45:37,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:45:37,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-04 09:45:37,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:45:37,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce3ab5cb08ea23a1f68aeb HTTP/1.1" 200 None 2026-04-04 09:45:37,079 - lava_callback - ERROR - Error processing callback for node 69ce3ab5cb08ea23a1f68aeb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48848 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:46:57,082 - lava_callback - INFO - Received callback for node 69ce3b01cb08ea23a1f68af6 INFO: 172.21.0.1:48860 - "POST /node/69ce3b01cb08ea23a1f68af6 HTTP/1.0" 202 Accepted 2026-04-04 09:46:57,088 - lava_callback - INFO - Starting async job submit for node 69ce3b01cb08ea23a1f68af6 2026-04-04 09:46:57,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:46:57,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3b01cb08ea23a1f68af6 HTTP/1.1" 200 None 2026-04-04 09:46:57,103 - lava_callback - DEBUG - Processing node 69ce3b01cb08ea23a1f68af6: baseline-arm64-clabbe 2026-04-04 09:46:57,103 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce3b01cb08ea23a1f68af6 2026-04-04 09:46:57,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:46:57,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3b01cb08ea23a1f68af6 HTTP/1.1" 200 None 2026-04-04 09:46:57,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:46:57,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-04 09:46:57,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:46:57,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce3b01cb08ea23a1f68af6 HTTP/1.1" 200 None 2026-04-04 09:46:57,162 - lava_callback - ERROR - Error processing callback for node 69ce3b01cb08ea23a1f68af6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54862 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:48:21,121 - lava_callback - INFO - Received callback for node 69d0d9c2691bac272b323fdc INFO: 172.21.0.1:51846 - "POST /node/69d0d9c2691bac272b323fdc HTTP/1.0" 202 Accepted 2026-04-04 09:48:21,129 - lava_callback - INFO - Starting async job submit for node 69d0d9c2691bac272b323fdc 2026-04-04 09:48:21,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:48:21,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d9c2691bac272b323fdc HTTP/1.1" 200 None 2026-04-04 09:48:21,198 - lava_callback - DEBUG - Processing node 69d0d9c2691bac272b323fdc: baseline-nfs-arm64 2026-04-04 09:48:22,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:48:22,569 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:48:22,571 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d0d9c2691bac272b323fdc/log.txt.gz 2026-04-04 09:48:23,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:48:23,420 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:48:23,423 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d0d9c2691bac272b323fdc/lava-logs.yaml 2026-04-04 09:48:23,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:48:23,688 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:48:23,690 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d0d9c2691bac272b323fdc/lava_callback.json.gz DEBUG: Setup failed for 69d0d9c2691bac272b323fdc. Transitting job node result: incomplete -> fail 2026-04-04 09:48:23,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:48:23,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d9c2691bac272b323fdc HTTP/1.1" 200 None 2026-04-04 09:48:23,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:48:23,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 09:48:23,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:48:23,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0d9c2691bac272b323fdc HTTP/1.1" 200 None 2026-04-04 09:48:23,986 - lava_callback - INFO - Completed processing callback for node 69d0d9c2691bac272b323fdc 2026-04-04 09:48:24,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:48:24,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53056 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53064 - "GET / HTTP/1.0" 200 OK 2026-04-04 09:53:18,674 - lava_callback - INFO - Received callback for node 69d0de58691bac272b3243ec INFO: 172.21.0.1:53068 - "POST /node/69d0de58691bac272b3243ec HTTP/1.0" 202 Accepted 2026-04-04 09:53:18,681 - lava_callback - INFO - Starting async job submit for node 69d0de58691bac272b3243ec 2026-04-04 09:53:18,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:53:18,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0de58691bac272b3243ec HTTP/1.1" 200 None 2026-04-04 09:53:18,721 - lava_callback - DEBUG - Processing node 69d0de58691bac272b3243ec: ltp-syscalls-ipc 2026-04-04 09:53:19,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:53:19,273 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:53:19,275 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69d0de58691bac272b3243ec/log.txt.gz 2026-04-04 09:53:19,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:53:19,730 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:53:19,732 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69d0de58691bac272b3243ec/lava-logs.yaml 2026-04-04 09:53:19,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 09:53:19,926 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 09:53:19,927 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69d0de58691bac272b3243ec/lava_callback.json.gz 2026-04-04 09:53:19,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:53:19,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0de58691bac272b3243ec HTTP/1.1" 200 None 2026-04-04 09:53:19,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:53:19,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-04 09:53:19,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:53:20,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0de58691bac272b3243ec HTTP/1.1" 200 None 2026-04-04 09:53:20,017 - lava_callback - INFO - Completed processing callback for node 69d0de58691bac272b3243ec 2026-04-04 09:53:24,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 09:53:24,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60222 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51484 - "GET / HTTP/1.0" 200 OK 2026-04-04 10:06:04,563 - lava_callback - INFO - Received callback for node 69d0de61691bac272b3243ef INFO: 172.21.0.1:35302 - "POST /node/69d0de61691bac272b3243ef HTTP/1.0" 202 Accepted 2026-04-04 10:06:04,570 - lava_callback - INFO - Starting async job submit for node 69d0de61691bac272b3243ef 2026-04-04 10:06:04,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:06:04,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0de61691bac272b3243ef HTTP/1.1" 200 None 2026-04-04 10:06:04,632 - lava_callback - DEBUG - Processing node 69d0de61691bac272b3243ef: baseline-arm64 2026-04-04 10:06:05,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 10:06:05,179 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 10:06:05,181 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0de61691bac272b3243ef/log.txt.gz 2026-04-04 10:06:05,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 10:06:05,692 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 10:06:05,694 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0de61691bac272b3243ef/lava-logs.yaml 2026-04-04 10:06:05,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 10:06:05,893 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 10:06:05,896 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0de61691bac272b3243ef/lava_callback.json.gz DEBUG: Setup failed for 69d0de61691bac272b3243ef. Transitting job node result: incomplete -> fail 2026-04-04 10:06:05,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:06:06,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0de61691bac272b3243ef HTTP/1.1" 200 None 2026-04-04 10:06:06,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:06:06,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 10:06:06,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:06:06,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0de61691bac272b3243ef HTTP/1.1" 200 None 2026-04-04 10:06:06,149 - lava_callback - INFO - Completed processing callback for node 69d0de61691bac272b3243ef INFO: 172.21.0.1:35316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51136 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51146 - "GET / HTTP/1.0" 200 OK 2026-04-04 10:06:24,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:06:24,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37912 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50210 - "GET / HTTP/1.0" 200 OK 2026-04-04 10:08:02,901 - lava_callback - INFO - Received callback for node 69ce3ff1cb08ea23a1f68bd9 INFO: 172.21.0.1:59714 - "POST /node/69ce3ff1cb08ea23a1f68bd9 HTTP/1.0" 202 Accepted 2026-04-04 10:08:02,907 - lava_callback - INFO - Starting async job submit for node 69ce3ff1cb08ea23a1f68bd9 2026-04-04 10:08:02,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:08:02,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3ff1cb08ea23a1f68bd9 HTTP/1.1" 200 None 2026-04-04 10:08:02,923 - lava_callback - DEBUG - Processing node 69ce3ff1cb08ea23a1f68bd9: baseline-arm64-baylibre 2026-04-04 10:08:02,923 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce3ff1cb08ea23a1f68bd9 2026-04-04 10:08:02,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:08:02,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3ff1cb08ea23a1f68bd9 HTTP/1.1" 200 None 2026-04-04 10:08:02,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:08:02,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63cf0b98d4d3c02067dd7 HTTP/1.1" 200 None 2026-04-04 10:08:02,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:08:02,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce3ff1cb08ea23a1f68bd9 HTTP/1.1" 200 None 2026-04-04 10:08:02,980 - lava_callback - ERROR - Error processing callback for node 69ce3ff1cb08ea23a1f68bd9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60580 - "GET / HTTP/1.0" 200 OK 2026-04-04 10:09:02,868 - lava_callback - INFO - Received callback for node 69ce4039cb08ea23a1f68be1 INFO: 172.21.0.1:33202 - "POST /node/69ce4039cb08ea23a1f68be1 HTTP/1.0" 202 Accepted 2026-04-04 10:09:02,877 - lava_callback - INFO - Starting async job submit for node 69ce4039cb08ea23a1f68be1 2026-04-04 10:09:02,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:09:02,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce4039cb08ea23a1f68be1 HTTP/1.1" 200 None 2026-04-04 10:09:02,893 - lava_callback - DEBUG - Processing node 69ce4039cb08ea23a1f68be1: baseline-arm64-baylibre 2026-04-04 10:09:02,893 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce4039cb08ea23a1f68be1 2026-04-04 10:09:02,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:09:02,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce4039cb08ea23a1f68be1 HTTP/1.1" 200 None 2026-04-04 10:09:02,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:09:02,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63cf0b98d4d3c02067dd7 HTTP/1.1" 200 None 2026-04-04 10:09:02,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:09:02,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce4039cb08ea23a1f68be1 HTTP/1.1" 200 None 2026-04-04 10:09:02,971 - lava_callback - ERROR - Error processing callback for node 69ce4039cb08ea23a1f68be1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50258 - "GET / HTTP/1.0" 200 OK 2026-04-04 10:11:43,060 - lava_callback - INFO - Received callback for node 69ce40cdcb08ea23a1f68bf9 INFO: 172.21.0.1:46568 - "POST /node/69ce40cdcb08ea23a1f68bf9 HTTP/1.0" 202 Accepted 2026-04-04 10:11:43,069 - lava_callback - INFO - Starting async job submit for node 69ce40cdcb08ea23a1f68bf9 2026-04-04 10:11:43,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:11:43,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce40cdcb08ea23a1f68bf9 HTTP/1.1" 200 None 2026-04-04 10:11:43,086 - lava_callback - DEBUG - Processing node 69ce40cdcb08ea23a1f68bf9: baseline-arm64-baylibre 2026-04-04 10:11:43,086 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce40cdcb08ea23a1f68bf9 2026-04-04 10:11:43,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:11:43,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce40cdcb08ea23a1f68bf9 HTTP/1.1" 200 None 2026-04-04 10:11:43,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:11:43,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63cf0b98d4d3c02067dd7 HTTP/1.1" 200 None 2026-04-04 10:11:43,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:11:43,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce40cdcb08ea23a1f68bf9 HTTP/1.1" 200 None 2026-04-04 10:11:43,147 - lava_callback - ERROR - Error processing callback for node 69ce40cdcb08ea23a1f68bf9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37430 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57326 - "GET / HTTP/1.0" 200 OK 2026-04-04 10:14:03,225 - lava_callback - INFO - Received callback for node 69ce4169cb08ea23a1f68c10 INFO: 172.21.0.1:37630 - "POST /node/69ce4169cb08ea23a1f68c10 HTTP/1.0" 202 Accepted 2026-04-04 10:14:03,231 - lava_callback - INFO - Starting async job submit for node 69ce4169cb08ea23a1f68c10 2026-04-04 10:14:03,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:14:03,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce4169cb08ea23a1f68c10 HTTP/1.1" 200 None 2026-04-04 10:14:03,248 - lava_callback - DEBUG - Processing node 69ce4169cb08ea23a1f68c10: baseline-arm64-baylibre 2026-04-04 10:14:03,248 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce4169cb08ea23a1f68c10 2026-04-04 10:14:03,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:14:03,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce4169cb08ea23a1f68c10 HTTP/1.1" 200 None 2026-04-04 10:14:03,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:14:03,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63cf0b98d4d3c02067dd7 HTTP/1.1" 200 None 2026-04-04 10:14:03,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:14:03,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce4169cb08ea23a1f68c10 HTTP/1.1" 200 None 2026-04-04 10:14:03,309 - lava_callback - ERROR - Error processing callback for node 69ce4169cb08ea23a1f68c10: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45342 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45346 - "GET / HTTP/1.0" 200 OK 2026-04-04 10:16:23,091 - lava_callback - INFO - Received callback for node 69d0e4e6691bac272b324977 INFO: 172.21.0.1:49340 - "POST /node/69d0e4e6691bac272b324977 HTTP/1.0" 202 Accepted 2026-04-04 10:16:23,097 - lava_callback - INFO - Starting async job submit for node 69d0e4e6691bac272b324977 2026-04-04 10:16:23,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:16:23,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e4e6691bac272b324977 HTTP/1.1" 200 None 2026-04-04 10:16:23,116 - lava_callback - DEBUG - Processing node 69d0e4e6691bac272b324977: baseline-nfs-arm64 2026-04-04 10:16:23,118 - lava_callback - WARNING - Failed to upload log 2026-04-04 10:16:23,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 10:16:23,269 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 10:16:23,271 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d0e4e6691bac272b324977/lava-logs.yaml 2026-04-04 10:16:23,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 10:16:23,458 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 10:16:23,460 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d0e4e6691bac272b324977/lava_callback.json.gz 2026-04-04 10:16:23,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:16:23,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e4e6691bac272b324977 HTTP/1.1" 200 None 2026-04-04 10:16:23,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:16:23,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 10:16:23,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:16:23,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0e4e6691bac272b324977 HTTP/1.1" 200 None 2026-04-04 10:16:23,529 - lava_callback - INFO - Completed processing callback for node 69d0e4e6691bac272b324977 2026-04-04 10:16:24,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:16:24,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57192 - "GET / HTTP/1.0" 200 OK 2026-04-04 10:16:43,417 - lava_callback - INFO - Received callback for node 69ce41fccb08ea23a1f68c35 INFO: 172.21.0.1:58966 - "POST /node/69ce41fccb08ea23a1f68c35 HTTP/1.0" 202 Accepted 2026-04-04 10:16:43,423 - lava_callback - INFO - Starting async job submit for node 69ce41fccb08ea23a1f68c35 2026-04-04 10:16:43,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:16:43,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce41fccb08ea23a1f68c35 HTTP/1.1" 200 None 2026-04-04 10:16:43,453 - lava_callback - DEBUG - Processing node 69ce41fccb08ea23a1f68c35: baseline-arm64-baylibre 2026-04-04 10:16:43,453 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce41fccb08ea23a1f68c35 2026-04-04 10:16:43,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:16:43,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce41fccb08ea23a1f68c35 HTTP/1.1" 200 None 2026-04-04 10:16:43,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:16:43,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63cf0b98d4d3c02067dd7 HTTP/1.1" 200 None 2026-04-04 10:16:43,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:16:43,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce41fccb08ea23a1f68c35 HTTP/1.1" 200 None 2026-04-04 10:16:43,508 - lava_callback - ERROR - Error processing callback for node 69ce41fccb08ea23a1f68c35: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54636 - "GET / HTTP/1.0" 200 OK 2026-04-04 10:17:43,377 - lava_callback - INFO - Received callback for node 69ce4245cb08ea23a1f68c40 INFO: 172.21.0.1:51860 - "POST /node/69ce4245cb08ea23a1f68c40 HTTP/1.0" 202 Accepted 2026-04-04 10:17:43,382 - lava_callback - INFO - Starting async job submit for node 69ce4245cb08ea23a1f68c40 2026-04-04 10:17:43,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:17:43,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce4245cb08ea23a1f68c40 HTTP/1.1" 200 None 2026-04-04 10:17:43,401 - lava_callback - DEBUG - Processing node 69ce4245cb08ea23a1f68c40: baseline-arm64-baylibre 2026-04-04 10:17:43,401 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce4245cb08ea23a1f68c40 2026-04-04 10:17:43,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:17:43,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce4245cb08ea23a1f68c40 HTTP/1.1" 200 None 2026-04-04 10:17:43,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:17:43,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63cf0b98d4d3c02067dd7 HTTP/1.1" 200 None 2026-04-04 10:17:43,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:17:43,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce4245cb08ea23a1f68c40 HTTP/1.1" 200 None 2026-04-04 10:17:43,471 - lava_callback - ERROR - Error processing callback for node 69ce4245cb08ea23a1f68c40: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50446 - "GET / HTTP/1.0" 200 OK 2026-04-04 10:20:18,602 - lava_callback - INFO - Received callback for node 69ce42dfcb08ea23a1f68c51 INFO: 172.21.0.1:50460 - "POST /node/69ce42dfcb08ea23a1f68c51 HTTP/1.0" 202 Accepted 2026-04-04 10:20:18,608 - lava_callback - INFO - Starting async job submit for node 69ce42dfcb08ea23a1f68c51 2026-04-04 10:20:18,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:20:18,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce42dfcb08ea23a1f68c51 HTTP/1.1" 200 None 2026-04-04 10:20:18,624 - lava_callback - DEBUG - Processing node 69ce42dfcb08ea23a1f68c51: baseline-arm64-clabbe 2026-04-04 10:20:18,624 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce42dfcb08ea23a1f68c51 2026-04-04 10:20:18,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:20:18,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce42dfcb08ea23a1f68c51 HTTP/1.1" 200 None 2026-04-04 10:20:18,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:20:18,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63cf0b98d4d3c02067dd7 HTTP/1.1" 200 None 2026-04-04 10:20:18,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:20:18,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce42dfcb08ea23a1f68c51 HTTP/1.1" 200 None 2026-04-04 10:20:18,674 - lava_callback - ERROR - Error processing callback for node 69ce42dfcb08ea23a1f68c51: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34442 - "GET / HTTP/1.0" 200 OK 2026-04-04 10:21:03,788 - lava_callback - INFO - Received callback for node 69d0e56d691bac272b3249b9 INFO: 172.21.0.1:50712 - "POST /node/69d0e56d691bac272b3249b9 HTTP/1.0" 202 Accepted 2026-04-04 10:21:03,795 - lava_callback - INFO - Starting async job submit for node 69d0e56d691bac272b3249b9 2026-04-04 10:21:03,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:21:03,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e56d691bac272b3249b9 HTTP/1.1" 200 None 2026-04-04 10:21:03,860 - lava_callback - DEBUG - Processing node 69d0e56d691bac272b3249b9: baseline-arm64 2026-04-04 10:21:04,058 - lava_callback - WARNING - Failed to upload log 2026-04-04 10:21:04,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 10:21:04,397 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 10:21:04,400 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0e56d691bac272b3249b9/lava-logs.yaml 2026-04-04 10:21:04,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 10:21:04,558 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 10:21:04,560 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0e56d691bac272b3249b9/lava_callback.json.gz 2026-04-04 10:21:04,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:21:04,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e56d691bac272b3249b9 HTTP/1.1" 200 None 2026-04-04 10:21:04,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:21:04,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 10:21:04,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:21:04,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0e56d691bac272b3249b9 HTTP/1.1" 200 None 2026-04-04 10:21:04,713 - lava_callback - INFO - Completed processing callback for node 69d0e56d691bac272b3249b9 INFO: 172.21.0.1:50728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33556 - "GET / HTTP/1.0" 200 OK 2026-04-04 10:21:24,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:21:24,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60912 - "GET / HTTP/1.0" 200 OK 2026-04-04 10:21:34,941 - lava_callback - INFO - Received callback for node 69d0e5fb691bac272b324a0f INFO: 172.21.0.1:57184 - "POST /node/69d0e5fb691bac272b324a0f HTTP/1.0" 202 Accepted 2026-04-04 10:21:34,947 - lava_callback - INFO - Starting async job submit for node 69d0e5fb691bac272b324a0f 2026-04-04 10:21:34,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:21:35,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e5fb691bac272b324a0f HTTP/1.1" 200 None 2026-04-04 10:21:35,019 - lava_callback - DEBUG - Processing node 69d0e5fb691bac272b324a0f: baseline-arm64 2026-04-04 10:21:35,180 - lava_callback - WARNING - Failed to upload log 2026-04-04 10:21:35,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 10:21:35,432 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 10:21:35,434 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0e5fb691bac272b324a0f/lava-logs.yaml 2026-04-04 10:21:35,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 10:21:35,594 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 10:21:35,596 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0e5fb691bac272b324a0f/lava_callback.json.gz 2026-04-04 10:21:35,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:21:35,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e5fb691bac272b324a0f HTTP/1.1" 200 None 2026-04-04 10:21:35,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:21:35,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 10:21:35,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:21:35,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0e5fb691bac272b324a0f HTTP/1.1" 200 None 2026-04-04 10:21:35,809 - lava_callback - INFO - Completed processing callback for node 69d0e5fb691bac272b324a0f INFO: 172.21.0.1:57196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60526 - "GET / HTTP/1.0" 200 OK 2026-04-04 10:21:54,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:21:54,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47464 - "GET / HTTP/1.0" 200 OK 2026-04-04 10:22:58,966 - lava_callback - INFO - Received callback for node 69ce4371cb08ea23a1f68c67 INFO: 172.21.0.1:47476 - "POST /node/69ce4371cb08ea23a1f68c67 HTTP/1.0" 202 Accepted 2026-04-04 10:22:58,972 - lava_callback - INFO - Starting async job submit for node 69ce4371cb08ea23a1f68c67 2026-04-04 10:22:58,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:22:58,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce4371cb08ea23a1f68c67 HTTP/1.1" 200 None 2026-04-04 10:22:58,987 - lava_callback - DEBUG - Processing node 69ce4371cb08ea23a1f68c67: baseline-arm64-clabbe 2026-04-04 10:22:58,987 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce4371cb08ea23a1f68c67 2026-04-04 10:22:58,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:22:59,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce4371cb08ea23a1f68c67 HTTP/1.1" 200 None 2026-04-04 10:22:59,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:22:59,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63cf0b98d4d3c02067dd7 HTTP/1.1" 200 None 2026-04-04 10:22:59,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:22:59,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce4371cb08ea23a1f68c67 HTTP/1.1" 200 None 2026-04-04 10:22:59,050 - lava_callback - ERROR - Error processing callback for node 69ce4371cb08ea23a1f68c67: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34262 - "GET / HTTP/1.0" 200 OK 2026-04-04 10:25:23,324 - lava_callback - INFO - Received callback for node 69d0e4a2691bac272b32493c INFO: 172.21.0.1:36884 - "POST /node/69d0e4a2691bac272b32493c HTTP/1.0" 202 Accepted 2026-04-04 10:25:23,331 - lava_callback - INFO - Starting async job submit for node 69d0e4a2691bac272b32493c 2026-04-04 10:25:23,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:25:23,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e4a2691bac272b32493c HTTP/1.1" 200 None 2026-04-04 10:25:23,397 - lava_callback - DEBUG - Processing node 69d0e4a2691bac272b32493c: baseline-nfs-arm64 2026-04-04 10:25:24,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 10:25:24,206 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 10:25:24,209 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d0e4a2691bac272b32493c/log.txt.gz 2026-04-04 10:25:24,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 10:25:24,773 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 10:25:24,775 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d0e4a2691bac272b32493c/lava-logs.yaml 2026-04-04 10:25:24,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 10:25:24,956 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 10:25:24,958 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d0e4a2691bac272b32493c/lava_callback.json.gz 2026-04-04 10:25:24,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:25:25,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e4a2691bac272b32493c HTTP/1.1" 200 None 2026-04-04 10:25:25,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:25:25,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 10:25:25,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:25:25,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0e4a2691bac272b32493c HTTP/1.1" 200 None 2026-04-04 10:25:25,135 - lava_callback - INFO - Completed processing callback for node 69d0e4a2691bac272b32493c INFO: 172.21.0.1:36898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37188 - "GET / HTTP/1.0" 200 OK 2026-04-04 10:25:54,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:25:54,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33974 - "GET / HTTP/1.0" 200 OK 2026-04-04 10:26:11,487 - lava_callback - INFO - Received callback for node 69d0e70c691bac272b324b07 INFO: 172.21.0.1:34672 - "POST /node/69d0e70c691bac272b324b07 HTTP/1.0" 202 Accepted 2026-04-04 10:26:11,496 - lava_callback - INFO - Starting async job submit for node 69d0e70c691bac272b324b07 2026-04-04 10:26:11,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:26:11,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e70c691bac272b324b07 HTTP/1.1" 200 None 2026-04-04 10:26:11,557 - lava_callback - DEBUG - Processing node 69d0e70c691bac272b324b07: baseline-arm64 2026-04-04 10:26:11,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 10:26:12,009 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 10:26:12,011 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0e70c691bac272b324b07/log.txt.gz 2026-04-04 10:26:12,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 10:26:12,419 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 10:26:12,421 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0e70c691bac272b324b07/lava-logs.yaml 2026-04-04 10:26:12,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 10:26:12,569 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 10:26:12,571 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0e70c691bac272b324b07/lava_callback.json.gz 2026-04-04 10:26:12,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:26:12,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e70c691bac272b324b07 HTTP/1.1" 200 None 2026-04-04 10:26:12,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:26:12,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 10:26:12,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:26:12,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0e70c691bac272b324b07 HTTP/1.1" 200 None 2026-04-04 10:26:12,744 - lava_callback - INFO - Completed processing callback for node 69d0e70c691bac272b324b07 INFO: 172.21.0.1:34688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34712 - "GET / HTTP/1.0" 200 OK 2026-04-04 10:26:24,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:26:24,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47586 - "GET / HTTP/1.0" 200 OK 2026-04-04 10:26:38,812 - lava_callback - INFO - Received callback for node 69ce4450cb08ea23a1f68c80 INFO: 172.21.0.1:47600 - "POST /node/69ce4450cb08ea23a1f68c80 HTTP/1.0" 202 Accepted 2026-04-04 10:26:38,818 - lava_callback - INFO - Starting async job submit for node 69ce4450cb08ea23a1f68c80 2026-04-04 10:26:38,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:26:38,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce4450cb08ea23a1f68c80 HTTP/1.1" 200 None 2026-04-04 10:26:38,842 - lava_callback - DEBUG - Processing node 69ce4450cb08ea23a1f68c80: baseline-arm64-clabbe 2026-04-04 10:26:38,842 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce4450cb08ea23a1f68c80 2026-04-04 10:26:38,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:26:38,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce4450cb08ea23a1f68c80 HTTP/1.1" 200 None 2026-04-04 10:26:38,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:26:38,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63cf0b98d4d3c02067dd7 HTTP/1.1" 200 None 2026-04-04 10:26:38,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:26:38,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce4450cb08ea23a1f68c80 HTTP/1.1" 200 None 2026-04-04 10:26:38,898 - lava_callback - ERROR - Error processing callback for node 69ce4450cb08ea23a1f68c80: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37414 - "GET / HTTP/1.0" 200 OK 2026-04-04 10:27:02,205 - lava_callback - INFO - Received callback for node 69d0e418691bac272b3248a5 INFO: 172.21.0.1:34538 - "POST /node/69d0e418691bac272b3248a5 HTTP/1.0" 202 Accepted 2026-04-04 10:27:02,211 - lava_callback - INFO - Starting async job submit for node 69d0e418691bac272b3248a5 2026-04-04 10:27:02,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:27:02,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e418691bac272b3248a5 HTTP/1.1" 200 None 2026-04-04 10:27:02,258 - lava_callback - DEBUG - Processing node 69d0e418691bac272b3248a5: baseline-arm64 2026-04-04 10:27:02,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 10:27:02,967 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 10:27:02,969 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0e418691bac272b3248a5/log.txt.gz 2026-04-04 10:27:03,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 10:27:03,422 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 10:27:03,424 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0e418691bac272b3248a5/lava-logs.yaml 2026-04-04 10:27:03,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 10:27:03,604 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 10:27:03,606 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0e418691bac272b3248a5/lava_callback.json.gz 2026-04-04 10:27:03,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:27:03,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e418691bac272b3248a5 HTTP/1.1" 200 None 2026-04-04 10:27:03,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:27:03,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 10:27:03,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:27:03,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0e418691bac272b3248a5 HTTP/1.1" 200 None 2026-04-04 10:27:03,782 - lava_callback - INFO - Completed processing callback for node 69d0e418691bac272b3248a5 INFO: 172.21.0.1:34544 - "GET / HTTP/1.0" 200 OK 2026-04-04 10:27:14,550 - lava_callback - INFO - Received callback for node 69d0e35e691bac272b324854 INFO: 172.21.0.1:42160 - "POST /node/69d0e35e691bac272b324854 HTTP/1.0" 202 Accepted 2026-04-04 10:27:14,557 - lava_callback - INFO - Starting async job submit for node 69d0e35e691bac272b324854 2026-04-04 10:27:14,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:27:14,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e35e691bac272b324854 HTTP/1.1" 200 None 2026-04-04 10:27:14,629 - lava_callback - DEBUG - Processing node 69d0e35e691bac272b324854: baseline-arm INFO: 172.21.0.1:42162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42170 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-04 10:27:15,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 10:27:15,347 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 10:27:15,349 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d0e35e691bac272b324854/log.txt.gz 2026-04-04 10:27:15,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 10:27:16,068 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 10:27:16,071 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d0e35e691bac272b324854/lava-logs.yaml 2026-04-04 10:27:16,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 10:27:16,281 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 10:27:16,284 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d0e35e691bac272b324854/lava_callback.json.gz DEBUG: Setup failed for 69d0e35e691bac272b324854. Transitting job node result: incomplete -> fail 2026-04-04 10:27:16,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:27:16,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e35e691bac272b324854 HTTP/1.1" 200 None 2026-04-04 10:27:16,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:27:16,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-04 10:27:16,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:27:16,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0e35e691bac272b324854 HTTP/1.1" 200 None INFO: 172.21.0.1:42184 - "GET / HTTP/1.0" 200 OK 2026-04-04 10:27:16,621 - lava_callback - INFO - Completed processing callback for node 69d0e35e691bac272b324854 2026-04-04 10:27:24,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:27:24,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38488 - "GET / HTTP/1.0" 200 OK 2026-04-04 10:29:38,969 - lava_callback - INFO - Received callback for node 69ce450acb08ea23a1f68c9f INFO: 172.21.0.1:38498 - "POST /node/69ce450acb08ea23a1f68c9f HTTP/1.0" 202 Accepted 2026-04-04 10:29:38,975 - lava_callback - INFO - Starting async job submit for node 69ce450acb08ea23a1f68c9f 2026-04-04 10:29:38,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:29:39,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce450acb08ea23a1f68c9f HTTP/1.1" 200 None 2026-04-04 10:29:39,026 - lava_callback - DEBUG - Processing node 69ce450acb08ea23a1f68c9f: baseline-arm64-clabbe 2026-04-04 10:29:39,026 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce450acb08ea23a1f68c9f 2026-04-04 10:29:39,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:29:39,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce450acb08ea23a1f68c9f HTTP/1.1" 200 None 2026-04-04 10:29:39,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:29:39,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63cf0b98d4d3c02067dd7 HTTP/1.1" 200 None 2026-04-04 10:29:39,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:29:39,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce450acb08ea23a1f68c9f HTTP/1.1" 200 None 2026-04-04 10:29:39,097 - lava_callback - ERROR - Error processing callback for node 69ce450acb08ea23a1f68c9f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41480 - "GET / HTTP/1.0" 200 OK 2026-04-04 10:34:39,133 - lava_callback - INFO - Received callback for node 69ce4631cb08ea23a1f68cc9 INFO: 172.21.0.1:41486 - "POST /node/69ce4631cb08ea23a1f68cc9 HTTP/1.0" 202 Accepted 2026-04-04 10:34:39,140 - lava_callback - INFO - Starting async job submit for node 69ce4631cb08ea23a1f68cc9 2026-04-04 10:34:39,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:34:39,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce4631cb08ea23a1f68cc9 HTTP/1.1" 200 None 2026-04-04 10:34:39,156 - lava_callback - DEBUG - Processing node 69ce4631cb08ea23a1f68cc9: baseline-arm64-clabbe 2026-04-04 10:34:39,156 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce4631cb08ea23a1f68cc9 2026-04-04 10:34:39,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:34:39,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce4631cb08ea23a1f68cc9 HTTP/1.1" 200 None 2026-04-04 10:34:39,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:34:39,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63cf0b98d4d3c02067dd7 HTTP/1.1" 200 None 2026-04-04 10:34:39,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:34:39,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce4631cb08ea23a1f68cc9 HTTP/1.1" 200 None 2026-04-04 10:34:39,227 - lava_callback - ERROR - Error processing callback for node 69ce4631cb08ea23a1f68cc9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56512 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37150 - "GET / HTTP/1.0" 200 OK 2026-04-04 10:37:39,290 - lava_callback - INFO - Received callback for node 69ce46eecb08ea23a1f68ce8 INFO: 172.21.0.1:37152 - "POST /node/69ce46eecb08ea23a1f68ce8 HTTP/1.0" 202 Accepted 2026-04-04 10:37:39,299 - lava_callback - INFO - Starting async job submit for node 69ce46eecb08ea23a1f68ce8 2026-04-04 10:37:39,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:37:39,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce46eecb08ea23a1f68ce8 HTTP/1.1" 200 None 2026-04-04 10:37:39,324 - lava_callback - DEBUG - Processing node 69ce46eecb08ea23a1f68ce8: baseline-arm64-clabbe 2026-04-04 10:37:39,324 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce46eecb08ea23a1f68ce8 2026-04-04 10:37:39,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:37:39,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce46eecb08ea23a1f68ce8 HTTP/1.1" 200 None 2026-04-04 10:37:39,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:37:39,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63cf0b98d4d3c02067dd7 HTTP/1.1" 200 None 2026-04-04 10:37:39,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:37:39,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce46eecb08ea23a1f68ce8 HTTP/1.1" 200 None 2026-04-04 10:37:39,383 - lava_callback - ERROR - Error processing callback for node 69ce46eecb08ea23a1f68ce8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55326 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60056 - "GET / HTTP/1.0" 200 OK 2026-04-04 10:38:47,556 - lava_callback - INFO - Received callback for node 69d0e881691bac272b324c62 INFO: 172.21.0.1:60060 - "POST /node/69d0e881691bac272b324c62 HTTP/1.0" 202 Accepted 2026-04-04 10:38:47,565 - lava_callback - INFO - Starting async job submit for node 69d0e881691bac272b324c62 2026-04-04 10:38:47,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:38:47,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e881691bac272b324c62 HTTP/1.1" 200 None 2026-04-04 10:38:47,636 - lava_callback - DEBUG - Processing node 69d0e881691bac272b324c62: baseline-arm64 2026-04-04 10:38:48,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 10:38:48,162 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 10:38:48,164 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0e881691bac272b324c62/log.txt.gz 2026-04-04 10:38:48,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 10:38:48,649 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 10:38:48,651 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0e881691bac272b324c62/lava-logs.yaml 2026-04-04 10:38:48,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 10:38:48,823 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 10:38:48,825 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0e881691bac272b324c62/lava_callback.json.gz DEBUG: Setup failed for 69d0e881691bac272b324c62. Transitting job node result: incomplete -> fail 2026-04-04 10:38:48,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:38:48,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e881691bac272b324c62 HTTP/1.1" 200 None 2026-04-04 10:38:48,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:38:48,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 10:38:48,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:38:48,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0e881691bac272b324c62 HTTP/1.1" 200 None 2026-04-04 10:38:49,028 - lava_callback - INFO - Completed processing callback for node 69d0e881691bac272b324c62 2026-04-04 10:38:54,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:38:54,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57040 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48416 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57078 - "GET / HTTP/1.0" 200 OK 2026-04-04 10:43:43,740 - lava_callback - INFO - Received callback for node 69d0e8cf691bac272b324c69 INFO: 172.21.0.1:34580 - "POST /node/69d0e8cf691bac272b324c69 HTTP/1.0" 202 Accepted 2026-04-04 10:43:43,747 - lava_callback - INFO - Starting async job submit for node 69d0e8cf691bac272b324c69 2026-04-04 10:43:43,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:43:43,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e8cf691bac272b324c69 HTTP/1.1" 200 None 2026-04-04 10:43:43,796 - lava_callback - DEBUG - Processing node 69d0e8cf691bac272b324c69: baseline-nfs-arm64 2026-04-04 10:43:44,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 10:43:44,524 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 10:43:44,526 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d0e8cf691bac272b324c69/log.txt.gz 2026-04-04 10:43:44,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 10:43:45,079 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 10:43:45,081 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d0e8cf691bac272b324c69/lava-logs.yaml 2026-04-04 10:43:45,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 10:43:45,245 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 10:43:45,247 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d0e8cf691bac272b324c69/lava_callback.json.gz 2026-04-04 10:43:45,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:43:45,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e8cf691bac272b324c69 HTTP/1.1" 200 None 2026-04-04 10:43:45,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:43:45,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 10:43:45,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:43:45,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0e8cf691bac272b324c69 HTTP/1.1" 200 None 2026-04-04 10:43:45,382 - lava_callback - INFO - Completed processing callback for node 69d0e8cf691bac272b324c69 INFO: 172.21.0.1:34596 - "GET / HTTP/1.0" 200 OK 2026-04-04 10:43:48,743 - lava_callback - INFO - Received callback for node 69d0e910691bac272b324c97 INFO: 172.21.0.1:34612 - "POST /node/69d0e910691bac272b324c97 HTTP/1.0" 202 Accepted 2026-04-04 10:43:48,750 - lava_callback - INFO - Starting async job submit for node 69d0e910691bac272b324c97 2026-04-04 10:43:48,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:43:48,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e910691bac272b324c97 HTTP/1.1" 200 None 2026-04-04 10:43:48,798 - lava_callback - DEBUG - Processing node 69d0e910691bac272b324c97: baseline-arm64 2026-04-04 10:43:49,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 10:43:49,461 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 10:43:49,463 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0e910691bac272b324c97/log.txt.gz 2026-04-04 10:43:49,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 10:43:49,941 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 10:43:49,944 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0e910691bac272b324c97/lava-logs.yaml 2026-04-04 10:43:49,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 10:43:50,107 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 10:43:50,109 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d0e910691bac272b324c97/lava_callback.json.gz 2026-04-04 10:43:50,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:43:50,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e910691bac272b324c97 HTTP/1.1" 200 None 2026-04-04 10:43:50,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:43:50,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 10:43:50,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:43:50,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0e910691bac272b324c97 HTTP/1.1" 200 None 2026-04-04 10:43:50,247 - lava_callback - INFO - Completed processing callback for node 69d0e910691bac272b324c97 2026-04-04 10:43:54,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:43:55,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54384 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44550 - "GET / HTTP/1.0" 200 OK 2026-04-04 10:45:54,688 - lava_callback - INFO - Received callback for node 69d0e75d691bac272b324b2a INFO: 172.21.0.1:51260 - "POST /node/69d0e75d691bac272b324b2a HTTP/1.0" 202 Accepted 2026-04-04 10:45:54,742 - lava_callback - INFO - Starting async job submit for node 69d0e75d691bac272b324b2a 2026-04-04 10:45:54,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:45:54,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e75d691bac272b324b2a HTTP/1.1" 200 None 2026-04-04 10:45:54,782 - lava_callback - DEBUG - Processing node 69d0e75d691bac272b324b2a: baseline-arm-pengutronix 2026-04-04 10:45:54,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 10:45:55,026 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 10:45:55,028 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d0e75d691bac272b324b2a/log.txt.gz 2026-04-04 10:45:55,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 10:45:55,256 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 10:45:55,258 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d0e75d691bac272b324b2a/lava-logs.yaml 2026-04-04 10:45:55,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 10:45:55,391 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 10:45:55,393 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d0e75d691bac272b324b2a/lava_callback.json.gz DEBUG: Setup failed for 69d0e75d691bac272b324b2a. Transitting job node result: incomplete -> fail 2026-04-04 10:45:55,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:45:55,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e75d691bac272b324b2a HTTP/1.1" 200 None 2026-04-04 10:45:55,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:45:55,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-04 10:45:55,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:45:55,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0e75d691bac272b324b2a HTTP/1.1" 200 None 2026-04-04 10:45:55,559 - lava_callback - INFO - Completed processing callback for node 69d0e75d691bac272b324b2a INFO: 172.21.0.1:51262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56972 - "GET / HTTP/1.0" 200 OK 2026-04-04 10:46:25,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:46:25,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60040 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60046 - "GET / HTTP/1.0" 200 OK 2026-04-04 10:50:16,820 - lava_callback - INFO - Received callback for node 69d0e844691bac272b324c08 INFO: 172.21.0.1:60050 - "POST /node/69d0e844691bac272b324c08 HTTP/1.0" 202 Accepted 2026-04-04 10:50:16,833 - lava_callback - INFO - Starting async job submit for node 69d0e844691bac272b324c08 2026-04-04 10:50:16,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:50:16,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e844691bac272b324c08 HTTP/1.1" 200 None 2026-04-04 10:50:16,894 - lava_callback - DEBUG - Processing node 69d0e844691bac272b324c08: baseline-nfs-arm64 2026-04-04 10:50:17,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 10:50:18,104 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 10:50:18,106 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d0e844691bac272b324c08/log.txt.gz 2026-04-04 10:50:18,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 10:50:19,138 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 10:50:19,141 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d0e844691bac272b324c08/lava-logs.yaml 2026-04-04 10:50:19,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 10:50:19,336 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 10:50:19,338 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d0e844691bac272b324c08/lava_callback.json.gz DEBUG: Setup failed for 69d0e844691bac272b324c08. Transitting job node result: incomplete -> fail 2026-04-04 10:50:19,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:50:19,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e844691bac272b324c08 HTTP/1.1" 200 None 2026-04-04 10:50:19,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:50:19,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 10:50:19,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:50:19,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0e844691bac272b324c08 HTTP/1.1" 200 None 2026-04-04 10:50:19,576 - lava_callback - INFO - Completed processing callback for node 69d0e844691bac272b324c08 2026-04-04 10:50:25,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:50:25,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39218 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45874 - "GET / HTTP/1.0" 200 OK 2026-04-04 10:51:36,310 - lava_callback - INFO - Received callback for node 69d0e950691bac272b324cd2 INFO: 172.21.0.1:45510 - "POST /node/69d0e950691bac272b324cd2 HTTP/1.0" 202 Accepted 2026-04-04 10:51:36,320 - lava_callback - INFO - Starting async job submit for node 69d0e950691bac272b324cd2 2026-04-04 10:51:36,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:51:36,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e950691bac272b324cd2 HTTP/1.1" 200 None 2026-04-04 10:51:36,395 - lava_callback - DEBUG - Processing node 69d0e950691bac272b324cd2: baseline-arm INFO: 172.21.0.1:45520 - "GET / HTTP/1.0" 200 OK 2026-04-04 10:51:37,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 10:51:37,164 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 10:51:37,166 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d0e950691bac272b324cd2/log.txt.gz 2026-04-04 10:51:37,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 10:51:37,800 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 10:51:37,802 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d0e950691bac272b324cd2/lava-logs.yaml 2026-04-04 10:51:37,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 10:51:37,977 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 10:51:37,979 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d0e950691bac272b324cd2/lava_callback.json.gz DEBUG: Setup failed for 69d0e950691bac272b324cd2. Transitting job node result: incomplete -> fail 2026-04-04 10:51:38,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:51:38,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e950691bac272b324cd2 HTTP/1.1" 200 None 2026-04-04 10:51:38,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:51:38,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-04 10:51:38,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:51:38,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0e950691bac272b324cd2 HTTP/1.1" 200 None 2026-04-04 10:51:38,284 - lava_callback - INFO - Completed processing callback for node 69d0e950691bac272b324cd2 INFO: 172.21.0.1:49428 - "GET / HTTP/1.0" 200 OK 2026-04-04 10:51:55,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 10:51:55,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53388 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57472 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57352 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49970 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39394 - "GET / HTTP/1.0" 200 OK 2026-04-04 11:06:03,236 - lava_callback - INFO - Received callback for node 69d0ebf0691bac272b324cf4 INFO: 172.21.0.1:58258 - "POST /node/69d0ebf0691bac272b324cf4 HTTP/1.0" 202 Accepted 2026-04-04 11:06:03,286 - lava_callback - INFO - Starting async job submit for node 69d0ebf0691bac272b324cf4 2026-04-04 11:06:03,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 11:06:03,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ebf0691bac272b324cf4 HTTP/1.1" 200 None 2026-04-04 11:06:03,333 - lava_callback - DEBUG - Processing node 69d0ebf0691bac272b324cf4: baseline-arm-pengutronix 2026-04-04 11:06:03,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 11:06:03,586 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 11:06:03,588 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d0ebf0691bac272b324cf4/log.txt.gz 2026-04-04 11:06:03,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 11:06:03,813 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 11:06:03,815 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d0ebf0691bac272b324cf4/lava-logs.yaml 2026-04-04 11:06:03,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 11:06:03,939 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 11:06:03,942 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d0ebf0691bac272b324cf4/lava_callback.json.gz DEBUG: Setup failed for 69d0ebf0691bac272b324cf4. Transitting job node result: incomplete -> fail 2026-04-04 11:06:03,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 11:06:04,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ebf0691bac272b324cf4 HTTP/1.1" 200 None 2026-04-04 11:06:04,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 11:06:04,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-04 11:06:04,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 11:06:04,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0ebf0691bac272b324cf4 HTTP/1.1" 200 None 2026-04-04 11:06:04,107 - lava_callback - INFO - Completed processing callback for node 69d0ebf0691bac272b324cf4 INFO: 172.21.0.1:58264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33478 - "GET / HTTP/1.0" 200 OK 2026-04-04 11:06:25,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 11:06:25,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34212 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39056 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35296 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37808 - "GET / HTTP/1.0" 200 OK 2026-04-04 11:10:24,114 - lava_callback - INFO - Received callback for node 69d0ecf5691bac272b324d13 INFO: 172.21.0.1:58930 - "POST /node/69d0ecf5691bac272b324d13 HTTP/1.0" 202 Accepted 2026-04-04 11:10:24,122 - lava_callback - INFO - Starting async job submit for node 69d0ecf5691bac272b324d13 2026-04-04 11:10:24,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 11:10:24,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ecf5691bac272b324d13 HTTP/1.1" 200 None 2026-04-04 11:10:24,198 - lava_callback - DEBUG - Processing node 69d0ecf5691bac272b324d13: baseline-nfs-arm64 2026-04-04 11:10:25,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 11:10:25,449 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 11:10:25,451 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d0ecf5691bac272b324d13/log.txt.gz 2026-04-04 11:10:26,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 11:10:26,326 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 11:10:26,329 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d0ecf5691bac272b324d13/lava-logs.yaml 2026-04-04 11:10:26,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:58946 - "GET / HTTP/1.0" 200 OK 2026-04-04 11:10:26,539 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 11:10:26,541 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d0ecf5691bac272b324d13/lava_callback.json.gz DEBUG: Setup failed for 69d0ecf5691bac272b324d13. Transitting job node result: incomplete -> fail 2026-04-04 11:10:26,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 11:10:26,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ecf5691bac272b324d13 HTTP/1.1" 200 None 2026-04-04 11:10:26,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 11:10:26,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-04 11:10:26,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 11:10:26,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0ecf5691bac272b324d13 HTTP/1.1" 200 None 2026-04-04 11:10:26,786 - lava_callback - INFO - Completed processing callback for node 69d0ecf5691bac272b324d13 INFO: 172.21.0.1:41804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51986 - "GET / HTTP/1.0" 200 OK 2026-04-04 11:10:55,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 11:10:55,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33254 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45708 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46268 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42298 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56388 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36114 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53780 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33904 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43436 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48320 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37242 - "GET / HTTP/1.0" 200 OK 2026-04-04 11:53:45,433 - lava_callback - INFO - Received callback for node 69d0cd4a691bac272b322fd5 INFO: 172.21.0.1:39700 - "POST /node/69d0cd4a691bac272b322fd5 HTTP/1.0" 202 Accepted 2026-04-04 11:53:45,439 - lava_callback - INFO - Starting async job submit for node 69d0cd4a691bac272b322fd5 2026-04-04 11:53:45,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 11:53:45,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cd4a691bac272b322fd5 HTTP/1.1" 200 None 2026-04-04 11:53:45,471 - lava_callback - DEBUG - Processing node 69d0cd4a691bac272b322fd5: baseline-x86 2026-04-04 11:53:45,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 11:53:45,897 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 11:53:45,898 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69d0cd4a691bac272b322fd5/log.txt.gz 2026-04-04 11:53:46,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 11:53:46,286 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 11:53:46,288 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69d0cd4a691bac272b322fd5/lava-logs.yaml 2026-04-04 11:53:46,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-04 11:53:46,458 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-04 11:53:46,460 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69d0cd4a691bac272b322fd5/lava_callback.json.gz 2026-04-04 11:53:46,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 11:53:46,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cd4a691bac272b322fd5 HTTP/1.1" 200 None 2026-04-04 11:53:46,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:39704 - "GET / HTTP/1.0" 200 OK 2026-04-04 11:53:46,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c922691bac272b322db3 HTTP/1.1" 200 None 2026-04-04 11:53:46,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 11:53:46,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cd4a691bac272b322fd5 HTTP/1.1" 200 None 2026-04-04 11:53:46,535 - lava_callback - INFO - Completed processing callback for node 69d0cd4a691bac272b322fd5 2026-04-04 11:53:55,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 11:53:55,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37134 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42692 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38970 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35360 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39242 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51918 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60606 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38536 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47496 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55750 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46536 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60078 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50388 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46114 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38126 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40526 - "GET / HTTP/1.0" 200 OK 2026-04-04 12:48:11,639 - lava_callback - INFO - Received callback for node 69ce6587cb08ea23a1f68e15 INFO: 172.21.0.1:37406 - "POST /node/69ce6587cb08ea23a1f68e15 HTTP/1.0" 202 Accepted 2026-04-04 12:48:11,645 - lava_callback - INFO - Starting async job submit for node 69ce6587cb08ea23a1f68e15 2026-04-04 12:48:11,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 12:48:11,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce6587cb08ea23a1f68e15 HTTP/1.1" 200 None 2026-04-04 12:48:11,660 - lava_callback - DEBUG - Processing node 69ce6587cb08ea23a1f68e15: baseline-arm-baylibre 2026-04-04 12:48:11,661 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce6587cb08ea23a1f68e15 2026-04-04 12:48:11,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 12:48:11,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce6587cb08ea23a1f68e15 HTTP/1.1" 200 None 2026-04-04 12:48:11,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 12:48:11,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-04 12:48:11,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 12:48:11,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce6587cb08ea23a1f68e15 HTTP/1.1" 200 None 2026-04-04 12:48:11,716 - lava_callback - ERROR - Error processing callback for node 69ce6587cb08ea23a1f68e15: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37416 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60812 - "GET / HTTP/1.0" 200 OK 2026-04-04 12:48:51,647 - lava_callback - INFO - Received callback for node 69ce65adcb08ea23a1f68e26 INFO: 172.21.0.1:50888 - "POST /node/69ce65adcb08ea23a1f68e26 HTTP/1.0" 202 Accepted 2026-04-04 12:48:51,656 - lava_callback - INFO - Starting async job submit for node 69ce65adcb08ea23a1f68e26 2026-04-04 12:48:51,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 12:48:51,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce65adcb08ea23a1f68e26 HTTP/1.1" 200 None 2026-04-04 12:48:51,676 - lava_callback - DEBUG - Processing node 69ce65adcb08ea23a1f68e26: baseline-arm-baylibre 2026-04-04 12:48:51,676 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce65adcb08ea23a1f68e26 2026-04-04 12:48:51,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 12:48:51,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce65adcb08ea23a1f68e26 HTTP/1.1" 200 None 2026-04-04 12:48:51,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 12:48:51,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-04 12:48:51,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 12:48:51,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce65adcb08ea23a1f68e26 HTTP/1.1" 200 None 2026-04-04 12:48:51,751 - lava_callback - ERROR - Error processing callback for node 69ce65adcb08ea23a1f68e26: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43700 - "GET / HTTP/1.0" 200 OK 2026-04-04 12:49:31,754 - lava_callback - INFO - Received callback for node 69ce65d2cb08ea23a1f68e30 INFO: 172.21.0.1:50562 - "POST /node/69ce65d2cb08ea23a1f68e30 HTTP/1.0" 202 Accepted 2026-04-04 12:49:31,760 - lava_callback - INFO - Starting async job submit for node 69ce65d2cb08ea23a1f68e30 2026-04-04 12:49:31,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 12:49:31,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce65d2cb08ea23a1f68e30 HTTP/1.1" 200 None 2026-04-04 12:49:31,776 - lava_callback - DEBUG - Processing node 69ce65d2cb08ea23a1f68e30: baseline-arm-baylibre 2026-04-04 12:49:31,777 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce65d2cb08ea23a1f68e30 2026-04-04 12:49:31,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 12:49:31,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce65d2cb08ea23a1f68e30 HTTP/1.1" 200 None 2026-04-04 12:49:31,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 12:49:31,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-04 12:49:31,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 12:49:31,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce65d2cb08ea23a1f68e30 HTTP/1.1" 200 None 2026-04-04 12:49:31,838 - lava_callback - ERROR - Error processing callback for node 69ce65d2cb08ea23a1f68e30: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32814 - "GET / HTTP/1.0" 200 OK 2026-04-04 12:50:11,686 - lava_callback - INFO - Received callback for node 69ce65f5cb08ea23a1f68e3d INFO: 172.21.0.1:42204 - "POST /node/69ce65f5cb08ea23a1f68e3d HTTP/1.0" 202 Accepted 2026-04-04 12:50:11,691 - lava_callback - INFO - Starting async job submit for node 69ce65f5cb08ea23a1f68e3d 2026-04-04 12:50:11,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 12:50:11,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce65f5cb08ea23a1f68e3d HTTP/1.1" 200 None 2026-04-04 12:50:11,713 - lava_callback - DEBUG - Processing node 69ce65f5cb08ea23a1f68e3d: baseline-arm-baylibre 2026-04-04 12:50:11,713 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce65f5cb08ea23a1f68e3d 2026-04-04 12:50:11,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 12:50:11,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce65f5cb08ea23a1f68e3d HTTP/1.1" 200 None 2026-04-04 12:50:11,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 12:50:11,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-04 12:50:11,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 12:50:11,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce65f5cb08ea23a1f68e3d HTTP/1.1" 200 None 2026-04-04 12:50:11,770 - lava_callback - ERROR - Error processing callback for node 69ce65f5cb08ea23a1f68e3d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42216 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58176 - "GET / HTTP/1.0" 200 OK 2026-04-04 12:50:51,775 - lava_callback - INFO - Received callback for node 69ce661bcb08ea23a1f68e4d INFO: 172.21.0.1:58226 - "POST /node/69ce661bcb08ea23a1f68e4d HTTP/1.0" 202 Accepted 2026-04-04 12:50:51,781 - lava_callback - INFO - Starting async job submit for node 69ce661bcb08ea23a1f68e4d 2026-04-04 12:50:51,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 12:50:51,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce661bcb08ea23a1f68e4d HTTP/1.1" 200 None 2026-04-04 12:50:51,797 - lava_callback - DEBUG - Processing node 69ce661bcb08ea23a1f68e4d: baseline-arm-baylibre 2026-04-04 12:50:51,797 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce661bcb08ea23a1f68e4d 2026-04-04 12:50:51,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 12:50:51,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce661bcb08ea23a1f68e4d HTTP/1.1" 200 None 2026-04-04 12:50:51,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 12:50:51,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-04 12:50:51,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 12:50:51,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce661bcb08ea23a1f68e4d HTTP/1.1" 200 None 2026-04-04 12:50:51,866 - lava_callback - ERROR - Error processing callback for node 69ce661bcb08ea23a1f68e4d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42056 - "GET / HTTP/1.0" 200 OK 2026-04-04 12:51:31,740 - lava_callback - INFO - Received callback for node 69ce6640cb08ea23a1f68e56 INFO: 172.21.0.1:53218 - "POST /node/69ce6640cb08ea23a1f68e56 HTTP/1.0" 202 Accepted 2026-04-04 12:51:31,746 - lava_callback - INFO - Starting async job submit for node 69ce6640cb08ea23a1f68e56 2026-04-04 12:51:31,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 12:51:31,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce6640cb08ea23a1f68e56 HTTP/1.1" 200 None 2026-04-04 12:51:31,761 - lava_callback - DEBUG - Processing node 69ce6640cb08ea23a1f68e56: baseline-arm-baylibre 2026-04-04 12:51:31,761 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce6640cb08ea23a1f68e56 2026-04-04 12:51:31,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 12:51:31,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce6640cb08ea23a1f68e56 HTTP/1.1" 200 None 2026-04-04 12:51:31,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 12:51:31,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-04 12:51:31,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 12:51:31,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce6640cb08ea23a1f68e56 HTTP/1.1" 200 None 2026-04-04 12:51:31,830 - lava_callback - ERROR - Error processing callback for node 69ce6640cb08ea23a1f68e56: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47728 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44310 - "GET / HTTP/1.0" 200 OK 2026-04-04 12:53:25,286 - lava_callback - INFO - Received callback for node 69ce66b8cb08ea23a1f68e7e INFO: 172.21.0.1:33088 - "POST /node/69ce66b8cb08ea23a1f68e7e HTTP/1.0" 202 Accepted 2026-04-04 12:53:25,296 - lava_callback - INFO - Starting async job submit for node 69ce66b8cb08ea23a1f68e7e 2026-04-04 12:53:25,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 12:53:25,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce66b8cb08ea23a1f68e7e HTTP/1.1" 200 None 2026-04-04 12:53:25,316 - lava_callback - DEBUG - Processing node 69ce66b8cb08ea23a1f68e7e: baseline-arm-clabbe 2026-04-04 12:53:25,317 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce66b8cb08ea23a1f68e7e 2026-04-04 12:53:25,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 12:53:25,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce66b8cb08ea23a1f68e7e HTTP/1.1" 200 None 2026-04-04 12:53:25,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 12:53:25,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-04 12:53:25,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 12:53:25,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce66b8cb08ea23a1f68e7e HTTP/1.1" 200 None 2026-04-04 12:53:25,376 - lava_callback - ERROR - Error processing callback for node 69ce66b8cb08ea23a1f68e7e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42794 - "GET / HTTP/1.0" 200 OK 2026-04-04 12:54:05,276 - lava_callback - INFO - Received callback for node 69ce66ddcb08ea23a1f68e8f INFO: 172.21.0.1:44158 - "POST /node/69ce66ddcb08ea23a1f68e8f HTTP/1.0" 202 Accepted 2026-04-04 12:54:05,281 - lava_callback - INFO - Starting async job submit for node 69ce66ddcb08ea23a1f68e8f 2026-04-04 12:54:05,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 12:54:05,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce66ddcb08ea23a1f68e8f HTTP/1.1" 200 None 2026-04-04 12:54:05,296 - lava_callback - DEBUG - Processing node 69ce66ddcb08ea23a1f68e8f: baseline-arm-clabbe 2026-04-04 12:54:05,296 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce66ddcb08ea23a1f68e8f 2026-04-04 12:54:05,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 12:54:05,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce66ddcb08ea23a1f68e8f HTTP/1.1" 200 None 2026-04-04 12:54:05,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 12:54:05,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-04 12:54:05,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 12:54:05,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce66ddcb08ea23a1f68e8f HTTP/1.1" 200 None 2026-04-04 12:54:05,362 - lava_callback - ERROR - Error processing callback for node 69ce66ddcb08ea23a1f68e8f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34818 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52452 - "GET / HTTP/1.0" 200 OK 2026-04-04 12:54:45,284 - lava_callback - INFO - Received callback for node 69ce6703cb08ea23a1f68e98 INFO: 172.21.0.1:42100 - "POST /node/69ce6703cb08ea23a1f68e98 HTTP/1.0" 202 Accepted 2026-04-04 12:54:45,290 - lava_callback - INFO - Starting async job submit for node 69ce6703cb08ea23a1f68e98 2026-04-04 12:54:45,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 12:54:45,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce6703cb08ea23a1f68e98 HTTP/1.1" 200 None 2026-04-04 12:54:45,306 - lava_callback - DEBUG - Processing node 69ce6703cb08ea23a1f68e98: baseline-arm-clabbe 2026-04-04 12:54:45,306 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce6703cb08ea23a1f68e98 2026-04-04 12:54:45,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 12:54:45,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce6703cb08ea23a1f68e98 HTTP/1.1" 200 None 2026-04-04 12:54:45,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 12:54:45,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-04 12:54:45,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 12:54:45,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce6703cb08ea23a1f68e98 HTTP/1.1" 200 None 2026-04-04 12:54:45,357 - lava_callback - ERROR - Error processing callback for node 69ce6703cb08ea23a1f68e98: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34322 - "GET / HTTP/1.0" 200 OK 2026-04-04 12:55:25,288 - lava_callback - INFO - Received callback for node 69ce6729cb08ea23a1f68ea5 INFO: 172.21.0.1:47158 - "POST /node/69ce6729cb08ea23a1f68ea5 HTTP/1.0" 202 Accepted 2026-04-04 12:55:25,293 - lava_callback - INFO - Starting async job submit for node 69ce6729cb08ea23a1f68ea5 2026-04-04 12:55:25,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 12:55:25,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce6729cb08ea23a1f68ea5 HTTP/1.1" 200 None 2026-04-04 12:55:25,309 - lava_callback - DEBUG - Processing node 69ce6729cb08ea23a1f68ea5: baseline-arm-clabbe 2026-04-04 12:55:25,309 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce6729cb08ea23a1f68ea5 2026-04-04 12:55:25,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 12:55:25,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce6729cb08ea23a1f68ea5 HTTP/1.1" 200 None 2026-04-04 12:55:25,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 12:55:25,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-04 12:55:25,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 12:55:25,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce6729cb08ea23a1f68ea5 HTTP/1.1" 200 None 2026-04-04 12:55:25,379 - lava_callback - ERROR - Error processing callback for node 69ce6729cb08ea23a1f68ea5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54942 - "GET / HTTP/1.0" 200 OK 2026-04-04 12:55:45,402 - lava_callback - INFO - Received callback for node 69ce674dcb08ea23a1f68eb5 INFO: 172.21.0.1:45164 - "POST /node/69ce674dcb08ea23a1f68eb5 HTTP/1.0" 202 Accepted 2026-04-04 12:55:45,407 - lava_callback - INFO - Starting async job submit for node 69ce674dcb08ea23a1f68eb5 2026-04-04 12:55:45,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 12:55:45,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce674dcb08ea23a1f68eb5 HTTP/1.1" 200 None 2026-04-04 12:55:45,425 - lava_callback - DEBUG - Processing node 69ce674dcb08ea23a1f68eb5: baseline-arm-clabbe 2026-04-04 12:55:45,426 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce674dcb08ea23a1f68eb5 2026-04-04 12:55:45,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 12:55:45,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce674dcb08ea23a1f68eb5 HTTP/1.1" 200 None 2026-04-04 12:55:45,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 12:55:45,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-04 12:55:45,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 12:55:45,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce674dcb08ea23a1f68eb5 HTTP/1.1" 200 None 2026-04-04 12:55:45,485 - lava_callback - ERROR - Error processing callback for node 69ce674dcb08ea23a1f68eb5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37834 - "GET / HTTP/1.0" 200 OK 2026-04-04 12:56:25,314 - lava_callback - INFO - Received callback for node 69ce6772cb08ea23a1f68ec1 INFO: 172.21.0.1:40242 - "POST /node/69ce6772cb08ea23a1f68ec1 HTTP/1.0" 202 Accepted 2026-04-04 12:56:25,320 - lava_callback - INFO - Starting async job submit for node 69ce6772cb08ea23a1f68ec1 2026-04-04 12:56:25,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 12:56:25,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce6772cb08ea23a1f68ec1 HTTP/1.1" 200 None 2026-04-04 12:56:25,336 - lava_callback - DEBUG - Processing node 69ce6772cb08ea23a1f68ec1: baseline-arm-clabbe 2026-04-04 12:56:25,336 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce6772cb08ea23a1f68ec1 2026-04-04 12:56:25,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 12:56:25,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce6772cb08ea23a1f68ec1 HTTP/1.1" 200 None 2026-04-04 12:56:25,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 12:56:25,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-04 12:56:25,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 12:56:25,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce6772cb08ea23a1f68ec1 HTTP/1.1" 200 None 2026-04-04 12:56:25,398 - lava_callback - ERROR - Error processing callback for node 69ce6772cb08ea23a1f68ec1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49228 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38536 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37106 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53660 - "GET / HTTP/1.0" 200 OK 2026-04-04 13:07:12,788 - lava_callback - INFO - Received callback for node 69ce69f4cb08ea23a1f68ef8 INFO: 172.21.0.1:47958 - "POST /node/69ce69f4cb08ea23a1f68ef8 HTTP/1.0" 202 Accepted 2026-04-04 13:07:12,794 - lava_callback - INFO - Starting async job submit for node 69ce69f4cb08ea23a1f68ef8 2026-04-04 13:07:12,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:07:12,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce69f4cb08ea23a1f68ef8 HTTP/1.1" 200 None 2026-04-04 13:07:12,810 - lava_callback - DEBUG - Processing node 69ce69f4cb08ea23a1f68ef8: baseline-arm-baylibre 2026-04-04 13:07:12,811 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce69f4cb08ea23a1f68ef8 2026-04-04 13:07:12,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:07:12,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce69f4cb08ea23a1f68ef8 HTTP/1.1" 200 None 2026-04-04 13:07:12,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:07:12,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-04 13:07:12,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:07:12,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce69f4cb08ea23a1f68ef8 HTTP/1.1" 200 None 2026-04-04 13:07:12,882 - lava_callback - ERROR - Error processing callback for node 69ce69f4cb08ea23a1f68ef8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34256 - "GET / HTTP/1.0" 200 OK 2026-04-04 13:07:52,648 - lava_callback - INFO - Received callback for node 69ce6a1bcb08ea23a1f68f07 INFO: 172.21.0.1:60146 - "POST /node/69ce6a1bcb08ea23a1f68f07 HTTP/1.0" 202 Accepted 2026-04-04 13:07:52,654 - lava_callback - INFO - Starting async job submit for node 69ce6a1bcb08ea23a1f68f07 2026-04-04 13:07:52,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:07:52,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce6a1bcb08ea23a1f68f07 HTTP/1.1" 200 None 2026-04-04 13:07:52,671 - lava_callback - DEBUG - Processing node 69ce6a1bcb08ea23a1f68f07: baseline-arm-baylibre 2026-04-04 13:07:52,671 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce6a1bcb08ea23a1f68f07 2026-04-04 13:07:52,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:07:52,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce6a1bcb08ea23a1f68f07 HTTP/1.1" 200 None 2026-04-04 13:07:52,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:07:52,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-04 13:07:52,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:07:52,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce6a1bcb08ea23a1f68f07 HTTP/1.1" 200 None 2026-04-04 13:07:52,726 - lava_callback - ERROR - Error processing callback for node 69ce6a1bcb08ea23a1f68f07: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57580 - "GET / HTTP/1.0" 200 OK 2026-04-04 13:08:32,691 - lava_callback - INFO - Received callback for node 69ce6a44cb08ea23a1f68f12 INFO: 172.21.0.1:51398 - "POST /node/69ce6a44cb08ea23a1f68f12 HTTP/1.0" 202 Accepted 2026-04-04 13:08:32,696 - lava_callback - INFO - Starting async job submit for node 69ce6a44cb08ea23a1f68f12 2026-04-04 13:08:32,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:08:32,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce6a44cb08ea23a1f68f12 HTTP/1.1" 200 None 2026-04-04 13:08:32,712 - lava_callback - DEBUG - Processing node 69ce6a44cb08ea23a1f68f12: baseline-arm-baylibre 2026-04-04 13:08:32,712 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce6a44cb08ea23a1f68f12 2026-04-04 13:08:32,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:08:32,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce6a44cb08ea23a1f68f12 HTTP/1.1" 200 None 2026-04-04 13:08:32,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:08:32,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-04 13:08:32,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:08:32,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce6a44cb08ea23a1f68f12 HTTP/1.1" 200 None 2026-04-04 13:08:32,769 - lava_callback - ERROR - Error processing callback for node 69ce6a44cb08ea23a1f68f12: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58272 - "GET / HTTP/1.0" 200 OK 2026-04-04 13:09:12,702 - lava_callback - INFO - Received callback for node 69ce6a69cb08ea23a1f68f20 INFO: 172.21.0.1:47458 - "POST /node/69ce6a69cb08ea23a1f68f20 HTTP/1.0" 202 Accepted 2026-04-04 13:09:12,707 - lava_callback - INFO - Starting async job submit for node 69ce6a69cb08ea23a1f68f20 2026-04-04 13:09:12,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:09:12,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce6a69cb08ea23a1f68f20 HTTP/1.1" 200 None 2026-04-04 13:09:12,724 - lava_callback - DEBUG - Processing node 69ce6a69cb08ea23a1f68f20: baseline-arm-baylibre 2026-04-04 13:09:12,724 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce6a69cb08ea23a1f68f20 2026-04-04 13:09:12,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:09:12,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce6a69cb08ea23a1f68f20 HTTP/1.1" 200 None 2026-04-04 13:09:12,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:09:12,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-04 13:09:12,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:09:12,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce6a69cb08ea23a1f68f20 HTTP/1.1" 200 None 2026-04-04 13:09:12,780 - lava_callback - ERROR - Error processing callback for node 69ce6a69cb08ea23a1f68f20: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56720 - "GET / HTTP/1.0" 200 OK 2026-04-04 13:09:52,862 - lava_callback - INFO - Received callback for node 69ce6a8fcb08ea23a1f68f2c INFO: 172.21.0.1:40186 - "POST /node/69ce6a8fcb08ea23a1f68f2c HTTP/1.0" 202 Accepted 2026-04-04 13:09:52,868 - lava_callback - INFO - Starting async job submit for node 69ce6a8fcb08ea23a1f68f2c 2026-04-04 13:09:52,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:09:52,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce6a8fcb08ea23a1f68f2c HTTP/1.1" 200 None 2026-04-04 13:09:52,887 - lava_callback - DEBUG - Processing node 69ce6a8fcb08ea23a1f68f2c: baseline-arm-baylibre 2026-04-04 13:09:52,887 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce6a8fcb08ea23a1f68f2c 2026-04-04 13:09:52,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:09:52,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce6a8fcb08ea23a1f68f2c HTTP/1.1" 200 None 2026-04-04 13:09:52,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:09:52,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-04 13:09:52,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:09:52,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce6a8fcb08ea23a1f68f2c HTTP/1.1" 200 None 2026-04-04 13:09:52,946 - lava_callback - ERROR - Error processing callback for node 69ce6a8fcb08ea23a1f68f2c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55456 - "GET / HTTP/1.0" 200 OK 2026-04-04 13:10:32,737 - lava_callback - INFO - Received callback for node 69ce6ab6cb08ea23a1f68f3f INFO: 172.21.0.1:55726 - "POST /node/69ce6ab6cb08ea23a1f68f3f HTTP/1.0" 202 Accepted 2026-04-04 13:10:32,742 - lava_callback - INFO - Starting async job submit for node 69ce6ab6cb08ea23a1f68f3f 2026-04-04 13:10:32,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:10:32,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce6ab6cb08ea23a1f68f3f HTTP/1.1" 200 None 2026-04-04 13:10:32,758 - lava_callback - DEBUG - Processing node 69ce6ab6cb08ea23a1f68f3f: baseline-arm-baylibre 2026-04-04 13:10:32,758 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce6ab6cb08ea23a1f68f3f 2026-04-04 13:10:32,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:10:32,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce6ab6cb08ea23a1f68f3f HTTP/1.1" 200 None 2026-04-04 13:10:32,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:10:32,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-04 13:10:32,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:10:32,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce6ab6cb08ea23a1f68f3f HTTP/1.1" 200 None 2026-04-04 13:10:32,844 - lava_callback - ERROR - Error processing callback for node 69ce6ab6cb08ea23a1f68f3f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38814 - "GET / HTTP/1.0" 200 OK 2026-04-04 13:10:52,798 - lava_callback - INFO - Received callback for node 69ce6adbcb08ea23a1f68f4f INFO: 172.21.0.1:48448 - "POST /node/69ce6adbcb08ea23a1f68f4f HTTP/1.0" 202 Accepted 2026-04-04 13:10:52,804 - lava_callback - INFO - Starting async job submit for node 69ce6adbcb08ea23a1f68f4f 2026-04-04 13:10:52,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:10:52,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce6adbcb08ea23a1f68f4f HTTP/1.1" 200 None 2026-04-04 13:10:52,820 - lava_callback - DEBUG - Processing node 69ce6adbcb08ea23a1f68f4f: baseline-arm-baylibre 2026-04-04 13:10:52,820 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce6adbcb08ea23a1f68f4f 2026-04-04 13:10:52,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:10:52,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce6adbcb08ea23a1f68f4f HTTP/1.1" 200 None 2026-04-04 13:10:52,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:10:52,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-04 13:10:52,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:10:52,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce6adbcb08ea23a1f68f4f HTTP/1.1" 200 None 2026-04-04 13:10:52,902 - lava_callback - ERROR - Error processing callback for node 69ce6adbcb08ea23a1f68f4f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41488 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36150 - "GET / HTTP/1.0" 200 OK 2026-04-04 13:11:32,877 - lava_callback - INFO - Received callback for node 69ce6afdcb08ea23a1f68f5d INFO: 172.21.0.1:54618 - "POST /node/69ce6afdcb08ea23a1f68f5d HTTP/1.0" 202 Accepted 2026-04-04 13:11:32,882 - lava_callback - INFO - Starting async job submit for node 69ce6afdcb08ea23a1f68f5d 2026-04-04 13:11:32,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:11:32,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce6afdcb08ea23a1f68f5d HTTP/1.1" 200 None 2026-04-04 13:11:32,899 - lava_callback - DEBUG - Processing node 69ce6afdcb08ea23a1f68f5d: baseline-arm-baylibre 2026-04-04 13:11:32,899 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce6afdcb08ea23a1f68f5d 2026-04-04 13:11:32,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:11:32,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce6afdcb08ea23a1f68f5d HTTP/1.1" 200 None 2026-04-04 13:11:32,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:11:32,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-04 13:11:32,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:11:32,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce6afdcb08ea23a1f68f5d HTTP/1.1" 200 None 2026-04-04 13:11:32,949 - lava_callback - ERROR - Error processing callback for node 69ce6afdcb08ea23a1f68f5d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36986 - "GET / HTTP/1.0" 200 OK 2026-04-04 13:12:12,854 - lava_callback - INFO - Received callback for node 69ce6b23cb08ea23a1f68f71 INFO: 172.21.0.1:59888 - "POST /node/69ce6b23cb08ea23a1f68f71 HTTP/1.0" 202 Accepted 2026-04-04 13:12:12,863 - lava_callback - INFO - Starting async job submit for node 69ce6b23cb08ea23a1f68f71 2026-04-04 13:12:12,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:12:12,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce6b23cb08ea23a1f68f71 HTTP/1.1" 200 None 2026-04-04 13:12:12,886 - lava_callback - DEBUG - Processing node 69ce6b23cb08ea23a1f68f71: baseline-arm-baylibre 2026-04-04 13:12:12,886 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce6b23cb08ea23a1f68f71 2026-04-04 13:12:12,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:12:12,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce6b23cb08ea23a1f68f71 HTTP/1.1" 200 None 2026-04-04 13:12:12,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:12:12,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-04 13:12:12,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:12:12,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce6b23cb08ea23a1f68f71 HTTP/1.1" 200 None 2026-04-04 13:12:12,955 - lava_callback - ERROR - Error processing callback for node 69ce6b23cb08ea23a1f68f71: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56736 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56114 - "GET / HTTP/1.0" 200 OK 2026-04-04 13:14:06,090 - lava_callback - INFO - Received callback for node 69ce6b92cb08ea23a1f68f9c INFO: 172.21.0.1:33066 - "POST /node/69ce6b92cb08ea23a1f68f9c HTTP/1.0" 202 Accepted 2026-04-04 13:14:06,096 - lava_callback - INFO - Starting async job submit for node 69ce6b92cb08ea23a1f68f9c 2026-04-04 13:14:06,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:14:06,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce6b92cb08ea23a1f68f9c HTTP/1.1" 200 None 2026-04-04 13:14:06,111 - lava_callback - DEBUG - Processing node 69ce6b92cb08ea23a1f68f9c: baseline-arm-clabbe 2026-04-04 13:14:06,112 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce6b92cb08ea23a1f68f9c 2026-04-04 13:14:06,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:14:06,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce6b92cb08ea23a1f68f9c HTTP/1.1" 200 None 2026-04-04 13:14:06,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:14:06,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-04 13:14:06,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:14:06,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce6b92cb08ea23a1f68f9c HTTP/1.1" 200 None 2026-04-04 13:14:06,184 - lava_callback - ERROR - Error processing callback for node 69ce6b92cb08ea23a1f68f9c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59420 - "GET / HTTP/1.0" 200 OK 2026-04-04 13:14:46,104 - lava_callback - INFO - Received callback for node 69ce6bb7cb08ea23a1f68faa INFO: 172.21.0.1:51512 - "POST /node/69ce6bb7cb08ea23a1f68faa HTTP/1.0" 202 Accepted 2026-04-04 13:14:46,111 - lava_callback - INFO - Starting async job submit for node 69ce6bb7cb08ea23a1f68faa 2026-04-04 13:14:46,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:14:46,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce6bb7cb08ea23a1f68faa HTTP/1.1" 200 None 2026-04-04 13:14:46,125 - lava_callback - DEBUG - Processing node 69ce6bb7cb08ea23a1f68faa: baseline-arm-clabbe 2026-04-04 13:14:46,125 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce6bb7cb08ea23a1f68faa 2026-04-04 13:14:46,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:14:46,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce6bb7cb08ea23a1f68faa HTTP/1.1" 200 None 2026-04-04 13:14:46,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:14:46,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-04 13:14:46,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:14:46,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce6bb7cb08ea23a1f68faa HTTP/1.1" 200 None 2026-04-04 13:14:46,186 - lava_callback - ERROR - Error processing callback for node 69ce6bb7cb08ea23a1f68faa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44662 - "GET / HTTP/1.0" 200 OK 2026-04-04 13:15:26,159 - lava_callback - INFO - Received callback for node 69ce6bdbcb08ea23a1f68fbc INFO: 172.21.0.1:43722 - "POST /node/69ce6bdbcb08ea23a1f68fbc HTTP/1.0" 202 Accepted 2026-04-04 13:15:26,168 - lava_callback - INFO - Starting async job submit for node 69ce6bdbcb08ea23a1f68fbc 2026-04-04 13:15:26,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:15:26,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce6bdbcb08ea23a1f68fbc HTTP/1.1" 200 None 2026-04-04 13:15:26,184 - lava_callback - DEBUG - Processing node 69ce6bdbcb08ea23a1f68fbc: baseline-arm-clabbe 2026-04-04 13:15:26,184 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce6bdbcb08ea23a1f68fbc 2026-04-04 13:15:26,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:15:26,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce6bdbcb08ea23a1f68fbc HTTP/1.1" 200 None 2026-04-04 13:15:26,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:15:26,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-04 13:15:26,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:15:26,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce6bdbcb08ea23a1f68fbc HTTP/1.1" 200 None 2026-04-04 13:15:26,245 - lava_callback - ERROR - Error processing callback for node 69ce6bdbcb08ea23a1f68fbc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49528 - "GET / HTTP/1.0" 200 OK 2026-04-04 13:16:06,158 - lava_callback - INFO - Received callback for node 69ce6c00cb08ea23a1f68fd0 INFO: 172.21.0.1:38766 - "POST /node/69ce6c00cb08ea23a1f68fd0 HTTP/1.0" 202 Accepted 2026-04-04 13:16:06,163 - lava_callback - INFO - Starting async job submit for node 69ce6c00cb08ea23a1f68fd0 2026-04-04 13:16:06,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:16:06,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce6c00cb08ea23a1f68fd0 HTTP/1.1" 200 None 2026-04-04 13:16:06,180 - lava_callback - DEBUG - Processing node 69ce6c00cb08ea23a1f68fd0: baseline-arm-clabbe 2026-04-04 13:16:06,180 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce6c00cb08ea23a1f68fd0 2026-04-04 13:16:06,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:16:06,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce6c00cb08ea23a1f68fd0 HTTP/1.1" 200 None 2026-04-04 13:16:06,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:16:06,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-04 13:16:06,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:16:06,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce6c00cb08ea23a1f68fd0 HTTP/1.1" 200 None 2026-04-04 13:16:06,236 - lava_callback - ERROR - Error processing callback for node 69ce6c00cb08ea23a1f68fd0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38406 - "GET / HTTP/1.0" 200 OK 2026-04-04 13:16:33,201 - lava_callback - INFO - Received callback for node 69ce6c24cb08ea23a1f68fd7 INFO: 172.21.0.1:54334 - "POST /node/69ce6c24cb08ea23a1f68fd7 HTTP/1.0" 202 Accepted 2026-04-04 13:16:33,206 - lava_callback - INFO - Starting async job submit for node 69ce6c24cb08ea23a1f68fd7 2026-04-04 13:16:33,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:16:33,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce6c24cb08ea23a1f68fd7 HTTP/1.1" 200 None 2026-04-04 13:16:33,223 - lava_callback - DEBUG - Processing node 69ce6c24cb08ea23a1f68fd7: baseline-arm-baylibre 2026-04-04 13:16:33,223 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce6c24cb08ea23a1f68fd7 2026-04-04 13:16:33,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:16:33,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce6c24cb08ea23a1f68fd7 HTTP/1.1" 200 None 2026-04-04 13:16:33,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:16:33,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-04 13:16:33,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:16:33,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce6c24cb08ea23a1f68fd7 HTTP/1.1" 200 None 2026-04-04 13:16:33,282 - lava_callback - ERROR - Error processing callback for node 69ce6c24cb08ea23a1f68fd7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34864 - "GET / HTTP/1.0" 200 OK 2026-04-04 13:17:46,310 - lava_callback - INFO - Received callback for node 69ce6c6ecb08ea23a1f68ff0 INFO: 172.21.0.1:46262 - "POST /node/69ce6c6ecb08ea23a1f68ff0 HTTP/1.0" 202 Accepted 2026-04-04 13:17:46,316 - lava_callback - INFO - Starting async job submit for node 69ce6c6ecb08ea23a1f68ff0 2026-04-04 13:17:46,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:17:46,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce6c6ecb08ea23a1f68ff0 HTTP/1.1" 200 None 2026-04-04 13:17:46,332 - lava_callback - DEBUG - Processing node 69ce6c6ecb08ea23a1f68ff0: baseline-arm-clabbe 2026-04-04 13:17:46,332 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce6c6ecb08ea23a1f68ff0 2026-04-04 13:17:46,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:17:46,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce6c6ecb08ea23a1f68ff0 HTTP/1.1" 200 None 2026-04-04 13:17:46,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:17:46,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-04 13:17:46,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:17:46,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce6c6ecb08ea23a1f68ff0 HTTP/1.1" 200 None 2026-04-04 13:17:46,389 - lava_callback - ERROR - Error processing callback for node 69ce6c6ecb08ea23a1f68ff0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39638 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39660 - "GET / HTTP/1.0" 200 OK 2026-04-04 13:18:26,426 - lava_callback - INFO - Received callback for node 69ce6c93cb08ea23a1f68ffd INFO: 172.21.0.1:44384 - "POST /node/69ce6c93cb08ea23a1f68ffd HTTP/1.0" 202 Accepted 2026-04-04 13:18:26,432 - lava_callback - INFO - Starting async job submit for node 69ce6c93cb08ea23a1f68ffd 2026-04-04 13:18:26,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:18:26,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce6c93cb08ea23a1f68ffd HTTP/1.1" 200 None 2026-04-04 13:18:26,447 - lava_callback - DEBUG - Processing node 69ce6c93cb08ea23a1f68ffd: baseline-arm-clabbe 2026-04-04 13:18:26,447 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce6c93cb08ea23a1f68ffd 2026-04-04 13:18:26,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:18:26,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce6c93cb08ea23a1f68ffd HTTP/1.1" 200 None 2026-04-04 13:18:26,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:18:26,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-04 13:18:26,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:18:26,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce6c93cb08ea23a1f68ffd HTTP/1.1" 200 None 2026-04-04 13:18:26,510 - lava_callback - ERROR - Error processing callback for node 69ce6c93cb08ea23a1f68ffd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56690 - "GET / HTTP/1.0" 200 OK 2026-04-04 13:18:53,224 - lava_callback - INFO - Received callback for node 69ce6cb5cb08ea23a1f6900b INFO: 172.21.0.1:55226 - "POST /node/69ce6cb5cb08ea23a1f6900b HTTP/1.0" 202 Accepted 2026-04-04 13:18:53,230 - lava_callback - INFO - Starting async job submit for node 69ce6cb5cb08ea23a1f6900b 2026-04-04 13:18:53,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:18:53,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce6cb5cb08ea23a1f6900b HTTP/1.1" 200 None 2026-04-04 13:18:53,246 - lava_callback - DEBUG - Processing node 69ce6cb5cb08ea23a1f6900b: baseline-arm-baylibre 2026-04-04 13:18:53,246 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce6cb5cb08ea23a1f6900b 2026-04-04 13:18:53,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:18:53,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce6cb5cb08ea23a1f6900b HTTP/1.1" 200 None 2026-04-04 13:18:53,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:18:53,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-04 13:18:53,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:18:53,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce6cb5cb08ea23a1f6900b HTTP/1.1" 200 None 2026-04-04 13:18:53,306 - lava_callback - ERROR - Error processing callback for node 69ce6cb5cb08ea23a1f6900b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55684 - "GET / HTTP/1.0" 200 OK 2026-04-04 13:19:33,241 - lava_callback - INFO - Received callback for node 69ce6cd9cb08ea23a1f69015 INFO: 172.21.0.1:33068 - "POST /node/69ce6cd9cb08ea23a1f69015 HTTP/1.0" 202 Accepted 2026-04-04 13:19:33,247 - lava_callback - INFO - Starting async job submit for node 69ce6cd9cb08ea23a1f69015 2026-04-04 13:19:33,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:19:33,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce6cd9cb08ea23a1f69015 HTTP/1.1" 200 None 2026-04-04 13:19:33,265 - lava_callback - DEBUG - Processing node 69ce6cd9cb08ea23a1f69015: baseline-arm-baylibre 2026-04-04 13:19:33,265 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce6cd9cb08ea23a1f69015 2026-04-04 13:19:33,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:19:33,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce6cd9cb08ea23a1f69015 HTTP/1.1" 200 None 2026-04-04 13:19:33,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:19:33,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-04 13:19:33,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:19:33,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce6cd9cb08ea23a1f69015 HTTP/1.1" 200 None 2026-04-04 13:19:33,340 - lava_callback - ERROR - Error processing callback for node 69ce6cd9cb08ea23a1f69015: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55802 - "GET / HTTP/1.0" 200 OK 2026-04-04 13:25:13,646 - lava_callback - INFO - Received callback for node 69ce6e29cb08ea23a1f69050 INFO: 172.21.0.1:50400 - "POST /node/69ce6e29cb08ea23a1f69050 HTTP/1.0" 202 Accepted 2026-04-04 13:25:13,652 - lava_callback - INFO - Starting async job submit for node 69ce6e29cb08ea23a1f69050 2026-04-04 13:25:13,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:25:13,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce6e29cb08ea23a1f69050 HTTP/1.1" 200 None 2026-04-04 13:25:13,667 - lava_callback - DEBUG - Processing node 69ce6e29cb08ea23a1f69050: baseline-arm-baylibre 2026-04-04 13:25:13,667 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce6e29cb08ea23a1f69050 2026-04-04 13:25:13,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:25:13,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce6e29cb08ea23a1f69050 HTTP/1.1" 200 None 2026-04-04 13:25:13,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:25:13,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-04 13:25:13,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:25:13,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce6e29cb08ea23a1f69050 HTTP/1.1" 200 None 2026-04-04 13:25:13,721 - lava_callback - ERROR - Error processing callback for node 69ce6e29cb08ea23a1f69050: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50414 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46090 - "GET / HTTP/1.0" 200 OK 2026-04-04 13:25:53,586 - lava_callback - INFO - Received callback for node 69ce6e55cb08ea23a1f6905f INFO: 172.21.0.1:42666 - "POST /node/69ce6e55cb08ea23a1f6905f HTTP/1.0" 202 Accepted 2026-04-04 13:25:53,592 - lava_callback - INFO - Starting async job submit for node 69ce6e55cb08ea23a1f6905f 2026-04-04 13:25:53,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:25:53,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce6e55cb08ea23a1f6905f HTTP/1.1" 200 None 2026-04-04 13:25:53,609 - lava_callback - DEBUG - Processing node 69ce6e55cb08ea23a1f6905f: baseline-arm64-baylibre 2026-04-04 13:25:53,609 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce6e55cb08ea23a1f6905f 2026-04-04 13:25:53,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:25:53,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce6e55cb08ea23a1f6905f HTTP/1.1" 200 None 2026-04-04 13:25:53,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:25:53,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-04 13:25:53,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:25:53,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce6e55cb08ea23a1f6905f HTTP/1.1" 200 None 2026-04-04 13:25:53,675 - lava_callback - ERROR - Error processing callback for node 69ce6e55cb08ea23a1f6905f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57622 - "GET / HTTP/1.0" 200 OK 2026-04-04 13:27:13,664 - lava_callback - INFO - Received callback for node 69ce6ea0cb08ea23a1f69068 INFO: 172.21.0.1:45520 - "POST /node/69ce6ea0cb08ea23a1f69068 HTTP/1.0" 202 Accepted 2026-04-04 13:27:13,670 - lava_callback - INFO - Starting async job submit for node 69ce6ea0cb08ea23a1f69068 2026-04-04 13:27:13,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:27:13,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce6ea0cb08ea23a1f69068 HTTP/1.1" 200 None 2026-04-04 13:27:13,686 - lava_callback - DEBUG - Processing node 69ce6ea0cb08ea23a1f69068: baseline-arm64-baylibre 2026-04-04 13:27:13,686 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce6ea0cb08ea23a1f69068 2026-04-04 13:27:13,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:27:13,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce6ea0cb08ea23a1f69068 HTTP/1.1" 200 None 2026-04-04 13:27:13,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:27:13,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-04 13:27:13,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:27:13,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce6ea0cb08ea23a1f69068 HTTP/1.1" 200 None 2026-04-04 13:27:13,748 - lava_callback - ERROR - Error processing callback for node 69ce6ea0cb08ea23a1f69068: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49828 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58278 - "GET / HTTP/1.0" 200 OK 2026-04-04 13:28:33,746 - lava_callback - INFO - Received callback for node 69ce6eeccb08ea23a1f69071 INFO: 172.21.0.1:39450 - "POST /node/69ce6eeccb08ea23a1f69071 HTTP/1.0" 202 Accepted 2026-04-04 13:28:33,751 - lava_callback - INFO - Starting async job submit for node 69ce6eeccb08ea23a1f69071 2026-04-04 13:28:33,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:28:33,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce6eeccb08ea23a1f69071 HTTP/1.1" 200 None 2026-04-04 13:28:33,767 - lava_callback - DEBUG - Processing node 69ce6eeccb08ea23a1f69071: baseline-arm64-baylibre 2026-04-04 13:28:33,767 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce6eeccb08ea23a1f69071 2026-04-04 13:28:33,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:28:33,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce6eeccb08ea23a1f69071 HTTP/1.1" 200 None 2026-04-04 13:28:33,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:28:33,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-04 13:28:33,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:28:33,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce6eeccb08ea23a1f69071 HTTP/1.1" 200 None 2026-04-04 13:28:33,831 - lava_callback - ERROR - Error processing callback for node 69ce6eeccb08ea23a1f69071: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55616 - "GET / HTTP/1.0" 200 OK 2026-04-04 13:29:33,750 - lava_callback - INFO - Received callback for node 69ce6f39cb08ea23a1f6907a INFO: 172.21.0.1:53476 - "POST /node/69ce6f39cb08ea23a1f6907a HTTP/1.0" 202 Accepted 2026-04-04 13:29:33,759 - lava_callback - INFO - Starting async job submit for node 69ce6f39cb08ea23a1f6907a 2026-04-04 13:29:33,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:29:33,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce6f39cb08ea23a1f6907a HTTP/1.1" 200 None 2026-04-04 13:29:33,775 - lava_callback - DEBUG - Processing node 69ce6f39cb08ea23a1f6907a: baseline-arm64-baylibre 2026-04-04 13:29:33,776 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce6f39cb08ea23a1f6907a 2026-04-04 13:29:33,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:29:33,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce6f39cb08ea23a1f6907a HTTP/1.1" 200 None 2026-04-04 13:29:33,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:29:33,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-04 13:29:33,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:29:33,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce6f39cb08ea23a1f6907a HTTP/1.1" 200 None 2026-04-04 13:29:33,832 - lava_callback - ERROR - Error processing callback for node 69ce6f39cb08ea23a1f6907a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48238 - "GET / HTTP/1.0" 200 OK 2026-04-04 13:30:53,904 - lava_callback - INFO - Received callback for node 69ce6f85cb08ea23a1f6908e INFO: 172.21.0.1:34058 - "POST /node/69ce6f85cb08ea23a1f6908e HTTP/1.0" 202 Accepted 2026-04-04 13:30:53,910 - lava_callback - INFO - Starting async job submit for node 69ce6f85cb08ea23a1f6908e 2026-04-04 13:30:53,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:30:53,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce6f85cb08ea23a1f6908e HTTP/1.1" 200 None 2026-04-04 13:30:53,930 - lava_callback - DEBUG - Processing node 69ce6f85cb08ea23a1f6908e: baseline-arm64-baylibre 2026-04-04 13:30:53,930 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce6f85cb08ea23a1f6908e 2026-04-04 13:30:53,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:30:53,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce6f85cb08ea23a1f6908e HTTP/1.1" 200 None 2026-04-04 13:30:53,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:30:53,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-04 13:30:53,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:30:53,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce6f85cb08ea23a1f6908e HTTP/1.1" 200 None 2026-04-04 13:30:53,992 - lava_callback - ERROR - Error processing callback for node 69ce6f85cb08ea23a1f6908e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36122 - "GET / HTTP/1.0" 200 OK 2026-04-04 13:32:27,053 - lava_callback - INFO - Received callback for node 69ce6fd4cb08ea23a1f69097 INFO: 172.21.0.1:36124 - "POST /node/69ce6fd4cb08ea23a1f69097 HTTP/1.0" 202 Accepted 2026-04-04 13:32:27,059 - lava_callback - INFO - Starting async job submit for node 69ce6fd4cb08ea23a1f69097 2026-04-04 13:32:27,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:32:27,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce6fd4cb08ea23a1f69097 HTTP/1.1" 200 None 2026-04-04 13:32:27,076 - lava_callback - DEBUG - Processing node 69ce6fd4cb08ea23a1f69097: baseline-arm64-clabbe 2026-04-04 13:32:27,077 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce6fd4cb08ea23a1f69097 2026-04-04 13:32:27,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:32:27,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce6fd4cb08ea23a1f69097 HTTP/1.1" 200 None 2026-04-04 13:32:27,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:32:27,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-04 13:32:27,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:32:27,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce6fd4cb08ea23a1f69097 HTTP/1.1" 200 None 2026-04-04 13:32:27,132 - lava_callback - ERROR - Error processing callback for node 69ce6fd4cb08ea23a1f69097: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53146 - "GET / HTTP/1.0" 200 OK 2026-04-04 13:33:14,035 - lava_callback - INFO - Received callback for node 69ce7018cb08ea23a1f690a0 INFO: 172.21.0.1:36700 - "POST /node/69ce7018cb08ea23a1f690a0 HTTP/1.0" 202 Accepted 2026-04-04 13:33:14,040 - lava_callback - INFO - Starting async job submit for node 69ce7018cb08ea23a1f690a0 2026-04-04 13:33:14,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:33:14,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce7018cb08ea23a1f690a0 HTTP/1.1" 200 None 2026-04-04 13:33:14,058 - lava_callback - DEBUG - Processing node 69ce7018cb08ea23a1f690a0: baseline-arm64-baylibre 2026-04-04 13:33:14,058 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce7018cb08ea23a1f690a0 2026-04-04 13:33:14,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:33:14,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce7018cb08ea23a1f690a0 HTTP/1.1" 200 None 2026-04-04 13:33:14,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:33:14,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-04 13:33:14,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:33:14,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce7018cb08ea23a1f690a0 HTTP/1.1" 200 None 2026-04-04 13:33:14,117 - lava_callback - ERROR - Error processing callback for node 69ce7018cb08ea23a1f690a0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47912 - "GET / HTTP/1.0" 200 OK 2026-04-04 13:34:47,157 - lava_callback - INFO - Received callback for node 69ce706bcb08ea23a1f690ad INFO: 172.21.0.1:47914 - "POST /node/69ce706bcb08ea23a1f690ad HTTP/1.0" 202 Accepted 2026-04-04 13:34:47,163 - lava_callback - INFO - Starting async job submit for node 69ce706bcb08ea23a1f690ad 2026-04-04 13:34:47,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:34:47,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce706bcb08ea23a1f690ad HTTP/1.1" 200 None 2026-04-04 13:34:47,181 - lava_callback - DEBUG - Processing node 69ce706bcb08ea23a1f690ad: baseline-arm64-clabbe 2026-04-04 13:34:47,181 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce706bcb08ea23a1f690ad 2026-04-04 13:34:47,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:34:47,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce706bcb08ea23a1f690ad HTTP/1.1" 200 None 2026-04-04 13:34:47,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:34:47,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-04 13:34:47,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:34:47,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce706bcb08ea23a1f690ad HTTP/1.1" 200 None 2026-04-04 13:34:47,247 - lava_callback - ERROR - Error processing callback for node 69ce706bcb08ea23a1f690ad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56304 - "GET / HTTP/1.0" 200 OK 2026-04-04 13:36:07,240 - lava_callback - INFO - Received callback for node 69ce70b8cb08ea23a1f690bc INFO: 172.21.0.1:56318 - "POST /node/69ce70b8cb08ea23a1f690bc HTTP/1.0" 202 Accepted 2026-04-04 13:36:07,246 - lava_callback - INFO - Starting async job submit for node 69ce70b8cb08ea23a1f690bc 2026-04-04 13:36:07,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:36:07,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce70b8cb08ea23a1f690bc HTTP/1.1" 200 None 2026-04-04 13:36:07,265 - lava_callback - DEBUG - Processing node 69ce70b8cb08ea23a1f690bc: baseline-arm64-clabbe 2026-04-04 13:36:07,265 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce70b8cb08ea23a1f690bc 2026-04-04 13:36:07,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:36:07,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce70b8cb08ea23a1f690bc HTTP/1.1" 200 None 2026-04-04 13:36:07,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:36:07,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-04 13:36:07,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:36:07,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce70b8cb08ea23a1f690bc HTTP/1.1" 200 None 2026-04-04 13:36:07,323 - lava_callback - ERROR - Error processing callback for node 69ce70b8cb08ea23a1f690bc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57138 - "GET / HTTP/1.0" 200 OK 2026-04-04 13:37:27,262 - lava_callback - INFO - Received callback for node 69ce7105cb08ea23a1f690c6 INFO: 172.21.0.1:57142 - "POST /node/69ce7105cb08ea23a1f690c6 HTTP/1.0" 202 Accepted 2026-04-04 13:37:27,268 - lava_callback - INFO - Starting async job submit for node 69ce7105cb08ea23a1f690c6 2026-04-04 13:37:27,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:37:27,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce7105cb08ea23a1f690c6 HTTP/1.1" 200 None 2026-04-04 13:37:27,284 - lava_callback - DEBUG - Processing node 69ce7105cb08ea23a1f690c6: baseline-arm64-clabbe 2026-04-04 13:37:27,284 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce7105cb08ea23a1f690c6 2026-04-04 13:37:27,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:37:27,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce7105cb08ea23a1f690c6 HTTP/1.1" 200 None 2026-04-04 13:37:27,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:37:27,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-04 13:37:27,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:37:27,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce7105cb08ea23a1f690c6 HTTP/1.1" 200 None 2026-04-04 13:37:27,349 - lava_callback - ERROR - Error processing callback for node 69ce7105cb08ea23a1f690c6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60666 - "GET / HTTP/1.0" 200 OK 2026-04-04 13:38:34,786 - lava_callback - INFO - Received callback for node 69ce714ecb08ea23a1f690d6 INFO: 172.21.0.1:60078 - "POST /node/69ce714ecb08ea23a1f690d6 HTTP/1.0" 202 Accepted 2026-04-04 13:38:34,792 - lava_callback - INFO - Starting async job submit for node 69ce714ecb08ea23a1f690d6 2026-04-04 13:38:34,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:38:34,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce714ecb08ea23a1f690d6 HTTP/1.1" 200 None 2026-04-04 13:38:34,808 - lava_callback - DEBUG - Processing node 69ce714ecb08ea23a1f690d6: baseline-arm64-baylibre 2026-04-04 13:38:34,808 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce714ecb08ea23a1f690d6 2026-04-04 13:38:34,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:38:34,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce714ecb08ea23a1f690d6 HTTP/1.1" 200 None 2026-04-04 13:38:34,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:38:34,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-04 13:38:34,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:38:34,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce714ecb08ea23a1f690d6 HTTP/1.1" 200 None 2026-04-04 13:38:34,880 - lava_callback - ERROR - Error processing callback for node 69ce714ecb08ea23a1f690d6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34124 - "GET / HTTP/1.0" 200 OK 2026-04-04 13:39:47,338 - lava_callback - INFO - Received callback for node 69ce719fcb08ea23a1f690e9 INFO: 172.21.0.1:34134 - "POST /node/69ce719fcb08ea23a1f690e9 HTTP/1.0" 202 Accepted 2026-04-04 13:39:47,343 - lava_callback - INFO - Starting async job submit for node 69ce719fcb08ea23a1f690e9 2026-04-04 13:39:47,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:39:47,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce719fcb08ea23a1f690e9 HTTP/1.1" 200 None 2026-04-04 13:39:47,359 - lava_callback - DEBUG - Processing node 69ce719fcb08ea23a1f690e9: baseline-arm64-clabbe 2026-04-04 13:39:47,359 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce719fcb08ea23a1f690e9 2026-04-04 13:39:47,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:39:47,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce719fcb08ea23a1f690e9 HTTP/1.1" 200 None 2026-04-04 13:39:47,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:39:47,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-04 13:39:47,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:39:47,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce719fcb08ea23a1f690e9 HTTP/1.1" 200 None 2026-04-04 13:39:47,415 - lava_callback - ERROR - Error processing callback for node 69ce719fcb08ea23a1f690e9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52182 - "GET / HTTP/1.0" 200 OK 2026-04-04 13:41:07,460 - lava_callback - INFO - Received callback for node 69ce71ebcb08ea23a1f690fb INFO: 172.21.0.1:52188 - "POST /node/69ce71ebcb08ea23a1f690fb HTTP/1.0" 202 Accepted 2026-04-04 13:41:07,465 - lava_callback - INFO - Starting async job submit for node 69ce71ebcb08ea23a1f690fb 2026-04-04 13:41:07,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:41:07,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce71ebcb08ea23a1f690fb HTTP/1.1" 200 None 2026-04-04 13:41:07,492 - lava_callback - DEBUG - Processing node 69ce71ebcb08ea23a1f690fb: baseline-arm64-clabbe 2026-04-04 13:41:07,493 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce71ebcb08ea23a1f690fb 2026-04-04 13:41:07,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:41:07,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce71ebcb08ea23a1f690fb HTTP/1.1" 200 None 2026-04-04 13:41:07,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:41:07,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-04 13:41:07,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:41:07,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce71ebcb08ea23a1f690fb HTTP/1.1" 200 None 2026-04-04 13:41:07,551 - lava_callback - ERROR - Error processing callback for node 69ce71ebcb08ea23a1f690fb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35564 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48498 - "GET / HTTP/1.0" 200 OK 2026-04-04 13:42:27,474 - lava_callback - INFO - Received callback for node 69ce7236cb08ea23a1f6910a INFO: 172.21.0.1:48502 - "POST /node/69ce7236cb08ea23a1f6910a HTTP/1.0" 202 Accepted 2026-04-04 13:42:27,480 - lava_callback - INFO - Starting async job submit for node 69ce7236cb08ea23a1f6910a 2026-04-04 13:42:27,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:42:27,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce7236cb08ea23a1f6910a HTTP/1.1" 200 None 2026-04-04 13:42:27,499 - lava_callback - DEBUG - Processing node 69ce7236cb08ea23a1f6910a: baseline-arm64-clabbe 2026-04-04 13:42:27,499 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce7236cb08ea23a1f6910a 2026-04-04 13:42:27,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:42:27,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce7236cb08ea23a1f6910a HTTP/1.1" 200 None 2026-04-04 13:42:27,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:42:27,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-04 13:42:27,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:42:27,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce7236cb08ea23a1f6910a HTTP/1.1" 200 None 2026-04-04 13:42:27,563 - lava_callback - ERROR - Error processing callback for node 69ce7236cb08ea23a1f6910a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47162 - "GET / HTTP/1.0" 200 OK 2026-04-04 13:43:27,521 - lava_callback - INFO - Received callback for node 69ce7273cb08ea23a1f69119 INFO: 172.21.0.1:47174 - "POST /node/69ce7273cb08ea23a1f69119 HTTP/1.0" 202 Accepted 2026-04-04 13:43:27,527 - lava_callback - INFO - Starting async job submit for node 69ce7273cb08ea23a1f69119 2026-04-04 13:43:27,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:43:27,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce7273cb08ea23a1f69119 HTTP/1.1" 200 None 2026-04-04 13:43:27,543 - lava_callback - DEBUG - Processing node 69ce7273cb08ea23a1f69119: baseline-arm-clabbe 2026-04-04 13:43:27,543 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce7273cb08ea23a1f69119 2026-04-04 13:43:27,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:43:27,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce7273cb08ea23a1f69119 HTTP/1.1" 200 None 2026-04-04 13:43:27,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:43:27,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-04 13:43:27,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:43:27,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce7273cb08ea23a1f69119 HTTP/1.1" 200 None 2026-04-04 13:43:27,597 - lava_callback - ERROR - Error processing callback for node 69ce7273cb08ea23a1f69119: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51710 - "GET / HTTP/1.0" 200 OK 2026-04-04 13:43:54,616 - lava_callback - INFO - Received callback for node 69ce7296cb08ea23a1f69125 INFO: 172.21.0.1:46466 - "POST /node/69ce7296cb08ea23a1f69125 HTTP/1.0" 202 Accepted 2026-04-04 13:43:54,622 - lava_callback - INFO - Starting async job submit for node 69ce7296cb08ea23a1f69125 2026-04-04 13:43:54,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:43:54,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce7296cb08ea23a1f69125 HTTP/1.1" 200 None 2026-04-04 13:43:54,638 - lava_callback - DEBUG - Processing node 69ce7296cb08ea23a1f69125: baseline-arm-baylibre 2026-04-04 13:43:54,638 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce7296cb08ea23a1f69125 2026-04-04 13:43:54,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:43:54,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce7296cb08ea23a1f69125 HTTP/1.1" 200 None 2026-04-04 13:43:54,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:43:54,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-04 13:43:54,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:43:54,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce7296cb08ea23a1f69125 HTTP/1.1" 200 None 2026-04-04 13:43:54,691 - lava_callback - ERROR - Error processing callback for node 69ce7296cb08ea23a1f69125: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37780 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34866 - "GET / HTTP/1.0" 200 OK 2026-04-04 13:44:47,597 - lava_callback - INFO - Received callback for node 69ce72bccb08ea23a1f69131 INFO: 172.21.0.1:34874 - "POST /node/69ce72bccb08ea23a1f69131 HTTP/1.0" 202 Accepted 2026-04-04 13:44:47,603 - lava_callback - INFO - Starting async job submit for node 69ce72bccb08ea23a1f69131 2026-04-04 13:44:47,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:44:47,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce72bccb08ea23a1f69131 HTTP/1.1" 200 None 2026-04-04 13:44:47,624 - lava_callback - DEBUG - Processing node 69ce72bccb08ea23a1f69131: baseline-arm-clabbe 2026-04-04 13:44:47,625 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce72bccb08ea23a1f69131 2026-04-04 13:44:47,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:44:47,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce72bccb08ea23a1f69131 HTTP/1.1" 200 None 2026-04-04 13:44:47,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:44:47,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-04 13:44:47,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:44:47,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce72bccb08ea23a1f69131 HTTP/1.1" 200 None 2026-04-04 13:44:47,695 - lava_callback - ERROR - Error processing callback for node 69ce72bccb08ea23a1f69131: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49598 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59432 - "GET / HTTP/1.0" 200 OK 2026-04-04 13:45:27,558 - lava_callback - INFO - Received callback for node 69ce72efcb08ea23a1f69140 INFO: 172.21.0.1:59446 - "POST /node/69ce72efcb08ea23a1f69140 HTTP/1.0" 202 Accepted 2026-04-04 13:45:27,567 - lava_callback - INFO - Starting async job submit for node 69ce72efcb08ea23a1f69140 2026-04-04 13:45:27,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:45:27,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce72efcb08ea23a1f69140 HTTP/1.1" 200 None 2026-04-04 13:45:27,590 - lava_callback - DEBUG - Processing node 69ce72efcb08ea23a1f69140: baseline-arm64-clabbe 2026-04-04 13:45:27,590 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce72efcb08ea23a1f69140 2026-04-04 13:45:27,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:45:27,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce72efcb08ea23a1f69140 HTTP/1.1" 200 None 2026-04-04 13:45:27,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:45:27,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-04 13:45:27,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:45:27,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce72efcb08ea23a1f69140 HTTP/1.1" 200 None 2026-04-04 13:45:27,677 - lava_callback - ERROR - Error processing callback for node 69ce72efcb08ea23a1f69140: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47612 - "GET / HTTP/1.0" 200 OK 2026-04-04 13:46:27,634 - lava_callback - INFO - Received callback for node 69ce732dcb08ea23a1f69145 INFO: 172.21.0.1:47614 - "POST /node/69ce732dcb08ea23a1f69145 HTTP/1.0" 202 Accepted 2026-04-04 13:46:27,640 - lava_callback - INFO - Starting async job submit for node 69ce732dcb08ea23a1f69145 2026-04-04 13:46:27,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:46:27,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce732dcb08ea23a1f69145 HTTP/1.1" 200 None 2026-04-04 13:46:27,667 - lava_callback - DEBUG - Processing node 69ce732dcb08ea23a1f69145: baseline-arm-clabbe 2026-04-04 13:46:27,667 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce732dcb08ea23a1f69145 2026-04-04 13:46:27,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:46:27,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce732dcb08ea23a1f69145 HTTP/1.1" 200 None 2026-04-04 13:46:27,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:46:27,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-04 13:46:27,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:46:27,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce732dcb08ea23a1f69145 HTTP/1.1" 200 None 2026-04-04 13:46:27,736 - lava_callback - ERROR - Error processing callback for node 69ce732dcb08ea23a1f69145: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36012 - "GET / HTTP/1.0" 200 OK 2026-04-04 13:47:07,629 - lava_callback - INFO - Received callback for node 69ce7353cb08ea23a1f69154 INFO: 172.21.0.1:36026 - "POST /node/69ce7353cb08ea23a1f69154 HTTP/1.0" 202 Accepted 2026-04-04 13:47:07,639 - lava_callback - INFO - Starting async job submit for node 69ce7353cb08ea23a1f69154 2026-04-04 13:47:07,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:47:07,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce7353cb08ea23a1f69154 HTTP/1.1" 200 None 2026-04-04 13:47:07,655 - lava_callback - DEBUG - Processing node 69ce7353cb08ea23a1f69154: baseline-arm-clabbe 2026-04-04 13:47:07,655 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce7353cb08ea23a1f69154 2026-04-04 13:47:07,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:47:07,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce7353cb08ea23a1f69154 HTTP/1.1" 200 None 2026-04-04 13:47:07,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:47:07,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-04 13:47:07,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:47:07,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce7353cb08ea23a1f69154 HTTP/1.1" 200 None 2026-04-04 13:47:07,730 - lava_callback - ERROR - Error processing callback for node 69ce7353cb08ea23a1f69154: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52752 - "GET / HTTP/1.0" 200 OK 2026-04-04 13:47:47,699 - lava_callback - INFO - Received callback for node 69ce7379cb08ea23a1f69163 INFO: 172.21.0.1:52756 - "POST /node/69ce7379cb08ea23a1f69163 HTTP/1.0" 202 Accepted 2026-04-04 13:47:47,706 - lava_callback - INFO - Starting async job submit for node 69ce7379cb08ea23a1f69163 2026-04-04 13:47:47,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:47:47,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce7379cb08ea23a1f69163 HTTP/1.1" 200 None 2026-04-04 13:47:47,726 - lava_callback - DEBUG - Processing node 69ce7379cb08ea23a1f69163: baseline-arm-clabbe 2026-04-04 13:47:47,726 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce7379cb08ea23a1f69163 2026-04-04 13:47:47,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:47:47,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce7379cb08ea23a1f69163 HTTP/1.1" 200 None 2026-04-04 13:47:47,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:47:47,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-04 13:47:47,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:47:47,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce7379cb08ea23a1f69163 HTTP/1.1" 200 None 2026-04-04 13:47:47,777 - lava_callback - ERROR - Error processing callback for node 69ce7379cb08ea23a1f69163: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53594 - "GET / HTTP/1.0" 200 OK 2026-04-04 13:48:47,722 - lava_callback - INFO - Received callback for node 69ce73abcb08ea23a1f69171 INFO: 172.21.0.1:53608 - "POST /node/69ce73abcb08ea23a1f69171 HTTP/1.0" 202 Accepted 2026-04-04 13:48:47,728 - lava_callback - INFO - Starting async job submit for node 69ce73abcb08ea23a1f69171 2026-04-04 13:48:47,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:48:47,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce73abcb08ea23a1f69171 HTTP/1.1" 200 None 2026-04-04 13:48:47,744 - lava_callback - DEBUG - Processing node 69ce73abcb08ea23a1f69171: baseline-arm64-clabbe 2026-04-04 13:48:47,745 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce73abcb08ea23a1f69171 2026-04-04 13:48:47,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:48:47,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce73abcb08ea23a1f69171 HTTP/1.1" 200 None 2026-04-04 13:48:47,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:48:47,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-04 13:48:47,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:48:47,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce73abcb08ea23a1f69171 HTTP/1.1" 200 None 2026-04-04 13:48:47,795 - lava_callback - ERROR - Error processing callback for node 69ce73abcb08ea23a1f69171: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54394 - "GET / HTTP/1.0" 200 OK 2026-04-04 13:49:47,736 - lava_callback - INFO - Received callback for node 69ce73eacb08ea23a1f69178 INFO: 172.21.0.1:54402 - "POST /node/69ce73eacb08ea23a1f69178 HTTP/1.0" 202 Accepted 2026-04-04 13:49:47,743 - lava_callback - INFO - Starting async job submit for node 69ce73eacb08ea23a1f69178 2026-04-04 13:49:47,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:49:47,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce73eacb08ea23a1f69178 HTTP/1.1" 200 None 2026-04-04 13:49:47,767 - lava_callback - DEBUG - Processing node 69ce73eacb08ea23a1f69178: baseline-arm-clabbe 2026-04-04 13:49:47,768 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce73eacb08ea23a1f69178 2026-04-04 13:49:47,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:49:47,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce73eacb08ea23a1f69178 HTTP/1.1" 200 None 2026-04-04 13:49:47,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:49:47,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-04 13:49:47,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:49:47,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce73eacb08ea23a1f69178 HTTP/1.1" 200 None 2026-04-04 13:49:47,849 - lava_callback - ERROR - Error processing callback for node 69ce73eacb08ea23a1f69178: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55508 - "GET / HTTP/1.0" 200 OK 2026-04-04 13:50:27,788 - lava_callback - INFO - Received callback for node 69ce7410cb08ea23a1f69187 INFO: 172.21.0.1:55524 - "POST /node/69ce7410cb08ea23a1f69187 HTTP/1.0" 202 Accepted 2026-04-04 13:50:27,798 - lava_callback - INFO - Starting async job submit for node 69ce7410cb08ea23a1f69187 2026-04-04 13:50:27,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:50:27,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce7410cb08ea23a1f69187 HTTP/1.1" 200 None 2026-04-04 13:50:27,815 - lava_callback - DEBUG - Processing node 69ce7410cb08ea23a1f69187: baseline-arm-clabbe 2026-04-04 13:50:27,815 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce7410cb08ea23a1f69187 2026-04-04 13:50:27,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:50:27,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce7410cb08ea23a1f69187 HTTP/1.1" 200 None 2026-04-04 13:50:27,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:50:27,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-04 13:50:27,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:50:27,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce7410cb08ea23a1f69187 HTTP/1.1" 200 None 2026-04-04 13:50:27,874 - lava_callback - ERROR - Error processing callback for node 69ce7410cb08ea23a1f69187: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39612 - "GET / HTTP/1.0" 200 OK 2026-04-04 13:51:07,898 - lava_callback - INFO - Received callback for node 69ce7445cb08ea23a1f69198 INFO: 172.21.0.1:39614 - "POST /node/69ce7445cb08ea23a1f69198 HTTP/1.0" 202 Accepted 2026-04-04 13:51:07,903 - lava_callback - INFO - Starting async job submit for node 69ce7445cb08ea23a1f69198 2026-04-04 13:51:07,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:51:07,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce7445cb08ea23a1f69198 HTTP/1.1" 200 None 2026-04-04 13:51:07,920 - lava_callback - DEBUG - Processing node 69ce7445cb08ea23a1f69198: baseline-arm64-clabbe 2026-04-04 13:51:07,920 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce7445cb08ea23a1f69198 2026-04-04 13:51:07,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:51:07,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce7445cb08ea23a1f69198 HTTP/1.1" 200 None 2026-04-04 13:51:07,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:51:07,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-04 13:51:07,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:51:07,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce7445cb08ea23a1f69198 HTTP/1.1" 200 None 2026-04-04 13:51:07,971 - lava_callback - ERROR - Error processing callback for node 69ce7445cb08ea23a1f69198: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52942 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52304 - "GET / HTTP/1.0" 200 OK 2026-04-04 13:52:07,863 - lava_callback - INFO - Received callback for node 69ce7484cb08ea23a1f691a1 INFO: 172.21.0.1:52314 - "POST /node/69ce7484cb08ea23a1f691a1 HTTP/1.0" 202 Accepted 2026-04-04 13:52:07,870 - lava_callback - INFO - Starting async job submit for node 69ce7484cb08ea23a1f691a1 2026-04-04 13:52:07,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:52:07,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce7484cb08ea23a1f691a1 HTTP/1.1" 200 None 2026-04-04 13:52:07,895 - lava_callback - DEBUG - Processing node 69ce7484cb08ea23a1f691a1: baseline-arm-clabbe 2026-04-04 13:52:07,895 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce7484cb08ea23a1f691a1 2026-04-04 13:52:07,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:52:07,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce7484cb08ea23a1f691a1 HTTP/1.1" 200 None 2026-04-04 13:52:07,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:52:07,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-04 13:52:07,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:52:07,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce7484cb08ea23a1f691a1 HTTP/1.1" 200 None 2026-04-04 13:52:07,971 - lava_callback - ERROR - Error processing callback for node 69ce7484cb08ea23a1f691a1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39522 - "GET / HTTP/1.0" 200 OK 2026-04-04 13:52:47,895 - lava_callback - INFO - Received callback for node 69ce74a8cb08ea23a1f691b1 INFO: 172.21.0.1:39528 - "POST /node/69ce74a8cb08ea23a1f691b1 HTTP/1.0" 202 Accepted 2026-04-04 13:52:47,900 - lava_callback - INFO - Starting async job submit for node 69ce74a8cb08ea23a1f691b1 2026-04-04 13:52:47,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:52:47,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce74a8cb08ea23a1f691b1 HTTP/1.1" 200 None 2026-04-04 13:52:47,916 - lava_callback - DEBUG - Processing node 69ce74a8cb08ea23a1f691b1: baseline-arm-clabbe 2026-04-04 13:52:47,917 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce74a8cb08ea23a1f691b1 2026-04-04 13:52:47,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:52:47,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce74a8cb08ea23a1f691b1 HTTP/1.1" 200 None 2026-04-04 13:52:47,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:52:47,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-04 13:52:47,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:52:47,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce74a8cb08ea23a1f691b1 HTTP/1.1" 200 None 2026-04-04 13:52:47,999 - lava_callback - ERROR - Error processing callback for node 69ce74a8cb08ea23a1f691b1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48266 - "GET / HTTP/1.0" 200 OK 2026-04-04 13:53:47,932 - lava_callback - INFO - Received callback for node 69ce74dbcb08ea23a1f691bf INFO: 172.21.0.1:48282 - "POST /node/69ce74dbcb08ea23a1f691bf HTTP/1.0" 202 Accepted 2026-04-04 13:53:47,938 - lava_callback - INFO - Starting async job submit for node 69ce74dbcb08ea23a1f691bf 2026-04-04 13:53:47,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:53:47,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce74dbcb08ea23a1f691bf HTTP/1.1" 200 None 2026-04-04 13:53:47,954 - lava_callback - DEBUG - Processing node 69ce74dbcb08ea23a1f691bf: baseline-arm64-clabbe 2026-04-04 13:53:47,954 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce74dbcb08ea23a1f691bf 2026-04-04 13:53:47,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:53:47,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce74dbcb08ea23a1f691bf HTTP/1.1" 200 None 2026-04-04 13:53:47,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:53:47,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-04 13:53:47,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:53:48,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce74dbcb08ea23a1f691bf HTTP/1.1" 200 None 2026-04-04 13:53:48,007 - lava_callback - ERROR - Error processing callback for node 69ce74dbcb08ea23a1f691bf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58496 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39718 - "GET / HTTP/1.0" 200 OK 2026-04-04 13:54:55,311 - lava_callback - INFO - Received callback for node 69ce751fcb08ea23a1f691c9 INFO: 172.21.0.1:50752 - "POST /node/69ce751fcb08ea23a1f691c9 HTTP/1.0" 202 Accepted 2026-04-04 13:54:55,319 - lava_callback - INFO - Starting async job submit for node 69ce751fcb08ea23a1f691c9 2026-04-04 13:54:55,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:54:55,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce751fcb08ea23a1f691c9 HTTP/1.1" 200 None 2026-04-04 13:54:55,336 - lava_callback - DEBUG - Processing node 69ce751fcb08ea23a1f691c9: baseline-arm64-baylibre 2026-04-04 13:54:55,336 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce751fcb08ea23a1f691c9 2026-04-04 13:54:55,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:54:55,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce751fcb08ea23a1f691c9 HTTP/1.1" 200 None 2026-04-04 13:54:55,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:54:55,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-04 13:54:55,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:54:55,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce751fcb08ea23a1f691c9 HTTP/1.1" 200 None 2026-04-04 13:54:55,394 - lava_callback - ERROR - Error processing callback for node 69ce751fcb08ea23a1f691c9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50724 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-04 13:56:15,307 - lava_callback - INFO - Received callback for node 69ce7569cb08ea23a1f691d8 INFO: 172.21.0.1:50728 - "POST /node/69ce7569cb08ea23a1f691d8 HTTP/1.0" 202 Accepted 2026-04-04 13:56:15,313 - lava_callback - INFO - Starting async job submit for node 69ce7569cb08ea23a1f691d8 2026-04-04 13:56:15,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:56:15,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce7569cb08ea23a1f691d8 HTTP/1.1" 200 None 2026-04-04 13:56:15,329 - lava_callback - DEBUG - Processing node 69ce7569cb08ea23a1f691d8: baseline-arm64-baylibre 2026-04-04 13:56:15,330 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce7569cb08ea23a1f691d8 2026-04-04 13:56:15,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:56:15,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce7569cb08ea23a1f691d8 HTTP/1.1" 200 None 2026-04-04 13:56:15,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:56:15,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-04 13:56:15,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:56:15,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce7569cb08ea23a1f691d8 HTTP/1.1" 200 None 2026-04-04 13:56:15,400 - lava_callback - ERROR - Error processing callback for node 69ce7569cb08ea23a1f691d8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56594 - "GET / HTTP/1.0" 200 OK 2026-04-04 13:57:28,075 - lava_callback - INFO - Received callback for node 69ce75bbcb08ea23a1f691e1 INFO: 172.21.0.1:56600 - "POST /node/69ce75bbcb08ea23a1f691e1 HTTP/1.0" 202 Accepted 2026-04-04 13:57:28,081 - lava_callback - INFO - Starting async job submit for node 69ce75bbcb08ea23a1f691e1 2026-04-04 13:57:28,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:57:28,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce75bbcb08ea23a1f691e1 HTTP/1.1" 200 None 2026-04-04 13:57:28,097 - lava_callback - DEBUG - Processing node 69ce75bbcb08ea23a1f691e1: baseline-arm64-clabbe 2026-04-04 13:57:28,097 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce75bbcb08ea23a1f691e1 2026-04-04 13:57:28,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:57:28,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce75bbcb08ea23a1f691e1 HTTP/1.1" 200 None 2026-04-04 13:57:28,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:57:28,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-04 13:57:28,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:57:28,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce75bbcb08ea23a1f691e1 HTTP/1.1" 200 None 2026-04-04 13:57:28,159 - lava_callback - ERROR - Error processing callback for node 69ce75bbcb08ea23a1f691e1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46306 - "GET / HTTP/1.0" 200 OK 2026-04-04 13:58:35,331 - lava_callback - INFO - Received callback for node 69ce75ffcb08ea23a1f691eb INFO: 172.21.0.1:51028 - "POST /node/69ce75ffcb08ea23a1f691eb HTTP/1.0" 202 Accepted 2026-04-04 13:58:35,336 - lava_callback - INFO - Starting async job submit for node 69ce75ffcb08ea23a1f691eb 2026-04-04 13:58:35,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:58:35,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce75ffcb08ea23a1f691eb HTTP/1.1" 200 None 2026-04-04 13:58:35,353 - lava_callback - DEBUG - Processing node 69ce75ffcb08ea23a1f691eb: baseline-arm64-baylibre 2026-04-04 13:58:35,353 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce75ffcb08ea23a1f691eb 2026-04-04 13:58:35,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:58:35,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce75ffcb08ea23a1f691eb HTTP/1.1" 200 None 2026-04-04 13:58:35,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:58:35,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-04 13:58:35,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:58:35,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce75ffcb08ea23a1f691eb HTTP/1.1" 200 None 2026-04-04 13:58:35,408 - lava_callback - ERROR - Error processing callback for node 69ce75ffcb08ea23a1f691eb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48184 - "GET / HTTP/1.0" 200 OK 2026-04-04 13:59:55,437 - lava_callback - INFO - Received callback for node 69ce764ccb08ea23a1f691f4 INFO: 172.21.0.1:49252 - "POST /node/69ce764ccb08ea23a1f691f4 HTTP/1.0" 202 Accepted 2026-04-04 13:59:55,443 - lava_callback - INFO - Starting async job submit for node 69ce764ccb08ea23a1f691f4 2026-04-04 13:59:55,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:59:55,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce764ccb08ea23a1f691f4 HTTP/1.1" 200 None 2026-04-04 13:59:55,462 - lava_callback - DEBUG - Processing node 69ce764ccb08ea23a1f691f4: baseline-arm64-baylibre 2026-04-04 13:59:55,462 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce764ccb08ea23a1f691f4 2026-04-04 13:59:55,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:59:55,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce764ccb08ea23a1f691f4 HTTP/1.1" 200 None 2026-04-04 13:59:55,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:59:55,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-04 13:59:55,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 13:59:55,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce764ccb08ea23a1f691f4 HTTP/1.1" 200 None 2026-04-04 13:59:55,514 - lava_callback - ERROR - Error processing callback for node 69ce764ccb08ea23a1f691f4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37866 - "GET / HTTP/1.0" 200 OK 2026-04-04 14:01:08,266 - lava_callback - INFO - Received callback for node 69ce769ccb08ea23a1f69202 INFO: 172.21.0.1:37878 - "POST /node/69ce769ccb08ea23a1f69202 HTTP/1.0" 202 Accepted 2026-04-04 14:01:08,276 - lava_callback - INFO - Starting async job submit for node 69ce769ccb08ea23a1f69202 2026-04-04 14:01:08,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:01:08,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce769ccb08ea23a1f69202 HTTP/1.1" 200 None 2026-04-04 14:01:08,293 - lava_callback - DEBUG - Processing node 69ce769ccb08ea23a1f69202: baseline-arm64-clabbe 2026-04-04 14:01:08,294 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce769ccb08ea23a1f69202 2026-04-04 14:01:08,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:01:08,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce769ccb08ea23a1f69202 HTTP/1.1" 200 None 2026-04-04 14:01:08,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:01:08,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-04 14:01:08,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:01:08,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce769ccb08ea23a1f69202 HTTP/1.1" 200 None 2026-04-04 14:01:08,367 - lava_callback - ERROR - Error processing callback for node 69ce769ccb08ea23a1f69202: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60906 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56984 - "GET / HTTP/1.0" 200 OK 2026-04-04 14:02:28,365 - lava_callback - INFO - Received callback for node 69ce76e9cb08ea23a1f6920f INFO: 172.21.0.1:56996 - "POST /node/69ce76e9cb08ea23a1f6920f HTTP/1.0" 202 Accepted 2026-04-04 14:02:28,370 - lava_callback - INFO - Starting async job submit for node 69ce76e9cb08ea23a1f6920f 2026-04-04 14:02:28,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:02:28,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce76e9cb08ea23a1f6920f HTTP/1.1" 200 None 2026-04-04 14:02:28,395 - lava_callback - DEBUG - Processing node 69ce76e9cb08ea23a1f6920f: baseline-arm64-clabbe 2026-04-04 14:02:28,395 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce76e9cb08ea23a1f6920f 2026-04-04 14:02:28,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:02:28,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce76e9cb08ea23a1f6920f HTTP/1.1" 200 None 2026-04-04 14:02:28,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:02:28,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-04 14:02:28,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:02:28,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce76e9cb08ea23a1f6920f HTTP/1.1" 200 None 2026-04-04 14:02:28,454 - lava_callback - ERROR - Error processing callback for node 69ce76e9cb08ea23a1f6920f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34910 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60892 - "GET / HTTP/1.0" 200 OK 2026-04-04 14:03:35,631 - lava_callback - INFO - Received callback for node 69ce7730cb08ea23a1f69215 INFO: 172.21.0.1:48392 - "POST /node/69ce7730cb08ea23a1f69215 HTTP/1.0" 202 Accepted 2026-04-04 14:03:35,636 - lava_callback - INFO - Starting async job submit for node 69ce7730cb08ea23a1f69215 2026-04-04 14:03:35,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:03:35,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce7730cb08ea23a1f69215 HTTP/1.1" 200 None 2026-04-04 14:03:35,652 - lava_callback - DEBUG - Processing node 69ce7730cb08ea23a1f69215: baseline-arm64-baylibre 2026-04-04 14:03:35,652 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce7730cb08ea23a1f69215 2026-04-04 14:03:35,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:03:35,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce7730cb08ea23a1f69215 HTTP/1.1" 200 None 2026-04-04 14:03:35,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:03:35,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-04 14:03:35,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:03:35,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce7730cb08ea23a1f69215 HTTP/1.1" 200 None 2026-04-04 14:03:35,720 - lava_callback - ERROR - Error processing callback for node 69ce7730cb08ea23a1f69215: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43242 - "GET / HTTP/1.0" 200 OK 2026-04-04 14:05:08,496 - lava_callback - INFO - Received callback for node 69ce7781cb08ea23a1f69224 INFO: 172.21.0.1:43250 - "POST /node/69ce7781cb08ea23a1f69224 HTTP/1.0" 202 Accepted 2026-04-04 14:05:08,503 - lava_callback - INFO - Starting async job submit for node 69ce7781cb08ea23a1f69224 2026-04-04 14:05:08,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:05:08,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce7781cb08ea23a1f69224 HTTP/1.1" 200 None 2026-04-04 14:05:08,524 - lava_callback - DEBUG - Processing node 69ce7781cb08ea23a1f69224: baseline-arm64-clabbe 2026-04-04 14:05:08,524 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce7781cb08ea23a1f69224 2026-04-04 14:05:08,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:05:08,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce7781cb08ea23a1f69224 HTTP/1.1" 200 None 2026-04-04 14:05:08,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:05:08,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-04 14:05:08,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:05:08,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce7781cb08ea23a1f69224 HTTP/1.1" 200 None 2026-04-04 14:05:08,602 - lava_callback - ERROR - Error processing callback for node 69ce7781cb08ea23a1f69224: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52270 - "GET / HTTP/1.0" 200 OK 2026-04-04 14:06:08,502 - lava_callback - INFO - Received callback for node 69ce77cccb08ea23a1f6922b INFO: 172.21.0.1:52272 - "POST /node/69ce77cccb08ea23a1f6922b HTTP/1.0" 202 Accepted 2026-04-04 14:06:08,511 - lava_callback - INFO - Starting async job submit for node 69ce77cccb08ea23a1f6922b 2026-04-04 14:06:08,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:06:08,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce77cccb08ea23a1f6922b HTTP/1.1" 200 None 2026-04-04 14:06:08,533 - lava_callback - DEBUG - Processing node 69ce77cccb08ea23a1f6922b: baseline-arm64-clabbe 2026-04-04 14:06:08,533 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce77cccb08ea23a1f6922b 2026-04-04 14:06:08,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:06:08,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce77cccb08ea23a1f6922b HTTP/1.1" 200 None 2026-04-04 14:06:08,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:06:08,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-04 14:06:08,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:06:08,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce77cccb08ea23a1f6922b HTTP/1.1" 200 None 2026-04-04 14:06:08,598 - lava_callback - ERROR - Error processing callback for node 69ce77cccb08ea23a1f6922b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42904 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42300 - "GET / HTTP/1.0" 200 OK 2026-04-04 14:07:28,570 - lava_callback - INFO - Received callback for node 69ce7819cb08ea23a1f69238 INFO: 172.21.0.1:42306 - "POST /node/69ce7819cb08ea23a1f69238 HTTP/1.0" 202 Accepted 2026-04-04 14:07:28,576 - lava_callback - INFO - Starting async job submit for node 69ce7819cb08ea23a1f69238 2026-04-04 14:07:28,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:07:28,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce7819cb08ea23a1f69238 HTTP/1.1" 200 None 2026-04-04 14:07:28,592 - lava_callback - DEBUG - Processing node 69ce7819cb08ea23a1f69238: baseline-arm64-clabbe 2026-04-04 14:07:28,593 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce7819cb08ea23a1f69238 2026-04-04 14:07:28,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:07:28,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce7819cb08ea23a1f69238 HTTP/1.1" 200 None 2026-04-04 14:07:28,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:07:28,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-04 14:07:28,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:07:28,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce7819cb08ea23a1f69238 HTTP/1.1" 200 None 2026-04-04 14:07:28,660 - lava_callback - ERROR - Error processing callback for node 69ce7819cb08ea23a1f69238: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59602 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38812 - "GET / HTTP/1.0" 200 OK 2026-04-04 14:08:48,682 - lava_callback - INFO - Received callback for node 69ce7866cb08ea23a1f6923d INFO: 172.21.0.1:38814 - "POST /node/69ce7866cb08ea23a1f6923d HTTP/1.0" 202 Accepted 2026-04-04 14:08:48,691 - lava_callback - INFO - Starting async job submit for node 69ce7866cb08ea23a1f6923d 2026-04-04 14:08:48,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:08:48,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce7866cb08ea23a1f6923d HTTP/1.1" 200 None 2026-04-04 14:08:48,712 - lava_callback - DEBUG - Processing node 69ce7866cb08ea23a1f6923d: baseline-arm64-clabbe 2026-04-04 14:08:48,712 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce7866cb08ea23a1f6923d 2026-04-04 14:08:48,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:08:48,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce7866cb08ea23a1f6923d HTTP/1.1" 200 None 2026-04-04 14:08:48,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:08:48,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-04 14:08:48,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:08:48,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce7866cb08ea23a1f6923d HTTP/1.1" 200 None 2026-04-04 14:08:48,771 - lava_callback - ERROR - Error processing callback for node 69ce7866cb08ea23a1f6923d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59832 - "GET / HTTP/1.0" 200 OK 2026-04-04 14:10:08,746 - lava_callback - INFO - Received callback for node 69ce78b2cb08ea23a1f69248 INFO: 172.21.0.1:59848 - "POST /node/69ce78b2cb08ea23a1f69248 HTTP/1.0" 202 Accepted 2026-04-04 14:10:08,752 - lava_callback - INFO - Starting async job submit for node 69ce78b2cb08ea23a1f69248 2026-04-04 14:10:08,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:10:08,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce78b2cb08ea23a1f69248 HTTP/1.1" 200 None 2026-04-04 14:10:08,775 - lava_callback - DEBUG - Processing node 69ce78b2cb08ea23a1f69248: baseline-arm64-clabbe 2026-04-04 14:10:08,776 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce78b2cb08ea23a1f69248 2026-04-04 14:10:08,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:10:08,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce78b2cb08ea23a1f69248 HTTP/1.1" 200 None 2026-04-04 14:10:08,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:10:08,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-04 14:10:08,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:10:08,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce78b2cb08ea23a1f69248 HTTP/1.1" 200 None 2026-04-04 14:10:08,831 - lava_callback - ERROR - Error processing callback for node 69ce78b2cb08ea23a1f69248: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46722 - "GET / HTTP/1.0" 200 OK 2026-04-04 14:11:28,779 - lava_callback - INFO - Received callback for node 69ce78fdcb08ea23a1f6924f INFO: 172.21.0.1:46734 - "POST /node/69ce78fdcb08ea23a1f6924f HTTP/1.0" 202 Accepted 2026-04-04 14:11:28,785 - lava_callback - INFO - Starting async job submit for node 69ce78fdcb08ea23a1f6924f 2026-04-04 14:11:28,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:11:28,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce78fdcb08ea23a1f6924f HTTP/1.1" 200 None 2026-04-04 14:11:28,802 - lava_callback - DEBUG - Processing node 69ce78fdcb08ea23a1f6924f: baseline-arm64-clabbe 2026-04-04 14:11:28,802 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce78fdcb08ea23a1f6924f 2026-04-04 14:11:28,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:11:28,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce78fdcb08ea23a1f6924f HTTP/1.1" 200 None 2026-04-04 14:11:28,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:11:28,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-04 14:11:28,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:11:28,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce78fdcb08ea23a1f6924f HTTP/1.1" 200 None 2026-04-04 14:11:28,859 - lava_callback - ERROR - Error processing callback for node 69ce78fdcb08ea23a1f6924f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48132 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38950 - "GET / HTTP/1.0" 200 OK 2026-04-04 14:12:28,816 - lava_callback - INFO - Received callback for node 69ce7949cb08ea23a1f6925b INFO: 172.21.0.1:38958 - "POST /node/69ce7949cb08ea23a1f6925b HTTP/1.0" 202 Accepted 2026-04-04 14:12:28,825 - lava_callback - INFO - Starting async job submit for node 69ce7949cb08ea23a1f6925b 2026-04-04 14:12:28,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:12:28,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce7949cb08ea23a1f6925b HTTP/1.1" 200 None 2026-04-04 14:12:28,841 - lava_callback - DEBUG - Processing node 69ce7949cb08ea23a1f6925b: baseline-arm64-clabbe 2026-04-04 14:12:28,841 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce7949cb08ea23a1f6925b 2026-04-04 14:12:28,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:12:28,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce7949cb08ea23a1f6925b HTTP/1.1" 200 None 2026-04-04 14:12:28,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:12:28,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-04 14:12:28,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:12:28,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce7949cb08ea23a1f6925b HTTP/1.1" 200 None 2026-04-04 14:12:28,903 - lava_callback - ERROR - Error processing callback for node 69ce7949cb08ea23a1f6925b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46524 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57848 - "GET / HTTP/1.0" 200 OK 2026-04-04 14:13:48,837 - lava_callback - INFO - Received callback for node 69ce7996cb08ea23a1f69264 INFO: 172.21.0.1:57860 - "POST /node/69ce7996cb08ea23a1f69264 HTTP/1.0" 202 Accepted 2026-04-04 14:13:48,843 - lava_callback - INFO - Starting async job submit for node 69ce7996cb08ea23a1f69264 2026-04-04 14:13:48,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:13:48,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce7996cb08ea23a1f69264 HTTP/1.1" 200 None 2026-04-04 14:13:48,860 - lava_callback - DEBUG - Processing node 69ce7996cb08ea23a1f69264: baseline-arm64-clabbe 2026-04-04 14:13:48,860 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce7996cb08ea23a1f69264 2026-04-04 14:13:48,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:13:48,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce7996cb08ea23a1f69264 HTTP/1.1" 200 None 2026-04-04 14:13:48,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:13:48,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-04 14:13:48,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:13:48,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce7996cb08ea23a1f69264 HTTP/1.1" 200 None 2026-04-04 14:13:48,922 - lava_callback - ERROR - Error processing callback for node 69ce7996cb08ea23a1f69264: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52918 - "GET / HTTP/1.0" 200 OK 2026-04-04 14:15:08,952 - lava_callback - INFO - Received callback for node 69ce79e3cb08ea23a1f69270 INFO: 172.21.0.1:52934 - "POST /node/69ce79e3cb08ea23a1f69270 HTTP/1.0" 202 Accepted 2026-04-04 14:15:08,957 - lava_callback - INFO - Starting async job submit for node 69ce79e3cb08ea23a1f69270 2026-04-04 14:15:08,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:15:08,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce79e3cb08ea23a1f69270 HTTP/1.1" 200 None 2026-04-04 14:15:08,973 - lava_callback - DEBUG - Processing node 69ce79e3cb08ea23a1f69270: baseline-arm64-clabbe 2026-04-04 14:15:08,973 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce79e3cb08ea23a1f69270 2026-04-04 14:15:08,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:15:08,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce79e3cb08ea23a1f69270 HTTP/1.1" 200 None 2026-04-04 14:15:08,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:15:09,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-04 14:15:09,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:15:09,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce79e3cb08ea23a1f69270 HTTP/1.1" 200 None 2026-04-04 14:15:09,029 - lava_callback - ERROR - Error processing callback for node 69ce79e3cb08ea23a1f69270: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55016 - "GET / HTTP/1.0" 200 OK 2026-04-04 14:16:28,943 - lava_callback - INFO - Received callback for node 69ce7a2fcb08ea23a1f6927c INFO: 172.21.0.1:55020 - "POST /node/69ce7a2fcb08ea23a1f6927c HTTP/1.0" 202 Accepted 2026-04-04 14:16:28,949 - lava_callback - INFO - Starting async job submit for node 69ce7a2fcb08ea23a1f6927c 2026-04-04 14:16:28,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:16:28,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce7a2fcb08ea23a1f6927c HTTP/1.1" 200 None 2026-04-04 14:16:28,967 - lava_callback - DEBUG - Processing node 69ce7a2fcb08ea23a1f6927c: baseline-arm64-clabbe 2026-04-04 14:16:28,967 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce7a2fcb08ea23a1f6927c 2026-04-04 14:16:28,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:16:28,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce7a2fcb08ea23a1f6927c HTTP/1.1" 200 None 2026-04-04 14:16:28,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:16:29,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-04 14:16:29,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:16:29,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce7a2fcb08ea23a1f6927c HTTP/1.1" 200 None 2026-04-04 14:16:29,038 - lava_callback - ERROR - Error processing callback for node 69ce7a2fcb08ea23a1f6927c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36882 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38108 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53326 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38666 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57058 - "GET / HTTP/1.0" 200 OK 2026-04-04 14:38:37,573 - lava_callback - INFO - Received callback for node 69ce7f5bcb08ea23a1f6929b INFO: 172.21.0.1:57072 - "POST /node/69ce7f5bcb08ea23a1f6929b HTTP/1.0" 202 Accepted 2026-04-04 14:38:37,578 - lava_callback - INFO - Starting async job submit for node 69ce7f5bcb08ea23a1f6929b 2026-04-04 14:38:37,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:38:37,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce7f5bcb08ea23a1f6929b HTTP/1.1" 200 None 2026-04-04 14:38:37,594 - lava_callback - DEBUG - Processing node 69ce7f5bcb08ea23a1f6929b: baseline-arm-baylibre 2026-04-04 14:38:37,594 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce7f5bcb08ea23a1f6929b 2026-04-04 14:38:37,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:38:37,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce7f5bcb08ea23a1f6929b HTTP/1.1" 200 None 2026-04-04 14:38:37,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:38:37,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-04 14:38:37,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:38:37,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce7f5bcb08ea23a1f6929b HTTP/1.1" 200 None 2026-04-04 14:38:37,653 - lava_callback - ERROR - Error processing callback for node 69ce7f5bcb08ea23a1f6929b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54388 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59998 - "GET / HTTP/1.0" 200 OK 2026-04-04 14:41:37,680 - lava_callback - INFO - Received callback for node 69ce8012cb08ea23a1f6930a INFO: 172.21.0.1:60006 - "POST /node/69ce8012cb08ea23a1f6930a HTTP/1.0" 202 Accepted 2026-04-04 14:41:37,686 - lava_callback - INFO - Starting async job submit for node 69ce8012cb08ea23a1f6930a 2026-04-04 14:41:37,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:41:37,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8012cb08ea23a1f6930a HTTP/1.1" 200 None 2026-04-04 14:41:37,703 - lava_callback - DEBUG - Processing node 69ce8012cb08ea23a1f6930a: baseline-arm-baylibre 2026-04-04 14:41:37,703 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce8012cb08ea23a1f6930a 2026-04-04 14:41:37,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:41:37,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8012cb08ea23a1f6930a HTTP/1.1" 200 None 2026-04-04 14:41:37,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:41:37,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-04 14:41:37,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:41:37,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce8012cb08ea23a1f6930a HTTP/1.1" 200 None 2026-04-04 14:41:37,761 - lava_callback - ERROR - Error processing callback for node 69ce8012cb08ea23a1f6930a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56518 - "GET / HTTP/1.0" 200 OK 2026-04-04 14:42:17,682 - lava_callback - INFO - Received callback for node 69ce8038cb08ea23a1f69317 INFO: 172.21.0.1:56530 - "POST /node/69ce8038cb08ea23a1f69317 HTTP/1.0" 202 Accepted 2026-04-04 14:42:17,691 - lava_callback - INFO - Starting async job submit for node 69ce8038cb08ea23a1f69317 2026-04-04 14:42:17,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:42:17,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8038cb08ea23a1f69317 HTTP/1.1" 200 None 2026-04-04 14:42:17,714 - lava_callback - DEBUG - Processing node 69ce8038cb08ea23a1f69317: baseline-arm-baylibre 2026-04-04 14:42:17,715 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce8038cb08ea23a1f69317 2026-04-04 14:42:17,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:42:17,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8038cb08ea23a1f69317 HTTP/1.1" 200 None 2026-04-04 14:42:17,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:42:17,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-04 14:42:17,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:42:17,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce8038cb08ea23a1f69317 HTTP/1.1" 200 None 2026-04-04 14:42:17,774 - lava_callback - ERROR - Error processing callback for node 69ce8038cb08ea23a1f69317: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52374 - "GET / HTTP/1.0" 200 OK 2026-04-04 14:42:57,767 - lava_callback - INFO - Received callback for node 69ce805dcb08ea23a1f69325 INFO: 172.21.0.1:52390 - "POST /node/69ce805dcb08ea23a1f69325 HTTP/1.0" 202 Accepted 2026-04-04 14:42:57,772 - lava_callback - INFO - Starting async job submit for node 69ce805dcb08ea23a1f69325 2026-04-04 14:42:57,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:42:57,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce805dcb08ea23a1f69325 HTTP/1.1" 200 None 2026-04-04 14:42:57,787 - lava_callback - DEBUG - Processing node 69ce805dcb08ea23a1f69325: baseline-arm-baylibre 2026-04-04 14:42:57,788 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce805dcb08ea23a1f69325 2026-04-04 14:42:57,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:42:57,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce805dcb08ea23a1f69325 HTTP/1.1" 200 None 2026-04-04 14:42:57,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:42:57,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-04 14:42:57,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:42:57,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce805dcb08ea23a1f69325 HTTP/1.1" 200 None 2026-04-04 14:42:57,859 - lava_callback - ERROR - Error processing callback for node 69ce805dcb08ea23a1f69325: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56026 - "GET / HTTP/1.0" 200 OK 2026-04-04 14:43:17,742 - lava_callback - INFO - Received callback for node 69ce8083cb08ea23a1f69339 INFO: 172.21.0.1:56040 - "POST /node/69ce8083cb08ea23a1f69339 HTTP/1.0" 202 Accepted 2026-04-04 14:43:17,747 - lava_callback - INFO - Starting async job submit for node 69ce8083cb08ea23a1f69339 2026-04-04 14:43:17,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:43:17,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8083cb08ea23a1f69339 HTTP/1.1" 200 None 2026-04-04 14:43:17,772 - lava_callback - DEBUG - Processing node 69ce8083cb08ea23a1f69339: baseline-arm-baylibre 2026-04-04 14:43:17,773 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce8083cb08ea23a1f69339 2026-04-04 14:43:17,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:43:17,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8083cb08ea23a1f69339 HTTP/1.1" 200 None 2026-04-04 14:43:17,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:43:17,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-04 14:43:17,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:43:17,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce8083cb08ea23a1f69339 HTTP/1.1" 200 None 2026-04-04 14:43:17,847 - lava_callback - ERROR - Error processing callback for node 69ce8083cb08ea23a1f69339: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44556 - "GET / HTTP/1.0" 200 OK 2026-04-04 14:43:57,971 - lava_callback - INFO - Received callback for node 69ce80a8cb08ea23a1f69344 INFO: 172.21.0.1:44566 - "POST /node/69ce80a8cb08ea23a1f69344 HTTP/1.0" 202 Accepted 2026-04-04 14:43:57,981 - lava_callback - INFO - Starting async job submit for node 69ce80a8cb08ea23a1f69344 2026-04-04 14:43:57,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:43:58,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce80a8cb08ea23a1f69344 HTTP/1.1" 200 None 2026-04-04 14:43:58,014 - lava_callback - DEBUG - Processing node 69ce80a8cb08ea23a1f69344: baseline-arm-baylibre 2026-04-04 14:43:58,014 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce80a8cb08ea23a1f69344 2026-04-04 14:43:58,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:43:58,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce80a8cb08ea23a1f69344 HTTP/1.1" 200 None 2026-04-04 14:43:58,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:43:58,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-04 14:43:58,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:43:58,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce80a8cb08ea23a1f69344 HTTP/1.1" 200 None 2026-04-04 14:43:58,067 - lava_callback - ERROR - Error processing callback for node 69ce80a8cb08ea23a1f69344: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59114 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35436 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53196 - "GET / HTTP/1.0" 200 OK 2026-04-04 14:45:50,218 - lava_callback - INFO - Received callback for node 69ce8116cb08ea23a1f69370 INFO: 172.21.0.1:39082 - "POST /node/69ce8116cb08ea23a1f69370 HTTP/1.0" 202 Accepted 2026-04-04 14:45:50,223 - lava_callback - INFO - Starting async job submit for node 69ce8116cb08ea23a1f69370 2026-04-04 14:45:50,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:45:50,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8116cb08ea23a1f69370 HTTP/1.1" 200 None 2026-04-04 14:45:50,239 - lava_callback - DEBUG - Processing node 69ce8116cb08ea23a1f69370: baseline-arm-clabbe 2026-04-04 14:45:50,239 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce8116cb08ea23a1f69370 2026-04-04 14:45:50,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:45:50,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8116cb08ea23a1f69370 HTTP/1.1" 200 None 2026-04-04 14:45:50,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:45:50,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-04 14:45:50,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:45:50,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce8116cb08ea23a1f69370 HTTP/1.1" 200 None 2026-04-04 14:45:50,296 - lava_callback - ERROR - Error processing callback for node 69ce8116cb08ea23a1f69370: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57750 - "GET / HTTP/1.0" 200 OK 2026-04-04 14:46:30,151 - lava_callback - INFO - Received callback for node 69ce813bcb08ea23a1f69381 INFO: 172.21.0.1:57668 - "POST /node/69ce813bcb08ea23a1f69381 HTTP/1.0" 202 Accepted 2026-04-04 14:46:30,157 - lava_callback - INFO - Starting async job submit for node 69ce813bcb08ea23a1f69381 2026-04-04 14:46:30,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:46:30,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce813bcb08ea23a1f69381 HTTP/1.1" 200 None 2026-04-04 14:46:30,177 - lava_callback - DEBUG - Processing node 69ce813bcb08ea23a1f69381: baseline-arm-clabbe 2026-04-04 14:46:30,177 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce813bcb08ea23a1f69381 2026-04-04 14:46:30,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:46:30,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce813bcb08ea23a1f69381 HTTP/1.1" 200 None 2026-04-04 14:46:30,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:46:30,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-04 14:46:30,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:46:30,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce813bcb08ea23a1f69381 HTTP/1.1" 200 None 2026-04-04 14:46:30,228 - lava_callback - ERROR - Error processing callback for node 69ce813bcb08ea23a1f69381: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58256 - "GET / HTTP/1.0" 200 OK 2026-04-04 14:47:10,263 - lava_callback - INFO - Received callback for node 69ce8161cb08ea23a1f6938b INFO: 172.21.0.1:39380 - "POST /node/69ce8161cb08ea23a1f6938b HTTP/1.0" 202 Accepted 2026-04-04 14:47:10,269 - lava_callback - INFO - Starting async job submit for node 69ce8161cb08ea23a1f6938b 2026-04-04 14:47:10,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:47:10,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8161cb08ea23a1f6938b HTTP/1.1" 200 None 2026-04-04 14:47:10,284 - lava_callback - DEBUG - Processing node 69ce8161cb08ea23a1f6938b: baseline-arm-clabbe 2026-04-04 14:47:10,285 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce8161cb08ea23a1f6938b 2026-04-04 14:47:10,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:47:10,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8161cb08ea23a1f6938b HTTP/1.1" 200 None 2026-04-04 14:47:10,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:47:10,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-04 14:47:10,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:47:10,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce8161cb08ea23a1f6938b HTTP/1.1" 200 None 2026-04-04 14:47:10,344 - lava_callback - ERROR - Error processing callback for node 69ce8161cb08ea23a1f6938b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35714 - "GET / HTTP/1.0" 200 OK 2026-04-04 14:47:50,228 - lava_callback - INFO - Received callback for node 69ce8186cb08ea23a1f69398 INFO: 172.21.0.1:33076 - "POST /node/69ce8186cb08ea23a1f69398 HTTP/1.0" 202 Accepted 2026-04-04 14:47:50,238 - lava_callback - INFO - Starting async job submit for node 69ce8186cb08ea23a1f69398 2026-04-04 14:47:50,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:47:50,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8186cb08ea23a1f69398 HTTP/1.1" 200 None 2026-04-04 14:47:50,256 - lava_callback - DEBUG - Processing node 69ce8186cb08ea23a1f69398: baseline-arm-clabbe 2026-04-04 14:47:50,256 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce8186cb08ea23a1f69398 2026-04-04 14:47:50,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:47:50,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8186cb08ea23a1f69398 HTTP/1.1" 200 None 2026-04-04 14:47:50,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:47:50,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-04 14:47:50,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:47:50,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce8186cb08ea23a1f69398 HTTP/1.1" 200 None 2026-04-04 14:47:50,313 - lava_callback - ERROR - Error processing callback for node 69ce8186cb08ea23a1f69398: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60442 - "GET / HTTP/1.0" 200 OK 2026-04-04 14:48:30,401 - lava_callback - INFO - Received callback for node 69ce81abcb08ea23a1f693a5 INFO: 172.21.0.1:54890 - "POST /node/69ce81abcb08ea23a1f693a5 HTTP/1.0" 202 Accepted 2026-04-04 14:48:30,411 - lava_callback - INFO - Starting async job submit for node 69ce81abcb08ea23a1f693a5 2026-04-04 14:48:30,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:48:30,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce81abcb08ea23a1f693a5 HTTP/1.1" 200 None 2026-04-04 14:48:30,426 - lava_callback - DEBUG - Processing node 69ce81abcb08ea23a1f693a5: baseline-arm-clabbe 2026-04-04 14:48:30,426 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce81abcb08ea23a1f693a5 2026-04-04 14:48:30,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:48:30,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce81abcb08ea23a1f693a5 HTTP/1.1" 200 None 2026-04-04 14:48:30,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:48:30,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-04 14:48:30,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:48:30,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce81abcb08ea23a1f693a5 HTTP/1.1" 200 None 2026-04-04 14:48:30,485 - lava_callback - ERROR - Error processing callback for node 69ce81abcb08ea23a1f693a5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54550 - "GET / HTTP/1.0" 200 OK 2026-04-04 14:49:10,275 - lava_callback - INFO - Received callback for node 69ce81d1cb08ea23a1f693b5 INFO: 172.21.0.1:40560 - "POST /node/69ce81d1cb08ea23a1f693b5 HTTP/1.0" 202 Accepted 2026-04-04 14:49:10,280 - lava_callback - INFO - Starting async job submit for node 69ce81d1cb08ea23a1f693b5 2026-04-04 14:49:10,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:49:10,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce81d1cb08ea23a1f693b5 HTTP/1.1" 200 None 2026-04-04 14:49:10,297 - lava_callback - DEBUG - Processing node 69ce81d1cb08ea23a1f693b5: baseline-arm-clabbe 2026-04-04 14:49:10,297 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce81d1cb08ea23a1f693b5 2026-04-04 14:49:10,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:49:10,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce81d1cb08ea23a1f693b5 HTTP/1.1" 200 None 2026-04-04 14:49:10,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:49:10,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-04 14:49:10,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:49:10,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce81d1cb08ea23a1f693b5 HTTP/1.1" 200 None 2026-04-04 14:49:10,356 - lava_callback - ERROR - Error processing callback for node 69ce81d1cb08ea23a1f693b5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50418 - "GET / HTTP/1.0" 200 OK 2026-04-04 14:49:38,091 - lava_callback - INFO - Received callback for node 69ce81f3cb08ea23a1f693be INFO: 172.21.0.1:50432 - "POST /node/69ce81f3cb08ea23a1f693be HTTP/1.0" 202 Accepted 2026-04-04 14:49:38,096 - lava_callback - INFO - Starting async job submit for node 69ce81f3cb08ea23a1f693be 2026-04-04 14:49:38,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:49:38,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce81f3cb08ea23a1f693be HTTP/1.1" 200 None 2026-04-04 14:49:38,120 - lava_callback - DEBUG - Processing node 69ce81f3cb08ea23a1f693be: baseline-arm-baylibre 2026-04-04 14:49:38,120 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce81f3cb08ea23a1f693be 2026-04-04 14:49:38,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:49:38,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce81f3cb08ea23a1f693be HTTP/1.1" 200 None 2026-04-04 14:49:38,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:49:38,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-04 14:49:38,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:49:38,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce81f3cb08ea23a1f693be HTTP/1.1" 200 None 2026-04-04 14:49:38,191 - lava_callback - ERROR - Error processing callback for node 69ce81f3cb08ea23a1f693be: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37228 - "GET / HTTP/1.0" 200 OK 2026-04-04 14:49:58,034 - lava_callback - INFO - Received callback for node 69ce8214cb08ea23a1f693ca INFO: 172.21.0.1:37236 - "POST /node/69ce8214cb08ea23a1f693ca HTTP/1.0" 202 Accepted 2026-04-04 14:49:58,040 - lava_callback - INFO - Starting async job submit for node 69ce8214cb08ea23a1f693ca 2026-04-04 14:49:58,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:49:58,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8214cb08ea23a1f693ca HTTP/1.1" 200 None 2026-04-04 14:49:58,073 - lava_callback - DEBUG - Processing node 69ce8214cb08ea23a1f693ca: baseline-arm-baylibre 2026-04-04 14:49:58,074 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce8214cb08ea23a1f693ca 2026-04-04 14:49:58,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:49:58,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8214cb08ea23a1f693ca HTTP/1.1" 200 None 2026-04-04 14:49:58,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:49:58,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-04 14:49:58,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:49:58,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce8214cb08ea23a1f693ca HTTP/1.1" 200 None 2026-04-04 14:49:58,128 - lava_callback - ERROR - Error processing callback for node 69ce8214cb08ea23a1f693ca: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34382 - "GET / HTTP/1.0" 200 OK 2026-04-04 14:50:38,096 - lava_callback - INFO - Received callback for node 69ce823acb08ea23a1f693d7 INFO: 172.21.0.1:34386 - "POST /node/69ce823acb08ea23a1f693d7 HTTP/1.0" 202 Accepted 2026-04-04 14:50:38,102 - lava_callback - INFO - Starting async job submit for node 69ce823acb08ea23a1f693d7 2026-04-04 14:50:38,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:50:38,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce823acb08ea23a1f693d7 HTTP/1.1" 200 None 2026-04-04 14:50:38,121 - lava_callback - DEBUG - Processing node 69ce823acb08ea23a1f693d7: baseline-arm-baylibre 2026-04-04 14:50:38,121 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce823acb08ea23a1f693d7 2026-04-04 14:50:38,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:50:38,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce823acb08ea23a1f693d7 HTTP/1.1" 200 None 2026-04-04 14:50:38,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:50:38,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-04 14:50:38,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:50:38,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce823acb08ea23a1f693d7 HTTP/1.1" 200 None 2026-04-04 14:50:38,188 - lava_callback - ERROR - Error processing callback for node 69ce823acb08ea23a1f693d7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47534 - "GET / HTTP/1.0" 200 OK 2026-04-04 14:51:18,199 - lava_callback - INFO - Received callback for node 69ce825ecb08ea23a1f693e3 INFO: 172.21.0.1:47540 - "POST /node/69ce825ecb08ea23a1f693e3 HTTP/1.0" 202 Accepted 2026-04-04 14:51:18,205 - lava_callback - INFO - Starting async job submit for node 69ce825ecb08ea23a1f693e3 2026-04-04 14:51:18,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:51:18,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce825ecb08ea23a1f693e3 HTTP/1.1" 200 None 2026-04-04 14:51:18,220 - lava_callback - DEBUG - Processing node 69ce825ecb08ea23a1f693e3: baseline-arm-baylibre 2026-04-04 14:51:18,221 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce825ecb08ea23a1f693e3 2026-04-04 14:51:18,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:51:18,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce825ecb08ea23a1f693e3 HTTP/1.1" 200 None 2026-04-04 14:51:18,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:51:18,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-04 14:51:18,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:51:18,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce825ecb08ea23a1f693e3 HTTP/1.1" 200 None 2026-04-04 14:51:18,300 - lava_callback - ERROR - Error processing callback for node 69ce825ecb08ea23a1f693e3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36634 - "GET / HTTP/1.0" 200 OK 2026-04-04 14:51:58,170 - lava_callback - INFO - Received callback for node 69ce8284cb08ea23a1f693f0 INFO: 172.21.0.1:36646 - "POST /node/69ce8284cb08ea23a1f693f0 HTTP/1.0" 202 Accepted 2026-04-04 14:51:58,177 - lava_callback - INFO - Starting async job submit for node 69ce8284cb08ea23a1f693f0 2026-04-04 14:51:58,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:51:58,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8284cb08ea23a1f693f0 HTTP/1.1" 200 None 2026-04-04 14:51:58,200 - lava_callback - DEBUG - Processing node 69ce8284cb08ea23a1f693f0: baseline-arm-baylibre 2026-04-04 14:51:58,200 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce8284cb08ea23a1f693f0 2026-04-04 14:51:58,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:51:58,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8284cb08ea23a1f693f0 HTTP/1.1" 200 None 2026-04-04 14:51:58,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:51:58,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-04 14:51:58,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:51:58,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce8284cb08ea23a1f693f0 HTTP/1.1" 200 None 2026-04-04 14:51:58,293 - lava_callback - ERROR - Error processing callback for node 69ce8284cb08ea23a1f693f0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42464 - "GET / HTTP/1.0" 200 OK 2026-04-04 14:53:38,329 - lava_callback - INFO - Received callback for node 69ce82eccb08ea23a1f69407 INFO: 172.21.0.1:42468 - "POST /node/69ce82eccb08ea23a1f69407 HTTP/1.0" 202 Accepted 2026-04-04 14:53:38,337 - lava_callback - INFO - Starting async job submit for node 69ce82eccb08ea23a1f69407 2026-04-04 14:53:38,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:53:38,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce82eccb08ea23a1f69407 HTTP/1.1" 200 None 2026-04-04 14:53:38,358 - lava_callback - DEBUG - Processing node 69ce82eccb08ea23a1f69407: baseline-arm-baylibre 2026-04-04 14:53:38,358 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce82eccb08ea23a1f69407 2026-04-04 14:53:38,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:53:38,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce82eccb08ea23a1f69407 HTTP/1.1" 200 None 2026-04-04 14:53:38,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:53:38,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-04 14:53:38,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:53:38,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce82eccb08ea23a1f69407 HTTP/1.1" 200 None 2026-04-04 14:53:38,429 - lava_callback - ERROR - Error processing callback for node 69ce82eccb08ea23a1f69407: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47344 - "GET / HTTP/1.0" 200 OK 2026-04-04 14:54:18,265 - lava_callback - INFO - Received callback for node 69ce8310cb08ea23a1f6941e INFO: 172.21.0.1:47356 - "POST /node/69ce8310cb08ea23a1f6941e HTTP/1.0" 202 Accepted 2026-04-04 14:54:18,271 - lava_callback - INFO - Starting async job submit for node 69ce8310cb08ea23a1f6941e 2026-04-04 14:54:18,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:54:18,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8310cb08ea23a1f6941e HTTP/1.1" 200 None 2026-04-04 14:54:18,295 - lava_callback - DEBUG - Processing node 69ce8310cb08ea23a1f6941e: baseline-arm-baylibre 2026-04-04 14:54:18,295 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce8310cb08ea23a1f6941e 2026-04-04 14:54:18,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:54:18,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8310cb08ea23a1f6941e HTTP/1.1" 200 None 2026-04-04 14:54:18,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:54:18,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-04 14:54:18,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:54:18,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce8310cb08ea23a1f6941e HTTP/1.1" 200 None 2026-04-04 14:54:18,350 - lava_callback - ERROR - Error processing callback for node 69ce8310cb08ea23a1f6941e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35700 - "GET / HTTP/1.0" 200 OK 2026-04-04 14:54:50,507 - lava_callback - INFO - Received callback for node 69ce8337cb08ea23a1f6942f INFO: 172.21.0.1:60032 - "POST /node/69ce8337cb08ea23a1f6942f HTTP/1.0" 202 Accepted 2026-04-04 14:54:50,513 - lava_callback - INFO - Starting async job submit for node 69ce8337cb08ea23a1f6942f 2026-04-04 14:54:50,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:54:50,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8337cb08ea23a1f6942f HTTP/1.1" 200 None 2026-04-04 14:54:50,530 - lava_callback - DEBUG - Processing node 69ce8337cb08ea23a1f6942f: baseline-arm-clabbe 2026-04-04 14:54:50,531 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce8337cb08ea23a1f6942f 2026-04-04 14:54:50,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:54:50,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8337cb08ea23a1f6942f HTTP/1.1" 200 None 2026-04-04 14:54:50,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:54:50,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-04 14:54:50,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:54:50,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce8337cb08ea23a1f6942f HTTP/1.1" 200 None 2026-04-04 14:54:50,589 - lava_callback - ERROR - Error processing callback for node 69ce8337cb08ea23a1f6942f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60830 - "GET / HTTP/1.0" 200 OK 2026-04-04 14:56:18,510 - lava_callback - INFO - Received callback for node 69ce837ecb08ea23a1f69443 INFO: 172.21.0.1:60844 - "POST /node/69ce837ecb08ea23a1f69443 HTTP/1.0" 202 Accepted 2026-04-04 14:56:18,515 - lava_callback - INFO - Starting async job submit for node 69ce837ecb08ea23a1f69443 2026-04-04 14:56:18,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:56:18,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce837ecb08ea23a1f69443 HTTP/1.1" 200 None 2026-04-04 14:56:18,531 - lava_callback - DEBUG - Processing node 69ce837ecb08ea23a1f69443: baseline-arm-baylibre 2026-04-04 14:56:18,532 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce837ecb08ea23a1f69443 2026-04-04 14:56:18,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:56:18,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce837ecb08ea23a1f69443 HTTP/1.1" 200 None 2026-04-04 14:56:18,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:56:18,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-04 14:56:18,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:56:18,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce837ecb08ea23a1f69443 HTTP/1.1" 200 None 2026-04-04 14:56:18,597 - lava_callback - ERROR - Error processing callback for node 69ce837ecb08ea23a1f69443: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49136 - "GET / HTTP/1.0" 200 OK 2026-04-04 14:56:50,644 - lava_callback - INFO - Received callback for node 69ce83a5cb08ea23a1f69452 INFO: 172.21.0.1:34632 - "POST /node/69ce83a5cb08ea23a1f69452 HTTP/1.0" 202 Accepted 2026-04-04 14:56:50,650 - lava_callback - INFO - Starting async job submit for node 69ce83a5cb08ea23a1f69452 2026-04-04 14:56:50,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:56:50,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce83a5cb08ea23a1f69452 HTTP/1.1" 200 None 2026-04-04 14:56:50,677 - lava_callback - DEBUG - Processing node 69ce83a5cb08ea23a1f69452: baseline-arm-clabbe 2026-04-04 14:56:50,677 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce83a5cb08ea23a1f69452 2026-04-04 14:56:50,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:56:50,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce83a5cb08ea23a1f69452 HTTP/1.1" 200 None 2026-04-04 14:56:50,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:56:50,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-04 14:56:50,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:56:50,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce83a5cb08ea23a1f69452 HTTP/1.1" 200 None 2026-04-04 14:56:50,759 - lava_callback - ERROR - Error processing callback for node 69ce83a5cb08ea23a1f69452: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49086 - "GET / HTTP/1.0" 200 OK 2026-04-04 14:57:30,632 - lava_callback - INFO - Received callback for node 69ce83cacb08ea23a1f69462 INFO: 172.21.0.1:53076 - "POST /node/69ce83cacb08ea23a1f69462 HTTP/1.0" 202 Accepted 2026-04-04 14:57:30,638 - lava_callback - INFO - Starting async job submit for node 69ce83cacb08ea23a1f69462 2026-04-04 14:57:30,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:57:30,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce83cacb08ea23a1f69462 HTTP/1.1" 200 None 2026-04-04 14:57:30,655 - lava_callback - DEBUG - Processing node 69ce83cacb08ea23a1f69462: baseline-arm-clabbe 2026-04-04 14:57:30,655 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce83cacb08ea23a1f69462 2026-04-04 14:57:30,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:57:30,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce83cacb08ea23a1f69462 HTTP/1.1" 200 None 2026-04-04 14:57:30,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:57:30,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-04 14:57:30,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:57:30,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce83cacb08ea23a1f69462 HTTP/1.1" 200 None 2026-04-04 14:57:30,727 - lava_callback - ERROR - Error processing callback for node 69ce83cacb08ea23a1f69462: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55276 - "GET / HTTP/1.0" 200 OK 2026-04-04 14:58:10,723 - lava_callback - INFO - Received callback for node 69ce83efcb08ea23a1f69473 INFO: 172.21.0.1:52304 - "POST /node/69ce83efcb08ea23a1f69473 HTTP/1.0" 202 Accepted 2026-04-04 14:58:10,730 - lava_callback - INFO - Starting async job submit for node 69ce83efcb08ea23a1f69473 2026-04-04 14:58:10,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:58:10,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce83efcb08ea23a1f69473 HTTP/1.1" 200 None 2026-04-04 14:58:10,746 - lava_callback - DEBUG - Processing node 69ce83efcb08ea23a1f69473: baseline-arm-clabbe 2026-04-04 14:58:10,746 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce83efcb08ea23a1f69473 2026-04-04 14:58:10,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:58:10,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce83efcb08ea23a1f69473 HTTP/1.1" 200 None 2026-04-04 14:58:10,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:58:10,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-04 14:58:10,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:58:10,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce83efcb08ea23a1f69473 HTTP/1.1" 200 None 2026-04-04 14:58:10,804 - lava_callback - ERROR - Error processing callback for node 69ce83efcb08ea23a1f69473: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37930 - "GET / HTTP/1.0" 200 OK 2026-04-04 14:58:50,707 - lava_callback - INFO - Received callback for node 69ce8415cb08ea23a1f6947f INFO: 172.21.0.1:59812 - "POST /node/69ce8415cb08ea23a1f6947f HTTP/1.0" 202 Accepted 2026-04-04 14:58:50,715 - lava_callback - INFO - Starting async job submit for node 69ce8415cb08ea23a1f6947f 2026-04-04 14:58:50,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:58:50,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8415cb08ea23a1f6947f HTTP/1.1" 200 None 2026-04-04 14:58:50,741 - lava_callback - DEBUG - Processing node 69ce8415cb08ea23a1f6947f: baseline-arm-clabbe 2026-04-04 14:58:50,741 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce8415cb08ea23a1f6947f 2026-04-04 14:58:50,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:58:50,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8415cb08ea23a1f6947f HTTP/1.1" 200 None 2026-04-04 14:58:50,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:58:50,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-04 14:58:50,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:58:50,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce8415cb08ea23a1f6947f HTTP/1.1" 200 None 2026-04-04 14:58:50,798 - lava_callback - ERROR - Error processing callback for node 69ce8415cb08ea23a1f6947f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43126 - "GET / HTTP/1.0" 200 OK 2026-04-04 14:59:10,689 - lava_callback - INFO - Received callback for node 69ce843acb08ea23a1f6948c INFO: 172.21.0.1:49014 - "POST /node/69ce843acb08ea23a1f6948c HTTP/1.0" 202 Accepted 2026-04-04 14:59:10,698 - lava_callback - INFO - Starting async job submit for node 69ce843acb08ea23a1f6948c 2026-04-04 14:59:10,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:59:10,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce843acb08ea23a1f6948c HTTP/1.1" 200 None 2026-04-04 14:59:10,715 - lava_callback - DEBUG - Processing node 69ce843acb08ea23a1f6948c: baseline-arm-clabbe 2026-04-04 14:59:10,716 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce843acb08ea23a1f6948c 2026-04-04 14:59:10,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:59:10,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce843acb08ea23a1f6948c HTTP/1.1" 200 None 2026-04-04 14:59:10,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:59:10,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-04 14:59:10,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:59:10,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce843acb08ea23a1f6948c HTTP/1.1" 200 None 2026-04-04 14:59:10,779 - lava_callback - ERROR - Error processing callback for node 69ce843acb08ea23a1f6948c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42774 - "GET / HTTP/1.0" 200 OK 2026-04-04 14:59:50,724 - lava_callback - INFO - Received callback for node 69ce845ecb08ea23a1f69499 INFO: 172.21.0.1:55056 - "POST /node/69ce845ecb08ea23a1f69499 HTTP/1.0" 202 Accepted 2026-04-04 14:59:50,729 - lava_callback - INFO - Starting async job submit for node 69ce845ecb08ea23a1f69499 2026-04-04 14:59:50,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:59:50,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce845ecb08ea23a1f69499 HTTP/1.1" 200 None 2026-04-04 14:59:50,745 - lava_callback - DEBUG - Processing node 69ce845ecb08ea23a1f69499: baseline-arm-clabbe 2026-04-04 14:59:50,745 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce845ecb08ea23a1f69499 2026-04-04 14:59:50,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:59:50,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce845ecb08ea23a1f69499 HTTP/1.1" 200 None 2026-04-04 14:59:50,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:59:50,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-04 14:59:50,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 14:59:50,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce845ecb08ea23a1f69499 HTTP/1.1" 200 None 2026-04-04 14:59:50,800 - lava_callback - ERROR - Error processing callback for node 69ce845ecb08ea23a1f69499: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43600 - "GET / HTTP/1.0" 200 OK 2026-04-04 15:00:30,804 - lava_callback - INFO - Received callback for node 69ce8483cb08ea23a1f694a8 INFO: 172.21.0.1:48880 - "POST /node/69ce8483cb08ea23a1f694a8 HTTP/1.0" 202 Accepted 2026-04-04 15:00:30,810 - lava_callback - INFO - Starting async job submit for node 69ce8483cb08ea23a1f694a8 2026-04-04 15:00:30,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:00:30,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8483cb08ea23a1f694a8 HTTP/1.1" 200 None 2026-04-04 15:00:30,825 - lava_callback - DEBUG - Processing node 69ce8483cb08ea23a1f694a8: baseline-arm-clabbe 2026-04-04 15:00:30,826 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce8483cb08ea23a1f694a8 2026-04-04 15:00:30,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:00:30,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8483cb08ea23a1f694a8 HTTP/1.1" 200 None 2026-04-04 15:00:30,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:00:30,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-04 15:00:30,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:00:30,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce8483cb08ea23a1f694a8 HTTP/1.1" 200 None 2026-04-04 15:00:30,893 - lava_callback - ERROR - Error processing callback for node 69ce8483cb08ea23a1f694a8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50866 - "GET / HTTP/1.0" 200 OK 2026-04-04 15:01:10,769 - lava_callback - INFO - Received callback for node 69ce84a8cb08ea23a1f694b2 INFO: 172.21.0.1:46584 - "POST /node/69ce84a8cb08ea23a1f694b2 HTTP/1.0" 202 Accepted 2026-04-04 15:01:10,775 - lava_callback - INFO - Starting async job submit for node 69ce84a8cb08ea23a1f694b2 2026-04-04 15:01:10,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:01:10,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce84a8cb08ea23a1f694b2 HTTP/1.1" 200 None 2026-04-04 15:01:10,791 - lava_callback - DEBUG - Processing node 69ce84a8cb08ea23a1f694b2: baseline-arm-clabbe 2026-04-04 15:01:10,791 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce84a8cb08ea23a1f694b2 2026-04-04 15:01:10,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:01:10,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce84a8cb08ea23a1f694b2 HTTP/1.1" 200 None 2026-04-04 15:01:10,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:01:10,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-04 15:01:10,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:01:10,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce84a8cb08ea23a1f694b2 HTTP/1.1" 200 None 2026-04-04 15:01:10,848 - lava_callback - ERROR - Error processing callback for node 69ce84a8cb08ea23a1f694b2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55804 - "GET / HTTP/1.0" 200 OK 2026-04-04 15:01:50,828 - lava_callback - INFO - Received callback for node 69ce84cecb08ea23a1f694be INFO: 172.21.0.1:57868 - "POST /node/69ce84cecb08ea23a1f694be HTTP/1.0" 202 Accepted 2026-04-04 15:01:50,834 - lava_callback - INFO - Starting async job submit for node 69ce84cecb08ea23a1f694be 2026-04-04 15:01:50,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:01:50,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce84cecb08ea23a1f694be HTTP/1.1" 200 None 2026-04-04 15:01:50,850 - lava_callback - DEBUG - Processing node 69ce84cecb08ea23a1f694be: baseline-arm-clabbe 2026-04-04 15:01:50,850 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce84cecb08ea23a1f694be 2026-04-04 15:01:50,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:01:50,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce84cecb08ea23a1f694be HTTP/1.1" 200 None 2026-04-04 15:01:50,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:01:50,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-04 15:01:50,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:01:50,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce84cecb08ea23a1f694be HTTP/1.1" 200 None 2026-04-04 15:01:50,926 - lava_callback - ERROR - Error processing callback for node 69ce84cecb08ea23a1f694be: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50762 - "GET / HTTP/1.0" 200 OK 2026-04-04 15:02:18,934 - lava_callback - INFO - Received callback for node 69ce84efcb08ea23a1f694cc INFO: 172.21.0.1:50770 - "POST /node/69ce84efcb08ea23a1f694cc HTTP/1.0" 202 Accepted 2026-04-04 15:02:18,941 - lava_callback - INFO - Starting async job submit for node 69ce84efcb08ea23a1f694cc 2026-04-04 15:02:18,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:02:18,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce84efcb08ea23a1f694cc HTTP/1.1" 200 None 2026-04-04 15:02:18,957 - lava_callback - DEBUG - Processing node 69ce84efcb08ea23a1f694cc: baseline-arm-baylibre 2026-04-04 15:02:18,957 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce84efcb08ea23a1f694cc 2026-04-04 15:02:18,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:02:18,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce84efcb08ea23a1f694cc HTTP/1.1" 200 None 2026-04-04 15:02:18,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:02:18,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-04 15:02:18,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:02:19,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce84efcb08ea23a1f694cc HTTP/1.1" 200 None 2026-04-04 15:02:19,019 - lava_callback - ERROR - Error processing callback for node 69ce84efcb08ea23a1f694cc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38322 - "GET / HTTP/1.0" 200 OK 2026-04-04 15:02:58,747 - lava_callback - INFO - Received callback for node 69ce8513cb08ea23a1f694d7 INFO: 172.21.0.1:38338 - "POST /node/69ce8513cb08ea23a1f694d7 HTTP/1.0" 202 Accepted 2026-04-04 15:02:58,752 - lava_callback - INFO - Starting async job submit for node 69ce8513cb08ea23a1f694d7 2026-04-04 15:02:58,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:02:58,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8513cb08ea23a1f694d7 HTTP/1.1" 200 None 2026-04-04 15:02:58,768 - lava_callback - DEBUG - Processing node 69ce8513cb08ea23a1f694d7: baseline-arm-baylibre 2026-04-04 15:02:58,769 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce8513cb08ea23a1f694d7 2026-04-04 15:02:58,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:02:58,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8513cb08ea23a1f694d7 HTTP/1.1" 200 None 2026-04-04 15:02:58,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:02:58,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-04 15:02:58,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:02:58,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce8513cb08ea23a1f694d7 HTTP/1.1" 200 None 2026-04-04 15:02:58,841 - lava_callback - ERROR - Error processing callback for node 69ce8513cb08ea23a1f694d7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34242 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48036 - "GET / HTTP/1.0" 200 OK 2026-04-04 15:03:38,822 - lava_callback - INFO - Received callback for node 69ce853bcb08ea23a1f694e4 INFO: 172.21.0.1:48048 - "POST /node/69ce853bcb08ea23a1f694e4 HTTP/1.0" 202 Accepted 2026-04-04 15:03:38,827 - lava_callback - INFO - Starting async job submit for node 69ce853bcb08ea23a1f694e4 2026-04-04 15:03:38,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:03:38,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce853bcb08ea23a1f694e4 HTTP/1.1" 200 None 2026-04-04 15:03:38,843 - lava_callback - DEBUG - Processing node 69ce853bcb08ea23a1f694e4: baseline-arm-baylibre 2026-04-04 15:03:38,843 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce853bcb08ea23a1f694e4 2026-04-04 15:03:38,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:03:38,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce853bcb08ea23a1f694e4 HTTP/1.1" 200 None 2026-04-04 15:03:38,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:03:38,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-04 15:03:38,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:03:38,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce853bcb08ea23a1f694e4 HTTP/1.1" 200 None 2026-04-04 15:03:38,902 - lava_callback - ERROR - Error processing callback for node 69ce853bcb08ea23a1f694e4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36442 - "GET / HTTP/1.0" 200 OK 2026-04-04 15:04:18,834 - lava_callback - INFO - Received callback for node 69ce8560cb08ea23a1f694f0 INFO: 172.21.0.1:36448 - "POST /node/69ce8560cb08ea23a1f694f0 HTTP/1.0" 202 Accepted 2026-04-04 15:04:18,841 - lava_callback - INFO - Starting async job submit for node 69ce8560cb08ea23a1f694f0 2026-04-04 15:04:18,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:04:18,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8560cb08ea23a1f694f0 HTTP/1.1" 200 None 2026-04-04 15:04:18,865 - lava_callback - DEBUG - Processing node 69ce8560cb08ea23a1f694f0: baseline-arm-baylibre 2026-04-04 15:04:18,865 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce8560cb08ea23a1f694f0 2026-04-04 15:04:18,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:04:18,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8560cb08ea23a1f694f0 HTTP/1.1" 200 None 2026-04-04 15:04:18,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:04:18,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-04 15:04:18,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:04:18,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce8560cb08ea23a1f694f0 HTTP/1.1" 200 None 2026-04-04 15:04:18,920 - lava_callback - ERROR - Error processing callback for node 69ce8560cb08ea23a1f694f0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47958 - "GET / HTTP/1.0" 200 OK 2026-04-04 15:05:18,947 - lava_callback - INFO - Received callback for node 69ce85a8cb08ea23a1f69506 INFO: 172.21.0.1:47960 - "POST /node/69ce85a8cb08ea23a1f69506 HTTP/1.0" 202 Accepted 2026-04-04 15:05:18,952 - lava_callback - INFO - Starting async job submit for node 69ce85a8cb08ea23a1f69506 2026-04-04 15:05:18,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:05:18,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce85a8cb08ea23a1f69506 HTTP/1.1" 200 None 2026-04-04 15:05:18,968 - lava_callback - DEBUG - Processing node 69ce85a8cb08ea23a1f69506: baseline-arm-baylibre 2026-04-04 15:05:18,968 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce85a8cb08ea23a1f69506 2026-04-04 15:05:18,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:05:18,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce85a8cb08ea23a1f69506 HTTP/1.1" 200 None 2026-04-04 15:05:18,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:05:18,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-04 15:05:19,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:05:19,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce85a8cb08ea23a1f69506 HTTP/1.1" 200 None 2026-04-04 15:05:19,028 - lava_callback - ERROR - Error processing callback for node 69ce85a8cb08ea23a1f69506: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49040 - "GET / HTTP/1.0" 200 OK 2026-04-04 15:05:58,897 - lava_callback - INFO - Received callback for node 69ce85cecb08ea23a1f69514 INFO: 172.21.0.1:49056 - "POST /node/69ce85cecb08ea23a1f69514 HTTP/1.0" 202 Accepted 2026-04-04 15:05:58,903 - lava_callback - INFO - Starting async job submit for node 69ce85cecb08ea23a1f69514 2026-04-04 15:05:58,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:05:58,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce85cecb08ea23a1f69514 HTTP/1.1" 200 None 2026-04-04 15:05:58,918 - lava_callback - DEBUG - Processing node 69ce85cecb08ea23a1f69514: baseline-arm-baylibre 2026-04-04 15:05:58,918 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce85cecb08ea23a1f69514 2026-04-04 15:05:58,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:05:58,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce85cecb08ea23a1f69514 HTTP/1.1" 200 None 2026-04-04 15:05:58,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:05:58,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-04 15:05:58,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:05:58,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce85cecb08ea23a1f69514 HTTP/1.1" 200 None 2026-04-04 15:05:58,982 - lava_callback - ERROR - Error processing callback for node 69ce85cecb08ea23a1f69514: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40034 - "GET / HTTP/1.0" 200 OK 2026-04-04 15:06:31,066 - lava_callback - INFO - Received callback for node 69ce85f4cb08ea23a1f6951e INFO: 172.21.0.1:36344 - "POST /node/69ce85f4cb08ea23a1f6951e HTTP/1.0" 202 Accepted 2026-04-04 15:06:31,072 - lava_callback - INFO - Starting async job submit for node 69ce85f4cb08ea23a1f6951e 2026-04-04 15:06:31,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:06:31,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce85f4cb08ea23a1f6951e HTTP/1.1" 200 None 2026-04-04 15:06:31,095 - lava_callback - DEBUG - Processing node 69ce85f4cb08ea23a1f6951e: baseline-arm-clabbe 2026-04-04 15:06:31,095 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce85f4cb08ea23a1f6951e 2026-04-04 15:06:31,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:06:31,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce85f4cb08ea23a1f6951e HTTP/1.1" 200 None 2026-04-04 15:06:31,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:06:31,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-04 15:06:31,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:06:31,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce85f4cb08ea23a1f6951e HTTP/1.1" 200 None 2026-04-04 15:06:31,162 - lava_callback - ERROR - Error processing callback for node 69ce85f4cb08ea23a1f6951e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58938 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58944 - "GET / HTTP/1.0" 200 OK 2026-04-04 15:07:18,978 - lava_callback - INFO - Received callback for node 69ce8615cb08ea23a1f69528 INFO: 172.21.0.1:58950 - "POST /node/69ce8615cb08ea23a1f69528 HTTP/1.0" 202 Accepted 2026-04-04 15:07:18,984 - lava_callback - INFO - Starting async job submit for node 69ce8615cb08ea23a1f69528 2026-04-04 15:07:18,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:07:19,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8615cb08ea23a1f69528 HTTP/1.1" 200 None 2026-04-04 15:07:19,007 - lava_callback - DEBUG - Processing node 69ce8615cb08ea23a1f69528: baseline-arm-baylibre 2026-04-04 15:07:19,007 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce8615cb08ea23a1f69528 2026-04-04 15:07:19,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:07:19,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8615cb08ea23a1f69528 HTTP/1.1" 200 None 2026-04-04 15:07:19,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:07:19,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-04 15:07:19,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:07:19,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce8615cb08ea23a1f69528 HTTP/1.1" 200 None 2026-04-04 15:07:19,074 - lava_callback - ERROR - Error processing callback for node 69ce8615cb08ea23a1f69528: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41664 - "GET / HTTP/1.0" 200 OK 2026-04-04 15:07:51,146 - lava_callback - INFO - Received callback for node 69ce863dcb08ea23a1f69533 INFO: 172.21.0.1:40952 - "POST /node/69ce863dcb08ea23a1f69533 HTTP/1.0" 202 Accepted 2026-04-04 15:07:51,153 - lava_callback - INFO - Starting async job submit for node 69ce863dcb08ea23a1f69533 2026-04-04 15:07:51,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:07:51,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce863dcb08ea23a1f69533 HTTP/1.1" 200 None 2026-04-04 15:07:51,169 - lava_callback - DEBUG - Processing node 69ce863dcb08ea23a1f69533: baseline-arm-clabbe 2026-04-04 15:07:51,170 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce863dcb08ea23a1f69533 2026-04-04 15:07:51,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:07:51,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce863dcb08ea23a1f69533 HTTP/1.1" 200 None 2026-04-04 15:07:51,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:07:51,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-04 15:07:51,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:07:51,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce863dcb08ea23a1f69533 HTTP/1.1" 200 None 2026-04-04 15:07:51,242 - lava_callback - ERROR - Error processing callback for node 69ce863dcb08ea23a1f69533: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58074 - "GET / HTTP/1.0" 200 OK 2026-04-04 15:08:31,100 - lava_callback - INFO - Received callback for node 69ce8663cb08ea23a1f69549 INFO: 172.21.0.1:41970 - "POST /node/69ce8663cb08ea23a1f69549 HTTP/1.0" 202 Accepted 2026-04-04 15:08:31,108 - lava_callback - INFO - Starting async job submit for node 69ce8663cb08ea23a1f69549 2026-04-04 15:08:31,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:08:31,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8663cb08ea23a1f69549 HTTP/1.1" 200 None 2026-04-04 15:08:31,124 - lava_callback - DEBUG - Processing node 69ce8663cb08ea23a1f69549: baseline-arm-clabbe 2026-04-04 15:08:31,124 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce8663cb08ea23a1f69549 2026-04-04 15:08:31,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:08:31,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8663cb08ea23a1f69549 HTTP/1.1" 200 None 2026-04-04 15:08:31,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:08:31,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-04 15:08:31,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:08:31,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce8663cb08ea23a1f69549 HTTP/1.1" 200 None 2026-04-04 15:08:31,188 - lava_callback - ERROR - Error processing callback for node 69ce8663cb08ea23a1f69549: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48834 - "GET / HTTP/1.0" 200 OK 2026-04-04 15:09:11,202 - lava_callback - INFO - Received callback for node 69ce8689cb08ea23a1f69553 INFO: 172.21.0.1:46998 - "POST /node/69ce8689cb08ea23a1f69553 HTTP/1.0" 202 Accepted 2026-04-04 15:09:11,210 - lava_callback - INFO - Starting async job submit for node 69ce8689cb08ea23a1f69553 2026-04-04 15:09:11,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:09:11,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8689cb08ea23a1f69553 HTTP/1.1" 200 None 2026-04-04 15:09:11,231 - lava_callback - DEBUG - Processing node 69ce8689cb08ea23a1f69553: baseline-arm-clabbe 2026-04-04 15:09:11,231 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce8689cb08ea23a1f69553 2026-04-04 15:09:11,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:09:11,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8689cb08ea23a1f69553 HTTP/1.1" 200 None 2026-04-04 15:09:11,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:09:11,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-04 15:09:11,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:09:11,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce8689cb08ea23a1f69553 HTTP/1.1" 200 None 2026-04-04 15:09:11,294 - lava_callback - ERROR - Error processing callback for node 69ce8689cb08ea23a1f69553: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35682 - "GET / HTTP/1.0" 200 OK 2026-04-04 15:09:51,165 - lava_callback - INFO - Received callback for node 69ce86afcb08ea23a1f6955f INFO: 172.21.0.1:37668 - "POST /node/69ce86afcb08ea23a1f6955f HTTP/1.0" 202 Accepted 2026-04-04 15:09:51,174 - lava_callback - INFO - Starting async job submit for node 69ce86afcb08ea23a1f6955f 2026-04-04 15:09:51,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:09:51,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce86afcb08ea23a1f6955f HTTP/1.1" 200 None 2026-04-04 15:09:51,196 - lava_callback - DEBUG - Processing node 69ce86afcb08ea23a1f6955f: baseline-arm-clabbe 2026-04-04 15:09:51,196 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce86afcb08ea23a1f6955f 2026-04-04 15:09:51,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:09:51,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce86afcb08ea23a1f6955f HTTP/1.1" 200 None 2026-04-04 15:09:51,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:09:51,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-04 15:09:51,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:09:51,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce86afcb08ea23a1f6955f HTTP/1.1" 200 None 2026-04-04 15:09:51,255 - lava_callback - ERROR - Error processing callback for node 69ce86afcb08ea23a1f6955f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52280 - "GET / HTTP/1.0" 200 OK 2026-04-04 15:10:19,204 - lava_callback - INFO - Received callback for node 69ce86d3cb08ea23a1f6956d INFO: 172.21.0.1:52292 - "POST /node/69ce86d3cb08ea23a1f6956d HTTP/1.0" 202 Accepted 2026-04-04 15:10:19,210 - lava_callback - INFO - Starting async job submit for node 69ce86d3cb08ea23a1f6956d 2026-04-04 15:10:19,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:10:19,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce86d3cb08ea23a1f6956d HTTP/1.1" 200 None 2026-04-04 15:10:19,227 - lava_callback - DEBUG - Processing node 69ce86d3cb08ea23a1f6956d: baseline-arm-baylibre 2026-04-04 15:10:19,227 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce86d3cb08ea23a1f6956d 2026-04-04 15:10:19,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:10:19,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce86d3cb08ea23a1f6956d HTTP/1.1" 200 None 2026-04-04 15:10:19,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:10:19,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-04 15:10:19,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:10:19,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce86d3cb08ea23a1f6956d HTTP/1.1" 200 None 2026-04-04 15:10:19,305 - lava_callback - ERROR - Error processing callback for node 69ce86d3cb08ea23a1f6956d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46012 - "GET / HTTP/1.0" 200 OK 2026-04-04 15:11:11,521 - lava_callback - INFO - Received callback for node 69ce86facb08ea23a1f6957c INFO: 172.21.0.1:48194 - "POST /node/69ce86facb08ea23a1f6957c HTTP/1.0" 202 Accepted 2026-04-04 15:11:11,527 - lava_callback - INFO - Starting async job submit for node 69ce86facb08ea23a1f6957c 2026-04-04 15:11:11,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:11:11,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce86facb08ea23a1f6957c HTTP/1.1" 200 None 2026-04-04 15:11:11,544 - lava_callback - DEBUG - Processing node 69ce86facb08ea23a1f6957c: baseline-arm-clabbe 2026-04-04 15:11:11,544 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce86facb08ea23a1f6957c 2026-04-04 15:11:11,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:11:11,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce86facb08ea23a1f6957c HTTP/1.1" 200 None 2026-04-04 15:11:11,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:11:11,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-04 15:11:11,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:11:11,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce86facb08ea23a1f6957c HTTP/1.1" 200 None 2026-04-04 15:11:11,612 - lava_callback - ERROR - Error processing callback for node 69ce86facb08ea23a1f6957c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49050 - "GET / HTTP/1.0" 200 OK 2026-04-04 15:12:11,300 - lava_callback - INFO - Received callback for node 69ce8742cb08ea23a1f6958c INFO: 172.21.0.1:38054 - "POST /node/69ce8742cb08ea23a1f6958c HTTP/1.0" 202 Accepted 2026-04-04 15:12:11,308 - lava_callback - INFO - Starting async job submit for node 69ce8742cb08ea23a1f6958c 2026-04-04 15:12:11,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:12:11,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8742cb08ea23a1f6958c HTTP/1.1" 200 None 2026-04-04 15:12:11,325 - lava_callback - DEBUG - Processing node 69ce8742cb08ea23a1f6958c: baseline-arm-clabbe 2026-04-04 15:12:11,325 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce8742cb08ea23a1f6958c 2026-04-04 15:12:11,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:12:11,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8742cb08ea23a1f6958c HTTP/1.1" 200 None 2026-04-04 15:12:11,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:12:11,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-04 15:12:11,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:12:11,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce8742cb08ea23a1f6958c HTTP/1.1" 200 None 2026-04-04 15:12:11,406 - lava_callback - ERROR - Error processing callback for node 69ce8742cb08ea23a1f6958c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49470 - "GET / HTTP/1.0" 200 OK 2026-04-04 15:12:51,300 - lava_callback - INFO - Received callback for node 69ce8767cb08ea23a1f69597 INFO: 172.21.0.1:36698 - "POST /node/69ce8767cb08ea23a1f69597 HTTP/1.0" 202 Accepted 2026-04-04 15:12:51,309 - lava_callback - INFO - Starting async job submit for node 69ce8767cb08ea23a1f69597 2026-04-04 15:12:51,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:12:51,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8767cb08ea23a1f69597 HTTP/1.1" 200 None 2026-04-04 15:12:51,331 - lava_callback - DEBUG - Processing node 69ce8767cb08ea23a1f69597: baseline-arm-clabbe 2026-04-04 15:12:51,332 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce8767cb08ea23a1f69597 2026-04-04 15:12:51,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:12:51,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8767cb08ea23a1f69597 HTTP/1.1" 200 None 2026-04-04 15:12:51,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:12:51,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-04 15:12:51,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:12:51,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce8767cb08ea23a1f69597 HTTP/1.1" 200 None 2026-04-04 15:12:51,401 - lava_callback - ERROR - Error processing callback for node 69ce8767cb08ea23a1f69597: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39558 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60018 - "GET / HTTP/1.0" 200 OK 2026-04-04 15:13:31,415 - lava_callback - INFO - Received callback for node 69ce878ccb08ea23a1f695a5 INFO: 172.21.0.1:47798 - "POST /node/69ce878ccb08ea23a1f695a5 HTTP/1.0" 202 Accepted 2026-04-04 15:13:31,420 - lava_callback - INFO - Starting async job submit for node 69ce878ccb08ea23a1f695a5 2026-04-04 15:13:31,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:13:31,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce878ccb08ea23a1f695a5 HTTP/1.1" 200 None 2026-04-04 15:13:31,437 - lava_callback - DEBUG - Processing node 69ce878ccb08ea23a1f695a5: baseline-arm-clabbe 2026-04-04 15:13:31,437 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce878ccb08ea23a1f695a5 2026-04-04 15:13:31,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:13:31,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce878ccb08ea23a1f695a5 HTTP/1.1" 200 None 2026-04-04 15:13:31,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:13:31,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-04 15:13:31,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:13:31,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce878ccb08ea23a1f695a5 HTTP/1.1" 200 None 2026-04-04 15:13:31,487 - lava_callback - ERROR - Error processing callback for node 69ce878ccb08ea23a1f695a5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43746 - "GET / HTTP/1.0" 200 OK 2026-04-04 15:14:11,384 - lava_callback - INFO - Received callback for node 69ce87b1cb08ea23a1f695b2 INFO: 172.21.0.1:42990 - "POST /node/69ce87b1cb08ea23a1f695b2 HTTP/1.0" 202 Accepted 2026-04-04 15:14:11,390 - lava_callback - INFO - Starting async job submit for node 69ce87b1cb08ea23a1f695b2 2026-04-04 15:14:11,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:14:11,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce87b1cb08ea23a1f695b2 HTTP/1.1" 200 None 2026-04-04 15:14:11,406 - lava_callback - DEBUG - Processing node 69ce87b1cb08ea23a1f695b2: baseline-arm-clabbe 2026-04-04 15:14:11,406 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce87b1cb08ea23a1f695b2 2026-04-04 15:14:11,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:14:11,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce87b1cb08ea23a1f695b2 HTTP/1.1" 200 None 2026-04-04 15:14:11,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:14:11,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-04 15:14:11,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:14:11,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce87b1cb08ea23a1f695b2 HTTP/1.1" 200 None 2026-04-04 15:14:11,465 - lava_callback - ERROR - Error processing callback for node 69ce87b1cb08ea23a1f695b2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43000 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36316 - "GET / HTTP/1.0" 200 OK 2026-04-04 15:14:51,455 - lava_callback - INFO - Received callback for node 69ce87d6cb08ea23a1f695bc INFO: 172.21.0.1:59336 - "POST /node/69ce87d6cb08ea23a1f695bc HTTP/1.0" 202 Accepted 2026-04-04 15:14:51,460 - lava_callback - INFO - Starting async job submit for node 69ce87d6cb08ea23a1f695bc 2026-04-04 15:14:51,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:14:51,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce87d6cb08ea23a1f695bc HTTP/1.1" 200 None 2026-04-04 15:14:51,476 - lava_callback - DEBUG - Processing node 69ce87d6cb08ea23a1f695bc: baseline-arm-clabbe 2026-04-04 15:14:51,476 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce87d6cb08ea23a1f695bc 2026-04-04 15:14:51,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:14:51,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce87d6cb08ea23a1f695bc HTTP/1.1" 200 None 2026-04-04 15:14:51,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:14:51,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-04 15:14:51,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:14:51,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce87d6cb08ea23a1f695bc HTTP/1.1" 200 None 2026-04-04 15:14:51,535 - lava_callback - ERROR - Error processing callback for node 69ce87d6cb08ea23a1f695bc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59432 - "GET / HTTP/1.0" 200 OK 2026-04-04 15:15:11,474 - lava_callback - INFO - Received callback for node 69ce87facb08ea23a1f695c8 INFO: 172.21.0.1:51372 - "POST /node/69ce87facb08ea23a1f695c8 HTTP/1.0" 202 Accepted 2026-04-04 15:15:11,480 - lava_callback - INFO - Starting async job submit for node 69ce87facb08ea23a1f695c8 2026-04-04 15:15:11,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:15:11,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce87facb08ea23a1f695c8 HTTP/1.1" 200 None 2026-04-04 15:15:11,497 - lava_callback - DEBUG - Processing node 69ce87facb08ea23a1f695c8: baseline-arm-clabbe 2026-04-04 15:15:11,497 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce87facb08ea23a1f695c8 2026-04-04 15:15:11,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:15:11,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce87facb08ea23a1f695c8 HTTP/1.1" 200 None 2026-04-04 15:15:11,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:15:11,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-04 15:15:11,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:15:11,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce87facb08ea23a1f695c8 HTTP/1.1" 200 None 2026-04-04 15:15:11,559 - lava_callback - ERROR - Error processing callback for node 69ce87facb08ea23a1f695c8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51204 - "GET / HTTP/1.0" 200 OK 2026-04-04 15:15:51,454 - lava_callback - INFO - Received callback for node 69ce8820cb08ea23a1f695d3 INFO: 172.21.0.1:55826 - "POST /node/69ce8820cb08ea23a1f695d3 HTTP/1.0" 202 Accepted 2026-04-04 15:15:51,460 - lava_callback - INFO - Starting async job submit for node 69ce8820cb08ea23a1f695d3 2026-04-04 15:15:51,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:15:51,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8820cb08ea23a1f695d3 HTTP/1.1" 200 None 2026-04-04 15:15:51,483 - lava_callback - DEBUG - Processing node 69ce8820cb08ea23a1f695d3: baseline-arm-clabbe 2026-04-04 15:15:51,483 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce8820cb08ea23a1f695d3 2026-04-04 15:15:51,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:15:51,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8820cb08ea23a1f695d3 HTTP/1.1" 200 None 2026-04-04 15:15:51,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:15:51,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-04 15:15:51,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:15:51,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce8820cb08ea23a1f695d3 HTTP/1.1" 200 None 2026-04-04 15:15:51,536 - lava_callback - ERROR - Error processing callback for node 69ce8820cb08ea23a1f695d3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42158 - "GET / HTTP/1.0" 200 OK 2026-04-04 15:16:31,475 - lava_callback - INFO - Received callback for node 69ce8846cb08ea23a1f695df INFO: 172.21.0.1:50230 - "POST /node/69ce8846cb08ea23a1f695df HTTP/1.0" 202 Accepted 2026-04-04 15:16:31,481 - lava_callback - INFO - Starting async job submit for node 69ce8846cb08ea23a1f695df 2026-04-04 15:16:31,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:16:31,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8846cb08ea23a1f695df HTTP/1.1" 200 None 2026-04-04 15:16:31,498 - lava_callback - DEBUG - Processing node 69ce8846cb08ea23a1f695df: baseline-arm-clabbe 2026-04-04 15:16:31,498 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce8846cb08ea23a1f695df 2026-04-04 15:16:31,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:16:31,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8846cb08ea23a1f695df HTTP/1.1" 200 None 2026-04-04 15:16:31,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:16:31,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-04 15:16:31,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:16:31,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce8846cb08ea23a1f695df HTTP/1.1" 200 None 2026-04-04 15:16:31,563 - lava_callback - ERROR - Error processing callback for node 69ce8846cb08ea23a1f695df: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36926 - "GET / HTTP/1.0" 200 OK 2026-04-04 15:17:11,534 - lava_callback - INFO - Received callback for node 69ce886bcb08ea23a1f695e9 INFO: 172.21.0.1:56202 - "POST /node/69ce886bcb08ea23a1f695e9 HTTP/1.0" 202 Accepted 2026-04-04 15:17:11,539 - lava_callback - INFO - Starting async job submit for node 69ce886bcb08ea23a1f695e9 2026-04-04 15:17:11,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:17:11,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce886bcb08ea23a1f695e9 HTTP/1.1" 200 None 2026-04-04 15:17:11,558 - lava_callback - DEBUG - Processing node 69ce886bcb08ea23a1f695e9: baseline-arm-clabbe 2026-04-04 15:17:11,558 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce886bcb08ea23a1f695e9 2026-04-04 15:17:11,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:17:11,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce886bcb08ea23a1f695e9 HTTP/1.1" 200 None 2026-04-04 15:17:11,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:17:11,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-04 15:17:11,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:17:11,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce886bcb08ea23a1f695e9 HTTP/1.1" 200 None 2026-04-04 15:17:11,611 - lava_callback - ERROR - Error processing callback for node 69ce886bcb08ea23a1f695e9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39260 - "GET / HTTP/1.0" 200 OK 2026-04-04 15:17:59,584 - lava_callback - INFO - Received callback for node 69ce8895cb08ea23a1f695f4 INFO: 172.21.0.1:39270 - "POST /node/69ce8895cb08ea23a1f695f4 HTTP/1.0" 202 Accepted 2026-04-04 15:17:59,589 - lava_callback - INFO - Starting async job submit for node 69ce8895cb08ea23a1f695f4 2026-04-04 15:17:59,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:17:59,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8895cb08ea23a1f695f4 HTTP/1.1" 200 None 2026-04-04 15:17:59,606 - lava_callback - DEBUG - Processing node 69ce8895cb08ea23a1f695f4: baseline-arm64-baylibre 2026-04-04 15:17:59,606 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce8895cb08ea23a1f695f4 2026-04-04 15:17:59,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:17:59,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8895cb08ea23a1f695f4 HTTP/1.1" 200 None 2026-04-04 15:17:59,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:17:59,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-04 15:17:59,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:17:59,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce8895cb08ea23a1f695f4 HTTP/1.1" 200 None 2026-04-04 15:17:59,662 - lava_callback - ERROR - Error processing callback for node 69ce8895cb08ea23a1f695f4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38460 - "GET / HTTP/1.0" 200 OK 2026-04-04 15:19:19,701 - lava_callback - INFO - Received callback for node 69ce88e3cb08ea23a1f69600 INFO: 172.21.0.1:44656 - "POST /node/69ce88e3cb08ea23a1f69600 HTTP/1.0" 202 Accepted 2026-04-04 15:19:19,707 - lava_callback - INFO - Starting async job submit for node 69ce88e3cb08ea23a1f69600 2026-04-04 15:19:19,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:19:19,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce88e3cb08ea23a1f69600 HTTP/1.1" 200 None 2026-04-04 15:19:19,731 - lava_callback - DEBUG - Processing node 69ce88e3cb08ea23a1f69600: baseline-arm64-baylibre 2026-04-04 15:19:19,731 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce88e3cb08ea23a1f69600 2026-04-04 15:19:19,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:19:19,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce88e3cb08ea23a1f69600 HTTP/1.1" 200 None 2026-04-04 15:19:19,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:19:19,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-04 15:19:19,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:19:19,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce88e3cb08ea23a1f69600 HTTP/1.1" 200 None 2026-04-04 15:19:19,787 - lava_callback - ERROR - Error processing callback for node 69ce88e3cb08ea23a1f69600: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34284 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57482 - "GET / HTTP/1.0" 200 OK 2026-04-04 15:20:39,716 - lava_callback - INFO - Received callback for node 69ce8934cb08ea23a1f6960e INFO: 172.21.0.1:47384 - "POST /node/69ce8934cb08ea23a1f6960e HTTP/1.0" 202 Accepted 2026-04-04 15:20:39,722 - lava_callback - INFO - Starting async job submit for node 69ce8934cb08ea23a1f6960e 2026-04-04 15:20:39,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:20:39,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8934cb08ea23a1f6960e HTTP/1.1" 200 None 2026-04-04 15:20:39,738 - lava_callback - DEBUG - Processing node 69ce8934cb08ea23a1f6960e: baseline-arm64-baylibre 2026-04-04 15:20:39,738 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce8934cb08ea23a1f6960e 2026-04-04 15:20:39,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:20:39,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8934cb08ea23a1f6960e HTTP/1.1" 200 None 2026-04-04 15:20:39,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:20:39,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-04 15:20:39,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:20:39,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce8934cb08ea23a1f6960e HTTP/1.1" 200 None 2026-04-04 15:20:39,791 - lava_callback - ERROR - Error processing callback for node 69ce8934cb08ea23a1f6960e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49964 - "GET / HTTP/1.0" 200 OK 2026-04-04 15:21:59,858 - lava_callback - INFO - Received callback for node 69ce8982cb08ea23a1f69637 INFO: 172.21.0.1:41072 - "POST /node/69ce8982cb08ea23a1f69637 HTTP/1.0" 202 Accepted 2026-04-04 15:21:59,863 - lava_callback - INFO - Starting async job submit for node 69ce8982cb08ea23a1f69637 2026-04-04 15:21:59,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:21:59,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8982cb08ea23a1f69637 HTTP/1.1" 200 None 2026-04-04 15:21:59,892 - lava_callback - DEBUG - Processing node 69ce8982cb08ea23a1f69637: baseline-arm64-baylibre 2026-04-04 15:21:59,892 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce8982cb08ea23a1f69637 2026-04-04 15:21:59,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:21:59,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8982cb08ea23a1f69637 HTTP/1.1" 200 None 2026-04-04 15:21:59,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:21:59,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-04 15:21:59,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:21:59,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce8982cb08ea23a1f69637 HTTP/1.1" 200 None 2026-04-04 15:21:59,951 - lava_callback - ERROR - Error processing callback for node 69ce8982cb08ea23a1f69637: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57204 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39630 - "GET / HTTP/1.0" 200 OK 2026-04-04 15:22:59,824 - lava_callback - INFO - Received callback for node 69ce89cfcb08ea23a1f69659 INFO: 172.21.0.1:57196 - "POST /node/69ce89cfcb08ea23a1f69659 HTTP/1.0" 202 Accepted 2026-04-04 15:22:59,829 - lava_callback - INFO - Starting async job submit for node 69ce89cfcb08ea23a1f69659 2026-04-04 15:22:59,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:22:59,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce89cfcb08ea23a1f69659 HTTP/1.1" 200 None 2026-04-04 15:22:59,868 - lava_callback - DEBUG - Processing node 69ce89cfcb08ea23a1f69659: baseline-arm64-baylibre 2026-04-04 15:22:59,869 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce89cfcb08ea23a1f69659 2026-04-04 15:22:59,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:22:59,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce89cfcb08ea23a1f69659 HTTP/1.1" 200 None 2026-04-04 15:22:59,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:22:59,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-04 15:22:59,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:22:59,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce89cfcb08ea23a1f69659 HTTP/1.1" 200 None 2026-04-04 15:22:59,940 - lava_callback - ERROR - Error processing callback for node 69ce89cfcb08ea23a1f69659: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48810 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37900 - "GET / HTTP/1.0" 200 OK 2026-04-04 15:24:19,954 - lava_callback - INFO - Received callback for node 69ce8a19cb08ea23a1f69664 INFO: 172.21.0.1:33658 - "POST /node/69ce8a19cb08ea23a1f69664 HTTP/1.0" 202 Accepted 2026-04-04 15:24:19,959 - lava_callback - INFO - Starting async job submit for node 69ce8a19cb08ea23a1f69664 2026-04-04 15:24:19,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:24:19,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8a19cb08ea23a1f69664 HTTP/1.1" 200 None 2026-04-04 15:24:19,976 - lava_callback - DEBUG - Processing node 69ce8a19cb08ea23a1f69664: baseline-arm64-baylibre 2026-04-04 15:24:19,976 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce8a19cb08ea23a1f69664 2026-04-04 15:24:19,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:24:19,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8a19cb08ea23a1f69664 HTTP/1.1" 200 None 2026-04-04 15:24:19,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:24:20,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-04 15:24:20,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:24:20,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce8a19cb08ea23a1f69664 HTTP/1.1" 200 None 2026-04-04 15:24:20,027 - lava_callback - ERROR - Error processing callback for node 69ce8a19cb08ea23a1f69664: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35064 - "GET / HTTP/1.0" 200 OK 2026-04-04 15:25:51,918 - lava_callback - INFO - Received callback for node 69ce8a6acb08ea23a1f69672 INFO: 172.21.0.1:43492 - "POST /node/69ce8a6acb08ea23a1f69672 HTTP/1.0" 202 Accepted 2026-04-04 15:25:51,924 - lava_callback - INFO - Starting async job submit for node 69ce8a6acb08ea23a1f69672 2026-04-04 15:25:51,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:25:51,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8a6acb08ea23a1f69672 HTTP/1.1" 200 None 2026-04-04 15:25:51,940 - lava_callback - DEBUG - Processing node 69ce8a6acb08ea23a1f69672: baseline-arm64-clabbe 2026-04-04 15:25:51,940 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce8a6acb08ea23a1f69672 2026-04-04 15:25:51,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:25:51,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8a6acb08ea23a1f69672 HTTP/1.1" 200 None 2026-04-04 15:25:51,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:25:51,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-04 15:25:51,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:25:51,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce8a6acb08ea23a1f69672 HTTP/1.1" 200 None 2026-04-04 15:25:51,996 - lava_callback - ERROR - Error processing callback for node 69ce8a6acb08ea23a1f69672: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58116 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38838 - "GET / HTTP/1.0" 200 OK 2026-04-04 15:26:52,038 - lava_callback - INFO - Received callback for node 69ce8ab8cb08ea23a1f6967f INFO: 172.21.0.1:35536 - "POST /node/69ce8ab8cb08ea23a1f6967f HTTP/1.0" 202 Accepted 2026-04-04 15:26:52,044 - lava_callback - INFO - Starting async job submit for node 69ce8ab8cb08ea23a1f6967f 2026-04-04 15:26:52,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:26:52,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8ab8cb08ea23a1f6967f HTTP/1.1" 200 None 2026-04-04 15:26:52,061 - lava_callback - DEBUG - Processing node 69ce8ab8cb08ea23a1f6967f: baseline-arm64-clabbe 2026-04-04 15:26:52,061 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce8ab8cb08ea23a1f6967f 2026-04-04 15:26:52,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:26:52,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8ab8cb08ea23a1f6967f HTTP/1.1" 200 None 2026-04-04 15:26:52,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:26:52,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-04 15:26:52,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:26:52,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce8ab8cb08ea23a1f6967f HTTP/1.1" 200 None 2026-04-04 15:26:52,138 - lava_callback - ERROR - Error processing callback for node 69ce8ab8cb08ea23a1f6967f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47512 - "GET / HTTP/1.0" 200 OK 2026-04-04 15:28:12,047 - lava_callback - INFO - Received callback for node 69ce8b05cb08ea23a1f69688 INFO: 172.21.0.1:54896 - "POST /node/69ce8b05cb08ea23a1f69688 HTTP/1.0" 202 Accepted 2026-04-04 15:28:12,052 - lava_callback - INFO - Starting async job submit for node 69ce8b05cb08ea23a1f69688 2026-04-04 15:28:12,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:28:12,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8b05cb08ea23a1f69688 HTTP/1.1" 200 None 2026-04-04 15:28:12,069 - lava_callback - DEBUG - Processing node 69ce8b05cb08ea23a1f69688: baseline-arm64-clabbe 2026-04-04 15:28:12,070 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce8b05cb08ea23a1f69688 2026-04-04 15:28:12,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:28:12,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8b05cb08ea23a1f69688 HTTP/1.1" 200 None 2026-04-04 15:28:12,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:28:12,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-04 15:28:12,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:28:12,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce8b05cb08ea23a1f69688 HTTP/1.1" 200 None 2026-04-04 15:28:12,127 - lava_callback - ERROR - Error processing callback for node 69ce8b05cb08ea23a1f69688: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54906 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35768 - "GET / HTTP/1.0" 200 OK 2026-04-04 15:29:20,360 - lava_callback - INFO - Received callback for node 69ce8b49cb08ea23a1f69692 INFO: 172.21.0.1:39636 - "POST /node/69ce8b49cb08ea23a1f69692 HTTP/1.0" 202 Accepted 2026-04-04 15:29:20,367 - lava_callback - INFO - Starting async job submit for node 69ce8b49cb08ea23a1f69692 2026-04-04 15:29:20,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:29:20,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8b49cb08ea23a1f69692 HTTP/1.1" 200 None 2026-04-04 15:29:20,409 - lava_callback - DEBUG - Processing node 69ce8b49cb08ea23a1f69692: baseline-arm64-baylibre 2026-04-04 15:29:20,409 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce8b49cb08ea23a1f69692 2026-04-04 15:29:20,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:29:20,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8b49cb08ea23a1f69692 HTTP/1.1" 200 None 2026-04-04 15:29:20,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:29:20,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-04 15:29:20,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:29:20,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce8b49cb08ea23a1f69692 HTTP/1.1" 200 None 2026-04-04 15:29:20,488 - lava_callback - ERROR - Error processing callback for node 69ce8b49cb08ea23a1f69692: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44000 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53006 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49396 - "GET / HTTP/1.0" 200 OK 2026-04-04 15:35:52,610 - lava_callback - INFO - Received callback for node 69ce8cd2cb08ea23a1f696ce INFO: 172.21.0.1:52474 - "POST /node/69ce8cd2cb08ea23a1f696ce HTTP/1.0" 202 Accepted 2026-04-04 15:35:52,616 - lava_callback - INFO - Starting async job submit for node 69ce8cd2cb08ea23a1f696ce 2026-04-04 15:35:52,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:35:52,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8cd2cb08ea23a1f696ce HTTP/1.1" 200 None 2026-04-04 15:35:52,632 - lava_callback - DEBUG - Processing node 69ce8cd2cb08ea23a1f696ce: baseline-arm64-clabbe 2026-04-04 15:35:52,633 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce8cd2cb08ea23a1f696ce 2026-04-04 15:35:52,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:35:52,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8cd2cb08ea23a1f696ce HTTP/1.1" 200 None 2026-04-04 15:35:52,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:35:52,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-04 15:35:52,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:35:52,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce8cd2cb08ea23a1f696ce HTTP/1.1" 200 None 2026-04-04 15:35:52,697 - lava_callback - ERROR - Error processing callback for node 69ce8cd2cb08ea23a1f696ce: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58386 - "GET / HTTP/1.0" 200 OK 2026-04-04 15:37:00,651 - lava_callback - INFO - Received callback for node 69ce8d15cb08ea23a1f696dd INFO: 172.21.0.1:52362 - "POST /node/69ce8d15cb08ea23a1f696dd HTTP/1.0" 202 Accepted 2026-04-04 15:37:00,657 - lava_callback - INFO - Starting async job submit for node 69ce8d15cb08ea23a1f696dd 2026-04-04 15:37:00,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:37:00,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8d15cb08ea23a1f696dd HTTP/1.1" 200 None 2026-04-04 15:37:00,673 - lava_callback - DEBUG - Processing node 69ce8d15cb08ea23a1f696dd: baseline-arm64-baylibre 2026-04-04 15:37:00,673 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce8d15cb08ea23a1f696dd 2026-04-04 15:37:00,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:37:00,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8d15cb08ea23a1f696dd HTTP/1.1" 200 None 2026-04-04 15:37:00,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:37:00,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-04 15:37:00,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:37:00,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce8d15cb08ea23a1f696dd HTTP/1.1" 200 None 2026-04-04 15:37:00,737 - lava_callback - ERROR - Error processing callback for node 69ce8d15cb08ea23a1f696dd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53170 - "GET / HTTP/1.0" 200 OK 2026-04-04 15:38:20,791 - lava_callback - INFO - Received callback for node 69ce8d5fcb08ea23a1f696e5 INFO: 172.21.0.1:35016 - "POST /node/69ce8d5fcb08ea23a1f696e5 HTTP/1.0" 202 Accepted 2026-04-04 15:38:20,797 - lava_callback - INFO - Starting async job submit for node 69ce8d5fcb08ea23a1f696e5 2026-04-04 15:38:20,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:38:20,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8d5fcb08ea23a1f696e5 HTTP/1.1" 200 None 2026-04-04 15:38:20,813 - lava_callback - DEBUG - Processing node 69ce8d5fcb08ea23a1f696e5: baseline-arm64-baylibre 2026-04-04 15:38:20,813 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce8d5fcb08ea23a1f696e5 2026-04-04 15:38:20,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:38:20,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8d5fcb08ea23a1f696e5 HTTP/1.1" 200 None 2026-04-04 15:38:20,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:38:20,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-04 15:38:20,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:38:20,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce8d5fcb08ea23a1f696e5 HTTP/1.1" 200 None 2026-04-04 15:38:20,867 - lava_callback - ERROR - Error processing callback for node 69ce8d5fcb08ea23a1f696e5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53842 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35116 - "GET / HTTP/1.0" 200 OK 2026-04-04 15:39:40,867 - lava_callback - INFO - Received callback for node 69ce8daacb08ea23a1f696f1 INFO: 172.21.0.1:58438 - "POST /node/69ce8daacb08ea23a1f696f1 HTTP/1.0" 202 Accepted 2026-04-04 15:39:40,872 - lava_callback - INFO - Starting async job submit for node 69ce8daacb08ea23a1f696f1 2026-04-04 15:39:40,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:39:40,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8daacb08ea23a1f696f1 HTTP/1.1" 200 None 2026-04-04 15:39:40,888 - lava_callback - DEBUG - Processing node 69ce8daacb08ea23a1f696f1: baseline-arm64-baylibre 2026-04-04 15:39:40,888 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce8daacb08ea23a1f696f1 2026-04-04 15:39:40,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:39:40,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8daacb08ea23a1f696f1 HTTP/1.1" 200 None 2026-04-04 15:39:40,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:39:40,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-04 15:39:40,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:39:40,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce8daacb08ea23a1f696f1 HTTP/1.1" 200 None 2026-04-04 15:39:40,944 - lava_callback - ERROR - Error processing callback for node 69ce8daacb08ea23a1f696f1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56088 - "GET / HTTP/1.0" 200 OK 2026-04-04 15:40:40,777 - lava_callback - INFO - Received callback for node 69ce8df5cb08ea23a1f696fc INFO: 172.21.0.1:49930 - "POST /node/69ce8df5cb08ea23a1f696fc HTTP/1.0" 202 Accepted 2026-04-04 15:40:40,783 - lava_callback - INFO - Starting async job submit for node 69ce8df5cb08ea23a1f696fc 2026-04-04 15:40:40,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:40:40,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8df5cb08ea23a1f696fc HTTP/1.1" 200 None 2026-04-04 15:40:40,799 - lava_callback - DEBUG - Processing node 69ce8df5cb08ea23a1f696fc: baseline-arm64-baylibre 2026-04-04 15:40:40,799 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce8df5cb08ea23a1f696fc 2026-04-04 15:40:40,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:40:40,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8df5cb08ea23a1f696fc HTTP/1.1" 200 None 2026-04-04 15:40:40,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:40:40,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-04 15:40:40,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:40:40,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce8df5cb08ea23a1f696fc HTTP/1.1" 200 None 2026-04-04 15:40:40,874 - lava_callback - ERROR - Error processing callback for node 69ce8df5cb08ea23a1f696fc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56570 - "GET / HTTP/1.0" 200 OK 2026-04-04 15:42:00,909 - lava_callback - INFO - Received callback for node 69ce8e40cb08ea23a1f6970f INFO: 172.21.0.1:36126 - "POST /node/69ce8e40cb08ea23a1f6970f HTTP/1.0" 202 Accepted 2026-04-04 15:42:00,914 - lava_callback - INFO - Starting async job submit for node 69ce8e40cb08ea23a1f6970f 2026-04-04 15:42:00,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:42:00,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8e40cb08ea23a1f6970f HTTP/1.1" 200 None 2026-04-04 15:42:00,931 - lava_callback - DEBUG - Processing node 69ce8e40cb08ea23a1f6970f: baseline-arm64-baylibre 2026-04-04 15:42:00,931 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce8e40cb08ea23a1f6970f 2026-04-04 15:42:00,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:42:00,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8e40cb08ea23a1f6970f HTTP/1.1" 200 None 2026-04-04 15:42:00,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:42:00,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-04 15:42:00,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:42:00,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce8e40cb08ea23a1f6970f HTTP/1.1" 200 None 2026-04-04 15:42:00,992 - lava_callback - ERROR - Error processing callback for node 69ce8e40cb08ea23a1f6970f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34318 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34342 - "GET / HTTP/1.0" 200 OK 2026-04-04 15:43:20,997 - lava_callback - INFO - Received callback for node 69ce8e8acb08ea23a1f69718 INFO: 172.21.0.1:60382 - "POST /node/69ce8e8acb08ea23a1f69718 HTTP/1.0" 202 Accepted 2026-04-04 15:43:21,004 - lava_callback - INFO - Starting async job submit for node 69ce8e8acb08ea23a1f69718 2026-04-04 15:43:21,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:43:21,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8e8acb08ea23a1f69718 HTTP/1.1" 200 None 2026-04-04 15:43:21,047 - lava_callback - DEBUG - Processing node 69ce8e8acb08ea23a1f69718: baseline-arm64-baylibre 2026-04-04 15:43:21,047 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce8e8acb08ea23a1f69718 2026-04-04 15:43:21,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:43:21,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8e8acb08ea23a1f69718 HTTP/1.1" 200 None 2026-04-04 15:43:21,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:43:21,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-04 15:43:21,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:43:21,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce8e8acb08ea23a1f69718 HTTP/1.1" 200 None 2026-04-04 15:43:21,102 - lava_callback - ERROR - Error processing callback for node 69ce8e8acb08ea23a1f69718: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33630 - "GET / HTTP/1.0" 200 OK 2026-04-04 15:44:32,873 - lava_callback - INFO - Received callback for node 69ce8edbcb08ea23a1f6972a INFO: 172.21.0.1:50602 - "POST /node/69ce8edbcb08ea23a1f6972a HTTP/1.0" 202 Accepted 2026-04-04 15:44:32,884 - lava_callback - INFO - Starting async job submit for node 69ce8edbcb08ea23a1f6972a 2026-04-04 15:44:32,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:44:32,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8edbcb08ea23a1f6972a HTTP/1.1" 200 None 2026-04-04 15:44:32,899 - lava_callback - DEBUG - Processing node 69ce8edbcb08ea23a1f6972a: baseline-arm64-clabbe 2026-04-04 15:44:32,899 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce8edbcb08ea23a1f6972a 2026-04-04 15:44:32,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:44:32,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8edbcb08ea23a1f6972a HTTP/1.1" 200 None 2026-04-04 15:44:32,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:44:32,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-04 15:44:32,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:44:32,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce8edbcb08ea23a1f6972a HTTP/1.1" 200 None 2026-04-04 15:44:32,968 - lava_callback - ERROR - Error processing callback for node 69ce8edbcb08ea23a1f6972a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49536 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48794 - "GET / HTTP/1.0" 200 OK 2026-04-04 15:45:52,916 - lava_callback - INFO - Received callback for node 69ce8f2acb08ea23a1f69736 INFO: 172.21.0.1:36822 - "POST /node/69ce8f2acb08ea23a1f69736 HTTP/1.0" 202 Accepted 2026-04-04 15:45:52,922 - lava_callback - INFO - Starting async job submit for node 69ce8f2acb08ea23a1f69736 2026-04-04 15:45:52,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:45:52,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8f2acb08ea23a1f69736 HTTP/1.1" 200 None 2026-04-04 15:45:52,939 - lava_callback - DEBUG - Processing node 69ce8f2acb08ea23a1f69736: baseline-arm64-clabbe 2026-04-04 15:45:52,939 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce8f2acb08ea23a1f69736 2026-04-04 15:45:52,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:45:52,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8f2acb08ea23a1f69736 HTTP/1.1" 200 None 2026-04-04 15:45:52,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:45:52,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-04 15:45:52,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:45:52,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce8f2acb08ea23a1f69736 HTTP/1.1" 200 None 2026-04-04 15:45:53,005 - lava_callback - ERROR - Error processing callback for node 69ce8f2acb08ea23a1f69736: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48282 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:48288 - "GET / HTTP/1.0" 200 OK 2026-04-04 15:47:12,963 - lava_callback - INFO - Received callback for node 69ce8f76cb08ea23a1f69746 INFO: 172.21.0.1:60390 - "POST /node/69ce8f76cb08ea23a1f69746 HTTP/1.0" 202 Accepted 2026-04-04 15:47:12,969 - lava_callback - INFO - Starting async job submit for node 69ce8f76cb08ea23a1f69746 2026-04-04 15:47:12,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:47:12,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8f76cb08ea23a1f69746 HTTP/1.1" 200 None 2026-04-04 15:47:12,989 - lava_callback - DEBUG - Processing node 69ce8f76cb08ea23a1f69746: baseline-arm64-clabbe 2026-04-04 15:47:12,990 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce8f76cb08ea23a1f69746 2026-04-04 15:47:12,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:47:13,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8f76cb08ea23a1f69746 HTTP/1.1" 200 None 2026-04-04 15:47:13,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:47:13,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-04 15:47:13,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:47:13,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce8f76cb08ea23a1f69746 HTTP/1.1" 200 None 2026-04-04 15:47:13,044 - lava_callback - ERROR - Error processing callback for node 69ce8f76cb08ea23a1f69746: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36864 - "GET / HTTP/1.0" 200 OK 2026-04-04 15:48:33,080 - lava_callback - INFO - Received callback for node 69ce8fc1cb08ea23a1f69750 INFO: 172.21.0.1:46370 - "POST /node/69ce8fc1cb08ea23a1f69750 HTTP/1.0" 202 Accepted 2026-04-04 15:48:33,086 - lava_callback - INFO - Starting async job submit for node 69ce8fc1cb08ea23a1f69750 2026-04-04 15:48:33,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:48:33,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8fc1cb08ea23a1f69750 HTTP/1.1" 200 None 2026-04-04 15:48:33,102 - lava_callback - DEBUG - Processing node 69ce8fc1cb08ea23a1f69750: baseline-arm64-clabbe 2026-04-04 15:48:33,103 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce8fc1cb08ea23a1f69750 2026-04-04 15:48:33,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:48:33,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce8fc1cb08ea23a1f69750 HTTP/1.1" 200 None 2026-04-04 15:48:33,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:48:33,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-04 15:48:33,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:48:33,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce8fc1cb08ea23a1f69750 HTTP/1.1" 200 None 2026-04-04 15:48:33,171 - lava_callback - ERROR - Error processing callback for node 69ce8fc1cb08ea23a1f69750: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54910 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48090 - "GET / HTTP/1.0" 200 OK 2026-04-04 15:49:53,130 - lava_callback - INFO - Received callback for node 69ce9011cb08ea23a1f6975b INFO: 172.21.0.1:56758 - "POST /node/69ce9011cb08ea23a1f6975b HTTP/1.0" 202 Accepted 2026-04-04 15:49:53,136 - lava_callback - INFO - Starting async job submit for node 69ce9011cb08ea23a1f6975b 2026-04-04 15:49:53,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:49:53,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce9011cb08ea23a1f6975b HTTP/1.1" 200 None 2026-04-04 15:49:53,158 - lava_callback - DEBUG - Processing node 69ce9011cb08ea23a1f6975b: baseline-arm64-clabbe 2026-04-04 15:49:53,158 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce9011cb08ea23a1f6975b 2026-04-04 15:49:53,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:49:53,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce9011cb08ea23a1f6975b HTTP/1.1" 200 None 2026-04-04 15:49:53,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:49:53,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-04 15:49:53,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:49:53,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce9011cb08ea23a1f6975b HTTP/1.1" 200 None 2026-04-04 15:49:53,213 - lava_callback - ERROR - Error processing callback for node 69ce9011cb08ea23a1f6975b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57686 - "GET / HTTP/1.0" 200 OK 2026-04-04 15:51:13,163 - lava_callback - INFO - Received callback for node 69ce9060cb08ea23a1f69767 INFO: 172.21.0.1:53452 - "POST /node/69ce9060cb08ea23a1f69767 HTTP/1.0" 202 Accepted 2026-04-04 15:51:13,169 - lava_callback - INFO - Starting async job submit for node 69ce9060cb08ea23a1f69767 2026-04-04 15:51:13,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:51:13,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce9060cb08ea23a1f69767 HTTP/1.1" 200 None 2026-04-04 15:51:13,190 - lava_callback - DEBUG - Processing node 69ce9060cb08ea23a1f69767: baseline-arm64-clabbe 2026-04-04 15:51:13,190 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce9060cb08ea23a1f69767 2026-04-04 15:51:13,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:51:13,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce9060cb08ea23a1f69767 HTTP/1.1" 200 None 2026-04-04 15:51:13,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:51:13,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-04 15:51:13,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:51:13,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce9060cb08ea23a1f69767 HTTP/1.1" 200 None 2026-04-04 15:51:13,256 - lava_callback - ERROR - Error processing callback for node 69ce9060cb08ea23a1f69767: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59466 - "GET / HTTP/1.0" 200 OK 2026-04-04 15:52:33,220 - lava_callback - INFO - Received callback for node 69ce90accb08ea23a1f6976e INFO: 172.21.0.1:57250 - "POST /node/69ce90accb08ea23a1f6976e HTTP/1.0" 202 Accepted 2026-04-04 15:52:33,226 - lava_callback - INFO - Starting async job submit for node 69ce90accb08ea23a1f6976e 2026-04-04 15:52:33,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:52:33,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce90accb08ea23a1f6976e HTTP/1.1" 200 None 2026-04-04 15:52:33,250 - lava_callback - DEBUG - Processing node 69ce90accb08ea23a1f6976e: baseline-arm64-clabbe 2026-04-04 15:52:33,250 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce90accb08ea23a1f6976e 2026-04-04 15:52:33,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:52:33,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce90accb08ea23a1f6976e HTTP/1.1" 200 None 2026-04-04 15:52:33,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:52:33,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-04 15:52:33,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:52:33,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce90accb08ea23a1f6976e HTTP/1.1" 200 None 2026-04-04 15:52:33,307 - lava_callback - ERROR - Error processing callback for node 69ce90accb08ea23a1f6976e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39374 - "GET / HTTP/1.0" 200 OK 2026-04-04 15:53:21,562 - lava_callback - INFO - Received callback for node 69ce90efcb08ea23a1f6977b INFO: 172.21.0.1:39384 - "POST /node/69ce90efcb08ea23a1f6977b HTTP/1.0" 202 Accepted 2026-04-04 15:53:21,568 - lava_callback - INFO - Starting async job submit for node 69ce90efcb08ea23a1f6977b 2026-04-04 15:53:21,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:53:21,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce90efcb08ea23a1f6977b HTTP/1.1" 200 None 2026-04-04 15:53:21,590 - lava_callback - DEBUG - Processing node 69ce90efcb08ea23a1f6977b: baseline-arm64-baylibre 2026-04-04 15:53:21,590 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce90efcb08ea23a1f6977b 2026-04-04 15:53:21,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:53:21,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce90efcb08ea23a1f6977b HTTP/1.1" 200 None 2026-04-04 15:53:21,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:53:21,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-04 15:53:21,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:53:21,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce90efcb08ea23a1f6977b HTTP/1.1" 200 None 2026-04-04 15:53:21,662 - lava_callback - ERROR - Error processing callback for node 69ce90efcb08ea23a1f6977b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49586 - "GET / HTTP/1.0" 200 OK 2026-04-04 15:54:41,653 - lava_callback - INFO - Received callback for node 69ce913acb08ea23a1f69782 INFO: 172.21.0.1:58402 - "POST /node/69ce913acb08ea23a1f69782 HTTP/1.0" 202 Accepted 2026-04-04 15:54:41,662 - lava_callback - INFO - Starting async job submit for node 69ce913acb08ea23a1f69782 2026-04-04 15:54:41,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:54:41,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce913acb08ea23a1f69782 HTTP/1.1" 200 None 2026-04-04 15:54:41,680 - lava_callback - DEBUG - Processing node 69ce913acb08ea23a1f69782: baseline-arm64-baylibre 2026-04-04 15:54:41,681 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce913acb08ea23a1f69782 2026-04-04 15:54:41,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:54:41,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce913acb08ea23a1f69782 HTTP/1.1" 200 None 2026-04-04 15:54:41,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:54:41,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-04 15:54:41,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:54:41,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce913acb08ea23a1f69782 HTTP/1.1" 200 None 2026-04-04 15:54:41,754 - lava_callback - ERROR - Error processing callback for node 69ce913acb08ea23a1f69782: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46104 - "GET / HTTP/1.0" 200 OK 2026-04-04 15:56:13,427 - lava_callback - INFO - Received callback for node 69ce918dcb08ea23a1f69790 INFO: 172.21.0.1:36354 - "POST /node/69ce918dcb08ea23a1f69790 HTTP/1.0" 202 Accepted 2026-04-04 15:56:13,432 - lava_callback - INFO - Starting async job submit for node 69ce918dcb08ea23a1f69790 2026-04-04 15:56:13,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:56:13,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce918dcb08ea23a1f69790 HTTP/1.1" 200 None 2026-04-04 15:56:13,449 - lava_callback - DEBUG - Processing node 69ce918dcb08ea23a1f69790: baseline-arm64-clabbe 2026-04-04 15:56:13,449 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce918dcb08ea23a1f69790 2026-04-04 15:56:13,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:56:13,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce918dcb08ea23a1f69790 HTTP/1.1" 200 None 2026-04-04 15:56:13,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:56:13,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-04 15:56:13,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:56:13,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce918dcb08ea23a1f69790 HTTP/1.1" 200 None 2026-04-04 15:56:13,502 - lava_callback - ERROR - Error processing callback for node 69ce918dcb08ea23a1f69790: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37886 - "GET / HTTP/1.0" 200 OK 2026-04-04 15:57:21,853 - lava_callback - INFO - Received callback for node 69ce91d1cb08ea23a1f69796 INFO: 172.21.0.1:37888 - "POST /node/69ce91d1cb08ea23a1f69796 HTTP/1.0" 202 Accepted 2026-04-04 15:57:21,859 - lava_callback - INFO - Starting async job submit for node 69ce91d1cb08ea23a1f69796 2026-04-04 15:57:21,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:57:21,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce91d1cb08ea23a1f69796 HTTP/1.1" 200 None 2026-04-04 15:57:21,876 - lava_callback - DEBUG - Processing node 69ce91d1cb08ea23a1f69796: baseline-arm64-baylibre 2026-04-04 15:57:21,877 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce91d1cb08ea23a1f69796 2026-04-04 15:57:21,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:57:21,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce91d1cb08ea23a1f69796 HTTP/1.1" 200 None 2026-04-04 15:57:21,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:57:21,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-04 15:57:21,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:57:21,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce91d1cb08ea23a1f69796 HTTP/1.1" 200 None 2026-04-04 15:57:21,933 - lava_callback - ERROR - Error processing callback for node 69ce91d1cb08ea23a1f69796: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33372 - "GET / HTTP/1.0" 200 OK 2026-04-04 15:58:41,884 - lava_callback - INFO - Received callback for node 69ce921dcb08ea23a1f697a4 INFO: 172.21.0.1:48850 - "POST /node/69ce921dcb08ea23a1f697a4 HTTP/1.0" 202 Accepted 2026-04-04 15:58:41,893 - lava_callback - INFO - Starting async job submit for node 69ce921dcb08ea23a1f697a4 2026-04-04 15:58:41,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:58:41,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce921dcb08ea23a1f697a4 HTTP/1.1" 200 None 2026-04-04 15:58:41,911 - lava_callback - DEBUG - Processing node 69ce921dcb08ea23a1f697a4: baseline-arm64-baylibre 2026-04-04 15:58:41,911 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce921dcb08ea23a1f697a4 2026-04-04 15:58:41,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:58:41,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce921dcb08ea23a1f697a4 HTTP/1.1" 200 None 2026-04-04 15:58:41,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:58:41,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-04 15:58:41,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:58:41,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce921dcb08ea23a1f697a4 HTTP/1.1" 200 None 2026-04-04 15:58:41,997 - lava_callback - ERROR - Error processing callback for node 69ce921dcb08ea23a1f697a4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58238 - "GET / HTTP/1.0" 200 OK 2026-04-04 15:59:41,851 - lava_callback - INFO - Received callback for node 69ce9268cb08ea23a1f697ac INFO: 172.21.0.1:45826 - "POST /node/69ce9268cb08ea23a1f697ac HTTP/1.0" 202 Accepted 2026-04-04 15:59:41,857 - lava_callback - INFO - Starting async job submit for node 69ce9268cb08ea23a1f697ac 2026-04-04 15:59:41,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:59:41,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce9268cb08ea23a1f697ac HTTP/1.1" 200 None 2026-04-04 15:59:41,872 - lava_callback - DEBUG - Processing node 69ce9268cb08ea23a1f697ac: baseline-arm64-baylibre 2026-04-04 15:59:41,873 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce9268cb08ea23a1f697ac 2026-04-04 15:59:41,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:59:41,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce9268cb08ea23a1f697ac HTTP/1.1" 200 None 2026-04-04 15:59:41,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:59:41,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-04 15:59:41,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 15:59:41,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce9268cb08ea23a1f697ac HTTP/1.1" 200 None 2026-04-04 15:59:41,936 - lava_callback - ERROR - Error processing callback for node 69ce9268cb08ea23a1f697ac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34166 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60738 - "GET / HTTP/1.0" 200 OK 2026-04-04 16:01:13,693 - lava_callback - INFO - Received callback for node 69ce92b8cb08ea23a1f697b9 INFO: 172.21.0.1:33308 - "POST /node/69ce92b8cb08ea23a1f697b9 HTTP/1.0" 202 Accepted 2026-04-04 16:01:13,699 - lava_callback - INFO - Starting async job submit for node 69ce92b8cb08ea23a1f697b9 2026-04-04 16:01:13,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 16:01:13,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce92b8cb08ea23a1f697b9 HTTP/1.1" 200 None 2026-04-04 16:01:13,714 - lava_callback - DEBUG - Processing node 69ce92b8cb08ea23a1f697b9: baseline-arm64-clabbe 2026-04-04 16:01:13,715 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce92b8cb08ea23a1f697b9 2026-04-04 16:01:13,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 16:01:13,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce92b8cb08ea23a1f697b9 HTTP/1.1" 200 None 2026-04-04 16:01:13,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 16:01:13,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-04 16:01:13,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 16:01:13,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce92b8cb08ea23a1f697b9 HTTP/1.1" 200 None 2026-04-04 16:01:13,768 - lava_callback - ERROR - Error processing callback for node 69ce92b8cb08ea23a1f697b9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56022 - "GET / HTTP/1.0" 200 OK 2026-04-04 16:02:33,802 - lava_callback - INFO - Received callback for node 69ce9304cb08ea23a1f697c0 INFO: 172.21.0.1:44912 - "POST /node/69ce9304cb08ea23a1f697c0 HTTP/1.0" 202 Accepted 2026-04-04 16:02:33,808 - lava_callback - INFO - Starting async job submit for node 69ce9304cb08ea23a1f697c0 2026-04-04 16:02:33,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 16:02:33,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce9304cb08ea23a1f697c0 HTTP/1.1" 200 None 2026-04-04 16:02:33,831 - lava_callback - DEBUG - Processing node 69ce9304cb08ea23a1f697c0: baseline-arm64-clabbe 2026-04-04 16:02:33,831 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce9304cb08ea23a1f697c0 2026-04-04 16:02:33,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 16:02:33,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce9304cb08ea23a1f697c0 HTTP/1.1" 200 None 2026-04-04 16:02:33,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 16:02:33,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-04 16:02:33,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 16:02:33,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce9304cb08ea23a1f697c0 HTTP/1.1" 200 None 2026-04-04 16:02:33,900 - lava_callback - ERROR - Error processing callback for node 69ce9304cb08ea23a1f697c0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51836 - "GET / HTTP/1.0" 200 OK 2026-04-04 16:03:22,051 - lava_callback - INFO - Received callback for node 69ce9345cb08ea23a1f697c9 INFO: 172.21.0.1:51846 - "POST /node/69ce9345cb08ea23a1f697c9 HTTP/1.0" 202 Accepted 2026-04-04 16:03:22,058 - lava_callback - INFO - Starting async job submit for node 69ce9345cb08ea23a1f697c9 2026-04-04 16:03:22,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 16:03:22,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce9345cb08ea23a1f697c9 HTTP/1.1" 200 None 2026-04-04 16:03:22,082 - lava_callback - DEBUG - Processing node 69ce9345cb08ea23a1f697c9: baseline-arm64-baylibre 2026-04-04 16:03:22,083 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce9345cb08ea23a1f697c9 2026-04-04 16:03:22,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 16:03:22,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce9345cb08ea23a1f697c9 HTTP/1.1" 200 None 2026-04-04 16:03:22,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 16:03:22,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-04 16:03:22,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 16:03:22,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce9345cb08ea23a1f697c9 HTTP/1.1" 200 None 2026-04-04 16:03:22,143 - lava_callback - ERROR - Error processing callback for node 69ce9345cb08ea23a1f697c9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38780 - "GET / HTTP/1.0" 200 OK 2026-04-04 16:04:42,118 - lava_callback - INFO - Received callback for node 69ce9390cb08ea23a1f697d4 INFO: 172.21.0.1:50924 - "POST /node/69ce9390cb08ea23a1f697d4 HTTP/1.0" 202 Accepted 2026-04-04 16:04:42,124 - lava_callback - INFO - Starting async job submit for node 69ce9390cb08ea23a1f697d4 2026-04-04 16:04:42,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 16:04:42,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce9390cb08ea23a1f697d4 HTTP/1.1" 200 None 2026-04-04 16:04:42,142 - lava_callback - DEBUG - Processing node 69ce9390cb08ea23a1f697d4: baseline-arm64-baylibre 2026-04-04 16:04:42,142 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce9390cb08ea23a1f697d4 2026-04-04 16:04:42,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 16:04:42,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce9390cb08ea23a1f697d4 HTTP/1.1" 200 None 2026-04-04 16:04:42,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 16:04:42,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-04 16:04:42,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 16:04:42,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce9390cb08ea23a1f697d4 HTTP/1.1" 200 None 2026-04-04 16:04:42,202 - lava_callback - ERROR - Error processing callback for node 69ce9390cb08ea23a1f697d4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59136 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46888 - "GET / HTTP/1.0" 200 OK 2026-04-04 16:06:13,946 - lava_callback - INFO - Received callback for node 69ce93e4cb08ea23a1f697e2 INFO: 172.21.0.1:36122 - "POST /node/69ce93e4cb08ea23a1f697e2 HTTP/1.0" 202 Accepted 2026-04-04 16:06:13,952 - lava_callback - INFO - Starting async job submit for node 69ce93e4cb08ea23a1f697e2 2026-04-04 16:06:13,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 16:06:13,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce93e4cb08ea23a1f697e2 HTTP/1.1" 200 None 2026-04-04 16:06:13,968 - lava_callback - DEBUG - Processing node 69ce93e4cb08ea23a1f697e2: baseline-arm64-clabbe 2026-04-04 16:06:13,968 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce93e4cb08ea23a1f697e2 2026-04-04 16:06:13,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 16:06:13,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce93e4cb08ea23a1f697e2 HTTP/1.1" 200 None 2026-04-04 16:06:13,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 16:06:13,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-04 16:06:13,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 16:06:14,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce93e4cb08ea23a1f697e2 HTTP/1.1" 200 None 2026-04-04 16:06:14,024 - lava_callback - ERROR - Error processing callback for node 69ce93e4cb08ea23a1f697e2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36126 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49462 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50702 - "GET / HTTP/1.0" 200 OK 2026-04-04 16:07:34,047 - lava_callback - INFO - Received callback for node 69ce9430cb08ea23a1f697e9 INFO: 172.21.0.1:45928 - "POST /node/69ce9430cb08ea23a1f697e9 HTTP/1.0" 202 Accepted 2026-04-04 16:07:34,052 - lava_callback - INFO - Starting async job submit for node 69ce9430cb08ea23a1f697e9 2026-04-04 16:07:34,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 16:07:34,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce9430cb08ea23a1f697e9 HTTP/1.1" 200 None 2026-04-04 16:07:34,070 - lava_callback - DEBUG - Processing node 69ce9430cb08ea23a1f697e9: baseline-arm64-clabbe 2026-04-04 16:07:34,070 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce9430cb08ea23a1f697e9 2026-04-04 16:07:34,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 16:07:34,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce9430cb08ea23a1f697e9 HTTP/1.1" 200 None 2026-04-04 16:07:34,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 16:07:34,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-04 16:07:34,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 16:07:34,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce9430cb08ea23a1f697e9 HTTP/1.1" 200 None 2026-04-04 16:07:34,130 - lava_callback - ERROR - Error processing callback for node 69ce9430cb08ea23a1f697e9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35124 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33984 - "GET / HTTP/1.0" 200 OK 2026-04-04 16:08:22,272 - lava_callback - INFO - Received callback for node 69ce9473cb08ea23a1f697f7 INFO: 172.21.0.1:33994 - "POST /node/69ce9473cb08ea23a1f697f7 HTTP/1.0" 202 Accepted 2026-04-04 16:08:22,277 - lava_callback - INFO - Starting async job submit for node 69ce9473cb08ea23a1f697f7 2026-04-04 16:08:22,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 16:08:22,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce9473cb08ea23a1f697f7 HTTP/1.1" 200 None 2026-04-04 16:08:22,294 - lava_callback - DEBUG - Processing node 69ce9473cb08ea23a1f697f7: baseline-arm64-baylibre 2026-04-04 16:08:22,294 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce9473cb08ea23a1f697f7 2026-04-04 16:08:22,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 16:08:22,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce9473cb08ea23a1f697f7 HTTP/1.1" 200 None 2026-04-04 16:08:22,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 16:08:22,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-04 16:08:22,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 16:08:22,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce9473cb08ea23a1f697f7 HTTP/1.1" 200 None 2026-04-04 16:08:22,351 - lava_callback - ERROR - Error processing callback for node 69ce9473cb08ea23a1f697f7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38662 - "GET / HTTP/1.0" 200 OK 2026-04-04 16:09:42,338 - lava_callback - INFO - Received callback for node 69ce94bfcb08ea23a1f697ff INFO: 172.21.0.1:46736 - "POST /node/69ce94bfcb08ea23a1f697ff HTTP/1.0" 202 Accepted 2026-04-04 16:09:42,344 - lava_callback - INFO - Starting async job submit for node 69ce94bfcb08ea23a1f697ff 2026-04-04 16:09:42,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 16:09:42,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce94bfcb08ea23a1f697ff HTTP/1.1" 200 None 2026-04-04 16:09:42,363 - lava_callback - DEBUG - Processing node 69ce94bfcb08ea23a1f697ff: baseline-arm64-baylibre 2026-04-04 16:09:42,363 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce94bfcb08ea23a1f697ff 2026-04-04 16:09:42,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 16:09:42,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce94bfcb08ea23a1f697ff HTTP/1.1" 200 None 2026-04-04 16:09:42,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 16:09:42,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-04 16:09:42,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 16:09:42,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce94bfcb08ea23a1f697ff HTTP/1.1" 200 None 2026-04-04 16:09:42,416 - lava_callback - ERROR - Error processing callback for node 69ce94bfcb08ea23a1f697ff: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47000 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54850 - "GET / HTTP/1.0" 200 OK 2026-04-04 16:11:14,197 - lava_callback - INFO - Received callback for node 69ce9510cb08ea23a1f69811 INFO: 172.21.0.1:41384 - "POST /node/69ce9510cb08ea23a1f69811 HTTP/1.0" 202 Accepted 2026-04-04 16:11:14,203 - lava_callback - INFO - Starting async job submit for node 69ce9510cb08ea23a1f69811 2026-04-04 16:11:14,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 16:11:14,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce9510cb08ea23a1f69811 HTTP/1.1" 200 None 2026-04-04 16:11:14,220 - lava_callback - DEBUG - Processing node 69ce9510cb08ea23a1f69811: baseline-arm64-clabbe 2026-04-04 16:11:14,220 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce9510cb08ea23a1f69811 2026-04-04 16:11:14,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 16:11:14,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce9510cb08ea23a1f69811 HTTP/1.1" 200 None 2026-04-04 16:11:14,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 16:11:14,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-04 16:11:14,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 16:11:14,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce9510cb08ea23a1f69811 HTTP/1.1" 200 None 2026-04-04 16:11:14,275 - lava_callback - ERROR - Error processing callback for node 69ce9510cb08ea23a1f69811: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40578 - "GET / HTTP/1.0" 200 OK 2026-04-04 16:12:14,292 - lava_callback - INFO - Received callback for node 69ce955acb08ea23a1f6981a INFO: 172.21.0.1:54504 - "POST /node/69ce955acb08ea23a1f6981a HTTP/1.0" 202 Accepted 2026-04-04 16:12:14,297 - lava_callback - INFO - Starting async job submit for node 69ce955acb08ea23a1f6981a 2026-04-04 16:12:14,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 16:12:14,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce955acb08ea23a1f6981a HTTP/1.1" 200 None 2026-04-04 16:12:14,314 - lava_callback - DEBUG - Processing node 69ce955acb08ea23a1f6981a: baseline-arm64-clabbe 2026-04-04 16:12:14,314 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce955acb08ea23a1f6981a 2026-04-04 16:12:14,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 16:12:14,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce955acb08ea23a1f6981a HTTP/1.1" 200 None 2026-04-04 16:12:14,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 16:12:14,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-04 16:12:14,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 16:12:14,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce955acb08ea23a1f6981a HTTP/1.1" 200 None 2026-04-04 16:12:14,376 - lava_callback - ERROR - Error processing callback for node 69ce955acb08ea23a1f6981a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36684 - "GET / HTTP/1.0" 200 OK 2026-04-04 16:13:22,528 - lava_callback - INFO - Received callback for node 69ce959fcb08ea23a1f69829 INFO: 172.21.0.1:36698 - "POST /node/69ce959fcb08ea23a1f69829 HTTP/1.0" 202 Accepted 2026-04-04 16:13:22,538 - lava_callback - INFO - Starting async job submit for node 69ce959fcb08ea23a1f69829 2026-04-04 16:13:22,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 16:13:22,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce959fcb08ea23a1f69829 HTTP/1.1" 200 None 2026-04-04 16:13:22,598 - lava_callback - DEBUG - Processing node 69ce959fcb08ea23a1f69829: baseline-arm64-baylibre 2026-04-04 16:13:22,598 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ce959fcb08ea23a1f69829 2026-04-04 16:13:22,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 16:13:22,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce959fcb08ea23a1f69829 HTTP/1.1" 200 None 2026-04-04 16:13:22,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 16:13:22,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-04 16:13:22,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-04 16:13:22,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce959fcb08ea23a1f69829 HTTP/1.1" 200 None 2026-04-04 16:13:22,713 - lava_callback - ERROR - Error processing callback for node 69ce959fcb08ea23a1f69829: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38192 - "GET / HTTP/1.0" 200 OK INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1]